-- Logs begin at Thu 2022-10-20 05:17:36 UTC, end at Thu 2022-10-20 06:51:42 UTC. -- Oct 20 05:55:51.194625 dv-cinder-861566-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Oct 20 05:55:51.205732 dv-cinder-861566-3-iscsi devstack@n-api.service[103819]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 20 05:55:51.207735 dv-cinder-861566-3-iscsi devstack@n-api.service[103819]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Oct 20 05:55:51 2022] *** Oct 20 05:55:51.207735 dv-cinder-861566-3-iscsi devstack@n-api.service[103819]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 20 05:55:51.207735 dv-cinder-861566-3-iscsi devstack@n-api.service[103819]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 20 05:55:51.207735 dv-cinder-861566-3-iscsi devstack@n-api.service[103819]: nodename: dv-cinder-861566-3-iscsi Oct 20 05:55:51.207735 dv-cinder-861566-3-iscsi devstack@n-api.service[103819]: machine: x86_64 Oct 20 05:55:51.207735 dv-cinder-861566-3-iscsi devstack@n-api.service[103819]: clock source: unix Oct 20 05:55:51.207735 dv-cinder-861566-3-iscsi devstack@n-api.service[103819]: pcre jit disabled Oct 20 05:55:51.207735 dv-cinder-861566-3-iscsi devstack@n-api.service[103819]: detected number of CPU cores: 4 Oct 20 05:55:51.207735 dv-cinder-861566-3-iscsi devstack@n-api.service[103819]: current working directory: / Oct 20 05:55:51.207735 dv-cinder-861566-3-iscsi devstack@n-api.service[103819]: detected binary path: /usr/bin/uwsgi-core Oct 20 05:55:51.207735 dv-cinder-861566-3-iscsi devstack@n-api.service[103819]: your processes number limit is 47680 Oct 20 05:55:51.207735 dv-cinder-861566-3-iscsi devstack@n-api.service[103819]: your memory page size is 4096 bytes Oct 20 05:55:51.207735 dv-cinder-861566-3-iscsi devstack@n-api.service[103819]: detected max file descriptor number: 2048 Oct 20 05:55:51.207735 dv-cinder-861566-3-iscsi devstack@n-api.service[103819]: lock engine: pthread robust mutexes Oct 20 05:55:51.208536 dv-cinder-861566-3-iscsi devstack@n-api.service[103819]: thunder lock: enabled Oct 20 05:55:51.208536 dv-cinder-861566-3-iscsi devstack@n-api.service[103819]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 20 05:55:51.208536 dv-cinder-861566-3-iscsi devstack@n-api.service[103819]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 20 05:55:51.247449 dv-cinder-861566-3-iscsi devstack@n-api.service[103819]: Python main interpreter initialized at 0x5560a17a59c0 Oct 20 05:55:51.247449 dv-cinder-861566-3-iscsi devstack@n-api.service[103819]: python threads support enabled Oct 20 05:55:51.247449 dv-cinder-861566-3-iscsi devstack@n-api.service[103819]: your server socket listen backlog is limited to 100 connections Oct 20 05:55:51.247449 dv-cinder-861566-3-iscsi devstack@n-api.service[103819]: your mercy for graceful operations on workers is 90 seconds Oct 20 05:55:51.247786 dv-cinder-861566-3-iscsi devstack@n-api.service[103819]: mapped 403077 bytes (393 KB) for 2 cores Oct 20 05:55:51.247867 dv-cinder-861566-3-iscsi devstack@n-api.service[103819]: *** Operational MODE: preforking *** Oct 20 05:55:51.248100 dv-cinder-861566-3-iscsi devstack@n-api.service[103819]: *** uWSGI is running in multiple interpreter mode *** Oct 20 05:55:51.248100 dv-cinder-861566-3-iscsi devstack@n-api.service[103819]: spawned uWSGI master process (pid: 103819) Oct 20 05:55:51.248295 dv-cinder-861566-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Oct 20 05:55:51.249691 dv-cinder-861566-3-iscsi devstack@n-api.service[103819]: spawned uWSGI worker 1 (pid: 103820, cores: 1) Oct 20 05:55:51.249691 dv-cinder-861566-3-iscsi devstack@n-api.service[103819]: spawned uWSGI worker 2 (pid: 103821, cores: 1) Oct 20 05:55:51.249691 dv-cinder-861566-3-iscsi devstack@n-api.service[103819]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 20 05:55:51.904587 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 20 05:55:51.905769 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 20 05:55:52.981737 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 20 05:55:52.981737 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: from cryptography.utils import int_from_bytes Oct 20 05:55:52.982457 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 20 05:55:52.982457 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: from cryptography.utils import int_from_bytes Oct 20 05:55:52.989448 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 20 05:55:52.989448 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: from cryptography.utils import int_from_bytes Oct 20 05:55:52.989862 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 20 05:55:52.989862 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: from cryptography.utils import int_from_bytes Oct 20 05:55:55.446661 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 20 05:55:55.447222 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 20 05:55:55.447423 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 20 05:55:55.447783 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 20 05:55:55.448038 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 20 05:55:55.448423 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.448771 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.449093 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.449408 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.449735 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.450049 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.450367 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.450683 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.451004 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.451261 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.451573 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.451894 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-861566-3-iscsi {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.452210 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.452512 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.452869 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.452969 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 20 05:55:55.453358 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.453449 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 20 05:55:55.453539 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.453696 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 20 05:55:55.453839 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.454057 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 20 05:55:55.454157 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.454314 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 20 05:55:55.454540 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.454703 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.454984 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.455083 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.455288 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.455396 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.455593 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.455691 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.455924 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.456033 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.456233 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.456322 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.456537 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.456631 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.456876 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.457009 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.457181 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.457276 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.457466 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.457559 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.457784 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.457921 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.458112 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-861566-3-iscsi {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.458200 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-861566-3-iscsi {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.458434 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.458536 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.458743 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.458872 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.459059 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.459186 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.459375 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.459478 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.459680 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.459778 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.460002 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.460084 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.460307 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.460407 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.460663 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.460827 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.461000 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.461138 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.461323 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.461477 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.461700 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.461931 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.462044 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.462269 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.462451 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.462566 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.462777 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.462877 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.463093 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.463188 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.463417 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.463511 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.463730 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.463881 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.464029 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.464125 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.464276 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.464363 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.464578 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.464752 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-861566-3-iscsi {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.464930 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.465075 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.465247 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.465397 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.465562 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.465713 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.465800 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.466041 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.466143 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.466352 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.466437 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.466667 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.466755 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.466970 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.467086 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.467274 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.467368 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.467576 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.467669 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.467879 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.467978 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.468179 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.468274 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.468478 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.468572 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.468800 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.468903 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.469105 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.469199 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.469419 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.469508 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.469733 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.469832 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.470049 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.470150 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.470352 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.470437 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.470658 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.470753 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.470908 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.471045 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.20 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.471216 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.471311 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.20 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.471538 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.471625 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.471859 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.471948 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.472182 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.472279 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.472434 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.472566 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.472685 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.472815 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.473022 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.473194 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.473345 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.473443 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.473654 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.473747 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.473963 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.474063 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.474271 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.474421 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.474582 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.474676 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.474888 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.474975 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.475134 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.475231 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.475432 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.475579 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.475734 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.475829 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.476046 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.476133 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.476347 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.476444 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.476648 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.476773 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.476973 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.477065 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.477788 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.477954 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.478089 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.478389 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.478542 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.20 {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.478681 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.478801 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.20 {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.478975 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.479119 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.479274 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.479462 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.479561 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.479784 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.479885 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.480097 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.480184 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.480421 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.480508 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.480736 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.480838 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.481052 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.481145 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.481360 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.481445 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.481657 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.481763 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.481957 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.482047 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.482267 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.482355 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.482559 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.482659 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.482823 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.482909 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.483126 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.483213 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.483434 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.483529 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.483744 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.483836 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.484043 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.484144 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.484343 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.484439 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.484647 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.484756 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.484973 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.485058 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.485273 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.485368 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.485577 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.485670 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.485871 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.485963 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.486171 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.486276 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.486472 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.486557 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.486770 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.486854 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.487071 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.487167 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.487369 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.487463 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.487667 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.487756 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.487967 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.488055 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.488265 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.488352 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.488564 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.488651 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.488887 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.488985 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.489183 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.489271 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.489486 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.489573 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.489792 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.489880 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.490093 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.490184 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.490394 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.490497 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.490695 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.490781 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.491006 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.491099 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.491309 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.491403 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.491614 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.491707 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.491931 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.492018 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.492236 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.492338 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.492541 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.492635 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.493458 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.493592 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.493774 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.494070 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.494215 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.494381 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.494479 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.494702 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.494797 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.495006 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.495091 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.495313 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.495406 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.495617 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.495759 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.495926 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.496014 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.496232 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.496330 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.496538 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.496638 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.496872 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.496961 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.497181 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.497266 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.497484 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.497590 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.497790 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.497877 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.498103 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.498189 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.498429 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.498594 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.498724 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.498814 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.499028 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.499113 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.499345 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 05:55:55.499432 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.499683 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.499778 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.499993 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.500090 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.500312 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.500402 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.500628 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.500778 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.500974 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.501074 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.501281 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.501370 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.501587 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.501682 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.501907 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.501994 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.502220 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.502307 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.502531 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.502618 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.502842 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.502926 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.503149 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.503235 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.503457 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.503551 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.503762 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.503856 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.504072 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.504160 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.504381 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.504470 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.504688 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.504848 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.505014 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.505101 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.505337 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.505422 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.505645 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.505740 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.505961 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.506047 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.506272 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.506358 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.506582 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.506678 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.506893 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.506986 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.507464 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.507556 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.507775 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.507864 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.508084 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.508173 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.508411 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.508503 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.508731 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.509087 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.509208 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.509414 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.509522 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.509733 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.509838 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.510051 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.510139 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.510397 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.510484 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.510716 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.510818 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.511033 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.511122 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.511334 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.511421 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.511641 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.511737 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.511948 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.512043 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.512255 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.512383 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.512557 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.512646 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.512893 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.512992 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.513200 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.513285 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.513502 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.513600 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.513820 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.513907 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.514128 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.514216 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.514428 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.514516 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.514746 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.514834 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.515048 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.515135 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.515352 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.515440 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.515663 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.515749 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.515971 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.516068 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.516280 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.516366 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.516586 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.516672 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.516917 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.517018 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.517226 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.517315 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.517533 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.517618 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.517836 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.517936 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.518159 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.518247 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.518485 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.518573 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.518786 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.518882 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.519107 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.519194 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.519412 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.519498 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.519725 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.519813 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.520023 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.520107 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.520328 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.520414 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.520628 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.520756 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.520954 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.521050 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.521254 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.521341 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.521559 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.521646 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.521856 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.521942 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.522154 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.522277 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.522452 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.522547 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.522751 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.522838 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.523049 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.523149 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.523364 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.523457 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.523666 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.523751 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.524477 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.524646 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.524992 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.525142 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.525297 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.525509 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.525638 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.525839 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.525935 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.526175 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.526270 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.526497 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.526596 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.526816 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.526912 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.527159 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.527254 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.527485 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.527580 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.527798 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.527894 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.528102 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.528200 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.528411 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.528511 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.528741 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.528845 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.529051 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.529176 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.529369 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.529465 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.529675 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.529761 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.529987 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.530075 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.530295 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.530396 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.530609 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.530697 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.530915 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.531008 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.531217 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.531305 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.531523 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.531608 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.531825 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.531921 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.532132 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.532227 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.532457 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.532604 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.532788 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.532880 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.533096 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.533193 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.533403 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.533489 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.533707 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.533800 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.534012 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.534100 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.534321 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.534407 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.534632 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.534727 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.534941 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.535037 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.535258 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.535345 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.535566 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.535661 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.535882 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.535970 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.536191 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.536279 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.536510 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.536611 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.536844 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.536932 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.537161 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.537249 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.537466 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.537562 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.537778 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.537865 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.538089 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.538174 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.538411 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.538508 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.538714 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.538800 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.539022 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.539110 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.539333 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.539421 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.540206 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.540352 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.540513 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.540854 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.540958 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.541160 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.541255 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.541465 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.541565 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.541775 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.541894 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.542087 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.542245 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.542383 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.542559 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.542697 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.542879 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.543000 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.543200 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.543312 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.543517 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.543619 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.543834 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.543922 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.544151 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.544246 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.544467 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.544570 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.544812 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.544905 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.545123 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.545209 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.545443 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.545547 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.545754 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.545844 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.546054 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.546139 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.546354 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.546451 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.546673 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.546772 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.546981 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.547068 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.547282 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.547378 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.547584 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.547672 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.547885 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.547979 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.548227 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.548316 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.548535 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.548622 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.548862 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.548952 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.549176 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.549266 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.549488 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.549590 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.549792 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.549879 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.550098 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.550187 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.550408 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.550504 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.550711 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.550806 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.551026 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.551114 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.551333 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.551420 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.551638 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.551734 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.551988 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.552082 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.552252 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.552339 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.552558 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.552681 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.552889 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.552994 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.553196 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.553313 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.553499 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.553605 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.553804 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.553891 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.554111 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.554197 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.554410 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.554573 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.554715 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.554826 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.555032 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.555130 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.555420 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.555615 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.555944 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.556030 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.556256 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.556342 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.556571 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.556666 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.556917 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.557015 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.557231 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.557333 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.557556 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.557650 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.557881 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.557973 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.558190 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.558276 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.558494 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.558589 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.558799 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.558884 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.559102 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.559188 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.559422 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.559517 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.559713 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.559809 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.560014 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.560100 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.560322 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.560411 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.560624 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.560734 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.560955 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.561052 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.561257 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.561346 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.561558 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.561651 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.561858 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.561944 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.562159 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.562257 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.562468 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.562555 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.562770 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.562865 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.563077 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.563222 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.563379 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.563474 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.563683 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.563777 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.563989 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.564074 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.564291 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.564376 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.564591 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.564881 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.564972 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.565224 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.565322 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.565528 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.565613 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.565859 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.565953 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.566179 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.566271 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.566514 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.566609 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.566814 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.566917 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.567115 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.567209 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.567433 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.567526 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.567736 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.567836 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.568038 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.568136 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.568338 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.568423 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.568647 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.568758 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.568975 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.569060 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.569274 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.569360 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.569579 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.569666 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.569882 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.569967 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.570190 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.570282 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.570494 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.570587 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.570793 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.570879 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.571120 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.571322 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.571554 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.571702 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.571800 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.572008 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.572094 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.572309 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.572404 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.572608 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.572715 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.572940 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.573070 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.573259 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.573349 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.573543 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.573629 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.573848 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.573934 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.574148 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.574236 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.574452 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.574536 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.574751 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.574836 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.575051 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.575140 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.575351 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.575439 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.575655 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.575741 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.575959 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.576048 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.576260 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.576345 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.576578 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.576672 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.576908 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.576997 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.577210 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.577297 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.577510 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.577609 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.577816 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.577902 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.578115 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.578203 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.578414 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.578581 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.578720 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.578806 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.579037 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.579130 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.579350 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.579438 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.579651 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.579780 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.579958 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.580044 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.580264 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.580352 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.580564 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.580650 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.580889 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.580976 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.581194 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.581291 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.581494 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.581588 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.581793 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.581886 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.582091 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.582179 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.582391 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.582478 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.582692 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.582779 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.582995 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.583086 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.583305 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.583436 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.583605 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.583701 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.583906 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.584000 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.584208 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.584294 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.584518 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.584622 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.584849 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.584937 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.585162 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.585250 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.585476 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.585579 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.585786 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.585873 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.586100 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.586184 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.586413 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.587029 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.587356 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.587451 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.587658 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.587874 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.588047 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.588198 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.588365 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.588510 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.588679 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.588847 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.589018 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.589163 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.589324 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.589492 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.589626 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.589817 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.589950 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.590127 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.590259 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.590440 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.590569 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.590748 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.590895 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.591057 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.591214 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.591366 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.591534 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.591677 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.591838 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.591983 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.592147 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.592289 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.592457 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.592593 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.592789 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.592931 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.593102 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.593223 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.593410 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.593558 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.593720 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.593851 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.594029 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.594160 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.594338 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.594468 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.594646 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.594776 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.594953 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.595121 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.595258 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.595426 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.595565 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.595787 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.595882 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.596097 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.596194 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.596422 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.596515 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.596772 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.596862 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.597073 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.597169 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.597381 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.597468 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.597684 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.597778 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.597992 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.598088 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.598289 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.598373 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.598613 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.598708 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.598930 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.599025 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.599239 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.599332 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.599546 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.599633 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.599871 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.599966 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.600175 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.600260 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.600487 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.600573 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.600831 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.600933 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.601136 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.601224 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.601466 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.601551 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.601776 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.601864 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.602701 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.602796 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.603127 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.603313 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.603441 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.603657 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.603753 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.603981 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.604067 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.604304 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.604395 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.604624 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.604740 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.604959 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.605043 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.605264 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.605353 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.605585 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.605671 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.605888 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.605973 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.606199 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.606286 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.606524 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.606611 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.606839 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.606935 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.607154 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.607247 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.607485 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.607593 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.607800 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.607897 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.608112 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.608199 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.608428 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.608515 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.608758 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.608927 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.609076 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.609171 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.609388 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.609481 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.609727 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.609820 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.610037 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.610123 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.610358 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.610445 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.610684 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.610772 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.610993 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.611079 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.611305 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.611391 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.611608 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.611696 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.611926 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.612011 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.612235 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.612321 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.612541 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.612658 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.612885 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.612997 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.613298 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.613396 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.613615 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.613727 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.613917 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.614004 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.614220 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.614306 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.614535 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.614629 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.614835 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.614923 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.615137 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.615223 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.615443 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.615537 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.615744 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.615830 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.616046 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.616139 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.616362 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.616455 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.616663 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.616767 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.616995 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.617116 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.617304 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.617432 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.617609 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.617792 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.617938 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.618239 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.618492 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.618587 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.618821 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.618908 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.619143 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.619237 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.619450 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.619545 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.619767 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.619853 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.620085 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.620172 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.620389 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.620477 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.620742 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.620842 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.621038 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.621124 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.621341 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.621429 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.621643 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.621729 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.621945 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.622030 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.622280 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.622367 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.622578 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.622662 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.622895 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.622990 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.623217 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.623343 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.623535 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.623638 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.623842 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.623948 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.624168 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.624257 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.624488 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.624574 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.624829 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.624931 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.625142 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.625228 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.625458 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.625545 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.625777 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.625871 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.626079 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.626172 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.626381 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.626470 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.626688 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.626785 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.626990 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.627078 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.627292 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.627385 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.627592 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.627680 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.627897 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.627985 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.628197 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.628282 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.628498 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.628586 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.628820 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.628922 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.629126 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.629211 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.629429 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.629515 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.629741 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.629827 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.630044 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.630141 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.630347 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.630436 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.630654 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.630740 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.630954 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.631055 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.631280 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.631367 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.631580 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.631666 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.631901 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.631996 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.632478 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.632581 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.632817 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.632909 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.633125 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.633230 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.633477 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.633578 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.633790 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.634082 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.634273 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.634417 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.634592 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.634756 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.634908 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.635091 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.635224 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.635408 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.635533 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.635747 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.635834 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.636077 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.636173 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.636408 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.636495 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.636747 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.636977 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.637067 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.637308 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.637397 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.637622 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.637717 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.637936 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.638031 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.638248 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.638344 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.638559 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.638652 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.638867 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.638961 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.639171 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.639256 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.639477 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.639561 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.639779 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.639876 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.640084 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.640172 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.640390 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.640493 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.640738 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.640840 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.641052 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.641139 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.641377 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.641470 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.641690 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.641777 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.641994 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.642079 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.642307 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.642399 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.642603 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.642699 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.642947 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.643040 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.643253 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.643352 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.643555 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.643640 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.643869 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.643957 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.644184 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.644282 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.644494 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.644595 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.644840 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.644939 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.645160 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.645261 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.645480 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.645567 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.645787 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.645871 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.646096 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.646192 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.646402 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.646490 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.646710 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.646796 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.647022 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.647110 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.647335 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.647427 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.647653 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.647739 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.647967 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.648172 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.648259 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.648502 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.648588 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.648847 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.649537 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.649884 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.650131 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.650374 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.650516 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.650702 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.650853 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.651021 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.651183 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.651337 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.651507 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.651654 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.651825 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.651970 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.652141 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.652338 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.652466 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.652616 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.652796 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.652969 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.653104 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.653298 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.653414 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.653634 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.653721 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.653958 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.654044 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.654278 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.654384 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.654598 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.654687 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.654908 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.654995 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.655228 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.655322 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.655534 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.655621 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.655860 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.656063 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.656179 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.656407 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.656493 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.656744 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.656846 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.657073 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.657169 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.657398 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.657485 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.657712 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.657805 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.658021 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.658116 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.658331 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.658417 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.658638 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.658722 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.658943 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.659031 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.659255 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.659341 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.659560 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.659644 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.659862 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.659952 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.660166 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.660298 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.660476 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.660612 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.660807 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.660898 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.661114 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.661211 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.661422 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.661639 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.661735 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.661957 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.662044 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.662291 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.662381 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.662608 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.662701 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.662911 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.662997 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.663218 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.663304 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.663521 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.663608 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.663823 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.663909 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.664127 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.664224 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.664427 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.664532 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.664857 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.664949 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.665264 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.665508 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.665606 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.665836 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.665923 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.666166 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.666254 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.666486 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.666576 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.666802 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.666896 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.667101 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.667186 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.667421 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.667510 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.667721 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.667954 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.668041 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.668302 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.668402 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.668613 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.668726 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.668957 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.669043 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.669268 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.669366 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.669577 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.669664 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.669885 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.669973 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.670210 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.670305 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.670520 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.670734 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.670830 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.671062 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.671158 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.671388 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.671475 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.671718 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.671817 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.672020 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.672120 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.672333 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.672420 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.672634 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.672739 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.672965 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.673063 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.673278 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.673365 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.673586 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.673671 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.673898 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.673986 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.674206 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.674302 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.674510 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.674612 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.674813 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.674900 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.675119 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.675205 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.675420 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.675512 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.675724 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.675810 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.676027 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.676112 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.676330 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.676424 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.676638 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.676752 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.676970 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.677057 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.677280 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.677375 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.677585 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.677672 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.677896 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.677982 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.678243 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.678341 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.678551 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.678637 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.678857 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.678943 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.679165 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.679326 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.679474 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.679566 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.679778 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.679872 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.680087 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.680677 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.680961 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.681057 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.681237 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.681559 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.681670 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.681881 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.681971 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.682191 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.682286 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.682495 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.682591 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.682847 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.683143 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.683385 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.683472 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.683727 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.683816 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.684056 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.684142 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.684362 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.684446 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.684682 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.684825 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.685025 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.685130 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.685334 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.685427 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.685646 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.685735 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.685951 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.686037 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.686275 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.686369 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.686592 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.686680 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.686905 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.686999 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.687218 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.687319 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.687517 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.687603 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.687820 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.687915 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.688121 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.688217 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.688426 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.688513 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.688760 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.688851 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.689071 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.689171 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.689374 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.689462 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.689675 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.689761 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.689980 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.690068 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.690282 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.690370 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.690583 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.690670 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.690883 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.691008 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.691185 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.691271 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.691494 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.691581 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.691794 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.691883 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.692094 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.692189 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.692394 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.692482 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.692725 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.692815 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.693012 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.693102 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.693313 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.693408 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.693617 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.693740 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.693917 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.694004 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.694219 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.694317 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.694520 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.694607 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.694820 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.695118 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.695204 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.695447 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.695536 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.695777 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.695934 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.696235 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.696341 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.696560 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.696824 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.696915 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.697160 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.697247 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.697496 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.697586 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.697813 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.697898 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.698133 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.698219 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.698448 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.698562 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.698749 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.698840 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.699078 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.699175 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.699389 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.699476 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.699701 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.699788 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.700013 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.700112 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.700317 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.700404 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.700620 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.700727 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.700953 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.701093 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.701271 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.701358 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.701585 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.701672 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.701886 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.701982 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.702190 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.702283 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.702502 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.702590 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.702812 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.702904 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.703117 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.703204 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.703421 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.703506 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.703724 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.703813 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.704035 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.704122 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.704338 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.704425 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.704640 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.704786 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.704972 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.705061 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.705275 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.705373 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.705576 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.705662 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.705881 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.705966 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.706187 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.706282 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.706491 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.706585 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.706796 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.706890 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.707102 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.707198 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.707412 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.707499 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.707717 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.707801 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.708039 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.708137 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.708362 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.708449 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.708672 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.708832 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.709026 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.709114 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.709367 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.709453 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.709692 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.709778 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.709999 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.710086 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.710307 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.710393 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.710611 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.710708 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.710852 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 20 05:55:55.710941 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.711227 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.712151 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.712747 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.713087 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.713409 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.713725 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.714040 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.714354 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.714684 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.715013 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.715322 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.715651 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.715987 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.716293 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.716611 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.716949 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.717286 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.717601 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.717913 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.718223 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.718537 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.718849 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.719164 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.719475 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.719787 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.720104 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.720420 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.720773 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.721102 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.721416 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.721740 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.722067 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.722415 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.722731 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.723076 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.723407 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.723723 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.724038 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.724344 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 05:55:55.724589 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 20 05:55:55.863839 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: INFO dbcounter [None req-e38c4bbb-51fd-43b9-8300-769e0c06f60d None None] Registered counter for database nova_api Oct 20 05:55:55.879671 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: INFO dbcounter [None req-5469ec66-c756-44ab-9571-a812507f75cd None None] Registered counter for database nova_api Oct 20 05:55:55.884248 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG oslo_db.sqlalchemy.engines [None req-e38c4bbb-51fd-43b9-8300-769e0c06f60d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103820) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 20 05:55:55.890784 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG dbcounter [-] [103820] Writer thread running {{(pid=103820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 20 05:55:55.900821 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG oslo_db.sqlalchemy.engines [None req-5469ec66-c756-44ab-9571-a812507f75cd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103821) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 20 05:55:55.907258 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG dbcounter [-] [103821] Writer thread running {{(pid=103821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 20 05:55:55.948482 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.context [None req-e38c4bbb-51fd-43b9-8300-769e0c06f60d None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),0427de57-e601-4680-b509-510497497143(cell1) {{(pid=103820) load_cells /opt/stack/nova/nova/context.py:464}} Oct 20 05:55:55.952317 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG oslo_concurrency.lockutils [None req-e38c4bbb-51fd-43b9-8300-769e0c06f60d None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 05:55:55.952809 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG oslo_concurrency.lockutils [None req-e38c4bbb-51fd-43b9-8300-769e0c06f60d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 05:55:55.954366 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG oslo_concurrency.lockutils [None req-e38c4bbb-51fd-43b9-8300-769e0c06f60d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 05:55:55.955088 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG oslo_concurrency.lockutils [None req-e38c4bbb-51fd-43b9-8300-769e0c06f60d None None] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 05:55:55.955534 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG oslo_concurrency.lockutils [None req-e38c4bbb-51fd-43b9-8300-769e0c06f60d None None] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 05:55:55.957509 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG oslo_concurrency.lockutils [None req-e38c4bbb-51fd-43b9-8300-769e0c06f60d None None] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 05:55:55.959469 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: INFO dbcounter [None req-e38c4bbb-51fd-43b9-8300-769e0c06f60d None None] Registered counter for database nova_cell0 Oct 20 05:55:55.964249 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: INFO dbcounter [None req-e38c4bbb-51fd-43b9-8300-769e0c06f60d None None] Registered counter for database nova_cell1 Oct 20 05:55:55.966637 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.context [None req-5469ec66-c756-44ab-9571-a812507f75cd None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),0427de57-e601-4680-b509-510497497143(cell1) {{(pid=103821) load_cells /opt/stack/nova/nova/context.py:464}} Oct 20 05:55:55.970509 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG oslo_concurrency.lockutils [None req-5469ec66-c756-44ab-9571-a812507f75cd None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 05:55:55.970989 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG oslo_concurrency.lockutils [None req-5469ec66-c756-44ab-9571-a812507f75cd None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 05:55:55.971449 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG oslo_db.sqlalchemy.engines [None req-e38c4bbb-51fd-43b9-8300-769e0c06f60d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103820) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 20 05:55:55.972599 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG oslo_concurrency.lockutils [None req-5469ec66-c756-44ab-9571-a812507f75cd None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 05:55:55.973372 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG oslo_concurrency.lockutils [None req-5469ec66-c756-44ab-9571-a812507f75cd None None] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 05:55:55.973590 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG oslo_db.sqlalchemy.engines [None req-e38c4bbb-51fd-43b9-8300-769e0c06f60d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103820) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 20 05:55:55.973815 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG oslo_concurrency.lockutils [None req-5469ec66-c756-44ab-9571-a812507f75cd None None] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 05:55:55.975801 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG oslo_concurrency.lockutils [None req-5469ec66-c756-44ab-9571-a812507f75cd None None] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 05:55:55.978307 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: INFO dbcounter [None req-5469ec66-c756-44ab-9571-a812507f75cd None None] Registered counter for database nova_cell0 Oct 20 05:55:55.979044 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG dbcounter [-] [103820] Writer thread running {{(pid=103820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 20 05:55:55.980838 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG dbcounter [-] [103820] Writer thread running {{(pid=103820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 20 05:55:55.982386 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: INFO dbcounter [None req-5469ec66-c756-44ab-9571-a812507f75cd None None] Registered counter for database nova_cell1 Oct 20 05:55:55.989489 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG oslo_db.sqlalchemy.engines [None req-5469ec66-c756-44ab-9571-a812507f75cd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103821) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 20 05:55:55.993385 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG oslo_db.sqlalchemy.engines [None req-5469ec66-c756-44ab-9571-a812507f75cd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103821) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 20 05:55:55.995290 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG dbcounter [-] [103821] Writer thread running {{(pid=103821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 20 05:55:56.125048 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: INFO dbcounter [None req-e38c4bbb-51fd-43b9-8300-769e0c06f60d None None] Registered counter for database nova_cell0 Oct 20 05:55:56.134856 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG oslo_db.sqlalchemy.engines [None req-e38c4bbb-51fd-43b9-8300-769e0c06f60d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103820) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 20 05:55:56.139152 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG dbcounter [-] [103820] Writer thread running {{(pid=103820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 20 05:55:56.141635 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG dbcounter [-] [103821] Writer thread running {{(pid=103821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 20 05:55:56.152404 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: INFO dbcounter [None req-5469ec66-c756-44ab-9571-a812507f75cd None None] Registered counter for database nova_cell0 Oct 20 05:55:56.159582 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG oslo_db.sqlalchemy.engines [None req-5469ec66-c756-44ab-9571-a812507f75cd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103821) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 20 05:55:56.165382 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG dbcounter [-] [103821] Writer thread running {{(pid=103821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 20 05:55:56.475239 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: WARNING keystonemiddleware.auth_token [None req-e38c4bbb-51fd-43b9-8300-769e0c06f60d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 20 05:55:56.482577 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: WARNING keystonemiddleware.auth_token [None req-e38c4bbb-51fd-43b9-8300-769e0c06f60d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 20 05:55:56.489232 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: WARNING keystonemiddleware.auth_token [None req-5469ec66-c756-44ab-9571-a812507f75cd None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 20 05:55:56.497465 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: WARNING keystonemiddleware.auth_token [None req-5469ec66-c756-44ab-9571-a812507f75cd None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 20 05:55:56.824306 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: WARNING keystonemiddleware.auth_token [None req-e38c4bbb-51fd-43b9-8300-769e0c06f60d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 20 05:55:56.830205 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: WARNING keystonemiddleware.auth_token [None req-e38c4bbb-51fd-43b9-8300-769e0c06f60d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 20 05:55:56.835422 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5560a17a59c0 pid: 103820 (default app) Oct 20 05:55:56.837762 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi [None req-e38c4bbb-51fd-43b9-8300-769e0c06f60d None None] Calling method '>' {{(pid=103820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 05:55:56.838929 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: INFO nova.api.openstack.requestlog [None req-e38c4bbb-51fd-43b9-8300-769e0c06f60d None None] 10.222.0.20 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001847 Oct 20 05:55:56.839339 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: [pid: 103820|app: 0|req: 1/1] 10.222.0.20 () {50 vars in 788 bytes} [Thu Oct 20 05:55:56 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 05:55:56.847037 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: WARNING keystonemiddleware.auth_token [None req-5469ec66-c756-44ab-9571-a812507f75cd None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 20 05:55:56.854008 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: WARNING keystonemiddleware.auth_token [None req-5469ec66-c756-44ab-9571-a812507f75cd None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 20 05:55:56.859202 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5560a17a59c0 pid: 103821 (default app) Oct 20 05:57:18.096348 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi [None req-e38c4bbb-51fd-43b9-8300-769e0c06f60d None None] Calling method '>' {{(pid=103820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 05:57:18.098163 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: INFO nova.api.openstack.requestlog [None req-e38c4bbb-51fd-43b9-8300-769e0c06f60d None None] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002244 Oct 20 05:57:18.098768 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: [pid: 103820|app: 0|req: 2/2] 10.222.0.20 () {54 vars in 931 bytes} [Thu Oct 20 05:57:18 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 05:57:18.116531 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG dbcounter [-] [103821] Writing DB stats nova_api:SELECT=3 {{(pid=103821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:57:18.117535 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG dbcounter [-] [103821] Writing DB stats nova_cell0:SELECT=3 {{(pid=103821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:57:18.118525 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG dbcounter [-] [103821] Writing DB stats nova_cell1:SELECT=3 {{(pid=103821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:57:18.119535 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG dbcounter [-] [103821] Writing DB stats nova_cell0:SELECT=3 {{(pid=103821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:57:18.988396 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi [None req-aba65912-273e-4142-a1f7-7a3645507604 admin admin] Calling method '>' {{(pid=103821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 05:57:19.022437 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: INFO nova.api.openstack.requestlog [None req-aba65912-273e-4142-a1f7-7a3645507604 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.916952 Oct 20 05:57:19.023242 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: [pid: 103821|app: 0|req: 1/3] 10.222.0.20 () {60 vars in 1292 bytes} [Thu Oct 20 05:57:18 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 05:57:21.643108 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi [None req-e38c4bbb-51fd-43b9-8300-769e0c06f60d None None] Calling method '>' {{(pid=103820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 05:57:21.645153 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: INFO nova.api.openstack.requestlog [None req-e38c4bbb-51fd-43b9-8300-769e0c06f60d None None] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002493 Oct 20 05:57:21.645849 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: [pid: 103820|app: 0|req: 3/4] 10.222.0.20 () {54 vars in 931 bytes} [Thu Oct 20 05:57:21 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 05:57:22.105735 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi [None req-7f71a12d-ffa6-47ae-bad1-443bc3e9b7d7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 256, "rxtx_factor": 1.0, "disk": 1, "id": "c1", "vcpus": 1, "swap": 0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "cirros256"}} {{(pid=103821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 05:57:22.154692 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: INFO nova.api.openstack.requestlog [None req-7f71a12d-ffa6-47ae-bad1-443bc3e9b7d7 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.502550 Oct 20 05:57:22.155541 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: [pid: 103821|app: 0|req: 2/5] 10.222.0.20 () {64 vars in 1283 bytes} [Thu Oct 20 05:57:21 2022] POST /compute/v2.1/flavors => generated 407 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 20 05:57:22.170394 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG dbcounter [-] [103820] Writing DB stats nova_api:SELECT=3 {{(pid=103820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:57:22.171251 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG dbcounter [-] [103820] Writing DB stats nova_cell1:SELECT=3 {{(pid=103820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:57:22.173243 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG dbcounter [-] [103820] Writing DB stats nova_cell0:SELECT=3 {{(pid=103820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:57:22.174042 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG dbcounter [-] [103820] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:57:22.378728 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi [None req-a150dbb7-144d-4104-bfc2-f387f9bfb65f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 05:57:22.450941 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: INFO nova.api.openstack.requestlog [None req-a150dbb7-144d-4104-bfc2-f387f9bfb65f admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.286544 Oct 20 05:57:22.451530 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: [pid: 103820|app: 0|req: 4/6] 10.222.0.20 () {64 vars in 1336 bytes} [Thu Oct 20 05:57:22 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 05:57:25.054045 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi [None req-7f71a12d-ffa6-47ae-bad1-443bc3e9b7d7 admin admin] Calling method '>' {{(pid=103821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 05:57:25.055058 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: INFO nova.api.openstack.requestlog [None req-7f71a12d-ffa6-47ae-bad1-443bc3e9b7d7 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Oct 20 05:57:25.055627 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: [pid: 103821|app: 0|req: 3/7] 10.222.0.20 () {54 vars in 931 bytes} [Thu Oct 20 05:57:25 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 05:57:25.707271 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi [None req-b68bfa2a-5e45-416d-996d-14469fad8890 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 5, "id": "d1", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "ds512M", "vcpus": 1, "swap": 0}} {{(pid=103820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 05:57:25.747390 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: INFO nova.api.openstack.requestlog [None req-b68bfa2a-5e45-416d-996d-14469fad8890 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.685554 Oct 20 05:57:25.748740 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: [pid: 103820|app: 0|req: 5/8] 10.222.0.20 () {64 vars in 1283 bytes} [Thu Oct 20 05:57:25 2022] POST /compute/v2.1/flavors => generated 404 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 20 05:57:25.760954 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi [None req-7ac01357-9b15-4bf2-8485-baa6ad4a14ea admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 05:57:25.804312 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: INFO nova.api.openstack.requestlog [None req-7ac01357-9b15-4bf2-8485-baa6ad4a14ea admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.046959 Oct 20 05:57:25.805087 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: [pid: 103821|app: 0|req: 4/9] 10.222.0.20 () {64 vars in 1336 bytes} [Thu Oct 20 05:57:25 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 05:57:28.421202 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi [None req-b68bfa2a-5e45-416d-996d-14469fad8890 admin admin] Calling method '>' {{(pid=103820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 05:57:28.422243 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: INFO nova.api.openstack.requestlog [None req-b68bfa2a-5e45-416d-996d-14469fad8890 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 Oct 20 05:57:28.422642 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: [pid: 103820|app: 0|req: 6/10] 10.222.0.20 () {54 vars in 931 bytes} [Thu Oct 20 05:57:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 05:57:28.841207 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi [None req-858b4835-fd48-4335-889a-a819219a13bb admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "name": "ds1G", "swap": 0, "ram": 1024, "disk": 10, "id": "d2", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true}} {{(pid=103821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 05:57:28.861172 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: INFO nova.api.openstack.requestlog [None req-858b4835-fd48-4335-889a-a819219a13bb admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.431755 Oct 20 05:57:28.862328 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: [pid: 103821|app: 0|req: 5/11] 10.222.0.20 () {64 vars in 1283 bytes} [Thu Oct 20 05:57:28 2022] POST /compute/v2.1/flavors => generated 404 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 20 05:57:28.874349 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi [None req-eebebf0e-13f6-49ec-b8c7-a9c21a533678 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 05:57:28.904070 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: INFO nova.api.openstack.requestlog [None req-eebebf0e-13f6-49ec-b8c7-a9c21a533678 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033482 Oct 20 05:57:28.904653 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: [pid: 103820|app: 0|req: 7/12] 10.222.0.20 () {64 vars in 1336 bytes} [Thu Oct 20 05:57:28 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 05:57:31.528729 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi [None req-858b4835-fd48-4335-889a-a819219a13bb admin admin] Calling method '>' {{(pid=103821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 05:57:31.530247 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: INFO nova.api.openstack.requestlog [None req-858b4835-fd48-4335-889a-a819219a13bb admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001964 Oct 20 05:57:31.530958 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: [pid: 103821|app: 0|req: 6/13] 10.222.0.20 () {54 vars in 931 bytes} [Thu Oct 20 05:57:31 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 05:57:31.942312 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi [None req-4160d823-b493-4b9b-802b-a64eb66a8f17 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "id": "d3", "ram": 2048, "disk": 10, "name": "ds2G", "vcpus": 2}} {{(pid=103820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 05:57:31.962788 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: INFO nova.api.openstack.requestlog [None req-4160d823-b493-4b9b-802b-a64eb66a8f17 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.424480 Oct 20 05:57:31.964052 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: [pid: 103820|app: 0|req: 8/14] 10.222.0.20 () {64 vars in 1283 bytes} [Thu Oct 20 05:57:31 2022] POST /compute/v2.1/flavors => generated 404 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 20 05:57:31.980201 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi [None req-e8decc23-e4e7-4eb0-a12e-47cb9569d2a5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 05:57:32.015879 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: INFO nova.api.openstack.requestlog [None req-e8decc23-e4e7-4eb0-a12e-47cb9569d2a5 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.041881 Oct 20 05:57:32.016524 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: [pid: 103821|app: 0|req: 7/15] 10.222.0.20 () {64 vars in 1336 bytes} [Thu Oct 20 05:57:31 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 05:57:34.625346 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi [None req-4160d823-b493-4b9b-802b-a64eb66a8f17 admin admin] Calling method '>' {{(pid=103820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 05:57:34.626277 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: INFO nova.api.openstack.requestlog [None req-4160d823-b493-4b9b-802b-a64eb66a8f17 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001496 Oct 20 05:57:34.626705 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: [pid: 103820|app: 0|req: 9/16] 10.222.0.20 () {54 vars in 931 bytes} [Thu Oct 20 05:57:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 05:57:35.078914 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi [None req-6b7d88bc-523e-49e7-be37-4297a8de2fa5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "os-flavor-access:is_public": true, "name": "ds4G", "ram": 4096, "swap": 0, "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "id": "d4"}} {{(pid=103821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 05:57:35.100296 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: INFO nova.api.openstack.requestlog [None req-6b7d88bc-523e-49e7-be37-4297a8de2fa5 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.466772 Oct 20 05:57:35.100890 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: [pid: 103821|app: 0|req: 8/17] 10.222.0.20 () {64 vars in 1283 bytes} [Thu Oct 20 05:57:34 2022] POST /compute/v2.1/flavors => generated 404 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 20 05:57:35.113791 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi [None req-4583fcdf-f7c7-438e-8906-e507f56d2a7d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 05:57:35.138257 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: INFO nova.api.openstack.requestlog [None req-4583fcdf-f7c7-438e-8906-e507f56d2a7d admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028615 Oct 20 05:57:35.138849 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: [pid: 103820|app: 0|req: 10/18] 10.222.0.20 () {64 vars in 1336 bytes} [Thu Oct 20 05:57:35 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 05:57:37.737625 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi [None req-6b7d88bc-523e-49e7-be37-4297a8de2fa5 admin admin] Calling method '>' {{(pid=103821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 05:57:37.738660 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: INFO nova.api.openstack.requestlog [None req-6b7d88bc-523e-49e7-be37-4297a8de2fa5 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001492 Oct 20 05:57:37.739084 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: [pid: 103821|app: 0|req: 9/19] 10.222.0.20 () {54 vars in 931 bytes} [Thu Oct 20 05:57:37 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 05:57:38.191217 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi [None req-e6392538-58e5-4b07-86b7-c0f9addbc5fa admin admin] Calling method '>' {{(pid=103820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 05:57:38.216036 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: INFO nova.api.openstack.requestlog [None req-e6392538-58e5-4b07-86b7-c0f9addbc5fa admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.470825 Oct 20 05:57:38.216599 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: [pid: 103820|app: 0|req: 11/20] 10.222.0.20 () {60 vars in 1292 bytes} [Thu Oct 20 05:57:37 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 05:57:40.990611 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi [None req-6b7d88bc-523e-49e7-be37-4297a8de2fa5 admin admin] Calling method '>' {{(pid=103821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 05:57:40.991625 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: INFO nova.api.openstack.requestlog [None req-6b7d88bc-523e-49e7-be37-4297a8de2fa5 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Oct 20 05:57:40.992022 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: [pid: 103821|app: 0|req: 10/21] 10.222.0.20 () {54 vars in 931 bytes} [Thu Oct 20 05:57:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 05:57:41.387647 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi [None req-14b4759d-2453-4ec3-ab19-355491afa136 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.tiny", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "id": "1", "disk": 1, "rxtx_factor": 1.0, "ram": 512, "os-flavor-access:is_public": true}} {{(pid=103820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 05:57:41.407174 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: INFO nova.api.openstack.requestlog [None req-14b4759d-2453-4ec3-ab19-355491afa136 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.409110 Oct 20 05:57:41.407987 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: [pid: 103820|app: 0|req: 12/22] 10.222.0.20 () {64 vars in 1283 bytes} [Thu Oct 20 05:57:40 2022] POST /compute/v2.1/flavors => generated 402 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 20 05:57:41.419921 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi [None req-0cb9ffcc-acbc-455e-b093-65f1cc0f97d1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 05:57:41.449203 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: INFO nova.api.openstack.requestlog [None req-0cb9ffcc-acbc-455e-b093-65f1cc0f97d1 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032992 Oct 20 05:57:41.449879 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: [pid: 103821|app: 0|req: 11/23] 10.222.0.20 () {64 vars in 1333 bytes} [Thu Oct 20 05:57:41 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 05:57:44.043773 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi [None req-14b4759d-2453-4ec3-ab19-355491afa136 admin admin] Calling method '>' {{(pid=103820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 05:57:44.044812 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: INFO nova.api.openstack.requestlog [None req-14b4759d-2453-4ec3-ab19-355491afa136 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001418 Oct 20 05:57:44.045217 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: [pid: 103820|app: 0|req: 13/24] 10.222.0.20 () {54 vars in 931 bytes} [Thu Oct 20 05:57:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 05:57:44.425897 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi [None req-a6c2e765-1f38-4b29-8c81-f70d325bb7d6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.small", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "swap": 0, "id": "2", "ram": 2048, "rxtx_factor": 1.0, "disk": 20}} {{(pid=103821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 05:57:44.444828 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: INFO nova.api.openstack.requestlog [None req-a6c2e765-1f38-4b29-8c81-f70d325bb7d6 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.392301 Oct 20 05:57:44.445759 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: [pid: 103821|app: 0|req: 12/25] 10.222.0.20 () {64 vars in 1283 bytes} [Thu Oct 20 05:57:44 2022] POST /compute/v2.1/flavors => generated 405 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 20 05:57:44.458217 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi [None req-a1e08cc9-0b81-41de-b8d8-55734700b006 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 05:57:44.482798 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: INFO nova.api.openstack.requestlog [None req-a1e08cc9-0b81-41de-b8d8-55734700b006 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028801 Oct 20 05:57:44.483380 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: [pid: 103820|app: 0|req: 14/26] 10.222.0.20 () {64 vars in 1333 bytes} [Thu Oct 20 05:57:44 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 05:57:47.138963 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi [None req-a6c2e765-1f38-4b29-8c81-f70d325bb7d6 admin admin] Calling method '>' {{(pid=103821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 05:57:47.139980 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: INFO nova.api.openstack.requestlog [None req-a6c2e765-1f38-4b29-8c81-f70d325bb7d6 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Oct 20 05:57:47.140849 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: [pid: 103821|app: 0|req: 13/27] 10.222.0.20 () {54 vars in 931 bytes} [Thu Oct 20 05:57:47 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 05:57:47.653653 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi [None req-c668239b-0098-45ed-870b-7556efef819a admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "3", "ram": 4096, "swap": 0, "rxtx_factor": 1.0, "vcpus": 2, "name": "m1.medium", "disk": 40}} {{(pid=103820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 05:57:47.681856 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: INFO nova.api.openstack.requestlog [None req-c668239b-0098-45ed-870b-7556efef819a admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.534567 Oct 20 05:57:47.682415 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: [pid: 103820|app: 0|req: 15/28] 10.222.0.20 () {64 vars in 1283 bytes} [Thu Oct 20 05:57:47 2022] POST /compute/v2.1/flavors => generated 406 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 20 05:57:47.695884 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi [None req-07a53f34-8779-46ba-8ba3-fa0bf44c74c4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 05:57:47.727115 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: INFO nova.api.openstack.requestlog [None req-07a53f34-8779-46ba-8ba3-fa0bf44c74c4 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035138 Oct 20 05:57:47.736759 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: [pid: 103821|app: 0|req: 14/29] 10.222.0.20 () {64 vars in 1333 bytes} [Thu Oct 20 05:57:47 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 05:57:50.356879 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi [None req-c668239b-0098-45ed-870b-7556efef819a admin admin] Calling method '>' {{(pid=103820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 05:57:50.357876 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: INFO nova.api.openstack.requestlog [None req-c668239b-0098-45ed-870b-7556efef819a admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 Oct 20 05:57:50.358271 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: [pid: 103820|app: 0|req: 16/30] 10.222.0.20 () {54 vars in 931 bytes} [Thu Oct 20 05:57:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 05:57:50.823101 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi [None req-7f14eb1f-16b3-417b-a772-2d73db92f656 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "id": "4", "rxtx_factor": 1.0, "swap": 0, "ram": 8192, "os-flavor-access:is_public": true, "vcpus": 4, "disk": 80, "name": "m1.large"}} {{(pid=103821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 05:57:50.831400 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG dbcounter [-] [103821] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=103821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:57:50.843950 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: INFO nova.api.openstack.requestlog [None req-7f14eb1f-16b3-417b-a772-2d73db92f656 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.478866 Oct 20 05:57:50.853101 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: [pid: 103821|app: 0|req: 15/31] 10.222.0.20 () {64 vars in 1283 bytes} [Thu Oct 20 05:57:50 2022] POST /compute/v2.1/flavors => generated 405 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 20 05:57:50.859432 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi [None req-fe7f3608-23b6-44a8-84e1-24ebbb6e6d88 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 05:57:50.885472 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: INFO nova.api.openstack.requestlog [None req-fe7f3608-23b6-44a8-84e1-24ebbb6e6d88 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029857 Oct 20 05:57:50.886172 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: [pid: 103820|app: 0|req: 17/32] 10.222.0.20 () {64 vars in 1333 bytes} [Thu Oct 20 05:57:50 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 05:57:53.578602 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi [None req-7f14eb1f-16b3-417b-a772-2d73db92f656 admin admin] Calling method '>' {{(pid=103821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 05:57:53.579774 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: INFO nova.api.openstack.requestlog [None req-7f14eb1f-16b3-417b-a772-2d73db92f656 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001463 Oct 20 05:57:53.585370 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: [pid: 103821|app: 0|req: 16/33] 10.222.0.20 () {54 vars in 931 bytes} [Thu Oct 20 05:57:53 2022] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 05:57:54.018875 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi [None req-cb3f921e-288b-4b24-9afe-fd1b94c5b2ab admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "disk": 160, "ram": 16384, "swap": 0, "vcpus": 8, "name": "m1.xlarge", "rxtx_factor": 1.0, "id": "5", "os-flavor-access:is_public": true}} {{(pid=103820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 05:57:54.025812 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG dbcounter [-] [103820] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=103820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:57:54.045365 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: INFO nova.api.openstack.requestlog [None req-cb3f921e-288b-4b24-9afe-fd1b94c5b2ab admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.458882 Oct 20 05:57:54.045932 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: [pid: 103820|app: 0|req: 18/34] 10.222.0.20 () {64 vars in 1283 bytes} [Thu Oct 20 05:57:53 2022] POST /compute/v2.1/flavors => generated 408 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 20 05:57:54.058629 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi [None req-0097bbc4-58b7-4d6c-9163-191f6e05b61d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 05:57:54.088248 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: INFO nova.api.openstack.requestlog [None req-0097bbc4-58b7-4d6c-9163-191f6e05b61d admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033258 Oct 20 05:57:54.088968 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: [pid: 103821|app: 0|req: 17/35] 10.222.0.20 () {64 vars in 1333 bytes} [Thu Oct 20 05:57:54 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 05:58:11.047942 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi [None req-cb3f921e-288b-4b24-9afe-fd1b94c5b2ab admin admin] Calling method '>' {{(pid=103820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 05:58:11.049017 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: INFO nova.api.openstack.requestlog [None req-cb3f921e-288b-4b24-9afe-fd1b94c5b2ab admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002015 Oct 20 05:58:11.049454 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: [pid: 103820|app: 0|req: 19/36] 10.222.0.20 () {54 vars in 931 bytes} [Thu Oct 20 05:58:11 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 05:58:11.059935 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG dbcounter [-] [103821] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=103821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:58:11.434553 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi [None req-ad3cab55-30e0-4d01-a7ad-211ce8366202 admin admin] Calling method '>' {{(pid=103821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 05:58:11.452351 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: INFO nova.api.openstack.requestlog [None req-ad3cab55-30e0-4d01-a7ad-211ce8366202 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.396832 Oct 20 05:58:11.453404 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: [pid: 103821|app: 0|req: 18/37] 10.222.0.20 () {60 vars in 1292 bytes} [Thu Oct 20 05:58:11 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 05:58:12.754233 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi [None req-cb3f921e-288b-4b24-9afe-fd1b94c5b2ab admin admin] Calling method '>' {{(pid=103820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 05:58:12.755233 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: INFO nova.api.openstack.requestlog [None req-cb3f921e-288b-4b24-9afe-fd1b94c5b2ab admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001699 Oct 20 05:58:12.755632 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: [pid: 103820|app: 0|req: 20/38] 10.222.0.20 () {56 vars in 1074 bytes} [Thu Oct 20 05:58:12 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 05:58:13.278744 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi [None req-e72006c4-edb3-4e89-a8fd-b6971014208a admin admin] Calling method '>' {{(pid=103821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 05:58:13.284780 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: INFO nova.api.openstack.wsgi [None req-e72006c4-edb3-4e89-a8fd-b6971014208a admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 20 05:58:13.287941 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi [None req-e72006c4-edb3-4e89-a8fd-b6971014208a admin admin] Request method failure captured: Oct 20 05:58:13.287941 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 20 05:58:13.287941 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: Accept: application/json Oct 20 05:58:13.287941 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: Accept-Encoding: gzip, deflate Oct 20 05:58:13.287941 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: Connection: keep-alive Oct 20 05:58:13.287941 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: Content-Length: 0 Oct 20 05:58:13.287941 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: Host: 10.222.0.20 Oct 20 05:58:13.287941 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: Openstack-Api-Version: compute 2.92 Oct 20 05:58:13.287941 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: Openstack-System-Scope: None Oct 20 05:58:13.287941 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: User-Agent: python-novaclient Oct 20 05:58:13.287941 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: X-Auth-Token: gAAAAABjUON0Gegx5stV-xGdBSHQAtbsIGLESO6GQuhVkBCwyuohydGXBFF61M5J3TfEkBSHCW-Q6pILWK8eB5ycXGNA5tuPHPMLMovA3u9SVNWB9IGdyh_vd5pP80Tpt2-BVgA73Vu-lAHRRzjJKTLFzK_iNYRF047zowV2n1BeuNpoE2DnJmU Oct 20 05:58:13.287941 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: X-Domain-Id: None Oct 20 05:58:13.287941 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: X-Domain-Name: None Oct 20 05:58:13.287941 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: X-Identity-Status: Confirmed Oct 20 05:58:13.287941 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: X-Is-Admin-Project: True Oct 20 05:58:13.287941 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: X-Openstack-Nova-Api-Version: 2.92 Oct 20 05:58:13.287941 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: X-Project-Domain-Id: default Oct 20 05:58:13.287941 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: X-Project-Domain-Name: Default Oct 20 05:58:13.287941 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: X-Project-Id: edda8534137f405d818dbc74b7391c73 Oct 20 05:58:13.287941 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: X-Project-Name: admin Oct 20 05:58:13.287941 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: X-Role: admin,reader,member Oct 20 05:58:13.287941 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: X-Roles: admin,reader,member Oct 20 05:58:13.289670 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/edda8534137f405d818dbc74b7391c73"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_edda8534137f405d818dbc74b7391c73"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/edda8534137f405d818dbc74b7391c73"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/edda8534137f405d818dbc74b7391c73"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 20 05:58:13.289670 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: X-Tenant: admin Oct 20 05:58:13.289670 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: X-Tenant-Id: edda8534137f405d818dbc74b7391c73 Oct 20 05:58:13.289670 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: X-Tenant-Name: admin Oct 20 05:58:13.289670 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: X-User: admin Oct 20 05:58:13.289670 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: X-User-Domain-Id: default Oct 20 05:58:13.289670 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: X-User-Domain-Name: Default Oct 20 05:58:13.289670 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: X-User-Id: 6f317beb484644609d07d666527f760d Oct 20 05:58:13.289670 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: X-User-Name: admin Oct 20 05:58:13.289670 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: method: > Oct 20 05:58:13.289670 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: exception: Flavor 42 could not be found. Oct 20 05:58:13.289670 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: action_args: {'id': '42'} Oct 20 05:58:13.289670 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: {{(pid=103821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 20 05:58:13.289670 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 05:58:13.290700 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 20 05:58:13.290700 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 20 05:58:13.290700 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 20 05:58:13.290700 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 20 05:58:13.290700 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 20 05:58:13.290700 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 20 05:58:13.290700 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 20 05:58:13.290700 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 20 05:58:13.290700 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 20 05:58:13.290700 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 20 05:58:13.290700 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 20 05:58:13.290700 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 20 05:58:13.290700 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 20 05:58:13.290700 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: ERROR nova.api.openstack.wsgi Oct 20 05:58:13.290700 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 05:58:13.290700 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: ERROR nova.api.openstack.wsgi Oct 20 05:58:13.290700 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 05:58:13.290700 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 05:58:13.290700 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 05:58:13.291933 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 20 05:58:13.291933 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 20 05:58:13.291933 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 20 05:58:13.291933 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 20 05:58:13.291933 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 20 05:58:13.291933 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 20 05:58:13.291933 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 20 05:58:13.291933 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: ERROR nova.api.openstack.wsgi Oct 20 05:58:13.291933 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 05:58:13.291933 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: ERROR nova.api.openstack.wsgi Oct 20 05:58:13.291933 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 05:58:13.291933 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 05:58:13.291933 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 05:58:13.291933 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 20 05:58:13.291933 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 20 05:58:13.291933 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 20 05:58:13.291933 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: ERROR nova.api.openstack.wsgi Oct 20 05:58:13.291933 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi [None req-e72006c4-edb3-4e89-a8fd-b6971014208a admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103821) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 20 05:58:13.293031 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: INFO nova.api.openstack.requestlog [None req-e72006c4-edb3-4e89-a8fd-b6971014208a admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.391376 Oct 20 05:58:13.293031 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: [pid: 103821|app: 0|req: 19/39] 10.222.0.20 () {60 vars in 1190 bytes} [Thu Oct 20 05:58:12 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 392 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 20 05:58:13.300513 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi [None req-d76e4d86-c6a4-4df8-91f4-f9013fa458d2 admin admin] Calling method '>' {{(pid=103820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 05:58:13.323248 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: INFO nova.api.openstack.requestlog [None req-d76e4d86-c6a4-4df8-91f4-f9013fa458d2 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.027709 Oct 20 05:58:13.323793 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: [pid: 103820|app: 0|req: 21/40] 10.222.0.20 () {60 vars in 1210 bytes} [Thu Oct 20 05:58:13 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 05:58:13.334948 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi [None req-0391fab5-6708-429a-98d2-c3ccd85fc729 admin admin] Calling method '>' {{(pid=103821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 05:58:13.357231 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: INFO nova.api.openstack.requestlog [None req-0391fab5-6708-429a-98d2-c3ccd85fc729 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026739 Oct 20 05:58:13.357765 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: [pid: 103821|app: 0|req: 20/41] 10.222.0.20 () {60 vars in 1210 bytes} [Thu Oct 20 05:58:13 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 05:58:13.367995 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi [None req-4f1e8842-1f40-43f3-a08f-f2487a5339cd admin admin] Calling method '>' {{(pid=103820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 05:58:13.373273 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: INFO nova.api.openstack.wsgi [None req-4f1e8842-1f40-43f3-a08f-f2487a5339cd admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 20 05:58:13.377072 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi [None req-4f1e8842-1f40-43f3-a08f-f2487a5339cd admin admin] Request method failure captured: Oct 20 05:58:13.377072 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 20 05:58:13.377072 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: Accept: application/json Oct 20 05:58:13.377072 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: Accept-Encoding: gzip, deflate Oct 20 05:58:13.377072 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: Connection: keep-alive Oct 20 05:58:13.377072 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: Content-Length: 0 Oct 20 05:58:13.377072 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: Host: 10.222.0.20 Oct 20 05:58:13.377072 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: Openstack-Api-Version: compute 2.92 Oct 20 05:58:13.377072 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: Openstack-System-Scope: None Oct 20 05:58:13.377072 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: User-Agent: python-novaclient Oct 20 05:58:13.377072 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: X-Auth-Token: gAAAAABjUON0Gegx5stV-xGdBSHQAtbsIGLESO6GQuhVkBCwyuohydGXBFF61M5J3TfEkBSHCW-Q6pILWK8eB5ycXGNA5tuPHPMLMovA3u9SVNWB9IGdyh_vd5pP80Tpt2-BVgA73Vu-lAHRRzjJKTLFzK_iNYRF047zowV2n1BeuNpoE2DnJmU Oct 20 05:58:13.377072 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: X-Domain-Id: None Oct 20 05:58:13.377072 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: X-Domain-Name: None Oct 20 05:58:13.377072 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: X-Identity-Status: Confirmed Oct 20 05:58:13.377072 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: X-Is-Admin-Project: True Oct 20 05:58:13.377072 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: X-Openstack-Nova-Api-Version: 2.92 Oct 20 05:58:13.377072 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: X-Project-Domain-Id: default Oct 20 05:58:13.377072 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: X-Project-Domain-Name: Default Oct 20 05:58:13.377072 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: X-Project-Id: edda8534137f405d818dbc74b7391c73 Oct 20 05:58:13.377072 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: X-Project-Name: admin Oct 20 05:58:13.377072 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: X-Role: admin,reader,member Oct 20 05:58:13.377072 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: X-Roles: admin,reader,member Oct 20 05:58:13.378831 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/edda8534137f405d818dbc74b7391c73"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_edda8534137f405d818dbc74b7391c73"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/edda8534137f405d818dbc74b7391c73"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/edda8534137f405d818dbc74b7391c73"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 20 05:58:13.378831 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: X-Tenant: admin Oct 20 05:58:13.378831 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: X-Tenant-Id: edda8534137f405d818dbc74b7391c73 Oct 20 05:58:13.378831 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: X-Tenant-Name: admin Oct 20 05:58:13.378831 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: X-User: admin Oct 20 05:58:13.378831 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: X-User-Domain-Id: default Oct 20 05:58:13.378831 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: X-User-Domain-Name: Default Oct 20 05:58:13.378831 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: X-User-Id: 6f317beb484644609d07d666527f760d Oct 20 05:58:13.378831 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: X-User-Name: admin Oct 20 05:58:13.378831 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: method: > Oct 20 05:58:13.378831 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: exception: Flavor 42 could not be found. Oct 20 05:58:13.378831 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: action_args: {'id': '42'} Oct 20 05:58:13.378831 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: {{(pid=103820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 20 05:58:13.378831 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 05:58:13.379678 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 20 05:58:13.379678 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 20 05:58:13.379678 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 20 05:58:13.379678 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 20 05:58:13.379678 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 20 05:58:13.379678 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 20 05:58:13.379678 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 20 05:58:13.379678 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 20 05:58:13.379678 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 20 05:58:13.379678 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 20 05:58:13.379678 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 20 05:58:13.379678 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 20 05:58:13.379678 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 20 05:58:13.379678 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: ERROR nova.api.openstack.wsgi Oct 20 05:58:13.379678 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 05:58:13.379678 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: ERROR nova.api.openstack.wsgi Oct 20 05:58:13.379678 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 05:58:13.379678 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 05:58:13.379678 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 05:58:13.380731 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 20 05:58:13.380731 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 20 05:58:13.380731 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 20 05:58:13.380731 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 20 05:58:13.380731 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 20 05:58:13.380731 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 20 05:58:13.380731 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 20 05:58:13.380731 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: ERROR nova.api.openstack.wsgi Oct 20 05:58:13.380731 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 05:58:13.380731 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: ERROR nova.api.openstack.wsgi Oct 20 05:58:13.380731 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 05:58:13.380731 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 05:58:13.380731 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 05:58:13.380731 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 20 05:58:13.380731 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 20 05:58:13.380731 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 20 05:58:13.380731 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: ERROR nova.api.openstack.wsgi Oct 20 05:58:13.380731 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi [None req-4f1e8842-1f40-43f3-a08f-f2487a5339cd admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103820) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 20 05:58:13.381735 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: INFO nova.api.openstack.requestlog [None req-4f1e8842-1f40-43f3-a08f-f2487a5339cd admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.013984 Oct 20 05:58:13.381735 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: [pid: 103820|app: 0|req: 22/42] 10.222.0.20 () {60 vars in 1190 bytes} [Thu Oct 20 05:58:13 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 20 05:58:14.596066 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi [None req-0391fab5-6708-429a-98d2-c3ccd85fc729 admin admin] Calling method '>' {{(pid=103821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 05:58:14.597128 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: INFO nova.api.openstack.requestlog [None req-0391fab5-6708-429a-98d2-c3ccd85fc729 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001491 Oct 20 05:58:14.597524 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: [pid: 103821|app: 0|req: 21/43] 10.222.0.20 () {56 vars in 1074 bytes} [Thu Oct 20 05:58:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 05:58:15.110282 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi [None req-294eb261-892a-4cd5-a4c7-05b64865a816 admin admin] Calling method '>' {{(pid=103820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 05:58:15.115270 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: INFO nova.api.openstack.wsgi [None req-294eb261-892a-4cd5-a4c7-05b64865a816 admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 20 05:58:15.116780 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi [None req-294eb261-892a-4cd5-a4c7-05b64865a816 admin admin] Request method failure captured: Oct 20 05:58:15.116780 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 20 05:58:15.116780 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: Accept: application/json Oct 20 05:58:15.116780 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: Accept-Encoding: gzip, deflate Oct 20 05:58:15.116780 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: Connection: keep-alive Oct 20 05:58:15.116780 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: Content-Length: 0 Oct 20 05:58:15.116780 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: Host: 10.222.0.20 Oct 20 05:58:15.116780 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: Openstack-Api-Version: compute 2.92 Oct 20 05:58:15.116780 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: Openstack-System-Scope: None Oct 20 05:58:15.116780 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: User-Agent: python-novaclient Oct 20 05:58:15.116780 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: X-Auth-Token: gAAAAABjUON2Ad97_45isUBLY4jsBKBf0CuqOSXSx26CbVjnd57BsOfTHxG5FfpN-jPSOY-QYD9WuAECsTtVlyyoG84JwFck3IACs7Js8orP-qWQdy9XuSuBarr7AxfY5wZVkvtPrir6ljsqrRFY1PE-SbQ8T8Ebt1HdC6qYprbAV3cVGfxksuY Oct 20 05:58:15.116780 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: X-Domain-Id: None Oct 20 05:58:15.116780 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: X-Domain-Name: None Oct 20 05:58:15.116780 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: X-Identity-Status: Confirmed Oct 20 05:58:15.116780 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: X-Is-Admin-Project: True Oct 20 05:58:15.116780 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: X-Openstack-Nova-Api-Version: 2.92 Oct 20 05:58:15.116780 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: X-Project-Domain-Id: default Oct 20 05:58:15.116780 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: X-Project-Domain-Name: Default Oct 20 05:58:15.116780 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: X-Project-Id: edda8534137f405d818dbc74b7391c73 Oct 20 05:58:15.116780 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: X-Project-Name: admin Oct 20 05:58:15.116780 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: X-Role: admin,reader,member Oct 20 05:58:15.116780 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: X-Roles: admin,reader,member Oct 20 05:58:15.118354 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/edda8534137f405d818dbc74b7391c73"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_edda8534137f405d818dbc74b7391c73"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/edda8534137f405d818dbc74b7391c73"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/edda8534137f405d818dbc74b7391c73"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 20 05:58:15.118354 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: X-Tenant: admin Oct 20 05:58:15.118354 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: X-Tenant-Id: edda8534137f405d818dbc74b7391c73 Oct 20 05:58:15.118354 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: X-Tenant-Name: admin Oct 20 05:58:15.118354 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: X-User: admin Oct 20 05:58:15.118354 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: X-User-Domain-Id: default Oct 20 05:58:15.118354 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: X-User-Domain-Name: Default Oct 20 05:58:15.118354 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: X-User-Id: 6f317beb484644609d07d666527f760d Oct 20 05:58:15.118354 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: X-User-Name: admin Oct 20 05:58:15.118354 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: method: > Oct 20 05:58:15.118354 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: exception: Flavor 84 could not be found. Oct 20 05:58:15.118354 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: action_args: {'id': '84'} Oct 20 05:58:15.118354 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: {{(pid=103820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 20 05:58:15.118354 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 05:58:15.119337 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 20 05:58:15.119337 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 20 05:58:15.119337 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 20 05:58:15.119337 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 20 05:58:15.119337 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 20 05:58:15.119337 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 20 05:58:15.119337 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 20 05:58:15.119337 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 20 05:58:15.119337 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 20 05:58:15.119337 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 20 05:58:15.119337 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 20 05:58:15.119337 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 20 05:58:15.119337 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 20 05:58:15.119337 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: ERROR nova.api.openstack.wsgi Oct 20 05:58:15.119337 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 05:58:15.119337 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: ERROR nova.api.openstack.wsgi Oct 20 05:58:15.119337 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 05:58:15.119337 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 05:58:15.119337 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 05:58:15.120689 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 20 05:58:15.120689 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 20 05:58:15.120689 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 20 05:58:15.120689 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 20 05:58:15.120689 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 20 05:58:15.120689 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 20 05:58:15.120689 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 20 05:58:15.120689 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: ERROR nova.api.openstack.wsgi Oct 20 05:58:15.120689 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 05:58:15.120689 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: ERROR nova.api.openstack.wsgi Oct 20 05:58:15.120689 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 05:58:15.120689 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 05:58:15.120689 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 05:58:15.120689 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 20 05:58:15.120689 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 20 05:58:15.120689 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 20 05:58:15.120689 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: ERROR nova.api.openstack.wsgi Oct 20 05:58:15.120689 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi [None req-294eb261-892a-4cd5-a4c7-05b64865a816 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103820) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 20 05:58:15.121948 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: INFO nova.api.openstack.requestlog [None req-294eb261-892a-4cd5-a4c7-05b64865a816 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.381864 Oct 20 05:58:15.121948 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: [pid: 103820|app: 0|req: 23/44] 10.222.0.20 () {60 vars in 1190 bytes} [Thu Oct 20 05:58:14 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 383 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 20 05:58:15.128621 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi [None req-b94d4b8a-d119-4185-8b1f-e032c1458078 admin admin] Calling method '>' {{(pid=103821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 05:58:15.143209 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: INFO nova.api.openstack.requestlog [None req-b94d4b8a-d119-4185-8b1f-e032c1458078 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018947 Oct 20 05:58:15.143733 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: [pid: 103821|app: 0|req: 22/45] 10.222.0.20 () {60 vars in 1210 bytes} [Thu Oct 20 05:58:15 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 05:58:15.152979 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi [None req-8f48f12e-b21e-4d00-bfec-937352cd77f4 admin admin] Calling method '>' {{(pid=103820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 05:58:15.168267 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: INFO nova.api.openstack.requestlog [None req-8f48f12e-b21e-4d00-bfec-937352cd77f4 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018822 Oct 20 05:58:15.168837 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: [pid: 103820|app: 0|req: 24/46] 10.222.0.20 () {60 vars in 1210 bytes} [Thu Oct 20 05:58:15 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 05:58:15.178521 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi [None req-c185cd22-6c37-404f-ace8-6b225ba4e0bd admin admin] Calling method '>' {{(pid=103821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 05:58:15.183378 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: INFO nova.api.openstack.wsgi [None req-c185cd22-6c37-404f-ace8-6b225ba4e0bd admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 20 05:58:15.184922 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi [None req-c185cd22-6c37-404f-ace8-6b225ba4e0bd admin admin] Request method failure captured: Oct 20 05:58:15.184922 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 20 05:58:15.184922 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: Accept: application/json Oct 20 05:58:15.184922 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: Accept-Encoding: gzip, deflate Oct 20 05:58:15.184922 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: Connection: keep-alive Oct 20 05:58:15.184922 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: Content-Length: 0 Oct 20 05:58:15.184922 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: Host: 10.222.0.20 Oct 20 05:58:15.184922 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: Openstack-Api-Version: compute 2.92 Oct 20 05:58:15.184922 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: Openstack-System-Scope: None Oct 20 05:58:15.184922 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: User-Agent: python-novaclient Oct 20 05:58:15.184922 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: X-Auth-Token: gAAAAABjUON2Ad97_45isUBLY4jsBKBf0CuqOSXSx26CbVjnd57BsOfTHxG5FfpN-jPSOY-QYD9WuAECsTtVlyyoG84JwFck3IACs7Js8orP-qWQdy9XuSuBarr7AxfY5wZVkvtPrir6ljsqrRFY1PE-SbQ8T8Ebt1HdC6qYprbAV3cVGfxksuY Oct 20 05:58:15.184922 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: X-Domain-Id: None Oct 20 05:58:15.184922 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: X-Domain-Name: None Oct 20 05:58:15.184922 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: X-Identity-Status: Confirmed Oct 20 05:58:15.184922 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: X-Is-Admin-Project: True Oct 20 05:58:15.184922 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: X-Openstack-Nova-Api-Version: 2.92 Oct 20 05:58:15.184922 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: X-Project-Domain-Id: default Oct 20 05:58:15.184922 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: X-Project-Domain-Name: Default Oct 20 05:58:15.184922 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: X-Project-Id: edda8534137f405d818dbc74b7391c73 Oct 20 05:58:15.184922 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: X-Project-Name: admin Oct 20 05:58:15.184922 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: X-Role: admin,reader,member Oct 20 05:58:15.184922 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: X-Roles: admin,reader,member Oct 20 05:58:15.186353 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/edda8534137f405d818dbc74b7391c73"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_edda8534137f405d818dbc74b7391c73"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/edda8534137f405d818dbc74b7391c73"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/edda8534137f405d818dbc74b7391c73"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 20 05:58:15.186353 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: X-Tenant: admin Oct 20 05:58:15.186353 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: X-Tenant-Id: edda8534137f405d818dbc74b7391c73 Oct 20 05:58:15.186353 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: X-Tenant-Name: admin Oct 20 05:58:15.186353 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: X-User: admin Oct 20 05:58:15.186353 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: X-User-Domain-Id: default Oct 20 05:58:15.186353 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: X-User-Domain-Name: Default Oct 20 05:58:15.186353 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: X-User-Id: 6f317beb484644609d07d666527f760d Oct 20 05:58:15.186353 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: X-User-Name: admin Oct 20 05:58:15.186353 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: method: > Oct 20 05:58:15.186353 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: exception: Flavor 84 could not be found. Oct 20 05:58:15.186353 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: action_args: {'id': '84'} Oct 20 05:58:15.186353 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: {{(pid=103821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 20 05:58:15.186353 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 05:58:15.187176 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 20 05:58:15.187176 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 20 05:58:15.187176 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 20 05:58:15.187176 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 20 05:58:15.187176 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 20 05:58:15.187176 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 20 05:58:15.187176 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 20 05:58:15.187176 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 20 05:58:15.187176 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 20 05:58:15.187176 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 20 05:58:15.187176 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 20 05:58:15.187176 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 20 05:58:15.187176 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 20 05:58:15.187176 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: ERROR nova.api.openstack.wsgi Oct 20 05:58:15.187176 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 05:58:15.187176 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: ERROR nova.api.openstack.wsgi Oct 20 05:58:15.187176 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 05:58:15.187176 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 05:58:15.187176 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 05:58:15.188884 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 20 05:58:15.188884 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 20 05:58:15.188884 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 20 05:58:15.188884 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 20 05:58:15.188884 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 20 05:58:15.188884 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 20 05:58:15.188884 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 20 05:58:15.188884 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: ERROR nova.api.openstack.wsgi Oct 20 05:58:15.188884 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 05:58:15.188884 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: ERROR nova.api.openstack.wsgi Oct 20 05:58:15.188884 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 05:58:15.188884 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 05:58:15.188884 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 05:58:15.188884 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 20 05:58:15.188884 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 20 05:58:15.188884 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 20 05:58:15.188884 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: ERROR nova.api.openstack.wsgi Oct 20 05:58:15.188884 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi [None req-c185cd22-6c37-404f-ace8-6b225ba4e0bd admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103821) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 20 05:58:15.189934 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: INFO nova.api.openstack.requestlog [None req-c185cd22-6c37-404f-ace8-6b225ba4e0bd admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.011196 Oct 20 05:58:15.189934 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: [pid: 103821|app: 0|req: 23/47] 10.222.0.20 () {60 vars in 1190 bytes} [Thu Oct 20 05:58:15 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Oct 20 05:58:16.425196 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi [None req-8f48f12e-b21e-4d00-bfec-937352cd77f4 admin admin] Calling method '>' {{(pid=103820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 05:58:16.426217 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: INFO nova.api.openstack.requestlog [None req-8f48f12e-b21e-4d00-bfec-937352cd77f4 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 Oct 20 05:58:16.426603 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: [pid: 103820|app: 0|req: 25/48] 10.222.0.20 () {56 vars in 1074 bytes} [Thu Oct 20 05:58:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 05:58:16.942243 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi [None req-e3aca08a-e765-48e4-993b-dcf6d2d0f616 admin admin] Calling method '>' {{(pid=103821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 05:58:16.948002 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: INFO nova.api.openstack.wsgi [None req-e3aca08a-e765-48e4-993b-dcf6d2d0f616 admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 20 05:58:16.949518 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi [None req-e3aca08a-e765-48e4-993b-dcf6d2d0f616 admin admin] Request method failure captured: Oct 20 05:58:16.949518 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 20 05:58:16.949518 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: Accept: application/json Oct 20 05:58:16.949518 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: Accept-Encoding: gzip, deflate Oct 20 05:58:16.949518 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: Connection: keep-alive Oct 20 05:58:16.949518 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: Content-Length: 0 Oct 20 05:58:16.949518 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: Host: 10.222.0.20 Oct 20 05:58:16.949518 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: Openstack-Api-Version: compute 2.92 Oct 20 05:58:16.949518 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: Openstack-System-Scope: None Oct 20 05:58:16.949518 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: User-Agent: python-novaclient Oct 20 05:58:16.949518 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: X-Auth-Token: gAAAAABjUON41U_CDcYqhOPEvIkw3gO0hmr9NwUJgwBceL0GyhrRz1jBIRoBzbBVZb6psffBxxBs573jpjLBRyYVPE9xvypRiYmuo1ENZ8YxxTgVIWky5VuR9rDzZynvBXQYjXcnnbf6UU5Reo1kEKhIhIOCrFQDr3Gru7LNQyXtJ4ApLhk2Ges Oct 20 05:58:16.949518 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: X-Domain-Id: None Oct 20 05:58:16.949518 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: X-Domain-Name: None Oct 20 05:58:16.949518 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: X-Identity-Status: Confirmed Oct 20 05:58:16.949518 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: X-Is-Admin-Project: True Oct 20 05:58:16.949518 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: X-Openstack-Nova-Api-Version: 2.92 Oct 20 05:58:16.949518 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: X-Project-Domain-Id: default Oct 20 05:58:16.949518 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: X-Project-Domain-Name: Default Oct 20 05:58:16.949518 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: X-Project-Id: edda8534137f405d818dbc74b7391c73 Oct 20 05:58:16.949518 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: X-Project-Name: admin Oct 20 05:58:16.949518 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: X-Role: admin,reader,member Oct 20 05:58:16.949518 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: X-Roles: admin,reader,member Oct 20 05:58:16.951048 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/edda8534137f405d818dbc74b7391c73"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_edda8534137f405d818dbc74b7391c73"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/edda8534137f405d818dbc74b7391c73"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/edda8534137f405d818dbc74b7391c73"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 20 05:58:16.951048 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: X-Tenant: admin Oct 20 05:58:16.951048 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: X-Tenant-Id: edda8534137f405d818dbc74b7391c73 Oct 20 05:58:16.951048 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: X-Tenant-Name: admin Oct 20 05:58:16.951048 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: X-User: admin Oct 20 05:58:16.951048 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: X-User-Domain-Id: default Oct 20 05:58:16.951048 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: X-User-Domain-Name: Default Oct 20 05:58:16.951048 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: X-User-Id: 6f317beb484644609d07d666527f760d Oct 20 05:58:16.951048 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: X-User-Name: admin Oct 20 05:58:16.951048 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: method: > Oct 20 05:58:16.951048 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: exception: Flavor 451 could not be found. Oct 20 05:58:16.951048 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: action_args: {'id': '451'} Oct 20 05:58:16.951048 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: {{(pid=103821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 20 05:58:16.951048 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 05:58:16.952008 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 20 05:58:16.952008 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 20 05:58:16.952008 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 20 05:58:16.952008 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 20 05:58:16.952008 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 20 05:58:16.952008 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 20 05:58:16.952008 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 20 05:58:16.952008 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 20 05:58:16.952008 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 20 05:58:16.952008 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 20 05:58:16.952008 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 20 05:58:16.952008 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 20 05:58:16.952008 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 20 05:58:16.952008 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: ERROR nova.api.openstack.wsgi Oct 20 05:58:16.952008 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 05:58:16.952008 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: ERROR nova.api.openstack.wsgi Oct 20 05:58:16.952008 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 05:58:16.952008 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 05:58:16.952008 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 05:58:16.954397 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 20 05:58:16.954397 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 20 05:58:16.954397 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 20 05:58:16.954397 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 20 05:58:16.954397 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 20 05:58:16.954397 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 20 05:58:16.954397 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 20 05:58:16.954397 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: ERROR nova.api.openstack.wsgi Oct 20 05:58:16.954397 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 05:58:16.954397 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: ERROR nova.api.openstack.wsgi Oct 20 05:58:16.954397 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 05:58:16.954397 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 05:58:16.954397 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 05:58:16.954397 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 20 05:58:16.954397 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 20 05:58:16.954397 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 20 05:58:16.954397 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: ERROR nova.api.openstack.wsgi Oct 20 05:58:16.954397 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi [None req-e3aca08a-e765-48e4-993b-dcf6d2d0f616 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103821) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 20 05:58:16.955633 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: INFO nova.api.openstack.requestlog [None req-e3aca08a-e765-48e4-993b-dcf6d2d0f616 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.387477 Oct 20 05:58:16.955633 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: [pid: 103821|app: 0|req: 24/49] 10.222.0.20 () {60 vars in 1193 bytes} [Thu Oct 20 05:58:16 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 389 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 20 05:58:16.961268 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi [None req-b9b74db9-de12-4510-9e5f-cef64c5f6517 admin admin] Calling method '>' {{(pid=103820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 05:58:16.975880 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: INFO nova.api.openstack.requestlog [None req-b9b74db9-de12-4510-9e5f-cef64c5f6517 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018124 Oct 20 05:58:16.976414 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: [pid: 103820|app: 0|req: 26/50] 10.222.0.20 () {60 vars in 1210 bytes} [Thu Oct 20 05:58:16 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 05:58:16.986112 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi [None req-d9b28106-8c49-46af-8257-ecdfaab11e21 admin admin] Calling method '>' {{(pid=103821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 05:58:17.001545 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: INFO nova.api.openstack.requestlog [None req-d9b28106-8c49-46af-8257-ecdfaab11e21 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019062 Oct 20 05:58:17.002078 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: [pid: 103821|app: 0|req: 25/51] 10.222.0.20 () {60 vars in 1210 bytes} [Thu Oct 20 05:58:16 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 05:58:17.011370 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi [None req-d95caa93-b621-48ab-9758-999021e47407 admin admin] Calling method '>' {{(pid=103820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 05:58:17.016720 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: INFO nova.api.openstack.wsgi [None req-d95caa93-b621-48ab-9758-999021e47407 admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 20 05:58:17.018228 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi [None req-d95caa93-b621-48ab-9758-999021e47407 admin admin] Request method failure captured: Oct 20 05:58:17.018228 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 20 05:58:17.018228 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: Accept: application/json Oct 20 05:58:17.018228 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: Accept-Encoding: gzip, deflate Oct 20 05:58:17.018228 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: Connection: keep-alive Oct 20 05:58:17.018228 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: Content-Length: 0 Oct 20 05:58:17.018228 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: Host: 10.222.0.20 Oct 20 05:58:17.018228 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: Openstack-Api-Version: compute 2.92 Oct 20 05:58:17.018228 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: Openstack-System-Scope: None Oct 20 05:58:17.018228 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: User-Agent: python-novaclient Oct 20 05:58:17.018228 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: X-Auth-Token: gAAAAABjUON41U_CDcYqhOPEvIkw3gO0hmr9NwUJgwBceL0GyhrRz1jBIRoBzbBVZb6psffBxxBs573jpjLBRyYVPE9xvypRiYmuo1ENZ8YxxTgVIWky5VuR9rDzZynvBXQYjXcnnbf6UU5Reo1kEKhIhIOCrFQDr3Gru7LNQyXtJ4ApLhk2Ges Oct 20 05:58:17.018228 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: X-Domain-Id: None Oct 20 05:58:17.018228 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: X-Domain-Name: None Oct 20 05:58:17.018228 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: X-Identity-Status: Confirmed Oct 20 05:58:17.018228 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: X-Is-Admin-Project: True Oct 20 05:58:17.018228 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: X-Openstack-Nova-Api-Version: 2.92 Oct 20 05:58:17.018228 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: X-Project-Domain-Id: default Oct 20 05:58:17.018228 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: X-Project-Domain-Name: Default Oct 20 05:58:17.018228 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: X-Project-Id: edda8534137f405d818dbc74b7391c73 Oct 20 05:58:17.018228 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: X-Project-Name: admin Oct 20 05:58:17.018228 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: X-Role: admin,reader,member Oct 20 05:58:17.018228 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: X-Roles: admin,reader,member Oct 20 05:58:17.019775 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/edda8534137f405d818dbc74b7391c73"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_edda8534137f405d818dbc74b7391c73"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/edda8534137f405d818dbc74b7391c73"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/edda8534137f405d818dbc74b7391c73"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 20 05:58:17.019775 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: X-Tenant: admin Oct 20 05:58:17.019775 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: X-Tenant-Id: edda8534137f405d818dbc74b7391c73 Oct 20 05:58:17.019775 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: X-Tenant-Name: admin Oct 20 05:58:17.019775 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: X-User: admin Oct 20 05:58:17.019775 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: X-User-Domain-Id: default Oct 20 05:58:17.019775 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: X-User-Domain-Name: Default Oct 20 05:58:17.019775 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: X-User-Id: 6f317beb484644609d07d666527f760d Oct 20 05:58:17.019775 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: X-User-Name: admin Oct 20 05:58:17.019775 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: method: > Oct 20 05:58:17.019775 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: exception: Flavor 451 could not be found. Oct 20 05:58:17.019775 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: action_args: {'id': '451'} Oct 20 05:58:17.019775 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: {{(pid=103820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 20 05:58:17.019775 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 05:58:17.020724 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 20 05:58:17.020724 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 20 05:58:17.020724 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 20 05:58:17.020724 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 20 05:58:17.020724 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 20 05:58:17.020724 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 20 05:58:17.020724 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 20 05:58:17.020724 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 20 05:58:17.020724 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 20 05:58:17.020724 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 20 05:58:17.020724 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 20 05:58:17.020724 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 20 05:58:17.020724 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 20 05:58:17.020724 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: ERROR nova.api.openstack.wsgi Oct 20 05:58:17.020724 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 05:58:17.020724 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: ERROR nova.api.openstack.wsgi Oct 20 05:58:17.020724 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 05:58:17.020724 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 05:58:17.020724 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 05:58:17.021983 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 20 05:58:17.021983 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 20 05:58:17.021983 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 20 05:58:17.021983 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 20 05:58:17.021983 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 20 05:58:17.021983 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 20 05:58:17.021983 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 20 05:58:17.021983 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: ERROR nova.api.openstack.wsgi Oct 20 05:58:17.021983 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 05:58:17.021983 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: ERROR nova.api.openstack.wsgi Oct 20 05:58:17.021983 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 05:58:17.021983 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 05:58:17.021983 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 05:58:17.021983 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 20 05:58:17.021983 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 20 05:58:17.021983 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 20 05:58:17.021983 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: ERROR nova.api.openstack.wsgi Oct 20 05:58:17.021983 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi [None req-d95caa93-b621-48ab-9758-999021e47407 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103820) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 20 05:58:17.023507 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: INFO nova.api.openstack.requestlog [None req-d95caa93-b621-48ab-9758-999021e47407 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.011641 Oct 20 05:58:17.023507 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: [pid: 103820|app: 0|req: 27/52] 10.222.0.20 () {60 vars in 1193 bytes} [Thu Oct 20 05:58:17 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 20 05:58:18.250785 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi [None req-d9b28106-8c49-46af-8257-ecdfaab11e21 admin admin] Calling method '>' {{(pid=103821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 05:58:18.251832 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: INFO nova.api.openstack.requestlog [None req-d9b28106-8c49-46af-8257-ecdfaab11e21 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001483 Oct 20 05:58:18.252223 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: [pid: 103821|app: 0|req: 26/53] 10.222.0.20 () {56 vars in 1074 bytes} [Thu Oct 20 05:58:18 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 20 05:58:18.769549 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi [None req-49aa8601-2e1d-486e-bef0-62e245e16062 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 05:58:18.788660 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: INFO nova.api.openstack.requestlog [None req-49aa8601-2e1d-486e-bef0-62e245e16062 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.397422 Oct 20 05:58:18.789229 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: [pid: 103820|app: 0|req: 28/54] 10.222.0.20 () {64 vars in 1235 bytes} [Thu Oct 20 05:58:18 2022] POST /compute/v2.1/flavors => generated 404 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 20 05:58:20.007790 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi [None req-d9b28106-8c49-46af-8257-ecdfaab11e21 admin admin] Calling method '>' {{(pid=103821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 05:58:20.008865 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: INFO nova.api.openstack.requestlog [None req-d9b28106-8c49-46af-8257-ecdfaab11e21 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 Oct 20 05:58:20.009293 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: [pid: 103821|app: 0|req: 27/55] 10.222.0.20 () {56 vars in 1074 bytes} [Thu Oct 20 05:58:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 05:58:20.533794 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi [None req-6ff4c0dc-ad0f-4e26-b0a3-e358fc3e25e8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 05:58:20.552739 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: INFO nova.api.openstack.requestlog [None req-6ff4c0dc-ad0f-4e26-b0a3-e358fc3e25e8 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.403754 Oct 20 05:58:20.553298 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: [pid: 103820|app: 0|req: 29/56] 10.222.0.20 () {64 vars in 1235 bytes} [Thu Oct 20 05:58:20 2022] POST /compute/v2.1/flavors => generated 405 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 20 05:58:21.779756 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi [None req-d9b28106-8c49-46af-8257-ecdfaab11e21 admin admin] Calling method '>' {{(pid=103821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 05:58:21.781041 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: INFO nova.api.openstack.requestlog [None req-d9b28106-8c49-46af-8257-ecdfaab11e21 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001412 Oct 20 05:58:21.781448 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: [pid: 103821|app: 0|req: 28/57] 10.222.0.20 () {56 vars in 1074 bytes} [Thu Oct 20 05:58:21 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 05:58:22.295911 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi [None req-b81b445e-6872-42b1-a347-88f92ddc5776 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 05:58:22.316411 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: INFO nova.api.openstack.requestlog [None req-b81b445e-6872-42b1-a347-88f92ddc5776 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.398881 Oct 20 05:58:22.317003 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: [pid: 103820|app: 0|req: 30/58] 10.222.0.20 () {64 vars in 1235 bytes} [Thu Oct 20 05:58:21 2022] POST /compute/v2.1/flavors => generated 407 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 20 05:58:23.535860 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi [None req-d9b28106-8c49-46af-8257-ecdfaab11e21 admin admin] Calling method '>' {{(pid=103821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 05:58:23.536941 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: INFO nova.api.openstack.requestlog [None req-d9b28106-8c49-46af-8257-ecdfaab11e21 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Oct 20 05:58:23.537343 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: [pid: 103821|app: 0|req: 29/59] 10.222.0.20 () {56 vars in 1074 bytes} [Thu Oct 20 05:58:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 05:58:24.057801 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi [None req-1af9e033-bf06-4bfa-8d5a-4f5d018bfa5a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 05:58:24.076321 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: INFO nova.api.openstack.requestlog [None req-1af9e033-bf06-4bfa-8d5a-4f5d018bfa5a admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.396963 Oct 20 05:58:24.076910 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: [pid: 103820|app: 0|req: 31/60] 10.222.0.20 () {64 vars in 1235 bytes} [Thu Oct 20 05:58:23 2022] POST /compute/v2.1/flavors => generated 409 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 20 05:58:25.295040 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi [None req-d9b28106-8c49-46af-8257-ecdfaab11e21 admin admin] Calling method '>' {{(pid=103821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 05:58:25.296293 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: INFO nova.api.openstack.requestlog [None req-d9b28106-8c49-46af-8257-ecdfaab11e21 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 Oct 20 05:58:25.296706 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: [pid: 103821|app: 0|req: 30/61] 10.222.0.20 () {56 vars in 1074 bytes} [Thu Oct 20 05:58:25 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 05:58:25.812590 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi [None req-f2e3279e-7653-472f-be23-dde5e177072a admin admin] Calling method '>' {{(pid=103820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 05:58:25.832785 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: INFO nova.api.openstack.requestlog [None req-f2e3279e-7653-472f-be23-dde5e177072a admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.401348 Oct 20 05:58:25.833324 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: [pid: 103820|app: 0|req: 32/62] 10.222.0.20 () {60 vars in 1202 bytes} [Thu Oct 20 05:58:25 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 05:59:22.346368 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi [None req-d9b28106-8c49-46af-8257-ecdfaab11e21 admin admin] Calling method '>' {{(pid=103821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 05:59:22.347373 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: INFO nova.api.openstack.requestlog [None req-d9b28106-8c49-46af-8257-ecdfaab11e21 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001434 Oct 20 05:59:22.347774 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: [pid: 103821|app: 0|req: 31/63] 10.222.0.20 () {54 vars in 931 bytes} [Thu Oct 20 05:59:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 05:59:22.358594 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG dbcounter [-] [103820] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=103820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:59:22.737615 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi [None req-68ec12a4-1eaa-4e26-ad8f-a03612af0898 admin admin] Calling method '>' {{(pid=103820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 05:59:22.758476 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: INFO nova.api.openstack.requestlog [None req-68ec12a4-1eaa-4e26-ad8f-a03612af0898 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.404837 Oct 20 05:59:22.758944 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: [pid: 103820|app: 0|req: 33/64] 10.222.0.20 () {60 vars in 1292 bytes} [Thu Oct 20 05:59:22 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 20 05:59:22.780612 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG dbcounter [-] [103821] Writing DB stats nova_api:SELECT=14 {{(pid=103821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 05:59:22.784431 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi [None req-f83b7611-e64d-47e6-916a-2eeff3ac5633 admin admin] Calling method '>' {{(pid=103821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 05:59:22.791793 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: INFO nova.api.openstack.requestlog [None req-f83b7611-e64d-47e6-916a-2eeff3ac5633 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012659 Oct 20 05:59:22.792317 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: [pid: 103821|app: 0|req: 32/65] 10.222.0.20 () {60 vars in 1283 bytes} [Thu Oct 20 05:59:22 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 05:59:22.804575 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi [None req-a0d73cdc-617d-47a0-aa5d-1bc93c22ec6a admin admin] Calling method '>' {{(pid=103820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 05:59:22.812392 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: INFO nova.api.openstack.requestlog [None req-a0d73cdc-617d-47a0-aa5d-1bc93c22ec6a admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011357 Oct 20 05:59:22.813011 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: [pid: 103820|app: 0|req: 34/66] 10.222.0.20 () {60 vars in 1286 bytes} [Thu Oct 20 05:59:22 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 05:59:22.824037 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi [None req-ec3f6ecf-e045-4693-b9ee-e98d4715e5f8 admin admin] Calling method '>' {{(pid=103821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 05:59:22.831212 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: INFO nova.api.openstack.requestlog [None req-ec3f6ecf-e045-4693-b9ee-e98d4715e5f8 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010601 Oct 20 05:59:22.831727 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: [pid: 103821|app: 0|req: 33/67] 10.222.0.20 () {60 vars in 1286 bytes} [Thu Oct 20 05:59:22 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 05:59:22.843285 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi [None req-cccc85fa-960a-4686-982a-6e035ab25413 admin admin] Calling method '>' {{(pid=103820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 05:59:22.850260 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: INFO nova.api.openstack.requestlog [None req-cccc85fa-960a-4686-982a-6e035ab25413 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010951 Oct 20 05:59:22.850767 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: [pid: 103820|app: 0|req: 35/68] 10.222.0.20 () {60 vars in 1283 bytes} [Thu Oct 20 05:59:22 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 06:02:29.302430 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi [None req-ec3f6ecf-e045-4693-b9ee-e98d4715e5f8 admin admin] Calling method '>' {{(pid=103821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:02:29.303433 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: INFO nova.api.openstack.requestlog [None req-ec3f6ecf-e045-4693-b9ee-e98d4715e5f8 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Oct 20 06:02:29.303834 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: [pid: 103821|app: 0|req: 34/69] 10.222.0.20 () {56 vars in 1074 bytes} [Thu Oct 20 06:02:29 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:02:29.444740 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG dbcounter [-] [103820] Writing DB stats nova_api:SELECT=6 {{(pid=103820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:02:29.604351 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi [None req-51a435de-af69-453b-baee-51a4297fcdf6 admin admin] Calling method '>' {{(pid=103820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:02:29.609009 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG oslo_concurrency.lockutils [None req-51a435de-af69-453b-baee-51a4297fcdf6 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:02:29.609481 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG oslo_concurrency.lockutils [None req-51a435de-af69-453b-baee-51a4297fcdf6 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:02:29.609909 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG oslo_concurrency.lockutils [None req-51a435de-af69-453b-baee-51a4297fcdf6 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:02:29.610619 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG oslo_concurrency.lockutils [None req-51a435de-af69-453b-baee-51a4297fcdf6 admin admin] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:02:29.611068 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG oslo_concurrency.lockutils [None req-51a435de-af69-453b-baee-51a4297fcdf6 admin admin] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:02:29.611485 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG oslo_concurrency.lockutils [None req-51a435de-af69-453b-baee-51a4297fcdf6 admin admin] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:02:29.643079 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: INFO nova.api.openstack.requestlog [None req-51a435de-af69-453b-baee-51a4297fcdf6 admin admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.199496 Oct 20 06:02:29.643625 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: [pid: 103820|app: 0|req: 36/70] 10.222.0.20 () {60 vars in 1193 bytes} [Thu Oct 20 06:02:29 2022] GET /compute/v2.1/os-services => generated 791 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 20 06:02:30.734247 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi [None req-ec3f6ecf-e045-4693-b9ee-e98d4715e5f8 admin admin] Calling method '>' {{(pid=103821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:02:30.735259 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: INFO nova.api.openstack.requestlog [None req-ec3f6ecf-e045-4693-b9ee-e98d4715e5f8 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001447 Oct 20 06:02:30.735659 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: [pid: 103821|app: 0|req: 35/71] 10.222.0.20 () {56 vars in 1074 bytes} [Thu Oct 20 06:02:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:02:30.926801 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi [None req-014fbf9c-0bed-4459-82cc-87b56b266489 admin admin] Calling method '>' {{(pid=103820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:02:30.930205 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG oslo_concurrency.lockutils [None req-014fbf9c-0bed-4459-82cc-87b56b266489 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:02:30.930673 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG oslo_concurrency.lockutils [None req-014fbf9c-0bed-4459-82cc-87b56b266489 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:02:30.931126 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG oslo_concurrency.lockutils [None req-014fbf9c-0bed-4459-82cc-87b56b266489 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:02:30.931855 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG oslo_concurrency.lockutils [None req-014fbf9c-0bed-4459-82cc-87b56b266489 admin admin] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:02:30.932296 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG oslo_concurrency.lockutils [None req-014fbf9c-0bed-4459-82cc-87b56b266489 admin admin] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:02:30.932730 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG oslo_concurrency.lockutils [None req-014fbf9c-0bed-4459-82cc-87b56b266489 admin admin] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:02:30.952194 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: INFO nova.api.openstack.requestlog [None req-014fbf9c-0bed-4459-82cc-87b56b266489 admin admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.077272 Oct 20 06:02:30.952745 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: [pid: 103820|app: 0|req: 37/72] 10.222.0.20 () {60 vars in 1193 bytes} [Thu Oct 20 06:02:30 2022] GET /compute/v2.1/os-services => generated 791 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 20 06:02:42.437804 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi [None req-ec3f6ecf-e045-4693-b9ee-e98d4715e5f8 admin admin] Calling method '>' {{(pid=103821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:02:42.438812 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: INFO nova.api.openstack.requestlog [None req-ec3f6ecf-e045-4693-b9ee-e98d4715e5f8 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001413 Oct 20 06:02:42.439211 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: [pid: 103821|app: 0|req: 36/73] 10.222.0.20 () {56 vars in 1074 bytes} [Thu Oct 20 06:02:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:02:42.584425 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG dbcounter [-] [103820] Writing DB stats nova_cell0:SELECT=4 {{(pid=103820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:02:42.585197 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG dbcounter [-] [103820] Writing DB stats nova_cell1:SELECT=4 {{(pid=103820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:02:42.585883 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG dbcounter [-] [103820] Writing DB stats nova_api:SELECT=8 {{(pid=103820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:02:42.634348 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi [None req-ff67afcd-ae6c-423b-bed7-303c040c3544 admin admin] Calling method '>' {{(pid=103820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:02:42.637784 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG oslo_concurrency.lockutils [None req-ff67afcd-ae6c-423b-bed7-303c040c3544 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:02:42.638251 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG oslo_concurrency.lockutils [None req-ff67afcd-ae6c-423b-bed7-303c040c3544 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:02:42.638673 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG oslo_concurrency.lockutils [None req-ff67afcd-ae6c-423b-bed7-303c040c3544 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:02:42.639374 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG oslo_concurrency.lockutils [None req-ff67afcd-ae6c-423b-bed7-303c040c3544 admin admin] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:02:42.639815 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG oslo_concurrency.lockutils [None req-ff67afcd-ae6c-423b-bed7-303c040c3544 admin admin] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:02:42.640228 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG oslo_concurrency.lockutils [None req-ff67afcd-ae6c-423b-bed7-303c040c3544 admin admin] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:02:42.665962 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: INFO nova.api.openstack.requestlog [None req-ff67afcd-ae6c-423b-bed7-303c040c3544 admin admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.92 time: 0.086579 Oct 20 06:02:42.666507 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: [pid: 103820|app: 0|req: 38/74] 10.222.0.20 () {60 vars in 1193 bytes} [Thu Oct 20 06:02:42 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:02:43.739063 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG nova.api.openstack.wsgi [None req-ec3f6ecf-e045-4693-b9ee-e98d4715e5f8 admin admin] Calling method '>' {{(pid=103821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:02:43.740438 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: INFO nova.api.openstack.requestlog [None req-ec3f6ecf-e045-4693-b9ee-e98d4715e5f8 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001530 Oct 20 06:02:43.740870 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: [pid: 103821|app: 0|req: 37/75] 10.222.0.20 () {56 vars in 1074 bytes} [Thu Oct 20 06:02:43 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:02:43.929732 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG nova.api.openstack.wsgi [None req-973a0967-804f-48ac-8212-5ae98520313e admin admin] Calling method '>' {{(pid=103820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:02:43.933150 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG oslo_concurrency.lockutils [None req-973a0967-804f-48ac-8212-5ae98520313e admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:02:43.933631 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG oslo_concurrency.lockutils [None req-973a0967-804f-48ac-8212-5ae98520313e admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:02:43.934097 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG oslo_concurrency.lockutils [None req-973a0967-804f-48ac-8212-5ae98520313e admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:02:43.934814 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG oslo_concurrency.lockutils [None req-973a0967-804f-48ac-8212-5ae98520313e admin admin] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:02:43.935265 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG oslo_concurrency.lockutils [None req-973a0967-804f-48ac-8212-5ae98520313e admin admin] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:02:43.935687 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: DEBUG oslo_concurrency.lockutils [None req-973a0967-804f-48ac-8212-5ae98520313e admin admin] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:02:43.958752 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: INFO nova.api.openstack.requestlog [None req-973a0967-804f-48ac-8212-5ae98520313e admin admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.92 time: 0.079772 Oct 20 06:02:43.959282 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: [pid: 103820|app: 0|req: 39/76] 10.222.0.20 () {60 vars in 1193 bytes} [Thu Oct 20 06:02:43 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:03:41.891568 dv-cinder-861566-3-iscsi devstack@n-api.service[103819]: Thu Oct 20 06:03:41 2022 - graceful shutdown triggered... Oct 20 06:03:41.891461 dv-cinder-861566-3-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Oct 20 06:03:41.892553 dv-cinder-861566-3-iscsi devstack@n-api.service[103820]: Gracefully killing worker 1 (pid: 103820)... Oct 20 06:03:41.892948 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: Gracefully killing worker 2 (pid: 103821)... Oct 20 06:03:42.018348 dv-cinder-861566-3-iscsi devstack@n-api.service[103821]: DEBUG dbcounter [-] [103821] Writing DB stats nova_api:SELECT=4 {{(pid=103821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:03:42.892385 dv-cinder-861566-3-iscsi devstack@n-api.service[103819]: worker 1 buried after 1 seconds Oct 20 06:03:42.892385 dv-cinder-861566-3-iscsi devstack@n-api.service[103819]: worker 2 buried after 1 seconds Oct 20 06:03:42.892385 dv-cinder-861566-3-iscsi devstack@n-api.service[103819]: goodbye to uWSGI. Oct 20 06:03:42.893956 dv-cinder-861566-3-iscsi systemd[1]: devstack@n-api.service: Succeeded. Oct 20 06:03:42.894504 dv-cinder-861566-3-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Oct 20 06:03:42.897318 dv-cinder-861566-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Oct 20 06:03:42.908617 dv-cinder-861566-3-iscsi devstack@n-api.service[118838]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 20 06:03:42.910663 dv-cinder-861566-3-iscsi devstack@n-api.service[118838]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Oct 20 06:03:42 2022] *** Oct 20 06:03:42.910663 dv-cinder-861566-3-iscsi devstack@n-api.service[118838]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 20 06:03:42.910663 dv-cinder-861566-3-iscsi devstack@n-api.service[118838]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 20 06:03:42.910663 dv-cinder-861566-3-iscsi devstack@n-api.service[118838]: nodename: dv-cinder-861566-3-iscsi Oct 20 06:03:42.910663 dv-cinder-861566-3-iscsi devstack@n-api.service[118838]: machine: x86_64 Oct 20 06:03:42.910663 dv-cinder-861566-3-iscsi devstack@n-api.service[118838]: clock source: unix Oct 20 06:03:42.910663 dv-cinder-861566-3-iscsi devstack@n-api.service[118838]: pcre jit disabled Oct 20 06:03:42.910663 dv-cinder-861566-3-iscsi devstack@n-api.service[118838]: detected number of CPU cores: 4 Oct 20 06:03:42.910663 dv-cinder-861566-3-iscsi devstack@n-api.service[118838]: current working directory: / Oct 20 06:03:42.910663 dv-cinder-861566-3-iscsi devstack@n-api.service[118838]: detected binary path: /usr/bin/uwsgi-core Oct 20 06:03:42.911443 dv-cinder-861566-3-iscsi devstack@n-api.service[118838]: your processes number limit is 47680 Oct 20 06:03:42.911443 dv-cinder-861566-3-iscsi devstack@n-api.service[118838]: your memory page size is 4096 bytes Oct 20 06:03:42.911443 dv-cinder-861566-3-iscsi devstack@n-api.service[118838]: detected max file descriptor number: 2048 Oct 20 06:03:42.911443 dv-cinder-861566-3-iscsi devstack@n-api.service[118838]: lock engine: pthread robust mutexes Oct 20 06:03:42.911443 dv-cinder-861566-3-iscsi devstack@n-api.service[118838]: thunder lock: enabled Oct 20 06:03:42.911443 dv-cinder-861566-3-iscsi devstack@n-api.service[118838]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 20 06:03:42.911443 dv-cinder-861566-3-iscsi devstack@n-api.service[118838]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 20 06:03:42.953540 dv-cinder-861566-3-iscsi devstack@n-api.service[118838]: Python main interpreter initialized at 0x557c679ca9c0 Oct 20 06:03:42.953540 dv-cinder-861566-3-iscsi devstack@n-api.service[118838]: python threads support enabled Oct 20 06:03:42.953540 dv-cinder-861566-3-iscsi devstack@n-api.service[118838]: your server socket listen backlog is limited to 100 connections Oct 20 06:03:42.953540 dv-cinder-861566-3-iscsi devstack@n-api.service[118838]: your mercy for graceful operations on workers is 90 seconds Oct 20 06:03:42.953978 dv-cinder-861566-3-iscsi devstack@n-api.service[118838]: mapped 403077 bytes (393 KB) for 2 cores Oct 20 06:03:42.953978 dv-cinder-861566-3-iscsi devstack@n-api.service[118838]: *** Operational MODE: preforking *** Oct 20 06:03:42.954268 dv-cinder-861566-3-iscsi devstack@n-api.service[118838]: *** uWSGI is running in multiple interpreter mode *** Oct 20 06:03:42.954268 dv-cinder-861566-3-iscsi devstack@n-api.service[118838]: spawned uWSGI master process (pid: 118838) Oct 20 06:03:42.954478 dv-cinder-861566-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Oct 20 06:03:42.955658 dv-cinder-861566-3-iscsi devstack@n-api.service[118838]: spawned uWSGI worker 1 (pid: 118860, cores: 1) Oct 20 06:03:42.955658 dv-cinder-861566-3-iscsi devstack@n-api.service[118838]: spawned uWSGI worker 2 (pid: 118861, cores: 1) Oct 20 06:03:42.955658 dv-cinder-861566-3-iscsi devstack@n-api.service[118838]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 20 06:03:43.620772 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 20 06:03:43.629563 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 20 06:03:44.779750 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 20 06:03:44.779750 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: from cryptography.utils import int_from_bytes Oct 20 06:03:44.780371 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 20 06:03:44.780371 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: from cryptography.utils import int_from_bytes Oct 20 06:03:44.783585 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 20 06:03:44.783585 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: from cryptography.utils import int_from_bytes Oct 20 06:03:44.784049 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 20 06:03:44.784049 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: from cryptography.utils import int_from_bytes Oct 20 06:03:47.211270 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 20 06:03:47.211854 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 20 06:03:47.212056 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 20 06:03:47.212420 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 20 06:03:47.212676 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 20 06:03:47.213084 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.213405 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.213722 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.214195 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.214533 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.214845 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.215161 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.215475 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.215801 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.216058 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.216370 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.216714 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-861566-3-iscsi {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.217038 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.217342 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.217647 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.217962 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.218266 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.218585 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.218891 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.219389 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.219833 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.220147 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.220455 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.220831 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.221130 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.221434 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.221769 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.222073 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.222378 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.222694 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.223092 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-861566-3-iscsi {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.223399 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.223698 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.224009 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.224428 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.224760 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.225072 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.225392 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.226389 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.226703 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.227032 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.227351 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.227669 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.227989 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.228291 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.228598 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.228929 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.229247 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.229553 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.229856 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.230102 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.230406 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.230730 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.231049 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.231370 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.231470 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 20 06:03:47.231902 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.232006 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 20 06:03:47.232101 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.232198 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.232283 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 20 06:03:47.232462 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.232564 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 20 06:03:47.232792 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 20 06:03:47.232928 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.233100 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.233190 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.233407 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.233531 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.233709 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.233828 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.234013 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.234253 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.234357 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.234593 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.234688 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.234894 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.235063 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.235210 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.235363 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.235506 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.235646 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.235820 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.235967 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.236109 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.236265 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.236405 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.236550 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.236719 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-861566-3-iscsi {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.236838 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.20 {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.237096 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.237197 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.20 {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.237406 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.237512 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.237719 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.237817 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.238038 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.238141 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.238345 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.238452 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.238659 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.238760 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.238965 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.239062 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.239267 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.239472 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.239578 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.239785 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.239878 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.240091 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.240197 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.240401 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.240500 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.240757 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.240852 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.241036 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.241197 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.241876 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.242180 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.242383 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.242481 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.242717 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.242811 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.243034 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.243125 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.243362 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.243460 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.243659 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.243751 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.243960 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.244060 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-861566-3-iscsi {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.244261 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.244367 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.244563 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.244656 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.244892 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.244999 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.245197 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.245409 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.245504 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.245723 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.245823 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.246043 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.246143 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.246363 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.246454 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.246663 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.246762 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.246979 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.247083 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.247297 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.247397 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.247603 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.247695 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.247907 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.248008 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.248210 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.248309 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.248513 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.248617 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.248847 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.248939 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.249151 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.249241 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.249456 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.249558 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.249761 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.249852 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.250064 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.250155 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.250312 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.250411 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.250621 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.250713 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.251056 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.251177 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.251266 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.251350 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.251549 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.251767 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.251858 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.251948 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.252035 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.252132 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.252352 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.252452 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.252677 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.252836 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.253010 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.253101 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.253315 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.253415 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.253618 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.253719 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.253918 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.254013 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.254218 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.254312 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.254532 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.254630 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.254817 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.254909 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.255114 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.255258 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.255426 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.255523 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.255737 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.255835 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.256043 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.256216 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.256347 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.256446 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.256646 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.256824 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.257007 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.257340 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.257597 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.20 {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.257700 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.257860 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.20 {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.257998 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.258177 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.258311 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.258523 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.258644 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.258848 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.259245 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.259427 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.259530 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.259749 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.259843 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.260073 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.260174 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.260384 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.260485 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.260728 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.260867 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.261025 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.261162 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.261349 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.261452 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.261670 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.261767 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.261984 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.262075 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.262218 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.262317 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.262524 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.262619 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.262832 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.262932 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.263155 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.263249 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.263462 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.263561 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.263774 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.263918 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.264082 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.264187 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.264385 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.264485 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.264709 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.264823 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.265019 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.265110 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.265328 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.265455 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.265636 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.265781 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.265943 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.266036 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.266252 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.266350 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.266559 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.266669 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.266865 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.266963 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.267170 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.267269 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.267474 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.267568 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.267796 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.267890 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.268118 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.268221 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.268426 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.268527 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.268764 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.268874 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.269075 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.269169 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.269382 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.269473 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.269692 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.269794 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.269995 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.270093 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.270301 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.270392 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.270615 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.270719 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.270919 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.271018 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.271224 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.271352 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.271542 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.271646 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.271847 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.271947 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.272152 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.272254 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.273107 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.273203 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.273486 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.273795 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.273889 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.274108 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.274245 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.274417 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.274521 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.274725 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.274826 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.275030 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.275123 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.275333 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.275474 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.275637 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.275727 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.275941 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.276034 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.276248 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.276348 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.276552 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.276652 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.276885 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.276979 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.277188 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.277297 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.277494 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.277583 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.277810 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.277931 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.278119 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.278229 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.278422 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.278521 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.278724 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.278832 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.279029 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.279147 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 06:03:47.279333 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.279432 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.279656 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.279769 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.279966 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.280065 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.280270 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.280369 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.280592 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.280736 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.280929 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.281029 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.281237 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.281352 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.281552 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.281660 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.281864 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.281960 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.282174 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.282275 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.282485 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.282587 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.282792 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.282893 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.283104 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.283204 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.283412 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.283513 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.283719 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.283860 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.284052 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.284154 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.284368 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.284504 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.284674 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.284855 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.285016 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.285144 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.285330 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.285457 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.285642 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.285760 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.285946 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.286075 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.286255 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.286375 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.286558 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.286690 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.286862 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.287010 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.287167 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.287306 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.287476 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.287616 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.287779 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.287939 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.288254 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.288422 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.288664 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.288841 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.289026 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.289161 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.289383 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.289532 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.289664 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.289801 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.289945 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.290076 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.290204 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.290340 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.290499 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.290640 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.290847 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.290989 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.291153 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.291292 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.291496 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.291632 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.291819 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.291951 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.292133 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.292265 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.292448 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.292588 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.292780 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.292912 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.293091 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.293221 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.293399 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.293549 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.293711 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.293852 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.294023 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.294154 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.294332 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.294474 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.294653 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.294778 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.294964 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.295103 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.295277 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.295415 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.295585 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.295722 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.295895 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.296012 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.296206 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.296334 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.296515 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.296642 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.296841 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.296967 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.297151 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.297268 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.297459 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.297586 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.297785 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.297905 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.298108 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.298242 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.298441 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.298574 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.298728 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.298847 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.299034 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.299151 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.299419 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.299561 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.299698 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.299833 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.299973 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.300099 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.300224 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.300344 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.300544 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.300672 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.300881 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.301011 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.301196 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.301314 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.301504 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.301644 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.301824 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.301950 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.302132 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.302258 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.302450 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.302592 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.302754 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.302890 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.303063 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.303179 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.303383 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.303524 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.304226 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.304387 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.304534 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.304950 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.305099 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.305277 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.305410 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.305593 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.305732 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.305904 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.306051 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.306214 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.306348 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.306519 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.306652 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.306823 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.306968 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.307130 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.307261 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.307442 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.307582 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.307751 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.307893 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.308058 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.308200 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.308362 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.308582 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.308754 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.308887 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.309024 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.309795 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.309938 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.310079 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.310216 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.310345 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.310473 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.310600 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.310734 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.310876 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.310995 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.311112 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.311232 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.311349 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.311460 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.311604 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.311733 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.311860 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.311994 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.312113 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.312231 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.312372 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.312507 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.312643 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.313401 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.313510 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.313510 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.313761 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.313845 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.313989 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.314079 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.314164 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.314164 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.314454 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.314584 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.314685 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.314760 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.314875 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.314977 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.315072 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.315159 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.315410 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.315509 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.315722 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.315866 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.316030 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.316171 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.316354 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.316510 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.316666 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.316819 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.316996 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.317105 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.317306 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.317489 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.317616 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.317754 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.317925 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.318030 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.318233 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.318391 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.318561 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.318839 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.318950 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.319164 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.319884 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.320108 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.320504 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.320649 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.320798 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.320995 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.321096 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.321313 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.321636 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.321727 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.322001 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.322104 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.322300 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.322403 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.322621 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.322715 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.322944 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.323039 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.323262 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.323367 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.323586 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.323700 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.323901 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.324024 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.324210 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.324332 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.324518 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.324618 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.324851 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.324951 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.325177 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.325302 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.325464 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.325622 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.325774 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.325868 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.326075 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.326176 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.326380 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.326480 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.326683 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.326784 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.326989 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.327082 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.327290 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.327399 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.327591 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.327693 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.327890 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.327984 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.328193 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.328299 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.328504 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.328596 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.328831 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.328949 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.329139 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.329243 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.329441 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.329590 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.329762 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.329865 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.330070 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.330183 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.330369 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.330473 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.330671 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.330806 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.330973 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.331067 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.331288 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.331379 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.331601 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.331703 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.331912 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.332020 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.332222 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.332322 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.332536 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.332629 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.332875 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.332972 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.333182 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.333274 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.333489 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.333598 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.333795 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.333896 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.334097 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.334208 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.334403 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.334509 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.334712 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.334812 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.335046 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.335350 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.335493 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.335658 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.335815 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.335965 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.336130 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.336272 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.336462 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.336564 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.336806 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.336903 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.337120 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.337212 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.337430 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.337588 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.337740 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.337841 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.338070 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.338201 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.338374 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.338495 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.338677 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.338771 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.338988 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.339101 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.339291 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.339393 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.339593 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.339730 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.339903 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.339996 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.340206 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.340320 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.340513 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.340608 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.340839 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.340986 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.341150 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.341245 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.341453 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.341554 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.341762 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.341864 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.342069 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.342171 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.342370 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.342464 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.342686 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.342787 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.342992 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.343086 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.343296 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.343389 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.343597 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.343748 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.343906 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.344001 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.344211 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.344307 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.344514 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.344682 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.344847 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.344941 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.345172 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.345432 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.345534 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.345772 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.345874 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.346079 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.346185 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.346382 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.346523 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.346687 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.346812 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.346990 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.347122 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.347297 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.347400 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.347599 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.347728 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.347900 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.348001 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.348200 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.348301 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.348504 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.348597 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.348828 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.348924 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.349153 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.349270 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.349458 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.349552 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.349760 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.349857 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.350062 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.350183 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.350363 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.350477 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.350819 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.351139 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.351254 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.351481 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.351585 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.351791 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.351892 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.352100 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.352193 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.352413 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.352516 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.352742 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.352850 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.353055 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.353154 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.353368 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.353461 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.353674 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.353770 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.353992 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.354097 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.354299 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.354420 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.354653 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.354790 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.354927 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.355021 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.355329 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.355427 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.355657 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.355789 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.355972 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.356066 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.356286 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.356385 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.356610 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.356722 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.356970 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.357136 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.357301 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.357396 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.357609 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.357711 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.357922 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.358022 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.358235 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.358328 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.358541 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.358641 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.358846 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.358956 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.359163 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.359282 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.359472 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.359582 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.359780 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.359882 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.360091 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.360191 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.360398 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.360497 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.360742 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.360877 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.361032 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.361148 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.361346 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.361585 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.361688 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.361909 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.362004 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.362222 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.362325 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.362546 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.362648 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.362853 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.362948 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.363159 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.363264 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.363461 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.363564 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.363772 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.363911 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.364078 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.364173 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.364383 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.364515 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.364715 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.364852 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.365033 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.365172 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.365355 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.365616 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.365719 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.365808 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.365963 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.366068 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.366901 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.367216 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.367368 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.367523 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.367617 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.367854 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.367946 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.368167 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.368263 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.368498 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.368602 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.368847 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.368965 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.369153 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.369264 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.369459 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.369568 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.369773 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.369874 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.370086 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.370179 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.370390 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.370496 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.370700 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.370813 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.371003 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.371096 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.371331 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.371472 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.371636 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.371746 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.371947 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.372039 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.372256 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.372357 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.372565 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.372667 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.372904 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.373002 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.373220 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.373377 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.373547 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.373688 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.373819 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.373999 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.374126 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.374449 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.374557 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.374647 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.374734 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.374945 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.375090 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.375251 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.375354 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.375565 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.375668 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.375875 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.375968 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.376200 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.376295 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.376524 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.376618 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.376855 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.376964 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.377171 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.377272 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.377477 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.377579 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.377802 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.377896 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.378125 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.378227 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.378437 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.378531 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.378752 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.378845 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.379070 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.379165 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.379381 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.379522 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.379701 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.379805 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.380016 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.380110 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.380331 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.380431 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.380640 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.380847 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.380982 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.381102 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.381308 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.381454 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.381614 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.381740 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.381970 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.382450 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.382543 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.382765 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.382861 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.383078 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.383182 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.383388 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.383489 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.383696 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.383798 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.384267 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.384402 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.384573 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.384675 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.384921 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.385024 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.385224 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.385344 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.385550 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.385668 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.385863 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.385973 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.386178 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.386271 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.386496 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.386589 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.386801 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.386902 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.387117 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.387237 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.387423 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.387528 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.387728 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.387830 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.388034 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.388137 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.388342 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.388443 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.388674 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.388879 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.389023 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.389127 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.389333 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.389435 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.389649 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.389750 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.389960 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.390055 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.390275 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.390371 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.390585 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.390686 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.390922 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.391023 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.391244 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.391350 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.391561 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.391701 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.391880 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.391990 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.392204 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.392300 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.392508 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.392602 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.392832 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.392946 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.393143 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.393249 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.393446 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.393548 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.393750 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.393896 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.394053 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.394216 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.394359 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.394534 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.394669 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.394850 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.394969 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.395162 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.395263 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.395480 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.395581 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.395807 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.395939 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.396127 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.396232 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.396439 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.396542 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.396773 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.396880 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.397078 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.397173 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.397911 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.398403 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.398541 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.398759 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.398861 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.399087 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.399181 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.399397 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.399499 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.399719 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.399813 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.400035 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.400135 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.400348 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.400582 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.400713 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.400894 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.400990 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.401213 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.401308 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.401544 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.401680 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.401876 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.401981 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.402190 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.402298 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.402503 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.402598 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.402817 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.402919 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.403129 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.403223 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.403457 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.403657 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.403787 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.403984 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.404157 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.404299 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.404393 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.404612 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.404790 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.404947 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.405044 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.405260 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.405361 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.405570 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.405672 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.405881 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.405977 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.406190 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.406396 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.406497 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.406726 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.406830 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.407043 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.407137 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.407369 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.407474 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.407701 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.407797 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.408012 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.408114 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.408323 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.408425 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.408640 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.408754 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.408977 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.409072 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.409286 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.409386 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.409617 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.409712 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.409929 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.410022 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.410232 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.410338 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.410542 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.410642 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.410853 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.410954 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.411163 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.411267 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.411470 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.411566 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.411779 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.411908 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.412089 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.412198 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.412397 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.412491 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.412723 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.412832 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.413115 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.413520 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.413615 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.413839 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.413953 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.414165 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.414270 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.414501 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.414609 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.414823 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.414950 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.415136 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.415243 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.415450 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.415542 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.415760 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.415860 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.416107 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.416276 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.416425 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.416588 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.416777 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.416960 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.417117 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.417285 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.417452 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.417610 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.417768 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.417926 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.418106 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.418243 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.418440 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.418642 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.418766 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.418952 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.419065 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.419257 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.419386 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.419566 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.419714 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.419874 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.420024 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.420181 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.420314 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.420504 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.420624 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.420841 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.420946 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.421149 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.421243 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.421470 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.421570 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.421779 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.421919 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.422136 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.422319 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.422440 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.422671 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.422775 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.422988 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.423082 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.423316 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.423409 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.423643 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.423782 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.423956 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.424049 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.424261 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.424361 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.424567 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.424671 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.424903 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.425006 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.425212 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.425317 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.425529 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.425624 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.425840 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.425934 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.426145 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.426246 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.426450 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.426546 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.426759 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.426854 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.427067 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.427162 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.427369 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.427465 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.427678 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.427779 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.427980 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.428083 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.428295 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.428387 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.429119 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.429222 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.429434 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.429739 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.429919 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.430049 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.430256 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.430360 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.430586 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.430690 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.430917 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.431019 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.431219 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.431511 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.431617 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.431786 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.431889 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.432109 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.432241 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.432408 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.432510 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.432741 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.432849 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.433067 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.433172 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.433385 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.433493 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.433686 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.433778 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.434001 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.434097 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.434302 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.434476 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.434605 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.434699 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.434919 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.435021 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.435228 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.435323 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.435550 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.435644 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.435859 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.435954 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.436167 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.436262 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.436506 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.436599 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.436847 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.436953 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.437166 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.437379 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.437527 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.437716 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.437843 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.438036 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.438154 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.438366 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.438460 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.438696 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.438790 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.439002 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.439096 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.439307 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.439408 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.439612 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.439713 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.439936 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.440039 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.440247 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.440340 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.440557 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.440659 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.440891 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.440986 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.441201 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.441304 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.441510 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.441676 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.441819 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.441916 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.442128 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.442259 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.442437 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.442551 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.442750 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.442844 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.443058 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.443158 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.443367 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.443463 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.443674 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.443885 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.444023 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.444201 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.444366 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.444622 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.444986 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.445127 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.445302 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.445446 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.445616 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.445720 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.445927 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.446029 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.446240 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.446385 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.446557 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.446737 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.446865 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.447049 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.447171 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.447360 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.447464 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.447674 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.447786 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.447987 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.448082 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.448299 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.448402 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.448626 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.448742 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.448994 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.449088 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.449306 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.449409 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.449631 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.449724 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.449945 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.450051 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.450295 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.450479 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.450615 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.450831 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.450925 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.451152 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.451254 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.451482 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.451578 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.451814 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.451915 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.452135 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.452237 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.452447 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.452593 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.452808 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.452904 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.453134 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.453229 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.453440 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.453533 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.453744 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.453851 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.454050 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.454151 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.454358 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.454454 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.454664 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.454804 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.454979 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.455080 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.455287 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.455387 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.455589 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.455697 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.455898 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.456003 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.456198 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.456292 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.456501 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.456603 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.456833 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.456930 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.457137 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.457233 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.457443 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.457539 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.457743 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.457851 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.458046 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.458146 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.458345 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.458446 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.458646 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.458739 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.458948 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.459040 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.459246 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.459346 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.459551 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.459645 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.460367 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.460595 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.460737 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.461126 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.461218 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.461431 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.461525 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.461737 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.461858 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.462069 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.462171 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.462404 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.462501 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.462724 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.462809 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.463050 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.463133 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.463360 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.463445 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.463677 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.463778 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.463983 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.464078 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.464306 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.464475 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.464622 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.464743 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.464958 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.465062 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.465266 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.465406 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.465597 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.465693 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.465904 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.466137 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.466232 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.466488 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.466582 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.466799 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.466900 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.467104 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.467205 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.467410 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.467506 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.467736 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.467830 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.468059 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.468164 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.468363 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.468455 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.468688 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.468811 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.469023 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.469134 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.469338 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.469430 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.469648 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.469741 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.469957 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.470060 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.470266 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.470359 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.470580 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.470680 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.470892 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.470987 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.471197 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.471289 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.471505 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.471606 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.471812 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.471907 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.472121 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.472223 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.472428 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.472522 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.472755 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.472854 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.473068 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.473161 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.473377 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.473479 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.473703 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.473798 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.474025 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.474118 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.474329 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.474431 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.474646 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.474738 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.474966 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.475061 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.475279 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.475382 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.475667 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.475890 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.476009 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.476302 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.476397 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.476621 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.476762 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.476960 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.477055 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.477267 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.477369 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.477507 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 20 06:03:47.477602 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.477895 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.478320 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.478635 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.478957 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.479280 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.479594 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.479918 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.480243 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.480558 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.480911 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.481225 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.481557 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.481899 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.482232 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.482560 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.482869 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.483177 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.483485 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.483796 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.484116 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.484427 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.484813 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.485123 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.485434 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.485743 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.486049 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.486354 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.486661 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.486969 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.487271 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.487576 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.487881 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.488184 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.488488 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.488816 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.489128 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.489429 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.489733 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.490036 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.490338 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.490642 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.490976 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.492233 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.492559 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.492920 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.493242 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.493574 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.493891 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.494224 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.494556 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.494877 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.495190 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.495525 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.495843 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.496154 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.496472 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.496812 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.497123 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.497435 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.497763 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.498093 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.498408 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.498729 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.499051 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.499373 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.499690 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.500003 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.500337 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.500651 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.500992 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.501304 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.501618 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.501929 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.502245 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.502557 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.502867 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.503184 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.503499 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.503827 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.504154 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.504464 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.504817 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.505147 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.505498 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.505812 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.506159 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.506490 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.507879 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.508208 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.508526 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 06:03:47.508798 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 20 06:03:47.539195 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO dbcounter [None req-c38ccd8b-3e70-4d3e-8863-b23aea1de771 None None] Registered counter for database nova_api Oct 20 06:03:47.559713 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_db.sqlalchemy.engines [None req-c38ccd8b-3e70-4d3e-8863-b23aea1de771 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118861) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 20 06:03:47.566462 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG dbcounter [-] [118861] Writer thread running {{(pid=118861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 20 06:03:47.572462 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO dbcounter [None req-67cf2369-9db8-4f58-b7c0-f04929f59193 None None] Registered counter for database nova_api Oct 20 06:03:47.593147 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_db.sqlalchemy.engines [None req-67cf2369-9db8-4f58-b7c0-f04929f59193 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118860) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 20 06:03:47.599974 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG dbcounter [-] [118860] Writer thread running {{(pid=118860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 20 06:03:47.623109 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.context [None req-c38ccd8b-3e70-4d3e-8863-b23aea1de771 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),0427de57-e601-4680-b509-510497497143(cell1) {{(pid=118861) load_cells /opt/stack/nova/nova/context.py:464}} Oct 20 06:03:47.627139 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c38ccd8b-3e70-4d3e-8863-b23aea1de771 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:03:47.627608 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c38ccd8b-3e70-4d3e-8863-b23aea1de771 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:03:47.629205 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c38ccd8b-3e70-4d3e-8863-b23aea1de771 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:03:47.629933 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c38ccd8b-3e70-4d3e-8863-b23aea1de771 None None] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:03:47.630377 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c38ccd8b-3e70-4d3e-8863-b23aea1de771 None None] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:03:47.632547 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c38ccd8b-3e70-4d3e-8863-b23aea1de771 None None] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:03:47.634949 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO dbcounter [None req-c38ccd8b-3e70-4d3e-8863-b23aea1de771 None None] Registered counter for database nova_cell0 Oct 20 06:03:47.639000 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO dbcounter [None req-c38ccd8b-3e70-4d3e-8863-b23aea1de771 None None] Registered counter for database nova_cell1 Oct 20 06:03:47.646532 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_db.sqlalchemy.engines [None req-c38ccd8b-3e70-4d3e-8863-b23aea1de771 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118861) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 20 06:03:47.648874 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_db.sqlalchemy.engines [None req-c38ccd8b-3e70-4d3e-8863-b23aea1de771 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118861) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 20 06:03:47.654301 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG dbcounter [-] [118861] Writer thread running {{(pid=118861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 20 06:03:47.656881 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG dbcounter [-] [118861] Writer thread running {{(pid=118861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 20 06:03:47.659980 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.context [None req-67cf2369-9db8-4f58-b7c0-f04929f59193 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),0427de57-e601-4680-b509-510497497143(cell1) {{(pid=118860) load_cells /opt/stack/nova/nova/context.py:464}} Oct 20 06:03:47.665181 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-67cf2369-9db8-4f58-b7c0-f04929f59193 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:03:47.665659 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-67cf2369-9db8-4f58-b7c0-f04929f59193 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:03:47.667245 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-67cf2369-9db8-4f58-b7c0-f04929f59193 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:03:47.667981 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-67cf2369-9db8-4f58-b7c0-f04929f59193 None None] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:03:47.668431 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-67cf2369-9db8-4f58-b7c0-f04929f59193 None None] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:03:47.670468 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-67cf2369-9db8-4f58-b7c0-f04929f59193 None None] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:03:47.672457 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO dbcounter [None req-67cf2369-9db8-4f58-b7c0-f04929f59193 None None] Registered counter for database nova_cell0 Oct 20 06:03:47.676505 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO dbcounter [None req-67cf2369-9db8-4f58-b7c0-f04929f59193 None None] Registered counter for database nova_cell1 Oct 20 06:03:47.685634 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_db.sqlalchemy.engines [None req-67cf2369-9db8-4f58-b7c0-f04929f59193 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118860) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 20 06:03:47.686953 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_db.sqlalchemy.engines [None req-67cf2369-9db8-4f58-b7c0-f04929f59193 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118860) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 20 06:03:47.693547 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG dbcounter [-] [118860] Writer thread running {{(pid=118860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 20 06:03:47.699053 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG dbcounter [-] [118860] Writer thread running {{(pid=118860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 20 06:03:47.805762 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO dbcounter [None req-c38ccd8b-3e70-4d3e-8863-b23aea1de771 None None] Registered counter for database nova_cell0 Oct 20 06:03:47.812595 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_db.sqlalchemy.engines [None req-c38ccd8b-3e70-4d3e-8863-b23aea1de771 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118861) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 20 06:03:47.817265 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG dbcounter [-] [118861] Writer thread running {{(pid=118861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 20 06:03:47.854266 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO dbcounter [None req-67cf2369-9db8-4f58-b7c0-f04929f59193 None None] Registered counter for database nova_cell0 Oct 20 06:03:47.862685 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_db.sqlalchemy.engines [None req-67cf2369-9db8-4f58-b7c0-f04929f59193 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118860) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 20 06:03:47.867983 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG dbcounter [-] [118860] Writer thread running {{(pid=118860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 20 06:03:48.135822 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: WARNING keystonemiddleware.auth_token [None req-c38ccd8b-3e70-4d3e-8863-b23aea1de771 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 20 06:03:48.143151 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: WARNING keystonemiddleware.auth_token [None req-c38ccd8b-3e70-4d3e-8863-b23aea1de771 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 20 06:03:48.193256 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: WARNING keystonemiddleware.auth_token [None req-67cf2369-9db8-4f58-b7c0-f04929f59193 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 20 06:03:48.200795 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: WARNING keystonemiddleware.auth_token [None req-67cf2369-9db8-4f58-b7c0-f04929f59193 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 20 06:03:48.487934 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: WARNING keystonemiddleware.auth_token [None req-c38ccd8b-3e70-4d3e-8863-b23aea1de771 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 20 06:03:48.493943 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: WARNING keystonemiddleware.auth_token [None req-c38ccd8b-3e70-4d3e-8863-b23aea1de771 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 20 06:03:48.499180 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x557c679ca9c0 pid: 118861 (default app) Oct 20 06:03:48.543882 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: WARNING keystonemiddleware.auth_token [None req-67cf2369-9db8-4f58-b7c0-f04929f59193 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 20 06:03:48.549870 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: WARNING keystonemiddleware.auth_token [None req-67cf2369-9db8-4f58-b7c0-f04929f59193 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 20 06:03:48.555244 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x557c679ca9c0 pid: 118860 (default app) Oct 20 06:04:25.291576 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG dbcounter [-] [118861] Writing DB stats nova_api:SELECT=3 {{(pid=118861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:04:25.293031 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG dbcounter [-] [118861] Writing DB stats nova_cell1:SELECT=3 {{(pid=118861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:04:25.293768 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG dbcounter [-] [118861] Writing DB stats nova_cell0:SELECT=3 {{(pid=118861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:04:25.294471 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG dbcounter [-] [118861] Writing DB stats nova_cell0:SELECT=3 {{(pid=118861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:04:27.055788 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-f26c7a62-0705-4846-ad93-626ea30e6e85 tempest-VolumesSnapshotsTestJSON-886705292 tempest-VolumesSnapshotsTestJSON-886705292-project] Action: 'create', calling method: .version_select at 0x7fbe4bb45b80>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1136312783"}} {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 06:04:28.789520 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-f26c7a62-0705-4846-ad93-626ea30e6e85 tempest-VolumesSnapshotsTestJSON-886705292 tempest-VolumesSnapshotsTestJSON-886705292-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 3.507459 Oct 20 06:04:28.790877 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1/1] 10.222.0.20 () {60 vars in 1155 bytes} [Thu Oct 20 06:04:25 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 3510 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 20 06:04:28.811743 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG dbcounter [-] [118860] Writing DB stats nova_api:SELECT=3 {{(pid=118860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:04:28.812613 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG dbcounter [-] [118860] Writing DB stats nova_cell0:SELECT=3 {{(pid=118860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:04:28.813355 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG dbcounter [-] [118860] Writing DB stats nova_cell1:SELECT=3 {{(pid=118860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:04:28.814115 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG dbcounter [-] [118860] Writing DB stats nova_cell0:SELECT=3 {{(pid=118860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:04:29.122834 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-081d23cd-ad6d-4abf-8869-d3ad8e5eca02 tempest-VolumesSnapshotsTestJSON-886705292 tempest-VolumesSnapshotsTestJSON-886705292-project] Calling method '.version_select at 0x7fbe4bb94790>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:04:29.526373 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-081d23cd-ad6d-4abf-8869-d3ad8e5eca02 tempest-VolumesSnapshotsTestJSON-886705292 tempest-VolumesSnapshotsTestJSON-886705292-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/2b7ffaaa-2471-4888-93c1-b67b7868013e" status: 200 len: 345 microversion: 2.1 time: 0.721733 Oct 20 06:04:29.534469 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1/2] 10.222.0.20 () {58 vars in 1245 bytes} [Thu Oct 20 06:04:28 2022] GET /compute/v2.1/os-volumes/2b7ffaaa-2471-4888-93c1-b67b7868013e => generated 345 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:04:30.542142 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-9bd4f5e0-806b-403f-a451-288f7d9ebcd1 tempest-VolumesSnapshotsTestJSON-886705292 tempest-VolumesSnapshotsTestJSON-886705292-project] Calling method '.version_select at 0x7fbe4ba1e9d0>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:04:30.693372 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-9bd4f5e0-806b-403f-a451-288f7d9ebcd1 tempest-VolumesSnapshotsTestJSON-886705292 tempest-VolumesSnapshotsTestJSON-886705292-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/2b7ffaaa-2471-4888-93c1-b67b7868013e" status: 200 len: 346 microversion: 2.1 time: 0.155436 Oct 20 06:04:30.694528 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 2/3] 10.222.0.20 () {58 vars in 1245 bytes} [Thu Oct 20 06:04:30 2022] GET /compute/v2.1/os-volumes/2b7ffaaa-2471-4888-93c1-b67b7868013e => generated 346 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:04:30.708166 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-22d287b7-ada3-41bb-a15e-88a7913900f4 tempest-VolumesSnapshotsTestJSON-886705292 tempest-VolumesSnapshotsTestJSON-886705292-project] Action: 'create', calling method: .version_select at 0x7fbe4ba59790>, body: {"snapshot": {"volume_id": "2b7ffaaa-2471-4888-93c1-b67b7868013e", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-123700100"}} {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 06:04:31.350764 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-22d287b7-ada3-41bb-a15e-88a7913900f4 tempest-VolumesSnapshotsTestJSON-886705292 tempest-VolumesSnapshotsTestJSON-886705292-project] 10.222.0.20 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.646836 Oct 20 06:04:31.357918 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 2/4] 10.222.0.20 () {60 vars in 1162 bytes} [Thu Oct 20 06:04:30 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:04:31.363803 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-652c3f2f-78c2-499d-b9fb-e7e3f96a9e3d tempest-VolumesSnapshotsTestJSON-886705292 tempest-VolumesSnapshotsTestJSON-886705292-project] Calling method '.version_select at 0x7fbe4b9ae0d0>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:04:31.491831 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-652c3f2f-78c2-499d-b9fb-e7e3f96a9e3d tempest-VolumesSnapshotsTestJSON-886705292 tempest-VolumesSnapshotsTestJSON-886705292-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/e29715a1-a427-4823-9688-07e0020955ab" status: 200 len: 286 microversion: 2.1 time: 0.132210 Oct 20 06:04:31.492495 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 3/5] 10.222.0.20 () {58 vars in 1251 bytes} [Thu Oct 20 06:04:31 2022] GET /compute/v2.1/os-snapshots/e29715a1-a427-4823-9688-07e0020955ab => generated 286 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:04:31.507212 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-7e72de31-bf00-42bd-a348-30489335f84b tempest-VolumesSnapshotsTestJSON-886705292 tempest-VolumesSnapshotsTestJSON-886705292-project] Calling method '.version_select at 0x7fbe4ba1b820>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:04:31.590494 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-7e72de31-bf00-42bd-a348-30489335f84b tempest-VolumesSnapshotsTestJSON-886705292 tempest-VolumesSnapshotsTestJSON-886705292-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.088709 Oct 20 06:04:31.591459 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 3/6] 10.222.0.20 () {58 vars in 1140 bytes} [Thu Oct 20 06:04:31 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:04:31.603038 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-13a59398-7d4f-40a7-80f3-6e33d08629f9 tempest-VolumesSnapshotsTestJSON-886705292 tempest-VolumesSnapshotsTestJSON-886705292-project] Calling method '.version_select at 0x7fbe4b9ae820>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:04:31.647195 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-13a59398-7d4f-40a7-80f3-6e33d08629f9 tempest-VolumesSnapshotsTestJSON-886705292 tempest-VolumesSnapshotsTestJSON-886705292-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/e29715a1-a427-4823-9688-07e0020955ab" status: 200 len: 286 microversion: 2.1 time: 0.048238 Oct 20 06:04:31.647968 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 4/7] 10.222.0.20 () {58 vars in 1251 bytes} [Thu Oct 20 06:04:31 2022] GET /compute/v2.1/os-snapshots/e29715a1-a427-4823-9688-07e0020955ab => generated 286 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:04:32.660329 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-5641c916-96fe-4d35-8892-ef28e74c24aa tempest-VolumesSnapshotsTestJSON-886705292 tempest-VolumesSnapshotsTestJSON-886705292-project] Calling method '.version_select at 0x7fbe4ba1eaf0>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:04:32.704931 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-08b21e91-b7b1-44b8-a232-9cb634df6b7e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Action: 'create', calling method: .version_select at 0x7fbe4ba1bc10>, body: {"keypair": {"name": "tempest-keypair-259144965", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCXuHfUn9WQbz1cHyMXcr328pNy7+VWOcif3+EIj9IQTM4A+GAbYM5tTvjYyPBXnyJHTkFbGfRICL9lLXcw9efwGSREzixlENEAOwEIuH29YZVCtLXTrLIFrOBdS7QUgvA=="}} {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 06:04:32.836223 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.quota [None req-08b21e91-b7b1-44b8-a232-9cb634df6b7e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Getting quotas for project b90087118fe040389f291d846461c0a7. Resources: {'key_pairs'} {{(pid=118860) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 20 06:04:32.846035 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-5641c916-96fe-4d35-8892-ef28e74c24aa tempest-VolumesSnapshotsTestJSON-886705292 tempest-VolumesSnapshotsTestJSON-886705292-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/e29715a1-a427-4823-9688-07e0020955ab" status: 200 len: 286 microversion: 2.1 time: 0.190254 Oct 20 06:04:32.846790 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 5/8] 10.222.0.20 () {58 vars in 1251 bytes} [Thu Oct 20 06:04:32 2022] GET /compute/v2.1/os-snapshots/e29715a1-a427-4823-9688-07e0020955ab => generated 286 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 20 06:04:32.847960 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.quota [None req-08b21e91-b7b1-44b8-a232-9cb634df6b7e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Getting quotas for user 2c6be23065c643939055a3de375187d5 and project b90087118fe040389f291d846461c0a7. Resources: {'key_pairs'} {{(pid=118860) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 20 06:04:32.949721 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-08b21e91-b7b1-44b8-a232-9cb634df6b7e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.392067 Oct 20 06:04:32.951088 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 4/9] 10.222.0.20 () {60 vars in 1159 bytes} [Thu Oct 20 06:04:32 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:04:33.860407 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-32313bce-2b8d-47f9-9142-8e6dbbd62dda tempest-VolumesSnapshotsTestJSON-886705292 tempest-VolumesSnapshotsTestJSON-886705292-project] Calling method '.version_select at 0x7fbe4b9aeb80>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:04:33.918898 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-32313bce-2b8d-47f9-9142-8e6dbbd62dda tempest-VolumesSnapshotsTestJSON-886705292 tempest-VolumesSnapshotsTestJSON-886705292-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/e29715a1-a427-4823-9688-07e0020955ab" status: 200 len: 286 microversion: 2.1 time: 0.062737 Oct 20 06:04:33.919741 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 6/10] 10.222.0.20 () {58 vars in 1251 bytes} [Thu Oct 20 06:04:33 2022] GET /compute/v2.1/os-snapshots/e29715a1-a427-4823-9688-07e0020955ab => generated 286 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:04:34.931619 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-8b1a170d-5e76-4589-b185-38e0412110ec tempest-VolumesSnapshotsTestJSON-886705292 tempest-VolumesSnapshotsTestJSON-886705292-project] Calling method '.version_select at 0x7fbe4b939040>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:04:34.980606 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-8b1a170d-5e76-4589-b185-38e0412110ec tempest-VolumesSnapshotsTestJSON-886705292 tempest-VolumesSnapshotsTestJSON-886705292-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/e29715a1-a427-4823-9688-07e0020955ab" status: 200 len: 287 microversion: 2.1 time: 0.052787 Oct 20 06:04:34.981206 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 5/11] 10.222.0.20 () {58 vars in 1251 bytes} [Thu Oct 20 06:04:34 2022] GET /compute/v2.1/os-snapshots/e29715a1-a427-4823-9688-07e0020955ab => generated 287 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:04:34.994261 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-a09da18a-06ba-446d-878a-ce81226584fe tempest-VolumesSnapshotsTestJSON-886705292 tempest-VolumesSnapshotsTestJSON-886705292-project] Calling method '.version_select at 0x7fbe4b9ae3a0>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:04:35.144870 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-a09da18a-06ba-446d-878a-ce81226584fe tempest-VolumesSnapshotsTestJSON-886705292 tempest-VolumesSnapshotsTestJSON-886705292-project] 10.222.0.20 "DELETE /compute/v2.1/os-snapshots/e29715a1-a427-4823-9688-07e0020955ab" status: 202 len: 0 microversion: 2.1 time: 0.156039 Oct 20 06:04:35.145449 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 7/12] 10.222.0.20 () {58 vars in 1254 bytes} [Thu Oct 20 06:04:34 2022] DELETE /compute/v2.1/os-snapshots/e29715a1-a427-4823-9688-07e0020955ab => generated 0 bytes in 157 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 20 06:04:35.154190 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-8550de1c-e3f9-4f50-a3a6-a185b33f6e3c tempest-VolumesSnapshotsTestJSON-886705292 tempest-VolumesSnapshotsTestJSON-886705292-project] Calling method '.version_select at 0x7fbe4b939790>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:04:35.252260 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-8550de1c-e3f9-4f50-a3a6-a185b33f6e3c tempest-VolumesSnapshotsTestJSON-886705292 tempest-VolumesSnapshotsTestJSON-886705292-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/e29715a1-a427-4823-9688-07e0020955ab" status: 200 len: 286 microversion: 2.1 time: 0.101768 Oct 20 06:04:35.253088 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 6/13] 10.222.0.20 () {58 vars in 1251 bytes} [Thu Oct 20 06:04:35 2022] GET /compute/v2.1/os-snapshots/e29715a1-a427-4823-9688-07e0020955ab => generated 286 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:04:36.265856 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-26da8c46-917f-4fc1-8cb0-66c83bbd57d1 tempest-VolumesSnapshotsTestJSON-886705292 tempest-VolumesSnapshotsTestJSON-886705292-project] Calling method '.version_select at 0x7fbe4b9aeee0>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:04:36.362732 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-26da8c46-917f-4fc1-8cb0-66c83bbd57d1 tempest-VolumesSnapshotsTestJSON-886705292 tempest-VolumesSnapshotsTestJSON-886705292-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/e29715a1-a427-4823-9688-07e0020955ab" status: 200 len: 286 microversion: 2.1 time: 0.100654 Oct 20 06:04:36.363652 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 8/14] 10.222.0.20 () {58 vars in 1251 bytes} [Thu Oct 20 06:04:36 2022] GET /compute/v2.1/os-snapshots/e29715a1-a427-4823-9688-07e0020955ab => generated 286 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:04:37.377239 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-367c9573-3a82-4f79-a519-9d7c7225392e tempest-VolumesSnapshotsTestJSON-886705292 tempest-VolumesSnapshotsTestJSON-886705292-project] Calling method '.version_select at 0x7fbe4b988b80>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:04:37.415264 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-367c9573-3a82-4f79-a519-9d7c7225392e tempest-VolumesSnapshotsTestJSON-886705292 tempest-VolumesSnapshotsTestJSON-886705292-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/e29715a1-a427-4823-9688-07e0020955ab" status: 200 len: 286 microversion: 2.1 time: 0.041658 Oct 20 06:04:37.415264 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 7/15] 10.222.0.20 () {58 vars in 1251 bytes} [Thu Oct 20 06:04:37 2022] GET /compute/v2.1/os-snapshots/e29715a1-a427-4823-9688-07e0020955ab => generated 286 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:04:38.427443 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-177bbcaf-1d28-407c-b2f4-c4ebeb002501 tempest-VolumesSnapshotsTestJSON-886705292 tempest-VolumesSnapshotsTestJSON-886705292-project] Calling method '.version_select at 0x7fbe4b9ae1f0>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:04:38.480545 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-177bbcaf-1d28-407c-b2f4-c4ebeb002501 tempest-VolumesSnapshotsTestJSON-886705292 tempest-VolumesSnapshotsTestJSON-886705292-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/e29715a1-a427-4823-9688-07e0020955ab" status: 200 len: 286 microversion: 2.1 time: 0.056849 Oct 20 06:04:38.481148 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 9/16] 10.222.0.20 () {58 vars in 1251 bytes} [Thu Oct 20 06:04:38 2022] GET /compute/v2.1/os-snapshots/e29715a1-a427-4823-9688-07e0020955ab => generated 286 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:04:39.091396 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-bf8d22fb-115e-479c-afcf-d55d0d9967ff tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1495265835", "imageRef": "9fcec276-734d-41d9-905b-10d2bbcbfba5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 06:04:39.278603 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.network.neutron [None req-bf8d22fb-115e-479c-afcf-d55d0d9967ff tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] validate_networks() for [('78068473-5127-42fd-9217-b2bd82fd7230', None, None, None, None, None)] {{(pid=118860) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 20 06:04:39.493797 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-e64d209a-c89a-4bfe-9e96-9db067d06ad1 tempest-VolumesSnapshotsTestJSON-886705292 tempest-VolumesSnapshotsTestJSON-886705292-project] Calling method '.version_select at 0x7fbe4b9aeaf0>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:04:39.578984 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-e64d209a-c89a-4bfe-9e96-9db067d06ad1 tempest-VolumesSnapshotsTestJSON-886705292 tempest-VolumesSnapshotsTestJSON-886705292-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/e29715a1-a427-4823-9688-07e0020955ab" status: 200 len: 286 microversion: 2.1 time: 0.088945 Oct 20 06:04:39.579810 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 10/17] 10.222.0.20 () {58 vars in 1251 bytes} [Thu Oct 20 06:04:39 2022] GET /compute/v2.1/os-snapshots/e29715a1-a427-4823-9688-07e0020955ab => generated 286 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:04:40.281081 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-33b15334-1dc8-4dfe-9308-4f8c794f4ed8 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1920996026", "imageRef": "9fcec276-734d-41d9-905b-10d2bbcbfba5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "25101033-a54e-4dc6-a6b0-89acf3ee0337"}], "security_groups": [{"name": "tempest-securitygroup--554044193"}], "key_name": "tempest-keypair-259144965", "user_data": "}} {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 06:04:40.562264 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.network.neutron [None req-33b15334-1dc8-4dfe-9308-4f8c794f4ed8 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] validate_networks() for [('25101033-a54e-4dc6-a6b0-89acf3ee0337', None, None, None, None, None)] {{(pid=118861) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 20 06:04:41.830275 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.virt.hardware [None req-33b15334-1dc8-4dfe-9308-4f8c794f4ed8 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Flavor limits 0:0:0 {{(pid=118861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 20 06:04:41.830876 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.virt.hardware [None req-33b15334-1dc8-4dfe-9308-4f8c794f4ed8 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Image limits 0:0:0 {{(pid=118861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 20 06:04:41.831277 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.virt.hardware [None req-33b15334-1dc8-4dfe-9308-4f8c794f4ed8 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Flavor pref 0:0:0 {{(pid=118861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 20 06:04:41.831698 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.virt.hardware [None req-33b15334-1dc8-4dfe-9308-4f8c794f4ed8 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Image pref 0:0:0 {{(pid=118861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 20 06:04:41.832113 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.virt.hardware [None req-33b15334-1dc8-4dfe-9308-4f8c794f4ed8 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 20 06:04:41.863054 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-33b15334-1dc8-4dfe-9308-4f8c794f4ed8 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:04:41.863732 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-33b15334-1dc8-4dfe-9308-4f8c794f4ed8 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:04:41.864257 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-33b15334-1dc8-4dfe-9308-4f8c794f4ed8 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:04:41.870999 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-33b15334-1dc8-4dfe-9308-4f8c794f4ed8 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:04:41.871547 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-33b15334-1dc8-4dfe-9308-4f8c794f4ed8 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:04:41.872121 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-33b15334-1dc8-4dfe-9308-4f8c794f4ed8 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:04:41.955576 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.quota [None req-33b15334-1dc8-4dfe-9308-4f8c794f4ed8 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Getting quotas for project b90087118fe040389f291d846461c0a7. Resources: {'cores', 'ram', 'instances'} {{(pid=118861) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 20 06:04:41.964261 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.quota [None req-33b15334-1dc8-4dfe-9308-4f8c794f4ed8 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Getting quotas for user 2c6be23065c643939055a3de375187d5 and project b90087118fe040389f291d846461c0a7. Resources: {'cores', 'ram', 'instances'} {{(pid=118861) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 20 06:04:42.000173 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-33b15334-1dc8-4dfe-9308-4f8c794f4ed8 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Going to run 1 instances... {{(pid=118861) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 20 06:04:42.003355 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-33b15334-1dc8-4dfe-9308-4f8c794f4ed8 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9fcec276-734d-41d9-905b-10d2bbcbfba5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118861) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 20 06:04:42.054656 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.virt.hardware [None req-bf8d22fb-115e-479c-afcf-d55d0d9967ff tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Flavor limits 0:0:0 {{(pid=118860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 20 06:04:42.055157 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.virt.hardware [None req-bf8d22fb-115e-479c-afcf-d55d0d9967ff tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Image limits 0:0:0 {{(pid=118860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 20 06:04:42.057504 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.virt.hardware [None req-bf8d22fb-115e-479c-afcf-d55d0d9967ff tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Flavor pref 0:0:0 {{(pid=118860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 20 06:04:42.058029 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.virt.hardware [None req-bf8d22fb-115e-479c-afcf-d55d0d9967ff tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Image pref 0:0:0 {{(pid=118860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 20 06:04:42.058678 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.virt.hardware [None req-bf8d22fb-115e-479c-afcf-d55d0d9967ff tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 20 06:04:42.087222 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-bf8d22fb-115e-479c-afcf-d55d0d9967ff tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:04:42.088110 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-bf8d22fb-115e-479c-afcf-d55d0d9967ff tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:04:42.088838 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-bf8d22fb-115e-479c-afcf-d55d0d9967ff tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:04:42.093769 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-bf8d22fb-115e-479c-afcf-d55d0d9967ff tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:04:42.094707 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-bf8d22fb-115e-479c-afcf-d55d0d9967ff tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:04:42.095423 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-bf8d22fb-115e-479c-afcf-d55d0d9967ff tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:04:42.148663 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.quota [None req-bf8d22fb-115e-479c-afcf-d55d0d9967ff tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Getting quotas for project 9f0d80988ca941acb8ad4318338dfbea. Resources: {'cores', 'ram', 'instances'} {{(pid=118860) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 20 06:04:42.159763 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.quota [None req-bf8d22fb-115e-479c-afcf-d55d0d9967ff tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Getting quotas for user 57d4cbd2a2154e5d925462df7c77815a and project 9f0d80988ca941acb8ad4318338dfbea. Resources: {'cores', 'ram', 'instances'} {{(pid=118860) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 20 06:04:42.179132 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-bf8d22fb-115e-479c-afcf-d55d0d9967ff tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Going to run 1 instances... {{(pid=118860) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 20 06:04:42.186729 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-bf8d22fb-115e-479c-afcf-d55d0d9967ff tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] [instance: d38a019f-4bfc-4845-900b-a9e4e6397373] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9fcec276-734d-41d9-905b-10d2bbcbfba5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118860) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 20 06:04:42.246354 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-33b15334-1dc8-4dfe-9308-4f8c794f4ed8 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.972126 Oct 20 06:04:42.264943 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 11/18] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Oct 20 06:04:40 2022] POST /compute/v2.1/servers => generated 401 bytes in 1991 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 20 06:04:42.444937 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-bf8d22fb-115e-479c-afcf-d55d0d9967ff tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.446903 Oct 20 06:04:42.460354 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 8/19] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Oct 20 06:04:38 2022] POST /compute/v2.1/servers => generated 383 bytes in 3463 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 20 06:04:42.466470 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-43d2ce4a-6a6d-4a3e-ab46-c4b3ac5ea816 tempest-VolumesSnapshotsTestJSON-886705292 tempest-VolumesSnapshotsTestJSON-886705292-project] Calling method '.version_select at 0x7fbe4b8774c0>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:04:42.482419 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-38952d28-9067-4285-ab62-ea40f6381425 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Action: 'create', calling method: .version_select at 0x7fbe4b9ae9d0>, body: {"keypair": {"name": "tempest-keypair-530646533", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCP2U0EsgGMres9KptgLrhx0fgvQmKA26Lxo7tRDCmpmCtMMI0VbGDFLgnJ0/AY9hKYDSer6LQTowydTakc7w59Uc+hOnt64aQm0Fv9OTzU30pQpV9GA3ouzwUTpAwCqqw=="}} {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 06:04:42.591384 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.quota [None req-38952d28-9067-4285-ab62-ea40f6381425 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Getting quotas for project 66a33a727f9c40b99fb14bd2e0fc5090. Resources: {'key_pairs'} {{(pid=118861) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 20 06:04:42.610930 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.quota [None req-38952d28-9067-4285-ab62-ea40f6381425 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Getting quotas for user db34ffc8f90247daac1548bbb421b015 and project 66a33a727f9c40b99fb14bd2e0fc5090. Resources: {'key_pairs'} {{(pid=118861) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 20 06:04:42.622676 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.wsgi [None req-43d2ce4a-6a6d-4a3e-ab46-c4b3ac5ea816 tempest-VolumesSnapshotsTestJSON-886705292 tempest-VolumesSnapshotsTestJSON-886705292-project] HTTP exception thrown: Snapshot e29715a1-a427-4823-9688-07e0020955ab could not be found. Oct 20 06:04:42.629233 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-43d2ce4a-6a6d-4a3e-ab46-c4b3ac5ea816 tempest-VolumesSnapshotsTestJSON-886705292 tempest-VolumesSnapshotsTestJSON-886705292-project] Request method failure captured: Oct 20 06:04:42.629233 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: request: GET /compute/v2.1/os-snapshots/e29715a1-a427-4823-9688-07e0020955ab HTTP/1.1 Oct 20 06:04:42.629233 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: Accept: application/json Oct 20 06:04:42.629233 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: Accept-Encoding: identity Oct 20 06:04:42.629233 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: Connection: close Oct 20 06:04:42.629233 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: Content-Length: 0 Oct 20 06:04:42.629233 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: Content-Type: application/json Oct 20 06:04:42.629233 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: Host: 10.222.0.20 Oct 20 06:04:42.629233 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: Openstack-System-Scope: None Oct 20 06:04:42.629233 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: User-Agent: python-urllib3/1.26.12 Oct 20 06:04:42.629233 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Auth-Token: gAAAAABjUOTpNk-pZ7qx3MXmt88C4RawsbAprOTW3mmZpvC53Ovlc9B8euHhS3qK5IwzbafgEas-TeHasn9RSCyL4aXcKO5v7MI8xZxh0njUBMPBOQmvGpvKllIRpZCI6UkQyVRCPHu7Goy09NNwlAMFzOWPQ0ZgiB4xnkBN7t0avM7JsICi0_Q Oct 20 06:04:42.629233 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Domain-Id: None Oct 20 06:04:42.629233 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Domain-Name: None Oct 20 06:04:42.629233 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Identity-Status: Confirmed Oct 20 06:04:42.629233 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Is-Admin-Project: True Oct 20 06:04:42.629233 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Project-Domain-Id: default Oct 20 06:04:42.629233 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Project-Domain-Name: Default Oct 20 06:04:42.629233 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Project-Id: 48d87e6406724af3b1330e6f3cc15a28 Oct 20 06:04:42.629233 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-886705292 Oct 20 06:04:42.629233 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Role: reader,member Oct 20 06:04:42.629233 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Roles: reader,member Oct 20 06:04:42.631262 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/48d87e6406724af3b1330e6f3cc15a28"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_48d87e6406724af3b1330e6f3cc15a28"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/48d87e6406724af3b1330e6f3cc15a28"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/48d87e6406724af3b1330e6f3cc15a28"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 20 06:04:42.631262 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Tenant: tempest-VolumesSnapshotsTestJSON-886705292 Oct 20 06:04:42.631262 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Tenant-Id: 48d87e6406724af3b1330e6f3cc15a28 Oct 20 06:04:42.631262 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-886705292 Oct 20 06:04:42.631262 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-User: tempest-VolumesSnapshotsTestJSON-886705292-project Oct 20 06:04:42.631262 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-User-Domain-Id: default Oct 20 06:04:42.631262 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-User-Domain-Name: Default Oct 20 06:04:42.631262 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-User-Id: 870aa823b2e149dba5174fe9f7965a67 Oct 20 06:04:42.631262 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-User-Name: tempest-VolumesSnapshotsTestJSON-886705292-project Oct 20 06:04:42.631262 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: method: Oct 20 06:04:42.631262 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: exception: Snapshot e29715a1-a427-4823-9688-07e0020955ab could not be found. Oct 20 06:04:42.631262 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: action_args: {'id': 'e29715a1-a427-4823-9688-07e0020955ab'} Oct 20 06:04:42.631262 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 20 06:04:42.632272 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 06:04:42.632272 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 20 06:04:42.632272 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 20 06:04:42.632272 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 20 06:04:42.632272 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 20 06:04:42.632272 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 20 06:04:42.632272 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 20 06:04:42.632272 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 20 06:04:42.632272 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 20 06:04:42.632272 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 20 06:04:42.632272 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 20 06:04:42.632272 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 20 06:04:42.632272 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 20 06:04:42.632272 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 20 06:04:42.632272 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 20 06:04:42.632272 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot e29715a1-a427-4823-9688-07e0020955ab could not be found. (HTTP 404) (Request-ID: req-210237bf-9463-4636-9d2a-9b9b732570bb) Oct 20 06:04:42.632272 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi Oct 20 06:04:42.632272 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 06:04:42.633456 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi Oct 20 06:04:42.633456 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 06:04:42.633456 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Oct 20 06:04:42.633456 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Oct 20 06:04:42.633456 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 20 06:04:42.633456 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 20 06:04:42.633456 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Oct 20 06:04:42.633456 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Oct 20 06:04:42.633456 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 20 06:04:42.633456 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 20 06:04:42.633456 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 20 06:04:42.633456 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 20 06:04:42.633456 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 20 06:04:42.633456 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 20 06:04:42.633456 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 20 06:04:42.633456 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 20 06:04:42.633456 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 20 06:04:42.633456 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 20 06:04:42.633456 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 20 06:04:42.634902 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 20 06:04:42.634902 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 20 06:04:42.634902 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 20 06:04:42.634902 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 20 06:04:42.634902 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 20 06:04:42.634902 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot e29715a1-a427-4823-9688-07e0020955ab could not be found. Oct 20 06:04:42.634902 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi Oct 20 06:04:42.634902 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 06:04:42.634902 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi Oct 20 06:04:42.634902 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 06:04:42.634902 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 06:04:42.634902 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 06:04:42.634902 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 20 06:04:42.634902 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 20 06:04:42.634902 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 20 06:04:42.634902 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 20 06:04:42.634902 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 20 06:04:42.634902 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 20 06:04:42.634902 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Oct 20 06:04:42.634902 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 20 06:04:42.640553 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot e29715a1-a427-4823-9688-07e0020955ab could not be found. Oct 20 06:04:42.640553 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi Oct 20 06:04:42.640553 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 06:04:42.640553 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi Oct 20 06:04:42.640553 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 06:04:42.640553 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 06:04:42.640553 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 06:04:42.640553 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 20 06:04:42.640553 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 20 06:04:42.640553 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot e29715a1-a427-4823-9688-07e0020955ab could not be found. Oct 20 06:04:42.640553 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi Oct 20 06:04:42.649329 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-43d2ce4a-6a6d-4a3e-ab46-c4b3ac5ea816 tempest-VolumesSnapshotsTestJSON-886705292 tempest-VolumesSnapshotsTestJSON-886705292-project] Returning 404 to user: Snapshot e29715a1-a427-4823-9688-07e0020955ab could not be found. {{(pid=118860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 20 06:04:42.649329 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-43d2ce4a-6a6d-4a3e-ab46-c4b3ac5ea816 tempest-VolumesSnapshotsTestJSON-886705292 tempest-VolumesSnapshotsTestJSON-886705292-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/e29715a1-a427-4823-9688-07e0020955ab" status: 404 len: 111 microversion: 2.1 time: 0.181395 Oct 20 06:04:42.649329 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 9/20] 10.222.0.20 () {58 vars in 1251 bytes} [Thu Oct 20 06:04:42 2022] GET /compute/v2.1/os-snapshots/e29715a1-a427-4823-9688-07e0020955ab => generated 111 bytes in 183 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 20 06:04:42.673135 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-7939e615-57ef-426c-b4ba-8ca2c6dc9671 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:04:42.674734 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-7939e615-57ef-426c-b4ba-8ca2c6dc9671 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:04:42.755513 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-38952d28-9067-4285-ab62-ea40f6381425 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.486862 Oct 20 06:04:42.757163 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 12/21] 10.222.0.20 () {62 vars in 1200 bytes} [Thu Oct 20 06:04:42 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 491 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 20 06:04:42.798981 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-31c52726-65e2-48ba-a560-8124cd33fb9c tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:04:42.811942 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-31c52726-65e2-48ba-a560-8124cd33fb9c tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] [instance: d38a019f-4bfc-4845-900b-a9e4e6397373] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:04:42.974627 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-7939e615-57ef-426c-b4ba-8ca2c6dc9671 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:04:43.006188 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-7939e615-57ef-426c-b4ba-8ca2c6dc9671 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1241 microversion: 2.1 time: 0.348325 Oct 20 06:04:43.025872 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 10/22] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:04:42 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1241 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:04:43.037787 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-0ac7bc38-ecff-43ff-9ccb-ab1b521830c0 tempest-VolumesSnapshotsTestJSON-886705292 tempest-VolumesSnapshotsTestJSON-886705292-project] Calling method '.version_select at 0x7fbe4b05f1f0>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:04:43.332403 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-0ac7bc38-ecff-43ff-9ccb-ab1b521830c0 tempest-VolumesSnapshotsTestJSON-886705292 tempest-VolumesSnapshotsTestJSON-886705292-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/2b7ffaaa-2471-4888-93c1-b67b7868013e" status: 202 len: 0 microversion: 2.1 time: 0.304515 Oct 20 06:04:43.333276 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 11/23] 10.222.0.20 () {58 vars in 1248 bytes} [Thu Oct 20 06:04:43 2022] DELETE /compute/v2.1/os-volumes/2b7ffaaa-2471-4888-93c1-b67b7868013e => generated 0 bytes in 307 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 20 06:04:43.405350 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-31c52726-65e2-48ba-a560-8124cd33fb9c tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d4cbd2a2154e5d925462df7c77815a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0d80988ca941acb8ad4318338dfbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:04:43.458789 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-31c52726-65e2-48ba-a560-8124cd33fb9c tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] 10.222.0.20 "GET /compute/v2.1/servers/d38a019f-4bfc-4845-900b-a9e4e6397373" status: 200 len: 1222 microversion: 2.1 time: 0.690705 Oct 20 06:04:43.493879 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-9dee0f91-bb51-44d0-b081-dbf6b70bc63a tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1596912215", "imageRef": "9fcec276-734d-41d9-905b-10d2bbcbfba5", "flavorRef": "452", "networks": [{"uuid": "d3d5a8c8-5d71-4fad-8f8b-fe2a765327a8"}]}} {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 06:04:43.501226 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 13/24] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:04:42 2022] GET /compute/v2.1/servers/d38a019f-4bfc-4845-900b-a9e4e6397373 => generated 1222 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:04:43.551682 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-8c57ca15-3b2d-4692-a3bc-37c410103e09 tempest-VolumesSnapshotsTestJSON-886705292 tempest-VolumesSnapshotsTestJSON-886705292-project] Calling method '.version_select at 0x7fbe4b096f70>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:04:43.731511 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.wsgi [None req-8c57ca15-3b2d-4692-a3bc-37c410103e09 tempest-VolumesSnapshotsTestJSON-886705292 tempest-VolumesSnapshotsTestJSON-886705292-project] HTTP exception thrown: Volume 2b7ffaaa-2471-4888-93c1-b67b7868013e could not be found. Oct 20 06:04:43.735484 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-8c57ca15-3b2d-4692-a3bc-37c410103e09 tempest-VolumesSnapshotsTestJSON-886705292 tempest-VolumesSnapshotsTestJSON-886705292-project] Request method failure captured: Oct 20 06:04:43.735484 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: request: GET /compute/v2.1/os-volumes/2b7ffaaa-2471-4888-93c1-b67b7868013e HTTP/1.1 Oct 20 06:04:43.735484 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: Accept: application/json Oct 20 06:04:43.735484 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: Accept-Encoding: identity Oct 20 06:04:43.735484 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: Connection: close Oct 20 06:04:43.735484 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: Content-Length: 0 Oct 20 06:04:43.735484 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: Content-Type: application/json Oct 20 06:04:43.735484 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: Host: 10.222.0.20 Oct 20 06:04:43.735484 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: Openstack-System-Scope: None Oct 20 06:04:43.735484 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: User-Agent: python-urllib3/1.26.12 Oct 20 06:04:43.735484 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Auth-Token: gAAAAABjUOTpNk-pZ7qx3MXmt88C4RawsbAprOTW3mmZpvC53Ovlc9B8euHhS3qK5IwzbafgEas-TeHasn9RSCyL4aXcKO5v7MI8xZxh0njUBMPBOQmvGpvKllIRpZCI6UkQyVRCPHu7Goy09NNwlAMFzOWPQ0ZgiB4xnkBN7t0avM7JsICi0_Q Oct 20 06:04:43.735484 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Domain-Id: None Oct 20 06:04:43.735484 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Domain-Name: None Oct 20 06:04:43.735484 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Identity-Status: Confirmed Oct 20 06:04:43.735484 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Is-Admin-Project: True Oct 20 06:04:43.735484 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Project-Domain-Id: default Oct 20 06:04:43.735484 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Project-Domain-Name: Default Oct 20 06:04:43.735484 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Project-Id: 48d87e6406724af3b1330e6f3cc15a28 Oct 20 06:04:43.735484 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-886705292 Oct 20 06:04:43.735484 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Role: reader,member Oct 20 06:04:43.735484 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Roles: reader,member Oct 20 06:04:43.736779 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/48d87e6406724af3b1330e6f3cc15a28"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_48d87e6406724af3b1330e6f3cc15a28"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/48d87e6406724af3b1330e6f3cc15a28"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/48d87e6406724af3b1330e6f3cc15a28"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 20 06:04:43.736779 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Tenant: tempest-VolumesSnapshotsTestJSON-886705292 Oct 20 06:04:43.736779 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Tenant-Id: 48d87e6406724af3b1330e6f3cc15a28 Oct 20 06:04:43.736779 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-886705292 Oct 20 06:04:43.736779 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-User: tempest-VolumesSnapshotsTestJSON-886705292-project Oct 20 06:04:43.736779 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-User-Domain-Id: default Oct 20 06:04:43.736779 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-User-Domain-Name: Default Oct 20 06:04:43.736779 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-User-Id: 870aa823b2e149dba5174fe9f7965a67 Oct 20 06:04:43.736779 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-User-Name: tempest-VolumesSnapshotsTestJSON-886705292-project Oct 20 06:04:43.736779 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: method: Oct 20 06:04:43.736779 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: exception: Volume 2b7ffaaa-2471-4888-93c1-b67b7868013e could not be found. Oct 20 06:04:43.736779 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: action_args: {'id': '2b7ffaaa-2471-4888-93c1-b67b7868013e'} Oct 20 06:04:43.736779 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 20 06:04:43.737713 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 06:04:43.737713 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 20 06:04:43.737713 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 20 06:04:43.737713 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 20 06:04:43.737713 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 20 06:04:43.737713 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 20 06:04:43.737713 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 20 06:04:43.737713 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 20 06:04:43.737713 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 20 06:04:43.737713 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 20 06:04:43.737713 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 20 06:04:43.737713 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 20 06:04:43.737713 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 20 06:04:43.737713 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 20 06:04:43.737713 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 20 06:04:43.737713 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2b7ffaaa-2471-4888-93c1-b67b7868013e could not be found. (HTTP 404) (Request-ID: req-86852e28-63b6-4f85-bf57-87adecdee8da) Oct 20 06:04:43.737713 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi Oct 20 06:04:43.737713 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 06:04:43.737713 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi Oct 20 06:04:43.738883 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 06:04:43.738883 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 20 06:04:43.738883 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 20 06:04:43.738883 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 20 06:04:43.738883 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 20 06:04:43.738883 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 20 06:04:43.738883 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 20 06:04:43.738883 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 20 06:04:43.738883 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 20 06:04:43.738883 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 20 06:04:43.738883 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 20 06:04:43.738883 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 20 06:04:43.738883 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 20 06:04:43.738883 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 20 06:04:43.738883 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 20 06:04:43.738883 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 20 06:04:43.738883 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 20 06:04:43.738883 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 20 06:04:43.738883 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 20 06:04:43.743060 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 20 06:04:43.743060 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 20 06:04:43.743060 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 20 06:04:43.743060 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 20 06:04:43.743060 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2b7ffaaa-2471-4888-93c1-b67b7868013e could not be found. Oct 20 06:04:43.743060 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi Oct 20 06:04:43.743060 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 06:04:43.743060 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi Oct 20 06:04:43.743060 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 06:04:43.743060 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 06:04:43.743060 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 06:04:43.743060 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 20 06:04:43.743060 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 20 06:04:43.743060 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 20 06:04:43.743060 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 20 06:04:43.743060 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 20 06:04:43.743060 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 20 06:04:43.743060 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 20 06:04:43.743060 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 20 06:04:43.745902 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2b7ffaaa-2471-4888-93c1-b67b7868013e could not be found. Oct 20 06:04:43.745902 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi Oct 20 06:04:43.745902 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 06:04:43.745902 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi Oct 20 06:04:43.745902 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 06:04:43.745902 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 06:04:43.745902 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 06:04:43.745902 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 20 06:04:43.745902 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 20 06:04:43.745902 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2b7ffaaa-2471-4888-93c1-b67b7868013e could not be found. Oct 20 06:04:43.745902 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi Oct 20 06:04:43.745902 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-8c57ca15-3b2d-4692-a3bc-37c410103e09 tempest-VolumesSnapshotsTestJSON-886705292 tempest-VolumesSnapshotsTestJSON-886705292-project] Returning 404 to user: Volume 2b7ffaaa-2471-4888-93c1-b67b7868013e could not be found. {{(pid=118861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 20 06:04:43.745902 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-8c57ca15-3b2d-4692-a3bc-37c410103e09 tempest-VolumesSnapshotsTestJSON-886705292 tempest-VolumesSnapshotsTestJSON-886705292-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/2b7ffaaa-2471-4888-93c1-b67b7868013e" status: 404 len: 109 microversion: 2.1 time: 0.242044 Oct 20 06:04:43.747872 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 14/25] 10.222.0.20 () {58 vars in 1245 bytes} [Thu Oct 20 06:04:43 2022] GET /compute/v2.1/os-volumes/2b7ffaaa-2471-4888-93c1-b67b7868013e => generated 109 bytes in 245 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 20 06:04:43.770721 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-c8752d22-4667-4add-a9c2-e6e4f22e0e58 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2049071631", "imageRef": "9fcec276-734d-41d9-905b-10d2bbcbfba5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 06:04:43.793277 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.network.neutron [None req-9dee0f91-bb51-44d0-b081-dbf6b70bc63a tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] validate_networks() for [('d3d5a8c8-5d71-4fad-8f8b-fe2a765327a8', None, None, None, None, None)] {{(pid=118860) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 20 06:04:43.937336 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.network.neutron [None req-c8752d22-4667-4add-a9c2-e6e4f22e0e58 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] validate_networks() for [('78068473-5127-42fd-9217-b2bd82fd7230', None, None, None, None, None)] {{(pid=118861) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 20 06:04:45.003386 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.virt.hardware [None req-9dee0f91-bb51-44d0-b081-dbf6b70bc63a tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Flavor limits 0:0:0 {{(pid=118860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 20 06:04:45.005470 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.virt.hardware [None req-9dee0f91-bb51-44d0-b081-dbf6b70bc63a tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Image limits 0:0:0 {{(pid=118860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 20 06:04:45.006207 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.virt.hardware [None req-9dee0f91-bb51-44d0-b081-dbf6b70bc63a tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Flavor pref 0:0:0 {{(pid=118860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 20 06:04:45.007505 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.virt.hardware [None req-9dee0f91-bb51-44d0-b081-dbf6b70bc63a tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Image pref 0:0:0 {{(pid=118860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 20 06:04:45.008536 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.virt.hardware [None req-9dee0f91-bb51-44d0-b081-dbf6b70bc63a tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 20 06:04:45.034111 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-9dee0f91-bb51-44d0-b081-dbf6b70bc63a tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:04:45.038295 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-9dee0f91-bb51-44d0-b081-dbf6b70bc63a tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:04:45.039372 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-9dee0f91-bb51-44d0-b081-dbf6b70bc63a tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:04:45.040889 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-9dee0f91-bb51-44d0-b081-dbf6b70bc63a tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:04:45.042367 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-9dee0f91-bb51-44d0-b081-dbf6b70bc63a tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:04:45.046057 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-9dee0f91-bb51-44d0-b081-dbf6b70bc63a tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:04:45.093497 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.quota [None req-9dee0f91-bb51-44d0-b081-dbf6b70bc63a tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Getting quotas for project 72e1785381dd4bdaa2803fa7ef711dcb. Resources: {'cores', 'ram', 'instances'} {{(pid=118860) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 20 06:04:45.108422 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.quota [None req-9dee0f91-bb51-44d0-b081-dbf6b70bc63a tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Getting quotas for user c85953d8e7394fb0a6f425ce51420325 and project 72e1785381dd4bdaa2803fa7ef711dcb. Resources: {'cores', 'ram', 'instances'} {{(pid=118860) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 20 06:04:45.135424 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-9dee0f91-bb51-44d0-b081-dbf6b70bc63a tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Going to run 1 instances... {{(pid=118860) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 20 06:04:45.141325 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-9dee0f91-bb51-44d0-b081-dbf6b70bc63a tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] [instance: ab6b2605-695c-4ee9-ae33-6234ef22536c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9fcec276-734d-41d9-905b-10d2bbcbfba5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118860) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 20 06:04:45.267618 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-9dee0f91-bb51-44d0-b081-dbf6b70bc63a tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.927510 Oct 20 06:04:45.276805 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 12/26] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Oct 20 06:04:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 1943 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 20 06:04:45.283651 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-146e6770-07d5-4312-88f9-c5d0008f522c tempest-VolumesSnapshotsTestJSON-886705292 tempest-VolumesSnapshotsTestJSON-886705292-project] Calling method '.version_select at 0x7fbe4b002550>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:04:45.360799 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.wsgi [None req-146e6770-07d5-4312-88f9-c5d0008f522c tempest-VolumesSnapshotsTestJSON-886705292 tempest-VolumesSnapshotsTestJSON-886705292-project] HTTP exception thrown: Volume 2b7ffaaa-2471-4888-93c1-b67b7868013e could not be found. Oct 20 06:04:45.364674 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-146e6770-07d5-4312-88f9-c5d0008f522c tempest-VolumesSnapshotsTestJSON-886705292 tempest-VolumesSnapshotsTestJSON-886705292-project] Request method failure captured: Oct 20 06:04:45.364674 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: request: DELETE /compute/v2.1/os-volumes/2b7ffaaa-2471-4888-93c1-b67b7868013e HTTP/1.1 Oct 20 06:04:45.364674 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: Accept: application/json Oct 20 06:04:45.364674 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: Accept-Encoding: identity Oct 20 06:04:45.364674 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: Connection: close Oct 20 06:04:45.364674 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: Content-Length: 0 Oct 20 06:04:45.364674 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: Content-Type: application/json Oct 20 06:04:45.364674 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: Host: 10.222.0.20 Oct 20 06:04:45.364674 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: Openstack-System-Scope: None Oct 20 06:04:45.364674 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: User-Agent: python-urllib3/1.26.12 Oct 20 06:04:45.364674 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Auth-Token: gAAAAABjUOTpNk-pZ7qx3MXmt88C4RawsbAprOTW3mmZpvC53Ovlc9B8euHhS3qK5IwzbafgEas-TeHasn9RSCyL4aXcKO5v7MI8xZxh0njUBMPBOQmvGpvKllIRpZCI6UkQyVRCPHu7Goy09NNwlAMFzOWPQ0ZgiB4xnkBN7t0avM7JsICi0_Q Oct 20 06:04:45.364674 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Domain-Id: None Oct 20 06:04:45.364674 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Domain-Name: None Oct 20 06:04:45.364674 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Identity-Status: Confirmed Oct 20 06:04:45.364674 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Is-Admin-Project: True Oct 20 06:04:45.364674 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Project-Domain-Id: default Oct 20 06:04:45.364674 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Project-Domain-Name: Default Oct 20 06:04:45.364674 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Project-Id: 48d87e6406724af3b1330e6f3cc15a28 Oct 20 06:04:45.364674 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-886705292 Oct 20 06:04:45.364674 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Role: reader,member Oct 20 06:04:45.364674 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Roles: reader,member Oct 20 06:04:45.365979 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/48d87e6406724af3b1330e6f3cc15a28"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_48d87e6406724af3b1330e6f3cc15a28"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/48d87e6406724af3b1330e6f3cc15a28"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/48d87e6406724af3b1330e6f3cc15a28"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 20 06:04:45.365979 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Tenant: tempest-VolumesSnapshotsTestJSON-886705292 Oct 20 06:04:45.365979 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Tenant-Id: 48d87e6406724af3b1330e6f3cc15a28 Oct 20 06:04:45.365979 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-886705292 Oct 20 06:04:45.365979 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-User: tempest-VolumesSnapshotsTestJSON-886705292-project Oct 20 06:04:45.365979 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-User-Domain-Id: default Oct 20 06:04:45.365979 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-User-Domain-Name: Default Oct 20 06:04:45.365979 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-User-Id: 870aa823b2e149dba5174fe9f7965a67 Oct 20 06:04:45.365979 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-User-Name: tempest-VolumesSnapshotsTestJSON-886705292-project Oct 20 06:04:45.365979 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: method: Oct 20 06:04:45.365979 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: exception: Volume 2b7ffaaa-2471-4888-93c1-b67b7868013e could not be found. Oct 20 06:04:45.365979 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: action_args: {'id': '2b7ffaaa-2471-4888-93c1-b67b7868013e'} Oct 20 06:04:45.365979 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 20 06:04:45.366736 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 06:04:45.366736 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 20 06:04:45.366736 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 20 06:04:45.366736 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 20 06:04:45.366736 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 20 06:04:45.366736 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 20 06:04:45.366736 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 20 06:04:45.366736 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 20 06:04:45.366736 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 20 06:04:45.366736 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 20 06:04:45.366736 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 20 06:04:45.366736 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 20 06:04:45.366736 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 20 06:04:45.366736 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 20 06:04:45.366736 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 20 06:04:45.366736 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2b7ffaaa-2471-4888-93c1-b67b7868013e could not be found. (HTTP 404) (Request-ID: req-3893f826-dffc-4a27-9b10-84e3caa58ff2) Oct 20 06:04:45.366736 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi Oct 20 06:04:45.366736 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 06:04:45.366736 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi Oct 20 06:04:45.367808 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 06:04:45.367808 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 20 06:04:45.367808 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 20 06:04:45.367808 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 20 06:04:45.367808 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 20 06:04:45.367808 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 20 06:04:45.367808 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 20 06:04:45.367808 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 20 06:04:45.367808 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 20 06:04:45.367808 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 20 06:04:45.367808 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 20 06:04:45.367808 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 20 06:04:45.367808 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 20 06:04:45.367808 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 20 06:04:45.367808 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 20 06:04:45.367808 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 20 06:04:45.367808 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 20 06:04:45.367808 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 20 06:04:45.367808 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 20 06:04:45.368860 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 20 06:04:45.368860 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 20 06:04:45.368860 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 20 06:04:45.368860 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 20 06:04:45.368860 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2b7ffaaa-2471-4888-93c1-b67b7868013e could not be found. Oct 20 06:04:45.368860 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi Oct 20 06:04:45.368860 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 06:04:45.368860 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi Oct 20 06:04:45.368860 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 06:04:45.368860 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 06:04:45.368860 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 06:04:45.368860 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 20 06:04:45.368860 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 20 06:04:45.368860 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 20 06:04:45.368860 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 20 06:04:45.368860 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 20 06:04:45.368860 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 20 06:04:45.368860 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 20 06:04:45.368860 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 20 06:04:45.370394 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2b7ffaaa-2471-4888-93c1-b67b7868013e could not be found. Oct 20 06:04:45.370394 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi Oct 20 06:04:45.370394 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 06:04:45.370394 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi Oct 20 06:04:45.370394 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 06:04:45.370394 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 06:04:45.370394 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 06:04:45.370394 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 20 06:04:45.370394 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 20 06:04:45.370394 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2b7ffaaa-2471-4888-93c1-b67b7868013e could not be found. Oct 20 06:04:45.370394 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi Oct 20 06:04:45.371673 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-146e6770-07d5-4312-88f9-c5d0008f522c tempest-VolumesSnapshotsTestJSON-886705292 tempest-VolumesSnapshotsTestJSON-886705292-project] Returning 404 to user: Volume 2b7ffaaa-2471-4888-93c1-b67b7868013e could not be found. {{(pid=118860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 20 06:04:45.372781 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-146e6770-07d5-4312-88f9-c5d0008f522c tempest-VolumesSnapshotsTestJSON-886705292 tempest-VolumesSnapshotsTestJSON-886705292-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/2b7ffaaa-2471-4888-93c1-b67b7868013e" status: 404 len: 109 microversion: 2.1 time: 0.093198 Oct 20 06:04:45.375876 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 13/27] 10.222.0.20 () {58 vars in 1248 bytes} [Thu Oct 20 06:04:45 2022] DELETE /compute/v2.1/os-volumes/2b7ffaaa-2471-4888-93c1-b67b7868013e => generated 109 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 20 06:04:45.386093 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-89075ba1-92c7-49f2-9641-a03dd54438d2 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:04:45.390214 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-89075ba1-92c7-49f2-9641-a03dd54438d2 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:04:45.418529 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-89075ba1-92c7-49f2-9641-a03dd54438d2 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:04:45.419432 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-89075ba1-92c7-49f2-9641-a03dd54438d2 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:04:45.428429 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-89075ba1-92c7-49f2-9641-a03dd54438d2 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:04:45.429216 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-89075ba1-92c7-49f2-9641-a03dd54438d2 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:04:45.429798 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-89075ba1-92c7-49f2-9641-a03dd54438d2 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:04:45.430166 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-89075ba1-92c7-49f2-9641-a03dd54438d2 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:04:45.558945 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.virt.hardware [None req-c8752d22-4667-4add-a9c2-e6e4f22e0e58 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Flavor limits 0:0:0 {{(pid=118861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 20 06:04:45.559621 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.virt.hardware [None req-c8752d22-4667-4add-a9c2-e6e4f22e0e58 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Image limits 0:0:0 {{(pid=118861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 20 06:04:45.560536 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.virt.hardware [None req-c8752d22-4667-4add-a9c2-e6e4f22e0e58 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Flavor pref 0:0:0 {{(pid=118861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 20 06:04:45.561566 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.virt.hardware [None req-c8752d22-4667-4add-a9c2-e6e4f22e0e58 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Image pref 0:0:0 {{(pid=118861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 20 06:04:45.562221 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.virt.hardware [None req-c8752d22-4667-4add-a9c2-e6e4f22e0e58 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 20 06:04:45.615876 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c8752d22-4667-4add-a9c2-e6e4f22e0e58 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:04:45.622176 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c8752d22-4667-4add-a9c2-e6e4f22e0e58 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:04:45.623811 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c8752d22-4667-4add-a9c2-e6e4f22e0e58 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:04:45.627373 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c8752d22-4667-4add-a9c2-e6e4f22e0e58 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:04:45.628101 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c8752d22-4667-4add-a9c2-e6e4f22e0e58 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:04:45.631920 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c8752d22-4667-4add-a9c2-e6e4f22e0e58 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:04:45.704892 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.quota [None req-c8752d22-4667-4add-a9c2-e6e4f22e0e58 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Getting quotas for project 9f0d80988ca941acb8ad4318338dfbea. Resources: {'cores', 'ram', 'instances'} {{(pid=118861) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 20 06:04:45.718655 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.quota [None req-c8752d22-4667-4add-a9c2-e6e4f22e0e58 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Getting quotas for user 57d4cbd2a2154e5d925462df7c77815a and project 9f0d80988ca941acb8ad4318338dfbea. Resources: {'cores', 'ram', 'instances'} {{(pid=118861) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 20 06:04:45.761342 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-c8752d22-4667-4add-a9c2-e6e4f22e0e58 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Going to run 1 instances... {{(pid=118861) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 20 06:04:45.768538 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-c8752d22-4667-4add-a9c2-e6e4f22e0e58 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] [instance: e8e2c461-4b15-42ea-bfc7-1daf1fe15f7f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9fcec276-734d-41d9-905b-10d2bbcbfba5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118861) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 20 06:04:45.908122 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-89075ba1-92c7-49f2-9641-a03dd54438d2 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:04:45.926495 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-c8752d22-4667-4add-a9c2-e6e4f22e0e58 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.163344 Oct 20 06:04:45.927530 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 15/28] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Oct 20 06:04:43 2022] POST /compute/v2.1/servers => generated 383 bytes in 2180 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 20 06:04:45.958322 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-89075ba1-92c7-49f2-9641-a03dd54438d2 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1237 microversion: 2.1 time: 0.578711 Oct 20 06:04:45.961867 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 14/29] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:04:45 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1237 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:04:45.990880 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-cefa486f-ae08-46f1-9904-cef17ae78591 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:04:45.993476 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-cefa486f-ae08-46f1-9904-cef17ae78591 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] [instance: ab6b2605-695c-4ee9-ae33-6234ef22536c] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:04:46.075638 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-cdb7b66a-dfa2-4024-b842-1766b2fe0c95 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Action: 'create', calling method: .version_select at 0x7fbe4b8e5dc0>, body: {"keypair": {"name": "tempest-keypair-994757528", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGikL9VKUEGUTU6XWAR5g/jDeZebEsb/1xcK+56fC8yRP8rGX9LxO5p11Qx5SSGjq+2uQiZuF//8w8kT1NaweRtMCb2fjGOqSRtqOZE/hueSDnB4D4Qz+4HUqLTYzO27gg=="}} {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 06:04:46.114547 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.quota [None req-cdb7b66a-dfa2-4024-b842-1766b2fe0c95 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Getting quotas for project b21953597b4c45059f7f78ac8fdecbee. Resources: {'key_pairs'} {{(pid=118861) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 20 06:04:46.125769 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.quota [None req-cdb7b66a-dfa2-4024-b842-1766b2fe0c95 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Getting quotas for user 6da8a7cb6ef849faad7d7091a1095ab9 and project b21953597b4c45059f7f78ac8fdecbee. Resources: {'key_pairs'} {{(pid=118861) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 20 06:04:46.185551 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-cdb7b66a-dfa2-4024-b842-1766b2fe0c95 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.256425 Oct 20 06:04:46.186668 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 16/30] 10.222.0.20 () {60 vars in 1159 bytes} [Thu Oct 20 06:04:45 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:04:46.201580 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-51301ada-1f0d-49c8-846f-cea9ba3e3845 tempest-VolumesSnapshotsTestJSON-886705292 tempest-VolumesSnapshotsTestJSON-886705292-project] Calling method '.version_select at 0x7fbe4b0104c0>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:04:46.260465 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.wsgi [None req-51301ada-1f0d-49c8-846f-cea9ba3e3845 tempest-VolumesSnapshotsTestJSON-886705292 tempest-VolumesSnapshotsTestJSON-886705292-project] HTTP exception thrown: Volume 2b7ffaaa-2471-4888-93c1-b67b7868013e could not be found. Oct 20 06:04:46.262530 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-51301ada-1f0d-49c8-846f-cea9ba3e3845 tempest-VolumesSnapshotsTestJSON-886705292 tempest-VolumesSnapshotsTestJSON-886705292-project] Request method failure captured: Oct 20 06:04:46.262530 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: request: GET /compute/v2.1/os-volumes/2b7ffaaa-2471-4888-93c1-b67b7868013e HTTP/1.1 Oct 20 06:04:46.262530 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: Accept: application/json Oct 20 06:04:46.262530 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: Accept-Encoding: identity Oct 20 06:04:46.262530 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: Connection: close Oct 20 06:04:46.262530 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: Content-Length: 0 Oct 20 06:04:46.262530 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: Content-Type: application/json Oct 20 06:04:46.262530 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: Host: 10.222.0.20 Oct 20 06:04:46.262530 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: Openstack-System-Scope: None Oct 20 06:04:46.262530 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: User-Agent: python-urllib3/1.26.12 Oct 20 06:04:46.262530 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Auth-Token: gAAAAABjUOTpNk-pZ7qx3MXmt88C4RawsbAprOTW3mmZpvC53Ovlc9B8euHhS3qK5IwzbafgEas-TeHasn9RSCyL4aXcKO5v7MI8xZxh0njUBMPBOQmvGpvKllIRpZCI6UkQyVRCPHu7Goy09NNwlAMFzOWPQ0ZgiB4xnkBN7t0avM7JsICi0_Q Oct 20 06:04:46.262530 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Domain-Id: None Oct 20 06:04:46.262530 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Domain-Name: None Oct 20 06:04:46.262530 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Identity-Status: Confirmed Oct 20 06:04:46.262530 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Is-Admin-Project: True Oct 20 06:04:46.262530 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Project-Domain-Id: default Oct 20 06:04:46.262530 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Project-Domain-Name: Default Oct 20 06:04:46.262530 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Project-Id: 48d87e6406724af3b1330e6f3cc15a28 Oct 20 06:04:46.262530 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-886705292 Oct 20 06:04:46.262530 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Role: reader,member Oct 20 06:04:46.262530 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Roles: reader,member Oct 20 06:04:46.263510 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/48d87e6406724af3b1330e6f3cc15a28"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_48d87e6406724af3b1330e6f3cc15a28"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/48d87e6406724af3b1330e6f3cc15a28"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/48d87e6406724af3b1330e6f3cc15a28"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 20 06:04:46.263510 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Tenant: tempest-VolumesSnapshotsTestJSON-886705292 Oct 20 06:04:46.263510 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Tenant-Id: 48d87e6406724af3b1330e6f3cc15a28 Oct 20 06:04:46.263510 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-886705292 Oct 20 06:04:46.263510 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-User: tempest-VolumesSnapshotsTestJSON-886705292-project Oct 20 06:04:46.263510 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-User-Domain-Id: default Oct 20 06:04:46.263510 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-User-Domain-Name: Default Oct 20 06:04:46.263510 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-User-Id: 870aa823b2e149dba5174fe9f7965a67 Oct 20 06:04:46.263510 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-User-Name: tempest-VolumesSnapshotsTestJSON-886705292-project Oct 20 06:04:46.263510 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: method: Oct 20 06:04:46.263510 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: exception: Volume 2b7ffaaa-2471-4888-93c1-b67b7868013e could not be found. Oct 20 06:04:46.263510 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: action_args: {'id': '2b7ffaaa-2471-4888-93c1-b67b7868013e'} Oct 20 06:04:46.263510 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 20 06:04:46.264132 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 06:04:46.264132 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 20 06:04:46.264132 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 20 06:04:46.264132 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 20 06:04:46.264132 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 20 06:04:46.264132 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 20 06:04:46.264132 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 20 06:04:46.264132 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 20 06:04:46.264132 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 20 06:04:46.264132 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 20 06:04:46.264132 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 20 06:04:46.264132 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 20 06:04:46.264132 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 20 06:04:46.264132 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 20 06:04:46.264132 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 20 06:04:46.264132 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2b7ffaaa-2471-4888-93c1-b67b7868013e could not be found. (HTTP 404) (Request-ID: req-ca519272-cda4-4ba9-9e51-d589559b5fc0) Oct 20 06:04:46.264132 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi Oct 20 06:04:46.264132 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 06:04:46.264132 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi Oct 20 06:04:46.268896 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 06:04:46.268896 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 20 06:04:46.268896 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 20 06:04:46.268896 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 20 06:04:46.268896 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 20 06:04:46.268896 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 20 06:04:46.268896 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 20 06:04:46.268896 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 20 06:04:46.268896 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 20 06:04:46.268896 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 20 06:04:46.268896 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 20 06:04:46.268896 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 20 06:04:46.268896 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 20 06:04:46.268896 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 20 06:04:46.268896 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 20 06:04:46.268896 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 20 06:04:46.268896 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 20 06:04:46.268896 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 20 06:04:46.268896 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 20 06:04:46.270501 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 20 06:04:46.270501 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 20 06:04:46.270501 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 20 06:04:46.270501 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 20 06:04:46.270501 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2b7ffaaa-2471-4888-93c1-b67b7868013e could not be found. Oct 20 06:04:46.270501 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi Oct 20 06:04:46.270501 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 06:04:46.270501 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi Oct 20 06:04:46.270501 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 06:04:46.270501 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 06:04:46.270501 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 06:04:46.270501 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 20 06:04:46.270501 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 20 06:04:46.270501 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 20 06:04:46.270501 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 20 06:04:46.270501 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 20 06:04:46.270501 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 20 06:04:46.270501 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 20 06:04:46.270501 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 20 06:04:46.271341 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2b7ffaaa-2471-4888-93c1-b67b7868013e could not be found. Oct 20 06:04:46.271341 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi Oct 20 06:04:46.271341 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 06:04:46.271341 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi Oct 20 06:04:46.271341 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 06:04:46.271341 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 06:04:46.271341 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 06:04:46.271341 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 20 06:04:46.271341 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 20 06:04:46.271341 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2b7ffaaa-2471-4888-93c1-b67b7868013e could not be found. Oct 20 06:04:46.271341 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi Oct 20 06:04:46.271341 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-51301ada-1f0d-49c8-846f-cea9ba3e3845 tempest-VolumesSnapshotsTestJSON-886705292 tempest-VolumesSnapshotsTestJSON-886705292-project] Returning 404 to user: Volume 2b7ffaaa-2471-4888-93c1-b67b7868013e could not be found. {{(pid=118861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 20 06:04:46.271341 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-51301ada-1f0d-49c8-846f-cea9ba3e3845 tempest-VolumesSnapshotsTestJSON-886705292 tempest-VolumesSnapshotsTestJSON-886705292-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/2b7ffaaa-2471-4888-93c1-b67b7868013e" status: 404 len: 109 microversion: 2.1 time: 0.076104 Oct 20 06:04:46.271341 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 17/31] 10.222.0.20 () {58 vars in 1245 bytes} [Thu Oct 20 06:04:46 2022] GET /compute/v2.1/os-volumes/2b7ffaaa-2471-4888-93c1-b67b7868013e => generated 109 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 20 06:04:46.288661 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-ba68e46f-ec94-4ff1-9644-acc9898b7b90 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:04:46.289123 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-ba68e46f-ec94-4ff1-9644-acc9898b7b90 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] [instance: e8e2c461-4b15-42ea-bfc7-1daf1fe15f7f] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:04:46.365893 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-cefa486f-ae08-46f1-9904-cef17ae78591 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85953d8e7394fb0a6f425ce51420325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72e1785381dd4bdaa2803fa7ef711dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:04:46.379624 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-cefa486f-ae08-46f1-9904-cef17ae78591 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] 10.222.0.20 "GET /compute/v2.1/servers/ab6b2605-695c-4ee9-ae33-6234ef22536c" status: 200 len: 1215 microversion: 2.1 time: 0.412585 Oct 20 06:04:46.381437 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 15/32] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:04:45 2022] GET /compute/v2.1/servers/ab6b2605-695c-4ee9-ae33-6234ef22536c => generated 1215 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:04:46.508610 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-ba68e46f-ec94-4ff1-9644-acc9898b7b90 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d4cbd2a2154e5d925462df7c77815a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0d80988ca941acb8ad4318338dfbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:04:46.520843 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-ba68e46f-ec94-4ff1-9644-acc9898b7b90 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] 10.222.0.20 "GET /compute/v2.1/servers/e8e2c461-4b15-42ea-bfc7-1daf1fe15f7f" status: 200 len: 1222 microversion: 2.1 time: 0.254997 Oct 20 06:04:46.525018 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 18/33] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:04:46 2022] GET /compute/v2.1/servers/e8e2c461-4b15-42ea-bfc7-1daf1fe15f7f => generated 1222 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:04:46.991844 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-8a7f68a5-faa0-40a1-baf1-2472d06b20cf tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:04:46.992480 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-8a7f68a5-faa0-40a1-baf1-2472d06b20cf tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:04:47.001668 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-8a7f68a5-faa0-40a1-baf1-2472d06b20cf tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:04:47.002247 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-8a7f68a5-faa0-40a1-baf1-2472d06b20cf tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:04:47.006917 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-8a7f68a5-faa0-40a1-baf1-2472d06b20cf tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:04:47.007785 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-8a7f68a5-faa0-40a1-baf1-2472d06b20cf tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:04:47.008277 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-8a7f68a5-faa0-40a1-baf1-2472d06b20cf tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:04:47.008772 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-8a7f68a5-faa0-40a1-baf1-2472d06b20cf tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:04:47.381785 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-8a7f68a5-faa0-40a1-baf1-2472d06b20cf tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:04:47.394932 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-8a7f68a5-faa0-40a1-baf1-2472d06b20cf tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1301 microversion: 2.1 time: 0.409437 Oct 20 06:04:47.399087 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 16/34] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:04:46 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1301 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:04:47.417669 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-c1bf1ea4-361b-4f80-a238-1c0161be0da4 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:04:47.418343 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-c1bf1ea4-361b-4f80-a238-1c0161be0da4 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] [instance: ab6b2605-695c-4ee9-ae33-6234ef22536c] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:04:47.440879 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c1bf1ea4-361b-4f80-a238-1c0161be0da4 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:04:47.447418 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c1bf1ea4-361b-4f80-a238-1c0161be0da4 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:04:47.448568 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c1bf1ea4-361b-4f80-a238-1c0161be0da4 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:04:47.450478 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c1bf1ea4-361b-4f80-a238-1c0161be0da4 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:04:47.450720 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c1bf1ea4-361b-4f80-a238-1c0161be0da4 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:04:47.451165 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c1bf1ea4-361b-4f80-a238-1c0161be0da4 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:04:47.547113 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-01f29003-64f2-4c3b-a0ce-2d1351c95889 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:04:47.547890 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-01f29003-64f2-4c3b-a0ce-2d1351c95889 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] [instance: e8e2c461-4b15-42ea-bfc7-1daf1fe15f7f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:04:47.561096 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-01f29003-64f2-4c3b-a0ce-2d1351c95889 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:04:47.562978 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-01f29003-64f2-4c3b-a0ce-2d1351c95889 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:04:47.563534 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-01f29003-64f2-4c3b-a0ce-2d1351c95889 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:04:47.591779 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-01f29003-64f2-4c3b-a0ce-2d1351c95889 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:04:47.594009 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-01f29003-64f2-4c3b-a0ce-2d1351c95889 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:04:47.595744 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-01f29003-64f2-4c3b-a0ce-2d1351c95889 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:04:47.931667 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-c1bf1ea4-361b-4f80-a238-1c0161be0da4 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85953d8e7394fb0a6f425ce51420325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72e1785381dd4bdaa2803fa7ef711dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:04:47.952074 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-c1bf1ea4-361b-4f80-a238-1c0161be0da4 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] 10.222.0.20 "GET /compute/v2.1/servers/ab6b2605-695c-4ee9-ae33-6234ef22536c" status: 200 len: 1211 microversion: 2.1 time: 0.547970 Oct 20 06:04:47.953501 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 19/35] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:04:47 2022] GET /compute/v2.1/servers/ab6b2605-695c-4ee9-ae33-6234ef22536c => generated 1211 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:04:48.093479 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-01f29003-64f2-4c3b-a0ce-2d1351c95889 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d4cbd2a2154e5d925462df7c77815a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0d80988ca941acb8ad4318338dfbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:04:48.106185 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-01f29003-64f2-4c3b-a0ce-2d1351c95889 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] 10.222.0.20 "GET /compute/v2.1/servers/e8e2c461-4b15-42ea-bfc7-1daf1fe15f7f" status: 200 len: 1218 microversion: 2.1 time: 0.563330 Oct 20 06:04:48.121667 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 17/36] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:04:47 2022] GET /compute/v2.1/servers/e8e2c461-4b15-42ea-bfc7-1daf1fe15f7f => generated 1218 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 06:04:48.427781 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-d7db54ce-753e-4a2a-b5d9-cc153b6f502e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:04:48.429143 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-d7db54ce-753e-4a2a-b5d9-cc153b6f502e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:04:48.448356 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d7db54ce-753e-4a2a-b5d9-cc153b6f502e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:04:48.450358 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d7db54ce-753e-4a2a-b5d9-cc153b6f502e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:04:48.451690 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d7db54ce-753e-4a2a-b5d9-cc153b6f502e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:04:48.454265 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d7db54ce-753e-4a2a-b5d9-cc153b6f502e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:04:48.455619 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d7db54ce-753e-4a2a-b5d9-cc153b6f502e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:04:48.456334 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d7db54ce-753e-4a2a-b5d9-cc153b6f502e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:04:48.667031 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-d7db54ce-753e-4a2a-b5d9-cc153b6f502e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:04:48.675991 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-d7db54ce-753e-4a2a-b5d9-cc153b6f502e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1299 microversion: 2.1 time: 0.255598 Oct 20 06:04:48.677149 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 20/37] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:04:48 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1299 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 06:04:48.981486 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-aaab131e-9c1c-4352-90e2-a4b6b81e4adf tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:04:48.982723 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-aaab131e-9c1c-4352-90e2-a4b6b81e4adf tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] [instance: ab6b2605-695c-4ee9-ae33-6234ef22536c] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:04:48.995100 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-aaab131e-9c1c-4352-90e2-a4b6b81e4adf tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:04:48.998457 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-aaab131e-9c1c-4352-90e2-a4b6b81e4adf tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:04:49.000736 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-aaab131e-9c1c-4352-90e2-a4b6b81e4adf tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:04:49.003300 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-aaab131e-9c1c-4352-90e2-a4b6b81e4adf tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:04:49.005133 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-aaab131e-9c1c-4352-90e2-a4b6b81e4adf tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:04:49.005822 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-aaab131e-9c1c-4352-90e2-a4b6b81e4adf tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:04:49.138619 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-4f036fd4-86b7-4095-8e94-16d054df745c tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:04:49.139548 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-4f036fd4-86b7-4095-8e94-16d054df745c tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] [instance: e8e2c461-4b15-42ea-bfc7-1daf1fe15f7f] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:04:49.191225 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4f036fd4-86b7-4095-8e94-16d054df745c tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:04:49.200879 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4f036fd4-86b7-4095-8e94-16d054df745c tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:04:49.205407 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4f036fd4-86b7-4095-8e94-16d054df745c tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:04:49.211160 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4f036fd4-86b7-4095-8e94-16d054df745c tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:04:49.214924 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4f036fd4-86b7-4095-8e94-16d054df745c tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:04:49.219823 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4f036fd4-86b7-4095-8e94-16d054df745c tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:04:49.701231 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-aaab131e-9c1c-4352-90e2-a4b6b81e4adf tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85953d8e7394fb0a6f425ce51420325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72e1785381dd4bdaa2803fa7ef711dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:04:49.729953 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-aaab131e-9c1c-4352-90e2-a4b6b81e4adf tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] 10.222.0.20 "GET /compute/v2.1/servers/ab6b2605-695c-4ee9-ae33-6234ef22536c" status: 200 len: 1267 microversion: 2.1 time: 0.755105 Oct 20 06:04:49.740871 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 18/38] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:04:48 2022] GET /compute/v2.1/servers/ab6b2605-695c-4ee9-ae33-6234ef22536c => generated 1267 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:04:49.765117 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-56483a2b-f3ae-4acf-bcdd-d255bcb20893 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-646662447", "imageRef": "9fcec276-734d-41d9-905b-10d2bbcbfba5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9c4850fd-a976-4360-b16b-9fd1520b1b08"}], "security_groups": [{"name": "tempest-securitygroup--2090748038"}], "key_name": "tempest-keypair-530646533", "user_data": "}} {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 06:04:50.293981 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-4f036fd4-86b7-4095-8e94-16d054df745c tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d4cbd2a2154e5d925462df7c77815a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0d80988ca941acb8ad4318338dfbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:04:50.306520 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-4f036fd4-86b7-4095-8e94-16d054df745c tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] 10.222.0.20 "GET /compute/v2.1/servers/e8e2c461-4b15-42ea-bfc7-1daf1fe15f7f" status: 200 len: 1274 microversion: 2.1 time: 1.175198 Oct 20 06:04:50.323457 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 21/39] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:04:49 2022] GET /compute/v2.1/servers/e8e2c461-4b15-42ea-bfc7-1daf1fe15f7f => generated 1274 bytes in 1193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 06:04:50.331721 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-a1f9d1d7-c655-4f6a-bb60-15130eba8165 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:04:50.333781 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-a1f9d1d7-c655-4f6a-bb60-15130eba8165 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:04:50.343084 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a1f9d1d7-c655-4f6a-bb60-15130eba8165 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:04:50.343985 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a1f9d1d7-c655-4f6a-bb60-15130eba8165 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:04:50.344655 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a1f9d1d7-c655-4f6a-bb60-15130eba8165 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:04:50.345719 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a1f9d1d7-c655-4f6a-bb60-15130eba8165 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:04:50.346326 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a1f9d1d7-c655-4f6a-bb60-15130eba8165 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:04:50.346946 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a1f9d1d7-c655-4f6a-bb60-15130eba8165 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:04:50.594873 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.network.neutron [None req-56483a2b-f3ae-4acf-bcdd-d255bcb20893 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] validate_networks() for [('9c4850fd-a976-4360-b16b-9fd1520b1b08', None, None, None, None, None)] {{(pid=118860) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 20 06:04:50.664890 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-a1f9d1d7-c655-4f6a-bb60-15130eba8165 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:04:50.680528 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-a1f9d1d7-c655-4f6a-bb60-15130eba8165 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1299 microversion: 2.1 time: 0.350933 Oct 20 06:04:50.682653 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 22/40] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:04:50 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1299 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:04:50.761325 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-ff3ef09a-b2be-4bb4-a692-761b19533e4c tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:04:50.762203 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-ff3ef09a-b2be-4bb4-a692-761b19533e4c tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] [instance: ab6b2605-695c-4ee9-ae33-6234ef22536c] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:04:50.775800 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ff3ef09a-b2be-4bb4-a692-761b19533e4c tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:04:50.780205 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ff3ef09a-b2be-4bb4-a692-761b19533e4c tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:04:50.781634 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ff3ef09a-b2be-4bb4-a692-761b19533e4c tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:04:50.786717 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ff3ef09a-b2be-4bb4-a692-761b19533e4c tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:04:50.787694 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ff3ef09a-b2be-4bb4-a692-761b19533e4c tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:04:50.789779 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ff3ef09a-b2be-4bb4-a692-761b19533e4c tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:04:50.969673 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-ff3ef09a-b2be-4bb4-a692-761b19533e4c tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85953d8e7394fb0a6f425ce51420325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72e1785381dd4bdaa2803fa7ef711dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:04:50.992062 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-ff3ef09a-b2be-4bb4-a692-761b19533e4c tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] 10.222.0.20 "GET /compute/v2.1/servers/ab6b2605-695c-4ee9-ae33-6234ef22536c" status: 200 len: 1273 microversion: 2.1 time: 0.232595 Oct 20 06:04:50.996502 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 23/41] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:04:50 2022] GET /compute/v2.1/servers/ab6b2605-695c-4ee9-ae33-6234ef22536c => generated 1273 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 06:04:51.340647 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-f40e954a-9f0f-4b10-ae55-8fc08a63f53c tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:04:51.341556 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-f40e954a-9f0f-4b10-ae55-8fc08a63f53c tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] [instance: e8e2c461-4b15-42ea-bfc7-1daf1fe15f7f] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:04:51.367073 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f40e954a-9f0f-4b10-ae55-8fc08a63f53c tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:04:51.368355 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f40e954a-9f0f-4b10-ae55-8fc08a63f53c tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:04:51.372061 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f40e954a-9f0f-4b10-ae55-8fc08a63f53c tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:04:51.373049 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f40e954a-9f0f-4b10-ae55-8fc08a63f53c tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:04:51.375918 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f40e954a-9f0f-4b10-ae55-8fc08a63f53c tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:04:51.380358 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f40e954a-9f0f-4b10-ae55-8fc08a63f53c tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:04:51.585099 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-f40e954a-9f0f-4b10-ae55-8fc08a63f53c tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d4cbd2a2154e5d925462df7c77815a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0d80988ca941acb8ad4318338dfbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:04:51.618596 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-f40e954a-9f0f-4b10-ae55-8fc08a63f53c tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] 10.222.0.20 "GET /compute/v2.1/servers/e8e2c461-4b15-42ea-bfc7-1daf1fe15f7f" status: 200 len: 1280 microversion: 2.1 time: 0.276223 Oct 20 06:04:51.619228 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 24/42] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:04:51 2022] GET /compute/v2.1/servers/e8e2c461-4b15-42ea-bfc7-1daf1fe15f7f => generated 1280 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:04:51.708283 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-a33af0f3-0b57-428d-8f12-927331f04542 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:04:51.709424 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-a33af0f3-0b57-428d-8f12-927331f04542 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:04:51.715818 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a33af0f3-0b57-428d-8f12-927331f04542 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:04:51.719894 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a33af0f3-0b57-428d-8f12-927331f04542 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:04:51.722201 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a33af0f3-0b57-428d-8f12-927331f04542 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:04:51.723174 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a33af0f3-0b57-428d-8f12-927331f04542 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:04:51.727768 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a33af0f3-0b57-428d-8f12-927331f04542 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:04:51.728359 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a33af0f3-0b57-428d-8f12-927331f04542 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:04:52.493058 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-a33af0f3-0b57-428d-8f12-927331f04542 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:04:52.503271 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-a33af0f3-0b57-428d-8f12-927331f04542 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1366 microversion: 2.1 time: 0.799695 Oct 20 06:04:52.525236 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 25/43] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:04:51 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1366 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:04:52.530861 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-f58431d9-e209-4966-b34d-ef7dee5f93e0 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:04:52.538395 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-f58431d9-e209-4966-b34d-ef7dee5f93e0 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] [instance: ab6b2605-695c-4ee9-ae33-6234ef22536c] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:04:52.550842 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f58431d9-e209-4966-b34d-ef7dee5f93e0 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:04:52.553417 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f58431d9-e209-4966-b34d-ef7dee5f93e0 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:04:52.554128 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f58431d9-e209-4966-b34d-ef7dee5f93e0 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:04:52.556883 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f58431d9-e209-4966-b34d-ef7dee5f93e0 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:04:52.557619 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f58431d9-e209-4966-b34d-ef7dee5f93e0 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:04:52.558894 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f58431d9-e209-4966-b34d-ef7dee5f93e0 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:04:53.099143 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-f58431d9-e209-4966-b34d-ef7dee5f93e0 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85953d8e7394fb0a6f425ce51420325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72e1785381dd4bdaa2803fa7ef711dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:04:53.108327 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-f58431d9-e209-4966-b34d-ef7dee5f93e0 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] 10.222.0.20 "GET /compute/v2.1/servers/ab6b2605-695c-4ee9-ae33-6234ef22536c" status: 200 len: 1273 microversion: 2.1 time: 0.581499 Oct 20 06:04:53.130429 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 26/44] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:04:52 2022] GET /compute/v2.1/servers/ab6b2605-695c-4ee9-ae33-6234ef22536c => generated 1273 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:04:53.140351 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-ed7b0185-ea89-49e1-ba62-6f2d8e31cedb tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:04:53.142217 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-ed7b0185-ea89-49e1-ba62-6f2d8e31cedb tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] [instance: e8e2c461-4b15-42ea-bfc7-1daf1fe15f7f] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:04:53.165387 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ed7b0185-ea89-49e1-ba62-6f2d8e31cedb tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:04:53.166202 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ed7b0185-ea89-49e1-ba62-6f2d8e31cedb tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:04:53.166829 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ed7b0185-ea89-49e1-ba62-6f2d8e31cedb tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:04:53.167743 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ed7b0185-ea89-49e1-ba62-6f2d8e31cedb tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:04:53.168653 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ed7b0185-ea89-49e1-ba62-6f2d8e31cedb tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:04:53.169339 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ed7b0185-ea89-49e1-ba62-6f2d8e31cedb tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:04:53.558375 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-ed7b0185-ea89-49e1-ba62-6f2d8e31cedb tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d4cbd2a2154e5d925462df7c77815a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0d80988ca941acb8ad4318338dfbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:04:53.580006 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-ed7b0185-ea89-49e1-ba62-6f2d8e31cedb tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] 10.222.0.20 "GET /compute/v2.1/servers/e8e2c461-4b15-42ea-bfc7-1daf1fe15f7f" status: 200 len: 1280 microversion: 2.1 time: 0.446021 Oct 20 06:04:53.581474 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 27/45] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:04:53 2022] GET /compute/v2.1/servers/e8e2c461-4b15-42ea-bfc7-1daf1fe15f7f => generated 1280 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:04:53.596258 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-de0c0c64-4c2e-49a8-b74f-aa610d90f2b2 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:04:53.602037 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-de0c0c64-4c2e-49a8-b74f-aa610d90f2b2 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:04:53.627782 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-de0c0c64-4c2e-49a8-b74f-aa610d90f2b2 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:04:53.630414 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-de0c0c64-4c2e-49a8-b74f-aa610d90f2b2 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:04:53.631076 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-de0c0c64-4c2e-49a8-b74f-aa610d90f2b2 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:04:53.635055 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-de0c0c64-4c2e-49a8-b74f-aa610d90f2b2 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:04:53.637724 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-de0c0c64-4c2e-49a8-b74f-aa610d90f2b2 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:04:53.639152 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-de0c0c64-4c2e-49a8-b74f-aa610d90f2b2 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:04:53.842189 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.virt.hardware [None req-56483a2b-f3ae-4acf-bcdd-d255bcb20893 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Flavor limits 0:0:0 {{(pid=118860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 20 06:04:53.842731 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.virt.hardware [None req-56483a2b-f3ae-4acf-bcdd-d255bcb20893 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Image limits 0:0:0 {{(pid=118860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 20 06:04:53.843090 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.virt.hardware [None req-56483a2b-f3ae-4acf-bcdd-d255bcb20893 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Flavor pref 0:0:0 {{(pid=118860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 20 06:04:53.843771 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.virt.hardware [None req-56483a2b-f3ae-4acf-bcdd-d255bcb20893 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Image pref 0:0:0 {{(pid=118860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 20 06:04:53.843936 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.virt.hardware [None req-56483a2b-f3ae-4acf-bcdd-d255bcb20893 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 20 06:04:53.864242 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-56483a2b-f3ae-4acf-bcdd-d255bcb20893 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:04:53.864839 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-56483a2b-f3ae-4acf-bcdd-d255bcb20893 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:04:53.865293 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-56483a2b-f3ae-4acf-bcdd-d255bcb20893 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:04:53.870266 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-56483a2b-f3ae-4acf-bcdd-d255bcb20893 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:04:53.870784 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-56483a2b-f3ae-4acf-bcdd-d255bcb20893 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:04:53.871232 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-56483a2b-f3ae-4acf-bcdd-d255bcb20893 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:04:53.919774 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.quota [None req-56483a2b-f3ae-4acf-bcdd-d255bcb20893 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Getting quotas for project 66a33a727f9c40b99fb14bd2e0fc5090. Resources: {'cores', 'ram', 'instances'} {{(pid=118860) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 20 06:04:53.950616 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.quota [None req-56483a2b-f3ae-4acf-bcdd-d255bcb20893 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Getting quotas for user db34ffc8f90247daac1548bbb421b015 and project 66a33a727f9c40b99fb14bd2e0fc5090. Resources: {'cores', 'ram', 'instances'} {{(pid=118860) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 20 06:04:53.967986 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-56483a2b-f3ae-4acf-bcdd-d255bcb20893 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Going to run 1 instances... {{(pid=118860) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 20 06:04:53.992478 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-56483a2b-f3ae-4acf-bcdd-d255bcb20893 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9fcec276-734d-41d9-905b-10d2bbcbfba5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118860) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 20 06:04:54.118571 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-56483a2b-f3ae-4acf-bcdd-d255bcb20893 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 4.374511 Oct 20 06:04:54.127528 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 19/46] 10.222.0.20 () {62 vars in 1188 bytes} [Thu Oct 20 06:04:49 2022] POST /compute/v2.1/servers => generated 402 bytes in 4386 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 20 06:04:54.155065 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-3e0c9d37-cd6c-4a46-9350-a7548342e858 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-352000794", "imageRef": "9fcec276-734d-41d9-905b-10d2bbcbfba5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "80bcba85-6a9c-4514-8c39-a60c7b6c80a5"}], "security_groups": [{"name": "tempest-securitygroup--407543573"}], "key_name": "tempest-keypair-994757528", "user_data": "}} {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 06:04:54.870185 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-de0c0c64-4c2e-49a8-b74f-aa610d90f2b2 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:04:54.887980 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-de0c0c64-4c2e-49a8-b74f-aa610d90f2b2 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1366 microversion: 2.1 time: 1.301478 Oct 20 06:04:54.897725 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 28/47] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:04:53 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1366 bytes in 1315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:04:54.925515 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-0e6378ba-f0ae-4213-a665-5a6884e43f37 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:04:54.929154 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-0e6378ba-f0ae-4213-a665-5a6884e43f37 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:04:54.986643 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.network.neutron [None req-3e0c9d37-cd6c-4a46-9350-a7548342e858 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] validate_networks() for [('80bcba85-6a9c-4514-8c39-a60c7b6c80a5', None, None, None, None, None)] {{(pid=118860) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 20 06:04:55.183120 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-0e6378ba-f0ae-4213-a665-5a6884e43f37 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:04:55.192417 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-0e6378ba-f0ae-4213-a665-5a6884e43f37 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:04:55.199150 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-0e6378ba-f0ae-4213-a665-5a6884e43f37 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:04:55.205658 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-0e6378ba-f0ae-4213-a665-5a6884e43f37 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1280 microversion: 2.20 time: 0.289830 Oct 20 06:04:55.212922 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 29/48] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:04:54 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1280 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:04:55.222350 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-37c7ca38-1872-4502-88cf-ab409c476086 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:04:55.237991 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-37c7ca38-1872-4502-88cf-ab409c476086 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] [instance: ab6b2605-695c-4ee9-ae33-6234ef22536c] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:04:55.253137 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-37c7ca38-1872-4502-88cf-ab409c476086 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:04:55.255426 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-37c7ca38-1872-4502-88cf-ab409c476086 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:04:55.257790 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-37c7ca38-1872-4502-88cf-ab409c476086 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:04:55.261197 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-37c7ca38-1872-4502-88cf-ab409c476086 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:04:55.262476 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-37c7ca38-1872-4502-88cf-ab409c476086 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:04:55.264534 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-37c7ca38-1872-4502-88cf-ab409c476086 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:04:55.568663 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-37c7ca38-1872-4502-88cf-ab409c476086 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85953d8e7394fb0a6f425ce51420325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72e1785381dd4bdaa2803fa7ef711dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:04:55.581155 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-37c7ca38-1872-4502-88cf-ab409c476086 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] 10.222.0.20 "GET /compute/v2.1/servers/ab6b2605-695c-4ee9-ae33-6234ef22536c" status: 200 len: 1273 microversion: 2.1 time: 0.361836 Oct 20 06:04:55.583611 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 30/49] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:04:55 2022] GET /compute/v2.1/servers/ab6b2605-695c-4ee9-ae33-6234ef22536c => generated 1273 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:04:55.599671 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-17691e71-0b5a-4904-ac83-81998c85c994 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:04:55.605450 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-17691e71-0b5a-4904-ac83-81998c85c994 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] [instance: e8e2c461-4b15-42ea-bfc7-1daf1fe15f7f] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:04:55.623822 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-17691e71-0b5a-4904-ac83-81998c85c994 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:04:55.627459 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-17691e71-0b5a-4904-ac83-81998c85c994 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:04:55.628676 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-17691e71-0b5a-4904-ac83-81998c85c994 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:04:55.631309 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-17691e71-0b5a-4904-ac83-81998c85c994 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:04:55.632032 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-17691e71-0b5a-4904-ac83-81998c85c994 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:04:55.633653 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-17691e71-0b5a-4904-ac83-81998c85c994 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:04:55.664837 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG dbcounter [-] [118861] Writing DB stats nova_cell0:SELECT=4 {{(pid=118861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:04:55.857452 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-17691e71-0b5a-4904-ac83-81998c85c994 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d4cbd2a2154e5d925462df7c77815a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0d80988ca941acb8ad4318338dfbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:04:55.872513 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-17691e71-0b5a-4904-ac83-81998c85c994 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] 10.222.0.20 "GET /compute/v2.1/servers/e8e2c461-4b15-42ea-bfc7-1daf1fe15f7f" status: 200 len: 1280 microversion: 2.1 time: 0.287588 Oct 20 06:04:55.874172 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 31/50] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:04:55 2022] GET /compute/v2.1/servers/e8e2c461-4b15-42ea-bfc7-1daf1fe15f7f => generated 1280 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:04:55.932030 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-7fa0be13-8694-41df-af0a-6d45d6524d7b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:04:55.933138 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-7fa0be13-8694-41df-af0a-6d45d6524d7b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:04:55.940180 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7fa0be13-8694-41df-af0a-6d45d6524d7b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:04:55.940941 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7fa0be13-8694-41df-af0a-6d45d6524d7b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:04:55.941537 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7fa0be13-8694-41df-af0a-6d45d6524d7b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:04:55.943542 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7fa0be13-8694-41df-af0a-6d45d6524d7b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:04:55.946565 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7fa0be13-8694-41df-af0a-6d45d6524d7b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:04:55.947217 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7fa0be13-8694-41df-af0a-6d45d6524d7b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:04:56.356517 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-7fa0be13-8694-41df-af0a-6d45d6524d7b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:04:56.375467 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-7fa0be13-8694-41df-af0a-6d45d6524d7b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1366 microversion: 2.1 time: 0.453552 Oct 20 06:04:56.376685 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 32/51] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:04:55 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1366 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:04:56.396050 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-c14f279e-9dfd-4690-aefe-5d47776bc302 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:04:56.396668 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-c14f279e-9dfd-4690-aefe-5d47776bc302 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:04:56.410782 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c14f279e-9dfd-4690-aefe-5d47776bc302 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:04:56.417436 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c14f279e-9dfd-4690-aefe-5d47776bc302 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:04:56.417436 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c14f279e-9dfd-4690-aefe-5d47776bc302 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:04:56.417436 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c14f279e-9dfd-4690-aefe-5d47776bc302 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:04:56.417436 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c14f279e-9dfd-4690-aefe-5d47776bc302 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:04:56.417799 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c14f279e-9dfd-4690-aefe-5d47776bc302 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:04:56.571608 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-c14f279e-9dfd-4690-aefe-5d47776bc302 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:04:56.596103 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-c14f279e-9dfd-4690-aefe-5d47776bc302 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:04:56.597571 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-c14f279e-9dfd-4690-aefe-5d47776bc302 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:04:56.598954 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-c14f279e-9dfd-4690-aefe-5d47776bc302 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1332 microversion: 2.20 time: 0.221173 Oct 20 06:04:56.615189 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 33/52] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:04:56 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1332 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:04:56.629905 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-b2aa617c-855a-4033-a117-c23500522488 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:04:56.635424 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-b2aa617c-855a-4033-a117-c23500522488 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] [instance: ab6b2605-695c-4ee9-ae33-6234ef22536c] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:04:56.655448 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG dbcounter [-] [118861] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=118861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:04:56.657156 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b2aa617c-855a-4033-a117-c23500522488 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:04:56.660209 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b2aa617c-855a-4033-a117-c23500522488 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:04:56.662739 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b2aa617c-855a-4033-a117-c23500522488 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:04:56.666727 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b2aa617c-855a-4033-a117-c23500522488 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:04:56.667385 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b2aa617c-855a-4033-a117-c23500522488 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:04:56.668086 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b2aa617c-855a-4033-a117-c23500522488 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:04:57.734960 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-b2aa617c-855a-4033-a117-c23500522488 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85953d8e7394fb0a6f425ce51420325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72e1785381dd4bdaa2803fa7ef711dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:04:57.744348 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-b2aa617c-855a-4033-a117-c23500522488 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] 10.222.0.20 "GET /compute/v2.1/servers/ab6b2605-695c-4ee9-ae33-6234ef22536c" status: 200 len: 1315 microversion: 2.1 time: 1.127839 Oct 20 06:04:57.764816 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 34/53] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:04:56 2022] GET /compute/v2.1/servers/ab6b2605-695c-4ee9-ae33-6234ef22536c => generated 1315 bytes in 1149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:04:57.775057 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-7fce168c-cb11-4c78-bb38-46ec6e3a3c57 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:04:57.788188 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-7fce168c-cb11-4c78-bb38-46ec6e3a3c57 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] [instance: e8e2c461-4b15-42ea-bfc7-1daf1fe15f7f] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:04:57.810052 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7fce168c-cb11-4c78-bb38-46ec6e3a3c57 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:04:57.810665 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7fce168c-cb11-4c78-bb38-46ec6e3a3c57 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:04:57.811268 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7fce168c-cb11-4c78-bb38-46ec6e3a3c57 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:04:57.812011 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7fce168c-cb11-4c78-bb38-46ec6e3a3c57 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:04:57.812465 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7fce168c-cb11-4c78-bb38-46ec6e3a3c57 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:04:57.812913 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7fce168c-cb11-4c78-bb38-46ec6e3a3c57 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:04:59.293561 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-7fce168c-cb11-4c78-bb38-46ec6e3a3c57 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d4cbd2a2154e5d925462df7c77815a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0d80988ca941acb8ad4318338dfbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:04:59.297457 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG dbcounter [-] [118861] Writing DB stats nova_cell1:SELECT=100 {{(pid=118861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:04:59.311110 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-7fce168c-cb11-4c78-bb38-46ec6e3a3c57 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] 10.222.0.20 "GET /compute/v2.1/servers/e8e2c461-4b15-42ea-bfc7-1daf1fe15f7f" status: 200 len: 1322 microversion: 2.1 time: 1.543162 Oct 20 06:04:59.322668 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 35/54] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:04:57 2022] GET /compute/v2.1/servers/e8e2c461-4b15-42ea-bfc7-1daf1fe15f7f => generated 1322 bytes in 1557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:04:59.334515 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-5c65773b-7c9d-4510-88e1-552d2837d466 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:04:59.338682 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-5c65773b-7c9d-4510-88e1-552d2837d466 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:04:59.359590 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5c65773b-7c9d-4510-88e1-552d2837d466 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:04:59.364591 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5c65773b-7c9d-4510-88e1-552d2837d466 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:04:59.365136 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5c65773b-7c9d-4510-88e1-552d2837d466 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:04:59.365901 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5c65773b-7c9d-4510-88e1-552d2837d466 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:04:59.366371 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5c65773b-7c9d-4510-88e1-552d2837d466 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:04:59.366805 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5c65773b-7c9d-4510-88e1-552d2837d466 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:04:59.452270 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.virt.hardware [None req-3e0c9d37-cd6c-4a46-9350-a7548342e858 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Flavor limits 0:0:0 {{(pid=118860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 20 06:04:59.454611 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.virt.hardware [None req-3e0c9d37-cd6c-4a46-9350-a7548342e858 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Image limits 0:0:0 {{(pid=118860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 20 06:04:59.455429 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.virt.hardware [None req-3e0c9d37-cd6c-4a46-9350-a7548342e858 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Flavor pref 0:0:0 {{(pid=118860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 20 06:04:59.456198 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.virt.hardware [None req-3e0c9d37-cd6c-4a46-9350-a7548342e858 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Image pref 0:0:0 {{(pid=118860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 20 06:04:59.456864 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.virt.hardware [None req-3e0c9d37-cd6c-4a46-9350-a7548342e858 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 20 06:04:59.469618 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG dbcounter [-] [118860] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=10 {{(pid=118860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:04:59.490765 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG dbcounter [-] [118860] Writing DB stats nova_cell0:SELECT=27 {{(pid=118860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:04:59.513370 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3e0c9d37-cd6c-4a46-9350-a7548342e858 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:04:59.513370 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3e0c9d37-cd6c-4a46-9350-a7548342e858 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:04:59.513370 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3e0c9d37-cd6c-4a46-9350-a7548342e858 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:04:59.523244 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3e0c9d37-cd6c-4a46-9350-a7548342e858 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:04:59.526362 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3e0c9d37-cd6c-4a46-9350-a7548342e858 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:04:59.526843 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3e0c9d37-cd6c-4a46-9350-a7548342e858 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:04:59.610106 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.quota [None req-3e0c9d37-cd6c-4a46-9350-a7548342e858 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Getting quotas for project b21953597b4c45059f7f78ac8fdecbee. Resources: {'cores', 'ram', 'instances'} {{(pid=118860) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 20 06:04:59.627004 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.quota [None req-3e0c9d37-cd6c-4a46-9350-a7548342e858 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Getting quotas for user 6da8a7cb6ef849faad7d7091a1095ab9 and project b21953597b4c45059f7f78ac8fdecbee. Resources: {'cores', 'ram', 'instances'} {{(pid=118860) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 20 06:04:59.667300 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-3e0c9d37-cd6c-4a46-9350-a7548342e858 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Going to run 1 instances... {{(pid=118860) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 20 06:04:59.673416 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-3e0c9d37-cd6c-4a46-9350-a7548342e858 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9fcec276-734d-41d9-905b-10d2bbcbfba5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118860) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 20 06:04:59.847047 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-3e0c9d37-cd6c-4a46-9350-a7548342e858 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 5.710568 Oct 20 06:04:59.851381 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 20/55] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Oct 20 06:04:54 2022] POST /compute/v2.1/servers => generated 401 bytes in 5723 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 20 06:04:59.876208 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-f78f5c80-07b1-4ddb-96c8-4a98cc2a3781 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:04:59.900063 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-f78f5c80-07b1-4ddb-96c8-4a98cc2a3781 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:04:59.932337 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f78f5c80-07b1-4ddb-96c8-4a98cc2a3781 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:04:59.936974 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f78f5c80-07b1-4ddb-96c8-4a98cc2a3781 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:04:59.942440 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f78f5c80-07b1-4ddb-96c8-4a98cc2a3781 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:04:59.943303 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f78f5c80-07b1-4ddb-96c8-4a98cc2a3781 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:04:59.943790 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f78f5c80-07b1-4ddb-96c8-4a98cc2a3781 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:04:59.944225 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f78f5c80-07b1-4ddb-96c8-4a98cc2a3781 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:00.434812 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-5c65773b-7c9d-4510-88e1-552d2837d466 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:05:00.446353 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-5c65773b-7c9d-4510-88e1-552d2837d466 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1366 microversion: 2.1 time: 1.122118 Oct 20 06:05:00.447267 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 36/56] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:04:59 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1366 bytes in 1124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:05:00.773271 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-f78f5c80-07b1-4ddb-96c8-4a98cc2a3781 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:05:00.795703 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-f78f5c80-07b1-4ddb-96c8-4a98cc2a3781 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:05:00.797821 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-f78f5c80-07b1-4ddb-96c8-4a98cc2a3781 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:05:00.799158 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-f78f5c80-07b1-4ddb-96c8-4a98cc2a3781 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1338 microversion: 2.20 time: 0.945608 Oct 20 06:05:00.800537 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 21/57] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:04:59 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1338 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:05:00.816589 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-4f5f90e3-f4a0-4028-9026-dbeaf60fd977 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:05:00.821650 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-4f5f90e3-f4a0-4028-9026-dbeaf60fd977 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] [instance: ab6b2605-695c-4ee9-ae33-6234ef22536c] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:05:00.837321 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-4f5f90e3-f4a0-4028-9026-dbeaf60fd977 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:00.842700 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-4f5f90e3-f4a0-4028-9026-dbeaf60fd977 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:00.844599 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-4f5f90e3-f4a0-4028-9026-dbeaf60fd977 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:00.846580 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-4f5f90e3-f4a0-4028-9026-dbeaf60fd977 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:00.851748 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-4f5f90e3-f4a0-4028-9026-dbeaf60fd977 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:00.852357 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-4f5f90e3-f4a0-4028-9026-dbeaf60fd977 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:01.010703 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [req-9ff810f2-d36f-4b34-a000-2460e583e3c0 req-991de08f-533d-4f03-bb43-ba4fdbae5b83 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4ba366c-2f51-44e0-b5da-c838e4672533", "tag": "943f88da-f813-40be-a9ed-2fe73f75124f"}]} {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 06:05:01.034995 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [req-9ff810f2-d36f-4b34-a000-2460e583e3c0 req-991de08f-533d-4f03-bb43-ba4fdbae5b83 service nova] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:01.035797 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [req-9ff810f2-d36f-4b34-a000-2460e583e3c0 req-991de08f-533d-4f03-bb43-ba4fdbae5b83 service nova] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:01.036247 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [req-9ff810f2-d36f-4b34-a000-2460e583e3c0 req-991de08f-533d-4f03-bb43-ba4fdbae5b83 service nova] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:01.080059 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.compute.server_external_events [req-9ff810f2-d36f-4b34-a000-2460e583e3c0 req-991de08f-533d-4f03-bb43-ba4fdbae5b83 service nova] Creating event network-changed:943f88da-f813-40be-a9ed-2fe73f75124f for instance d4ba366c-2f51-44e0-b5da-c838e4672533 on hv-cinder-86156 Oct 20 06:05:01.080759 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [req-9ff810f2-d36f-4b34-a000-2460e583e3c0 req-991de08f-533d-4f03-bb43-ba4fdbae5b83 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=118861) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 20 06:05:01.081161 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [req-9ff810f2-d36f-4b34-a000-2460e583e3c0 req-991de08f-533d-4f03-bb43-ba4fdbae5b83 service nova] Acquired lock "compute-rpcapi-router" {{(pid=118861) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 20 06:05:01.082779 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-00311925-9c09-44d2-ba7c-ac9afb675a2d None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:01.085743 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-00311925-9c09-44d2-ba7c-ac9afb675a2d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:01.086198 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-00311925-9c09-44d2-ba7c-ac9afb675a2d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:01.092338 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-00311925-9c09-44d2-ba7c-ac9afb675a2d None None] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:01.093030 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-00311925-9c09-44d2-ba7c-ac9afb675a2d None None] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:01.094324 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-00311925-9c09-44d2-ba7c-ac9afb675a2d None None] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:01.111852 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.compute.rpcapi [None req-00311925-9c09-44d2-ba7c-ac9afb675a2d None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 20 06:05:01.113061 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-00311925-9c09-44d2-ba7c-ac9afb675a2d None None] Releasing lock "compute-rpcapi-router" {{(pid=118861) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 20 06:05:01.136101 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-00311925-9c09-44d2-ba7c-ac9afb675a2d None None] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.682683 Oct 20 06:05:01.137225 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 37/58] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 20 06:05:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:05:01.161844 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-595194f9-5389-4195-b195-0efce1680dfe tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:05:01.162810 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-595194f9-5389-4195-b195-0efce1680dfe tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:05:01.170960 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-595194f9-5389-4195-b195-0efce1680dfe tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:01.171628 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-595194f9-5389-4195-b195-0efce1680dfe tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:01.172393 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-595194f9-5389-4195-b195-0efce1680dfe tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:01.173309 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-595194f9-5389-4195-b195-0efce1680dfe tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:01.173919 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-595194f9-5389-4195-b195-0efce1680dfe tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:01.174558 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-595194f9-5389-4195-b195-0efce1680dfe tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:01.281053 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-595194f9-5389-4195-b195-0efce1680dfe tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:05:01.313134 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-595194f9-5389-4195-b195-0efce1680dfe tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1240 microversion: 2.1 time: 0.166893 Oct 20 06:05:01.314889 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 38/59] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:05:01 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1240 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:05:01.329893 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-1241da18-eaff-456e-a79b-f893c57edeef tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:05:01.330888 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-1241da18-eaff-456e-a79b-f893c57edeef tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] [instance: e8e2c461-4b15-42ea-bfc7-1daf1fe15f7f] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:05:01.350881 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1241da18-eaff-456e-a79b-f893c57edeef tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:01.351168 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1241da18-eaff-456e-a79b-f893c57edeef tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:01.351860 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1241da18-eaff-456e-a79b-f893c57edeef tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:01.353021 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1241da18-eaff-456e-a79b-f893c57edeef tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:01.353650 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1241da18-eaff-456e-a79b-f893c57edeef tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:01.354292 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1241da18-eaff-456e-a79b-f893c57edeef tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:01.355694 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-4f5f90e3-f4a0-4028-9026-dbeaf60fd977 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85953d8e7394fb0a6f425ce51420325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72e1785381dd4bdaa2803fa7ef711dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:05:01.377321 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-4f5f90e3-f4a0-4028-9026-dbeaf60fd977 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] 10.222.0.20 "GET /compute/v2.1/servers/ab6b2605-695c-4ee9-ae33-6234ef22536c" status: 200 len: 1315 microversion: 2.1 time: 0.570742 Oct 20 06:05:01.380933 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 22/60] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:05:00 2022] GET /compute/v2.1/servers/ab6b2605-695c-4ee9-ae33-6234ef22536c => generated 1315 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:05:01.478860 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-89088e2d-8e28-40a9-b585-9c4cf24bb61b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:05:01.479688 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-89088e2d-8e28-40a9-b585-9c4cf24bb61b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:05:01.487240 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-89088e2d-8e28-40a9-b585-9c4cf24bb61b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:01.497112 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-89088e2d-8e28-40a9-b585-9c4cf24bb61b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:01.498904 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-89088e2d-8e28-40a9-b585-9c4cf24bb61b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:01.499793 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-89088e2d-8e28-40a9-b585-9c4cf24bb61b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:01.503603 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-89088e2d-8e28-40a9-b585-9c4cf24bb61b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:01.504537 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-89088e2d-8e28-40a9-b585-9c4cf24bb61b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:01.662366 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-1241da18-eaff-456e-a79b-f893c57edeef tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d4cbd2a2154e5d925462df7c77815a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0d80988ca941acb8ad4318338dfbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:05:01.683411 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-1241da18-eaff-456e-a79b-f893c57edeef tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] 10.222.0.20 "GET /compute/v2.1/servers/e8e2c461-4b15-42ea-bfc7-1daf1fe15f7f" status: 200 len: 1322 microversion: 2.1 time: 0.363180 Oct 20 06:05:01.689344 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 39/61] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:05:01 2022] GET /compute/v2.1/servers/e8e2c461-4b15-42ea-bfc7-1daf1fe15f7f => generated 1322 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:05:01.826839 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-c09d123f-dec8-4448-a3f0-43cff2939cdf tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:05:01.827436 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-c09d123f-dec8-4448-a3f0-43cff2939cdf tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:05:01.842385 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c09d123f-dec8-4448-a3f0-43cff2939cdf tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:01.843055 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c09d123f-dec8-4448-a3f0-43cff2939cdf tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:01.843658 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c09d123f-dec8-4448-a3f0-43cff2939cdf tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:01.844544 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c09d123f-dec8-4448-a3f0-43cff2939cdf tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:01.845189 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c09d123f-dec8-4448-a3f0-43cff2939cdf tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:01.845785 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c09d123f-dec8-4448-a3f0-43cff2939cdf tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:01.984546 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-89088e2d-8e28-40a9-b585-9c4cf24bb61b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:05:01.993622 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-89088e2d-8e28-40a9-b585-9c4cf24bb61b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1366 microversion: 2.1 time: 0.521170 Oct 20 06:05:01.997317 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 23/62] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:05:01 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1366 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:05:02.008437 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-c09d123f-dec8-4448-a3f0-43cff2939cdf tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:05:02.021573 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-c09d123f-dec8-4448-a3f0-43cff2939cdf tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:05:02.024306 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-c09d123f-dec8-4448-a3f0-43cff2939cdf tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:05:02.027894 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-c09d123f-dec8-4448-a3f0-43cff2939cdf tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1338 microversion: 2.20 time: 0.204865 Oct 20 06:05:02.033715 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 40/63] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:05:01 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1338 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:05:02.241812 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [req-44f9b659-3aa0-4ee3-852a-935a2e7aabb5 req-1c402667-6a58-4da8-abd1-17b202f6f686 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab6b2605-695c-4ee9-ae33-6234ef22536c", "tag": "e8a81f7e-ee04-474a-9073-057e1d862c26"}]} {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 06:05:02.266633 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [req-44f9b659-3aa0-4ee3-852a-935a2e7aabb5 req-1c402667-6a58-4da8-abd1-17b202f6f686 service nova] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:02.267625 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [req-44f9b659-3aa0-4ee3-852a-935a2e7aabb5 req-1c402667-6a58-4da8-abd1-17b202f6f686 service nova] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:02.268204 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [req-44f9b659-3aa0-4ee3-852a-935a2e7aabb5 req-1c402667-6a58-4da8-abd1-17b202f6f686 service nova] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:02.327778 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.compute.server_external_events [req-44f9b659-3aa0-4ee3-852a-935a2e7aabb5 req-1c402667-6a58-4da8-abd1-17b202f6f686 service nova] Creating event network-changed:e8a81f7e-ee04-474a-9073-057e1d862c26 for instance ab6b2605-695c-4ee9-ae33-6234ef22536c on hv-cinder-86156 Oct 20 06:05:02.328432 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [req-44f9b659-3aa0-4ee3-852a-935a2e7aabb5 req-1c402667-6a58-4da8-abd1-17b202f6f686 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=118860) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 20 06:05:02.328938 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [req-44f9b659-3aa0-4ee3-852a-935a2e7aabb5 req-1c402667-6a58-4da8-abd1-17b202f6f686 service nova] Acquired lock "compute-rpcapi-router" {{(pid=118860) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 20 06:05:02.330262 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-bb6dc086-0878-4530-a1ee-ba480a99060c None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:02.331188 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-bb6dc086-0878-4530-a1ee-ba480a99060c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:02.331300 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-bb6dc086-0878-4530-a1ee-ba480a99060c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:02.332299 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-bb6dc086-0878-4530-a1ee-ba480a99060c None None] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:02.333181 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-bb6dc086-0878-4530-a1ee-ba480a99060c None None] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:02.333681 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-bb6dc086-0878-4530-a1ee-ba480a99060c None None] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:02.342504 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-3aea8ff9-bc14-4e47-8e6e-cfc9c245f505 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:05:02.346469 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-3aea8ff9-bc14-4e47-8e6e-cfc9c245f505 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:05:02.355255 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-3aea8ff9-bc14-4e47-8e6e-cfc9c245f505 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:02.355545 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.compute.rpcapi [None req-bb6dc086-0878-4530-a1ee-ba480a99060c None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 20 06:05:02.355881 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-3aea8ff9-bc14-4e47-8e6e-cfc9c245f505 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:02.356729 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-bb6dc086-0878-4530-a1ee-ba480a99060c None None] Releasing lock "compute-rpcapi-router" {{(pid=118860) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 20 06:05:02.356998 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-3aea8ff9-bc14-4e47-8e6e-cfc9c245f505 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:02.357782 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-3aea8ff9-bc14-4e47-8e6e-cfc9c245f505 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:02.358297 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-3aea8ff9-bc14-4e47-8e6e-cfc9c245f505 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:02.358847 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-3aea8ff9-bc14-4e47-8e6e-cfc9c245f505 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:02.378488 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-bb6dc086-0878-4530-a1ee-ba480a99060c None None] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.214465 Oct 20 06:05:02.380617 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 24/64] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 20 06:05:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:05:02.406685 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-34833180-c353-4d80-9c44-e12af49a1679 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:05:02.410029 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-34833180-c353-4d80-9c44-e12af49a1679 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] [instance: ab6b2605-695c-4ee9-ae33-6234ef22536c] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:05:02.417253 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-34833180-c353-4d80-9c44-e12af49a1679 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:02.417978 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-34833180-c353-4d80-9c44-e12af49a1679 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:02.418565 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-34833180-c353-4d80-9c44-e12af49a1679 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:02.419270 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-34833180-c353-4d80-9c44-e12af49a1679 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:02.419719 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-34833180-c353-4d80-9c44-e12af49a1679 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:02.420142 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-34833180-c353-4d80-9c44-e12af49a1679 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:02.444906 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-3aea8ff9-bc14-4e47-8e6e-cfc9c245f505 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:05:02.454033 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-3aea8ff9-bc14-4e47-8e6e-cfc9c245f505 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1240 microversion: 2.1 time: 0.116517 Oct 20 06:05:02.454790 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 41/65] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:05:02 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1240 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 06:05:02.615570 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-34833180-c353-4d80-9c44-e12af49a1679 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85953d8e7394fb0a6f425ce51420325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72e1785381dd4bdaa2803fa7ef711dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:05:02.623352 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-34833180-c353-4d80-9c44-e12af49a1679 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] 10.222.0.20 "GET /compute/v2.1/servers/ab6b2605-695c-4ee9-ae33-6234ef22536c" status: 200 len: 1315 microversion: 2.1 time: 0.221500 Oct 20 06:05:02.623855 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 25/66] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:05:02 2022] GET /compute/v2.1/servers/ab6b2605-695c-4ee9-ae33-6234ef22536c => generated 1315 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:05:02.715695 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-7053e334-c226-4a24-84f4-e2f8153ce3e3 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:05:02.716325 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-7053e334-c226-4a24-84f4-e2f8153ce3e3 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] [instance: e8e2c461-4b15-42ea-bfc7-1daf1fe15f7f] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:05:02.723346 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7053e334-c226-4a24-84f4-e2f8153ce3e3 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:02.724104 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7053e334-c226-4a24-84f4-e2f8153ce3e3 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:02.724727 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7053e334-c226-4a24-84f4-e2f8153ce3e3 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:02.725473 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7053e334-c226-4a24-84f4-e2f8153ce3e3 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:02.725914 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7053e334-c226-4a24-84f4-e2f8153ce3e3 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:02.726556 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7053e334-c226-4a24-84f4-e2f8153ce3e3 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:02.925386 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-7053e334-c226-4a24-84f4-e2f8153ce3e3 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d4cbd2a2154e5d925462df7c77815a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0d80988ca941acb8ad4318338dfbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:05:02.933426 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-7053e334-c226-4a24-84f4-e2f8153ce3e3 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] 10.222.0.20 "GET /compute/v2.1/servers/e8e2c461-4b15-42ea-bfc7-1daf1fe15f7f" status: 200 len: 1322 microversion: 2.1 time: 0.221588 Oct 20 06:05:02.945369 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 42/67] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:05:02 2022] GET /compute/v2.1/servers/e8e2c461-4b15-42ea-bfc7-1daf1fe15f7f => generated 1322 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:05:03.025039 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-3ad5b3af-5efa-438d-a491-07403ebbb808 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:05:03.025664 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-3ad5b3af-5efa-438d-a491-07403ebbb808 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:05:03.032482 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3ad5b3af-5efa-438d-a491-07403ebbb808 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:03.033400 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3ad5b3af-5efa-438d-a491-07403ebbb808 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:03.034047 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3ad5b3af-5efa-438d-a491-07403ebbb808 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:03.034780 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3ad5b3af-5efa-438d-a491-07403ebbb808 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:03.035625 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3ad5b3af-5efa-438d-a491-07403ebbb808 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:03.036061 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3ad5b3af-5efa-438d-a491-07403ebbb808 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:03.064434 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-a538f693-4ef8-4b88-8c62-28b0de3e3792 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:05:03.065430 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-a538f693-4ef8-4b88-8c62-28b0de3e3792 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:05:03.073254 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a538f693-4ef8-4b88-8c62-28b0de3e3792 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:03.074767 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a538f693-4ef8-4b88-8c62-28b0de3e3792 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:03.075467 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a538f693-4ef8-4b88-8c62-28b0de3e3792 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:03.076752 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a538f693-4ef8-4b88-8c62-28b0de3e3792 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:03.077444 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a538f693-4ef8-4b88-8c62-28b0de3e3792 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:03.078061 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a538f693-4ef8-4b88-8c62-28b0de3e3792 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:03.155865 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-a538f693-4ef8-4b88-8c62-28b0de3e3792 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:05:03.166695 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-a538f693-4ef8-4b88-8c62-28b0de3e3792 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:05:03.168409 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-a538f693-4ef8-4b88-8c62-28b0de3e3792 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:05:03.169734 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-a538f693-4ef8-4b88-8c62-28b0de3e3792 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1338 microversion: 2.20 time: 0.109205 Oct 20 06:05:03.170769 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 43/68] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:05:03 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1338 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 20 06:05:03.176189 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [req-7773f967-ae4d-41c3-93f0-e6637e170830 req-33fd2b8a-75cd-4580-8537-42cc5883e0de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d38a019f-4bfc-4845-900b-a9e4e6397373", "tag": "96706f05-eb97-4530-8210-9800d1f1d106"}]} {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 06:05:03.193146 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [req-7773f967-ae4d-41c3-93f0-e6637e170830 req-33fd2b8a-75cd-4580-8537-42cc5883e0de service nova] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:03.193859 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [req-7773f967-ae4d-41c3-93f0-e6637e170830 req-33fd2b8a-75cd-4580-8537-42cc5883e0de service nova] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:03.194428 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [req-7773f967-ae4d-41c3-93f0-e6637e170830 req-33fd2b8a-75cd-4580-8537-42cc5883e0de service nova] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:03.206003 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.compute.server_external_events [req-7773f967-ae4d-41c3-93f0-e6637e170830 req-33fd2b8a-75cd-4580-8537-42cc5883e0de service nova] Creating event network-changed:96706f05-eb97-4530-8210-9800d1f1d106 for instance d38a019f-4bfc-4845-900b-a9e4e6397373 on hv-cinder-86156 Oct 20 06:05:03.211545 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [req-7773f967-ae4d-41c3-93f0-e6637e170830 req-33fd2b8a-75cd-4580-8537-42cc5883e0de service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039213 Oct 20 06:05:03.212678 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 44/69] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 20 06:05:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:05:03.242954 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-3ad5b3af-5efa-438d-a491-07403ebbb808 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:05:03.257581 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-3ad5b3af-5efa-438d-a491-07403ebbb808 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1366 microversion: 2.1 time: 0.237147 Oct 20 06:05:03.258531 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 26/70] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:05:03 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1366 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:05:03.490780 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-4cbc4250-53d8-427a-8ef8-f5b8e84f8179 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:05:03.493984 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-4cbc4250-53d8-427a-8ef8-f5b8e84f8179 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:05:03.500467 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4cbc4250-53d8-427a-8ef8-f5b8e84f8179 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:03.501519 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4cbc4250-53d8-427a-8ef8-f5b8e84f8179 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:03.502380 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4cbc4250-53d8-427a-8ef8-f5b8e84f8179 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:03.504191 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4cbc4250-53d8-427a-8ef8-f5b8e84f8179 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:03.505382 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4cbc4250-53d8-427a-8ef8-f5b8e84f8179 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:03.506047 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4cbc4250-53d8-427a-8ef8-f5b8e84f8179 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:03.628084 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-4cbc4250-53d8-427a-8ef8-f5b8e84f8179 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:05:03.646397 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-62da14fa-9f50-4378-b93f-39d6e805670d tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:05:03.647016 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-62da14fa-9f50-4378-b93f-39d6e805670d tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] [instance: ab6b2605-695c-4ee9-ae33-6234ef22536c] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:05:03.653030 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-62da14fa-9f50-4378-b93f-39d6e805670d tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:03.653527 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-62da14fa-9f50-4378-b93f-39d6e805670d tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:03.653967 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-62da14fa-9f50-4378-b93f-39d6e805670d tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:03.658994 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-4cbc4250-53d8-427a-8ef8-f5b8e84f8179 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1240 microversion: 2.1 time: 0.175921 Oct 20 06:05:03.669968 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 45/71] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:05:03 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1240 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:05:03.670653 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-62da14fa-9f50-4378-b93f-39d6e805670d tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:03.670653 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-62da14fa-9f50-4378-b93f-39d6e805670d tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:03.670653 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-62da14fa-9f50-4378-b93f-39d6e805670d tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:03.865968 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-62da14fa-9f50-4378-b93f-39d6e805670d tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85953d8e7394fb0a6f425ce51420325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72e1785381dd4bdaa2803fa7ef711dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:05:03.875237 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-62da14fa-9f50-4378-b93f-39d6e805670d tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] 10.222.0.20 "GET /compute/v2.1/servers/ab6b2605-695c-4ee9-ae33-6234ef22536c" status: 200 len: 1315 microversion: 2.1 time: 0.233509 Oct 20 06:05:03.876087 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 27/72] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:05:03 2022] GET /compute/v2.1/servers/ab6b2605-695c-4ee9-ae33-6234ef22536c => generated 1315 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 06:05:03.959004 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-6a594158-5ba0-4c1f-843c-54e4d60cb727 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:05:03.959611 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-6a594158-5ba0-4c1f-843c-54e4d60cb727 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] [instance: e8e2c461-4b15-42ea-bfc7-1daf1fe15f7f] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:05:03.970692 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-6a594158-5ba0-4c1f-843c-54e4d60cb727 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:03.971506 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-6a594158-5ba0-4c1f-843c-54e4d60cb727 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:03.972241 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-6a594158-5ba0-4c1f-843c-54e4d60cb727 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:03.974750 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-6a594158-5ba0-4c1f-843c-54e4d60cb727 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:03.975378 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-6a594158-5ba0-4c1f-843c-54e4d60cb727 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:03.978427 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-6a594158-5ba0-4c1f-843c-54e4d60cb727 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:04.200950 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-11486165-82d8-460d-ab95-cb632a165e42 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:05:04.200950 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-11486165-82d8-460d-ab95-cb632a165e42 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:05:04.218903 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-11486165-82d8-460d-ab95-cb632a165e42 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:04.220380 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-11486165-82d8-460d-ab95-cb632a165e42 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:04.221842 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-11486165-82d8-460d-ab95-cb632a165e42 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:04.222859 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-11486165-82d8-460d-ab95-cb632a165e42 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:04.224952 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-11486165-82d8-460d-ab95-cb632a165e42 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:04.226987 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-11486165-82d8-460d-ab95-cb632a165e42 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:04.285511 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-6a594158-5ba0-4c1f-843c-54e4d60cb727 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d4cbd2a2154e5d925462df7c77815a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0d80988ca941acb8ad4318338dfbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:05:04.296625 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-6a594158-5ba0-4c1f-843c-54e4d60cb727 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] 10.222.0.20 "GET /compute/v2.1/servers/e8e2c461-4b15-42ea-bfc7-1daf1fe15f7f" status: 200 len: 1322 microversion: 2.1 time: 0.341534 Oct 20 06:05:04.309591 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 46/73] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:05:03 2022] GET /compute/v2.1/servers/e8e2c461-4b15-42ea-bfc7-1daf1fe15f7f => generated 1322 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:05:04.324983 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-fd111f3b-1dbd-4b4a-9f42-72a5ea1ac98d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:05:04.329167 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-fd111f3b-1dbd-4b4a-9f42-72a5ea1ac98d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:05:04.349293 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-fd111f3b-1dbd-4b4a-9f42-72a5ea1ac98d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:04.351841 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-fd111f3b-1dbd-4b4a-9f42-72a5ea1ac98d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:04.354439 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-fd111f3b-1dbd-4b4a-9f42-72a5ea1ac98d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:04.356861 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-fd111f3b-1dbd-4b4a-9f42-72a5ea1ac98d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:04.357565 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-fd111f3b-1dbd-4b4a-9f42-72a5ea1ac98d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:04.358191 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-fd111f3b-1dbd-4b4a-9f42-72a5ea1ac98d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:04.387784 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-11486165-82d8-460d-ab95-cb632a165e42 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:05:04.399936 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-11486165-82d8-460d-ab95-cb632a165e42 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:05:04.404393 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-11486165-82d8-460d-ab95-cb632a165e42 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:05:04.408324 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-11486165-82d8-460d-ab95-cb632a165e42 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1338 microversion: 2.20 time: 0.216100 Oct 20 06:05:04.415267 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 28/74] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:05:04 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1338 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 20 06:05:04.430375 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [req-d2397495-8637-4eba-8c6f-94790985e5c3 req-609501f2-a272-45bd-bdf4-e4d35090f95c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e8e2c461-4b15-42ea-bfc7-1daf1fe15f7f", "tag": "c9ce8d7f-24b9-4d6f-ac5d-3049f7eed554"}]} {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 06:05:04.455897 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [req-d2397495-8637-4eba-8c6f-94790985e5c3 req-609501f2-a272-45bd-bdf4-e4d35090f95c service nova] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:04.456297 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [req-d2397495-8637-4eba-8c6f-94790985e5c3 req-609501f2-a272-45bd-bdf4-e4d35090f95c service nova] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:04.456751 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [req-d2397495-8637-4eba-8c6f-94790985e5c3 req-609501f2-a272-45bd-bdf4-e4d35090f95c service nova] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:04.495456 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.compute.server_external_events [req-d2397495-8637-4eba-8c6f-94790985e5c3 req-609501f2-a272-45bd-bdf4-e4d35090f95c service nova] Creating event network-changed:c9ce8d7f-24b9-4d6f-ac5d-3049f7eed554 for instance e8e2c461-4b15-42ea-bfc7-1daf1fe15f7f on hv-cinder-86156 Oct 20 06:05:04.505808 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [req-d2397495-8637-4eba-8c6f-94790985e5c3 req-609501f2-a272-45bd-bdf4-e4d35090f95c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087879 Oct 20 06:05:04.506845 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 29/75] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 20 06:05:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:05:04.690163 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-49ea6df5-d4d7-4aaa-b535-3e51dbcbf2ed tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:05:04.690964 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-49ea6df5-d4d7-4aaa-b535-3e51dbcbf2ed tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:05:04.693828 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-fd111f3b-1dbd-4b4a-9f42-72a5ea1ac98d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:05:04.700402 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-49ea6df5-d4d7-4aaa-b535-3e51dbcbf2ed tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:04.700990 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-49ea6df5-d4d7-4aaa-b535-3e51dbcbf2ed tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:04.701666 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-49ea6df5-d4d7-4aaa-b535-3e51dbcbf2ed tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:04.702220 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-fd111f3b-1dbd-4b4a-9f42-72a5ea1ac98d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1366 microversion: 2.1 time: 0.390882 Oct 20 06:05:04.703044 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 47/76] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:05:04 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1366 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:05:04.703636 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-49ea6df5-d4d7-4aaa-b535-3e51dbcbf2ed tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:04.704292 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-49ea6df5-d4d7-4aaa-b535-3e51dbcbf2ed tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:04.704967 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-49ea6df5-d4d7-4aaa-b535-3e51dbcbf2ed tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:04.788398 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-49ea6df5-d4d7-4aaa-b535-3e51dbcbf2ed tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:05:04.797174 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-49ea6df5-d4d7-4aaa-b535-3e51dbcbf2ed tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1240 microversion: 2.1 time: 0.111223 Oct 20 06:05:04.799329 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 30/77] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:05:04 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1240 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 06:05:04.900491 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-81bc1b58-2d5e-4812-9092-55436a14baf9 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:05:04.901481 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-81bc1b58-2d5e-4812-9092-55436a14baf9 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] [instance: ab6b2605-695c-4ee9-ae33-6234ef22536c] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:05:04.908750 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-81bc1b58-2d5e-4812-9092-55436a14baf9 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:04.909590 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-81bc1b58-2d5e-4812-9092-55436a14baf9 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:04.910581 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-81bc1b58-2d5e-4812-9092-55436a14baf9 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:04.911954 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-81bc1b58-2d5e-4812-9092-55436a14baf9 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:04.912832 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-81bc1b58-2d5e-4812-9092-55436a14baf9 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:04.913402 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-81bc1b58-2d5e-4812-9092-55436a14baf9 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:05.127135 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-81bc1b58-2d5e-4812-9092-55436a14baf9 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85953d8e7394fb0a6f425ce51420325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72e1785381dd4bdaa2803fa7ef711dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:05:05.139935 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-81bc1b58-2d5e-4812-9092-55436a14baf9 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] 10.222.0.20 "GET /compute/v2.1/servers/ab6b2605-695c-4ee9-ae33-6234ef22536c" status: 200 len: 1315 microversion: 2.1 time: 0.240805 Oct 20 06:05:05.140550 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 48/78] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:05:04 2022] GET /compute/v2.1/servers/ab6b2605-695c-4ee9-ae33-6234ef22536c => generated 1315 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 06:05:05.326334 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-3c0a33d8-25c9-4b9a-b804-55ce154f13b8 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:05:05.326948 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-3c0a33d8-25c9-4b9a-b804-55ce154f13b8 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] [instance: e8e2c461-4b15-42ea-bfc7-1daf1fe15f7f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:05:05.337096 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3c0a33d8-25c9-4b9a-b804-55ce154f13b8 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:05.339568 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3c0a33d8-25c9-4b9a-b804-55ce154f13b8 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:05.340406 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3c0a33d8-25c9-4b9a-b804-55ce154f13b8 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:05.342360 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3c0a33d8-25c9-4b9a-b804-55ce154f13b8 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:05.343583 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3c0a33d8-25c9-4b9a-b804-55ce154f13b8 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:05.343994 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3c0a33d8-25c9-4b9a-b804-55ce154f13b8 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:05.444541 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-2655b6fd-b348-4ec7-b59a-8ec16aab0a8f tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:05:05.446114 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-2655b6fd-b348-4ec7-b59a-8ec16aab0a8f tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:05:05.453148 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG dbcounter [-] [118861] Writing DB stats nova_cell0:SELECT=26 {{(pid=118861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:05:05.454823 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-2655b6fd-b348-4ec7-b59a-8ec16aab0a8f tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:05.455259 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-2655b6fd-b348-4ec7-b59a-8ec16aab0a8f tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:05.455783 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-2655b6fd-b348-4ec7-b59a-8ec16aab0a8f tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:05.456500 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-2655b6fd-b348-4ec7-b59a-8ec16aab0a8f tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:05.457643 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-2655b6fd-b348-4ec7-b59a-8ec16aab0a8f tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:05.461190 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-2655b6fd-b348-4ec7-b59a-8ec16aab0a8f tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:05.612944 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-3c0a33d8-25c9-4b9a-b804-55ce154f13b8 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d4cbd2a2154e5d925462df7c77815a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0d80988ca941acb8ad4318338dfbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:05:05.623166 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-3c0a33d8-25c9-4b9a-b804-55ce154f13b8 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] 10.222.0.20 "GET /compute/v2.1/servers/e8e2c461-4b15-42ea-bfc7-1daf1fe15f7f" status: 200 len: 1322 microversion: 2.1 time: 0.301031 Oct 20 06:05:05.623517 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-2655b6fd-b348-4ec7-b59a-8ec16aab0a8f tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:05:05.626271 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 31/79] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:05:05 2022] GET /compute/v2.1/servers/e8e2c461-4b15-42ea-bfc7-1daf1fe15f7f => generated 1322 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:05:05.643587 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-2655b6fd-b348-4ec7-b59a-8ec16aab0a8f tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:05:05.646400 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-2655b6fd-b348-4ec7-b59a-8ec16aab0a8f tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:05:05.653874 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-2655b6fd-b348-4ec7-b59a-8ec16aab0a8f tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1338 microversion: 2.20 time: 0.214139 Oct 20 06:05:05.663945 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 49/80] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:05:05 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1338 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:05:05.730618 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-3bfd5be6-e042-4f3f-a0ae-40f93a32ba27 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:05:05.731148 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-3bfd5be6-e042-4f3f-a0ae-40f93a32ba27 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:05:05.749876 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3bfd5be6-e042-4f3f-a0ae-40f93a32ba27 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:05.750784 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3bfd5be6-e042-4f3f-a0ae-40f93a32ba27 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:05.751382 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3bfd5be6-e042-4f3f-a0ae-40f93a32ba27 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:05.752316 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3bfd5be6-e042-4f3f-a0ae-40f93a32ba27 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:05.754105 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3bfd5be6-e042-4f3f-a0ae-40f93a32ba27 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:05.754380 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3bfd5be6-e042-4f3f-a0ae-40f93a32ba27 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:05.823480 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-ac0ae3f3-390f-47eb-a52d-e38a4cb46878 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:05:05.824233 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-ac0ae3f3-390f-47eb-a52d-e38a4cb46878 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:05:05.834225 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ac0ae3f3-390f-47eb-a52d-e38a4cb46878 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:05.836274 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ac0ae3f3-390f-47eb-a52d-e38a4cb46878 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:05.838765 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ac0ae3f3-390f-47eb-a52d-e38a4cb46878 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:05.840923 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ac0ae3f3-390f-47eb-a52d-e38a4cb46878 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:05.844436 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ac0ae3f3-390f-47eb-a52d-e38a4cb46878 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:05.845182 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ac0ae3f3-390f-47eb-a52d-e38a4cb46878 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:05.922633 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-ac0ae3f3-390f-47eb-a52d-e38a4cb46878 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:05:05.933664 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-ac0ae3f3-390f-47eb-a52d-e38a4cb46878 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1240 microversion: 2.1 time: 0.113357 Oct 20 06:05:05.934560 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 50/81] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:05:05 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1240 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:05:06.005039 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-3bfd5be6-e042-4f3f-a0ae-40f93a32ba27 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:05:06.015478 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-3bfd5be6-e042-4f3f-a0ae-40f93a32ba27 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1366 microversion: 2.1 time: 0.289758 Oct 20 06:05:06.017418 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 32/82] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:05:05 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1366 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 06:05:06.171223 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-f7760977-89d2-46e1-b5e0-1081b31b1dc9 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:05:06.171842 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-f7760977-89d2-46e1-b5e0-1081b31b1dc9 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] [instance: ab6b2605-695c-4ee9-ae33-6234ef22536c] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:05:06.179629 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f7760977-89d2-46e1-b5e0-1081b31b1dc9 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:06.180656 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f7760977-89d2-46e1-b5e0-1081b31b1dc9 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:06.181267 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f7760977-89d2-46e1-b5e0-1081b31b1dc9 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:06.182018 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f7760977-89d2-46e1-b5e0-1081b31b1dc9 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:06.182728 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f7760977-89d2-46e1-b5e0-1081b31b1dc9 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:06.183359 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f7760977-89d2-46e1-b5e0-1081b31b1dc9 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:06.344589 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-f7760977-89d2-46e1-b5e0-1081b31b1dc9 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85953d8e7394fb0a6f425ce51420325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72e1785381dd4bdaa2803fa7ef711dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:05:06.354075 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-f7760977-89d2-46e1-b5e0-1081b31b1dc9 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] 10.222.0.20 "GET /compute/v2.1/servers/ab6b2605-695c-4ee9-ae33-6234ef22536c" status: 200 len: 1315 microversion: 2.1 time: 0.188149 Oct 20 06:05:06.354777 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 51/83] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:05:06 2022] GET /compute/v2.1/servers/ab6b2605-695c-4ee9-ae33-6234ef22536c => generated 1315 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:05:06.650151 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-b17d95b7-6b12-4608-9995-1496b55036a5 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:05:06.650736 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-b17d95b7-6b12-4608-9995-1496b55036a5 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] [instance: e8e2c461-4b15-42ea-bfc7-1daf1fe15f7f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:05:06.658859 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b17d95b7-6b12-4608-9995-1496b55036a5 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:06.659622 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b17d95b7-6b12-4608-9995-1496b55036a5 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:06.662689 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b17d95b7-6b12-4608-9995-1496b55036a5 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:06.663671 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b17d95b7-6b12-4608-9995-1496b55036a5 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:06.665066 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b17d95b7-6b12-4608-9995-1496b55036a5 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:06.665730 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b17d95b7-6b12-4608-9995-1496b55036a5 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:06.671123 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG dbcounter [-] [118860] Writing DB stats nova_cell1:SELECT=100 {{(pid=118860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:05:06.697219 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-96baadc9-89f1-499d-b2ac-138f9590cee2 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:05:06.697835 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-96baadc9-89f1-499d-b2ac-138f9590cee2 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:05:06.704317 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-96baadc9-89f1-499d-b2ac-138f9590cee2 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:06.718303 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-96baadc9-89f1-499d-b2ac-138f9590cee2 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:06.719266 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-96baadc9-89f1-499d-b2ac-138f9590cee2 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:06.720543 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-96baadc9-89f1-499d-b2ac-138f9590cee2 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:06.721198 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-96baadc9-89f1-499d-b2ac-138f9590cee2 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:06.723835 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-96baadc9-89f1-499d-b2ac-138f9590cee2 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:06.796045 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-96baadc9-89f1-499d-b2ac-138f9590cee2 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:05:06.805712 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-96baadc9-89f1-499d-b2ac-138f9590cee2 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:05:06.807559 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-96baadc9-89f1-499d-b2ac-138f9590cee2 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:05:06.808680 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-96baadc9-89f1-499d-b2ac-138f9590cee2 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1338 microversion: 2.20 time: 0.115656 Oct 20 06:05:06.809566 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 52/84] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:05:06 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1338 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:05:06.871143 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-b17d95b7-6b12-4608-9995-1496b55036a5 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d4cbd2a2154e5d925462df7c77815a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0d80988ca941acb8ad4318338dfbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:05:06.882088 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-b17d95b7-6b12-4608-9995-1496b55036a5 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] 10.222.0.20 "GET /compute/v2.1/servers/e8e2c461-4b15-42ea-bfc7-1daf1fe15f7f" status: 200 len: 1322 microversion: 2.1 time: 0.235556 Oct 20 06:05:06.896721 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 33/85] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:05:06 2022] GET /compute/v2.1/servers/e8e2c461-4b15-42ea-bfc7-1daf1fe15f7f => generated 1322 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 06:05:06.960864 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-c89238a7-1013-438f-ad8b-5c5e8a918512 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:05:06.961342 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-c89238a7-1013-438f-ad8b-5c5e8a918512 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:05:06.980340 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c89238a7-1013-438f-ad8b-5c5e8a918512 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:06.982803 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c89238a7-1013-438f-ad8b-5c5e8a918512 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:06.983908 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c89238a7-1013-438f-ad8b-5c5e8a918512 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:06.989042 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c89238a7-1013-438f-ad8b-5c5e8a918512 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:06.991272 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c89238a7-1013-438f-ad8b-5c5e8a918512 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:06.992404 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c89238a7-1013-438f-ad8b-5c5e8a918512 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:07.033651 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG dbcounter [-] [118861] Writing DB stats nova_cell1:SELECT=100 {{(pid=118861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:05:07.041806 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-c589a104-097a-4b88-b75b-0764048ba67d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:05:07.042439 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-c589a104-097a-4b88-b75b-0764048ba67d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:05:07.054205 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c589a104-097a-4b88-b75b-0764048ba67d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:07.054809 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c589a104-097a-4b88-b75b-0764048ba67d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:07.055580 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c589a104-097a-4b88-b75b-0764048ba67d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:07.056749 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c589a104-097a-4b88-b75b-0764048ba67d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:07.059629 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c589a104-097a-4b88-b75b-0764048ba67d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:07.069153 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c589a104-097a-4b88-b75b-0764048ba67d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:07.093719 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-c89238a7-1013-438f-ad8b-5c5e8a918512 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:05:07.106747 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-c89238a7-1013-438f-ad8b-5c5e8a918512 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1240 microversion: 2.1 time: 0.152829 Oct 20 06:05:07.108782 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 53/86] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:05:06 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1240 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:05:07.379232 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-497bfcd7-366f-4efc-b36a-af9f4b1c2de2 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:05:07.379942 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-497bfcd7-366f-4efc-b36a-af9f4b1c2de2 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] [instance: ab6b2605-695c-4ee9-ae33-6234ef22536c] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:05:07.386807 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-497bfcd7-366f-4efc-b36a-af9f4b1c2de2 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:07.387364 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-497bfcd7-366f-4efc-b36a-af9f4b1c2de2 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:07.388048 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-497bfcd7-366f-4efc-b36a-af9f4b1c2de2 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:07.388870 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-497bfcd7-366f-4efc-b36a-af9f4b1c2de2 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:07.390194 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-497bfcd7-366f-4efc-b36a-af9f4b1c2de2 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:07.390721 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-497bfcd7-366f-4efc-b36a-af9f4b1c2de2 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:07.436724 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-c589a104-097a-4b88-b75b-0764048ba67d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:05:07.446357 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-c589a104-097a-4b88-b75b-0764048ba67d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1366 microversion: 2.1 time: 0.409144 Oct 20 06:05:07.461325 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 34/87] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:05:07 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1366 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 06:05:07.555446 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-497bfcd7-366f-4efc-b36a-af9f4b1c2de2 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85953d8e7394fb0a6f425ce51420325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72e1785381dd4bdaa2803fa7ef711dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:05:07.564290 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-497bfcd7-366f-4efc-b36a-af9f4b1c2de2 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] 10.222.0.20 "GET /compute/v2.1/servers/ab6b2605-695c-4ee9-ae33-6234ef22536c" status: 200 len: 1315 microversion: 2.1 time: 0.190352 Oct 20 06:05:07.576922 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 54/88] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:05:07 2022] GET /compute/v2.1/servers/ab6b2605-695c-4ee9-ae33-6234ef22536c => generated 1315 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:05:07.837348 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-2eec36f8-b84e-4b0b-9d73-4caaeaeb9650 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:05:07.837972 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-2eec36f8-b84e-4b0b-9d73-4caaeaeb9650 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:05:07.850143 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2eec36f8-b84e-4b0b-9d73-4caaeaeb9650 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:07.850654 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2eec36f8-b84e-4b0b-9d73-4caaeaeb9650 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:07.851102 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2eec36f8-b84e-4b0b-9d73-4caaeaeb9650 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:07.853163 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2eec36f8-b84e-4b0b-9d73-4caaeaeb9650 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:07.855007 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2eec36f8-b84e-4b0b-9d73-4caaeaeb9650 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:07.855627 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2eec36f8-b84e-4b0b-9d73-4caaeaeb9650 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:07.906919 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-4f314fb0-316b-4f17-9e9b-48a0e497df7a tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:05:07.907521 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-4f314fb0-316b-4f17-9e9b-48a0e497df7a tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] [instance: e8e2c461-4b15-42ea-bfc7-1daf1fe15f7f] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:05:07.924438 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4f314fb0-316b-4f17-9e9b-48a0e497df7a tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:07.925892 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4f314fb0-316b-4f17-9e9b-48a0e497df7a tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:07.926567 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4f314fb0-316b-4f17-9e9b-48a0e497df7a tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:07.929032 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4f314fb0-316b-4f17-9e9b-48a0e497df7a tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:07.930030 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4f314fb0-316b-4f17-9e9b-48a0e497df7a tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:07.930610 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4f314fb0-316b-4f17-9e9b-48a0e497df7a tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:08.067782 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-2eec36f8-b84e-4b0b-9d73-4caaeaeb9650 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:05:08.078236 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-2eec36f8-b84e-4b0b-9d73-4caaeaeb9650 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:05:08.080839 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-2eec36f8-b84e-4b0b-9d73-4caaeaeb9650 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:05:08.082457 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-2eec36f8-b84e-4b0b-9d73-4caaeaeb9650 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1406 microversion: 2.20 time: 0.250786 Oct 20 06:05:08.084421 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 35/89] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:05:07 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1406 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:05:08.131181 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-4f314fb0-316b-4f17-9e9b-48a0e497df7a tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d4cbd2a2154e5d925462df7c77815a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0d80988ca941acb8ad4318338dfbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:05:08.132274 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-6565e2b5-b29f-42aa-a885-ce021be4499c tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:05:08.133059 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-6565e2b5-b29f-42aa-a885-ce021be4499c tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:05:08.139606 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-4f314fb0-316b-4f17-9e9b-48a0e497df7a tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] 10.222.0.20 "GET /compute/v2.1/servers/e8e2c461-4b15-42ea-bfc7-1daf1fe15f7f" status: 200 len: 1322 microversion: 2.1 time: 0.236541 Oct 20 06:05:08.141829 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 55/90] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:05:07 2022] GET /compute/v2.1/servers/e8e2c461-4b15-42ea-bfc7-1daf1fe15f7f => generated 1322 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:05:08.141957 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-6565e2b5-b29f-42aa-a885-ce021be4499c tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:08.142433 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-6565e2b5-b29f-42aa-a885-ce021be4499c tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:08.142868 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-6565e2b5-b29f-42aa-a885-ce021be4499c tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:08.145460 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-6565e2b5-b29f-42aa-a885-ce021be4499c tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:08.146072 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-6565e2b5-b29f-42aa-a885-ce021be4499c tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:08.146641 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-6565e2b5-b29f-42aa-a885-ce021be4499c tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:08.223890 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-6565e2b5-b29f-42aa-a885-ce021be4499c tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:05:08.233026 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-6565e2b5-b29f-42aa-a885-ce021be4499c tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1232 microversion: 2.1 time: 0.104959 Oct 20 06:05:08.233607 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 36/91] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:05:08 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1232 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 06:05:08.469897 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-f67d6130-38eb-4c93-96ca-45f69a4f448f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:05:08.471124 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-f67d6130-38eb-4c93-96ca-45f69a4f448f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:05:08.486836 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f67d6130-38eb-4c93-96ca-45f69a4f448f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:08.487366 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f67d6130-38eb-4c93-96ca-45f69a4f448f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:08.487845 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f67d6130-38eb-4c93-96ca-45f69a4f448f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:08.491281 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f67d6130-38eb-4c93-96ca-45f69a4f448f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:08.491937 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f67d6130-38eb-4c93-96ca-45f69a4f448f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:08.492386 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f67d6130-38eb-4c93-96ca-45f69a4f448f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:08.593354 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-af863ff6-feb0-44a1-83e6-8077ac119871 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:05:08.595074 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-af863ff6-feb0-44a1-83e6-8077ac119871 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] [instance: ab6b2605-695c-4ee9-ae33-6234ef22536c] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:05:08.604021 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-af863ff6-feb0-44a1-83e6-8077ac119871 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:08.604842 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-af863ff6-feb0-44a1-83e6-8077ac119871 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:08.606388 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-af863ff6-feb0-44a1-83e6-8077ac119871 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:08.608280 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-af863ff6-feb0-44a1-83e6-8077ac119871 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:08.609266 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-af863ff6-feb0-44a1-83e6-8077ac119871 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:08.609993 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-af863ff6-feb0-44a1-83e6-8077ac119871 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:09.009824 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-af863ff6-feb0-44a1-83e6-8077ac119871 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85953d8e7394fb0a6f425ce51420325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72e1785381dd4bdaa2803fa7ef711dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:05:09.027937 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-af863ff6-feb0-44a1-83e6-8077ac119871 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] 10.222.0.20 "GET /compute/v2.1/servers/ab6b2605-695c-4ee9-ae33-6234ef22536c" status: 200 len: 1315 microversion: 2.1 time: 0.439653 Oct 20 06:05:09.036967 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 37/92] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:05:08 2022] GET /compute/v2.1/servers/ab6b2605-695c-4ee9-ae33-6234ef22536c => generated 1315 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:05:09.110551 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-e5e665f7-40e4-4455-80d1-731d342bbd69 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:05:09.111321 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-e5e665f7-40e4-4455-80d1-731d342bbd69 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:05:09.127159 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e5e665f7-40e4-4455-80d1-731d342bbd69 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:09.130283 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e5e665f7-40e4-4455-80d1-731d342bbd69 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:09.130933 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e5e665f7-40e4-4455-80d1-731d342bbd69 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:09.131822 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e5e665f7-40e4-4455-80d1-731d342bbd69 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:09.135923 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e5e665f7-40e4-4455-80d1-731d342bbd69 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:09.136538 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e5e665f7-40e4-4455-80d1-731d342bbd69 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:09.137494 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-f67d6130-38eb-4c93-96ca-45f69a4f448f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:05:09.145668 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-f67d6130-38eb-4c93-96ca-45f69a4f448f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1366 microversion: 2.1 time: 0.679691 Oct 20 06:05:09.158907 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 56/93] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:05:08 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1366 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:05:09.165934 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-d477182c-34e2-486d-97c2-4664855c0643 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:05:09.166653 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-d477182c-34e2-486d-97c2-4664855c0643 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] [instance: e8e2c461-4b15-42ea-bfc7-1daf1fe15f7f] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:05:09.193180 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d477182c-34e2-486d-97c2-4664855c0643 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:09.197684 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d477182c-34e2-486d-97c2-4664855c0643 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:09.198308 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d477182c-34e2-486d-97c2-4664855c0643 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:09.199290 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d477182c-34e2-486d-97c2-4664855c0643 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:09.199905 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d477182c-34e2-486d-97c2-4664855c0643 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:09.200479 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d477182c-34e2-486d-97c2-4664855c0643 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:09.653336 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG dbcounter [-] [118860] Writing DB stats nova_cell0:SELECT=5 {{(pid=118860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:05:09.863625 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-d477182c-34e2-486d-97c2-4664855c0643 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d4cbd2a2154e5d925462df7c77815a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0d80988ca941acb8ad4318338dfbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:05:09.871808 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-d477182c-34e2-486d-97c2-4664855c0643 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] 10.222.0.20 "GET /compute/v2.1/servers/e8e2c461-4b15-42ea-bfc7-1daf1fe15f7f" status: 200 len: 1322 microversion: 2.1 time: 0.709734 Oct 20 06:05:09.877957 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 57/94] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:05:09 2022] GET /compute/v2.1/servers/e8e2c461-4b15-42ea-bfc7-1daf1fe15f7f => generated 1322 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:05:09.883212 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-e884e0c5-f30e-4e3a-8661-1f6bafa2bcab tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:05:09.887393 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-e884e0c5-f30e-4e3a-8661-1f6bafa2bcab tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:05:09.902573 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e884e0c5-f30e-4e3a-8661-1f6bafa2bcab tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:09.903295 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e884e0c5-f30e-4e3a-8661-1f6bafa2bcab tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:09.904520 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e884e0c5-f30e-4e3a-8661-1f6bafa2bcab tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:09.905467 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e884e0c5-f30e-4e3a-8661-1f6bafa2bcab tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:09.907774 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e884e0c5-f30e-4e3a-8661-1f6bafa2bcab tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:09.912254 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e884e0c5-f30e-4e3a-8661-1f6bafa2bcab tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:10.153735 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-e884e0c5-f30e-4e3a-8661-1f6bafa2bcab tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:05:10.164821 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-e884e0c5-f30e-4e3a-8661-1f6bafa2bcab tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1294 microversion: 2.1 time: 0.285439 Oct 20 06:05:10.168498 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 58/95] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:05:09 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1294 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:05:10.194999 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-a185de61-a0bf-4fdb-ad9a-ec407d3fda48 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:05:10.196316 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-a185de61-a0bf-4fdb-ad9a-ec407d3fda48 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] [instance: ab6b2605-695c-4ee9-ae33-6234ef22536c] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:05:10.198326 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-e5e665f7-40e4-4455-80d1-731d342bbd69 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:05:10.204784 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a185de61-a0bf-4fdb-ad9a-ec407d3fda48 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:10.205359 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a185de61-a0bf-4fdb-ad9a-ec407d3fda48 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:10.205909 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a185de61-a0bf-4fdb-ad9a-ec407d3fda48 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:10.206606 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-e5e665f7-40e4-4455-80d1-731d342bbd69 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:05:10.207399 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a185de61-a0bf-4fdb-ad9a-ec407d3fda48 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:10.207930 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a185de61-a0bf-4fdb-ad9a-ec407d3fda48 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:10.208374 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a185de61-a0bf-4fdb-ad9a-ec407d3fda48 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:10.218250 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-e5e665f7-40e4-4455-80d1-731d342bbd69 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:05:10.219925 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-e5e665f7-40e4-4455-80d1-731d342bbd69 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1406 microversion: 2.20 time: 1.113961 Oct 20 06:05:10.220685 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 38/96] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:05:09 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1406 bytes in 1115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 20 06:05:10.226398 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-9d914335-aa3a-4226-843e-04f3c8d27c27 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:05:10.235874 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-9d914335-aa3a-4226-843e-04f3c8d27c27 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:05:10.245619 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-9d914335-aa3a-4226-843e-04f3c8d27c27 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:10.246390 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-9d914335-aa3a-4226-843e-04f3c8d27c27 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:10.246997 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-9d914335-aa3a-4226-843e-04f3c8d27c27 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:10.247874 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-9d914335-aa3a-4226-843e-04f3c8d27c27 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:10.250296 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-9d914335-aa3a-4226-843e-04f3c8d27c27 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:10.251478 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-9d914335-aa3a-4226-843e-04f3c8d27c27 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:10.600947 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-9d914335-aa3a-4226-843e-04f3c8d27c27 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:05:10.632564 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-9d914335-aa3a-4226-843e-04f3c8d27c27 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1366 microversion: 2.1 time: 0.410405 Oct 20 06:05:10.642699 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-a185de61-a0bf-4fdb-ad9a-ec407d3fda48 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85953d8e7394fb0a6f425ce51420325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72e1785381dd4bdaa2803fa7ef711dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:05:10.646140 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 39/97] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:05:10 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1366 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:05:10.661142 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-a185de61-a0bf-4fdb-ad9a-ec407d3fda48 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] 10.222.0.20 "GET /compute/v2.1/servers/ab6b2605-695c-4ee9-ae33-6234ef22536c" status: 200 len: 1315 microversion: 2.1 time: 0.488256 Oct 20 06:05:10.662053 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 59/98] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:05:10 2022] GET /compute/v2.1/servers/ab6b2605-695c-4ee9-ae33-6234ef22536c => generated 1315 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:05:10.856501 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [req-b9cadaf2-3709-450c-8a15-71a40eafd00f req-6905d19a-6774-408e-b50d-201b2c0f5c36 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71be459d-e948-4a17-b379-182f4196411d", "tag": "eb253026-482c-4675-acce-8325c21757fd"}]} {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 06:05:10.871301 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [req-b9cadaf2-3709-450c-8a15-71a40eafd00f req-6905d19a-6774-408e-b50d-201b2c0f5c36 service nova] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:10.872109 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [req-b9cadaf2-3709-450c-8a15-71a40eafd00f req-6905d19a-6774-408e-b50d-201b2c0f5c36 service nova] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:10.872911 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [req-b9cadaf2-3709-450c-8a15-71a40eafd00f req-6905d19a-6774-408e-b50d-201b2c0f5c36 service nova] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:10.891531 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.compute.server_external_events [req-b9cadaf2-3709-450c-8a15-71a40eafd00f req-6905d19a-6774-408e-b50d-201b2c0f5c36 service nova] Creating event network-changed:eb253026-482c-4675-acce-8325c21757fd for instance 71be459d-e948-4a17-b379-182f4196411d on hv-cinder-86156 Oct 20 06:05:10.900943 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [req-b9cadaf2-3709-450c-8a15-71a40eafd00f req-6905d19a-6774-408e-b50d-201b2c0f5c36 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047074 Oct 20 06:05:10.901813 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-cce78945-fc6a-4e2e-8cfb-3a05b8d9a638 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:05:10.902509 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 40/99] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 20 06:05:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:05:10.903369 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-cce78945-fc6a-4e2e-8cfb-3a05b8d9a638 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] [instance: e8e2c461-4b15-42ea-bfc7-1daf1fe15f7f] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:05:10.910875 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-cce78945-fc6a-4e2e-8cfb-3a05b8d9a638 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:10.911408 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-cce78945-fc6a-4e2e-8cfb-3a05b8d9a638 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:10.912002 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-cce78945-fc6a-4e2e-8cfb-3a05b8d9a638 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:10.912895 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-cce78945-fc6a-4e2e-8cfb-3a05b8d9a638 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:10.913482 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-cce78945-fc6a-4e2e-8cfb-3a05b8d9a638 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:10.914078 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-cce78945-fc6a-4e2e-8cfb-3a05b8d9a638 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:11.048903 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-cce78945-fc6a-4e2e-8cfb-3a05b8d9a638 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d4cbd2a2154e5d925462df7c77815a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0d80988ca941acb8ad4318338dfbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:05:11.057707 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-cce78945-fc6a-4e2e-8cfb-3a05b8d9a638 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] 10.222.0.20 "GET /compute/v2.1/servers/e8e2c461-4b15-42ea-bfc7-1daf1fe15f7f" status: 200 len: 1322 microversion: 2.1 time: 0.161577 Oct 20 06:05:11.058283 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 60/100] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:05:10 2022] GET /compute/v2.1/servers/e8e2c461-4b15-42ea-bfc7-1daf1fe15f7f => generated 1322 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:05:11.194832 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-4a2b9f1c-cf8a-4157-840e-52f93f163b46 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:05:11.196582 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-4a2b9f1c-cf8a-4157-840e-52f93f163b46 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:05:11.204444 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-4a2b9f1c-cf8a-4157-840e-52f93f163b46 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:11.205219 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-4a2b9f1c-cf8a-4157-840e-52f93f163b46 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:11.205613 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-4a2b9f1c-cf8a-4157-840e-52f93f163b46 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:11.207277 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-4a2b9f1c-cf8a-4157-840e-52f93f163b46 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:11.207748 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-4a2b9f1c-cf8a-4157-840e-52f93f163b46 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:11.208275 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-4a2b9f1c-cf8a-4157-840e-52f93f163b46 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:11.245203 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG dbcounter [-] [118861] Writing DB stats nova_cell0:SELECT=2 {{(pid=118861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:05:11.250178 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-25c07627-f0ba-4900-a394-ad27462740cf tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:05:11.252891 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-25c07627-f0ba-4900-a394-ad27462740cf tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:05:11.263541 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-25c07627-f0ba-4900-a394-ad27462740cf tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:11.264065 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-25c07627-f0ba-4900-a394-ad27462740cf tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:11.264461 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-25c07627-f0ba-4900-a394-ad27462740cf tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:11.265361 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-25c07627-f0ba-4900-a394-ad27462740cf tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:11.266017 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-25c07627-f0ba-4900-a394-ad27462740cf tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:11.266655 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-25c07627-f0ba-4900-a394-ad27462740cf tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:11.308833 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-4a2b9f1c-cf8a-4157-840e-52f93f163b46 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:05:11.327394 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-4a2b9f1c-cf8a-4157-840e-52f93f163b46 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1294 microversion: 2.1 time: 0.136508 Oct 20 06:05:11.332426 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 41/101] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:05:11 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1294 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:05:11.639323 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-25c07627-f0ba-4900-a394-ad27462740cf tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:05:11.651605 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-25c07627-f0ba-4900-a394-ad27462740cf tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:05:11.656101 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-25c07627-f0ba-4900-a394-ad27462740cf tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:05:11.660356 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-25c07627-f0ba-4900-a394-ad27462740cf tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1406 microversion: 2.20 time: 0.416084 Oct 20 06:05:11.663901 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 61/102] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:05:11 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1406 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:05:11.687636 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-8c474598-95c6-4bc7-b1be-bc8e61ff582d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:05:11.689264 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-8c474598-95c6-4bc7-b1be-bc8e61ff582d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:05:11.689971 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-78ae1601-c936-48e9-bb28-495c0cab283d tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:05:11.691502 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-78ae1601-c936-48e9-bb28-495c0cab283d tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] [instance: ab6b2605-695c-4ee9-ae33-6234ef22536c] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:05:11.700655 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-8c474598-95c6-4bc7-b1be-bc8e61ff582d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:11.701845 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-8c474598-95c6-4bc7-b1be-bc8e61ff582d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:11.702806 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-8c474598-95c6-4bc7-b1be-bc8e61ff582d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:11.703346 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-78ae1601-c936-48e9-bb28-495c0cab283d tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:11.703846 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-78ae1601-c936-48e9-bb28-495c0cab283d tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:11.704453 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-78ae1601-c936-48e9-bb28-495c0cab283d tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:11.704822 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-8c474598-95c6-4bc7-b1be-bc8e61ff582d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:11.705300 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-8c474598-95c6-4bc7-b1be-bc8e61ff582d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:11.705790 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-78ae1601-c936-48e9-bb28-495c0cab283d tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:11.706261 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-78ae1601-c936-48e9-bb28-495c0cab283d tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:11.706766 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-78ae1601-c936-48e9-bb28-495c0cab283d tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:11.707250 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-8c474598-95c6-4bc7-b1be-bc8e61ff582d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:11.977440 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-8c474598-95c6-4bc7-b1be-bc8e61ff582d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:05:11.988716 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-8c474598-95c6-4bc7-b1be-bc8e61ff582d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1366 microversion: 2.1 time: 0.314447 Oct 20 06:05:11.990045 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 42/103] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:05:11 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1366 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:05:12.084116 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-da24ec91-a7e1-4e70-aa60-68ca6a49287a tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:05:12.085296 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-da24ec91-a7e1-4e70-aa60-68ca6a49287a tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] [instance: e8e2c461-4b15-42ea-bfc7-1daf1fe15f7f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:05:12.108437 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-da24ec91-a7e1-4e70-aa60-68ca6a49287a tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:12.109140 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-da24ec91-a7e1-4e70-aa60-68ca6a49287a tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:12.109810 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-da24ec91-a7e1-4e70-aa60-68ca6a49287a tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:12.110894 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-da24ec91-a7e1-4e70-aa60-68ca6a49287a tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:12.111495 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-da24ec91-a7e1-4e70-aa60-68ca6a49287a tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:12.114370 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-da24ec91-a7e1-4e70-aa60-68ca6a49287a tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:12.293369 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-78ae1601-c936-48e9-bb28-495c0cab283d tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85953d8e7394fb0a6f425ce51420325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72e1785381dd4bdaa2803fa7ef711dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:05:12.303822 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-78ae1601-c936-48e9-bb28-495c0cab283d tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] 10.222.0.20 "GET /compute/v2.1/servers/ab6b2605-695c-4ee9-ae33-6234ef22536c" status: 200 len: 1315 microversion: 2.1 time: 0.618820 Oct 20 06:05:12.305261 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 62/104] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:05:11 2022] GET /compute/v2.1/servers/ab6b2605-695c-4ee9-ae33-6234ef22536c => generated 1315 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:05:12.345265 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG dbcounter [-] [118860] Writing DB stats nova_cell0:SELECT=10 {{(pid=118860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:05:12.387135 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [req-546c7847-da8d-40ce-a2e6-1dbb1eb32f61 req-49ebf626-da95-4026-80a0-cdd90c766e06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4ba366c-2f51-44e0-b5da-c838e4672533", "name": "network-vif-plugged", "status": "completed", "tag": "943f88da-f813-40be-a9ed-2fe73f75124f"}]} {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 06:05:12.396874 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [req-546c7847-da8d-40ce-a2e6-1dbb1eb32f61 req-49ebf626-da95-4026-80a0-cdd90c766e06 service nova] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:12.397343 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [req-546c7847-da8d-40ce-a2e6-1dbb1eb32f61 req-49ebf626-da95-4026-80a0-cdd90c766e06 service nova] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:12.397767 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [req-546c7847-da8d-40ce-a2e6-1dbb1eb32f61 req-49ebf626-da95-4026-80a0-cdd90c766e06 service nova] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:12.409019 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.compute.server_external_events [req-546c7847-da8d-40ce-a2e6-1dbb1eb32f61 req-49ebf626-da95-4026-80a0-cdd90c766e06 service nova] Creating event network-vif-plugged:943f88da-f813-40be-a9ed-2fe73f75124f for instance d4ba366c-2f51-44e0-b5da-c838e4672533 on hv-cinder-86156 Oct 20 06:05:12.414879 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [req-546c7847-da8d-40ce-a2e6-1dbb1eb32f61 req-49ebf626-da95-4026-80a0-cdd90c766e06 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107999 Oct 20 06:05:12.415472 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 63/105] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 20 06:05:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:05:12.420515 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-13a5c4d4-7cbc-4a6e-9571-92a985691aae tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:05:12.421243 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-13a5c4d4-7cbc-4a6e-9571-92a985691aae tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:05:12.428140 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-13a5c4d4-7cbc-4a6e-9571-92a985691aae tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:12.428616 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-13a5c4d4-7cbc-4a6e-9571-92a985691aae tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:12.429077 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-13a5c4d4-7cbc-4a6e-9571-92a985691aae tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:12.429761 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-13a5c4d4-7cbc-4a6e-9571-92a985691aae tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:12.430205 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-13a5c4d4-7cbc-4a6e-9571-92a985691aae tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:12.430619 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-13a5c4d4-7cbc-4a6e-9571-92a985691aae tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:12.491942 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-13a5c4d4-7cbc-4a6e-9571-92a985691aae tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:05:12.499545 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-13a5c4d4-7cbc-4a6e-9571-92a985691aae tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1294 microversion: 2.1 time: 0.082982 Oct 20 06:05:12.500112 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 64/106] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:05:12 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1294 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:05:12.594765 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-da24ec91-a7e1-4e70-aa60-68ca6a49287a tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d4cbd2a2154e5d925462df7c77815a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0d80988ca941acb8ad4318338dfbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:05:12.611925 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-da24ec91-a7e1-4e70-aa60-68ca6a49287a tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] 10.222.0.20 "GET /compute/v2.1/servers/e8e2c461-4b15-42ea-bfc7-1daf1fe15f7f" status: 200 len: 1322 microversion: 2.1 time: 0.533476 Oct 20 06:05:12.612778 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 43/107] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:05:12 2022] GET /compute/v2.1/servers/e8e2c461-4b15-42ea-bfc7-1daf1fe15f7f => generated 1322 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 06:05:12.694242 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-cdda6d44-1177-463d-993c-f44efe00fa95 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:05:12.694945 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-cdda6d44-1177-463d-993c-f44efe00fa95 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:05:12.701611 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-cdda6d44-1177-463d-993c-f44efe00fa95 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:12.702412 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-cdda6d44-1177-463d-993c-f44efe00fa95 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:12.702903 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-cdda6d44-1177-463d-993c-f44efe00fa95 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:12.703932 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-cdda6d44-1177-463d-993c-f44efe00fa95 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:12.704529 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-cdda6d44-1177-463d-993c-f44efe00fa95 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:12.704945 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-cdda6d44-1177-463d-993c-f44efe00fa95 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:12.848861 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-cdda6d44-1177-463d-993c-f44efe00fa95 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:05:12.859227 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-cdda6d44-1177-463d-993c-f44efe00fa95 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:05:12.861230 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-cdda6d44-1177-463d-993c-f44efe00fa95 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:05:12.862852 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-cdda6d44-1177-463d-993c-f44efe00fa95 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1406 microversion: 2.20 time: 0.173043 Oct 20 06:05:12.863595 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 65/108] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:05:12 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1406 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:05:13.015066 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-83fdcc58-cd81-4b3a-a84a-af3c3f7d5955 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:05:13.015505 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-83fdcc58-cd81-4b3a-a84a-af3c3f7d5955 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:05:13.023038 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-83fdcc58-cd81-4b3a-a84a-af3c3f7d5955 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:13.023576 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-83fdcc58-cd81-4b3a-a84a-af3c3f7d5955 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:13.024003 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-83fdcc58-cd81-4b3a-a84a-af3c3f7d5955 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:13.024702 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-83fdcc58-cd81-4b3a-a84a-af3c3f7d5955 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:13.025187 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-83fdcc58-cd81-4b3a-a84a-af3c3f7d5955 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:13.025689 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-83fdcc58-cd81-4b3a-a84a-af3c3f7d5955 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:13.327532 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-afc43917-4095-40ca-bd93-08d0e1069661 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:05:13.328788 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-afc43917-4095-40ca-bd93-08d0e1069661 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] [instance: ab6b2605-695c-4ee9-ae33-6234ef22536c] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:05:13.335693 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-afc43917-4095-40ca-bd93-08d0e1069661 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:13.336367 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-afc43917-4095-40ca-bd93-08d0e1069661 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:13.336995 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-afc43917-4095-40ca-bd93-08d0e1069661 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:13.337892 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-afc43917-4095-40ca-bd93-08d0e1069661 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:13.338570 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-afc43917-4095-40ca-bd93-08d0e1069661 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:13.339187 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-afc43917-4095-40ca-bd93-08d0e1069661 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:13.619513 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-afc43917-4095-40ca-bd93-08d0e1069661 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85953d8e7394fb0a6f425ce51420325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72e1785381dd4bdaa2803fa7ef711dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:05:13.632783 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-afc43917-4095-40ca-bd93-08d0e1069661 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] 10.222.0.20 "GET /compute/v2.1/servers/ab6b2605-695c-4ee9-ae33-6234ef22536c" status: 200 len: 1315 microversion: 2.1 time: 0.308949 Oct 20 06:05:13.647317 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 66/109] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:05:13 2022] GET /compute/v2.1/servers/ab6b2605-695c-4ee9-ae33-6234ef22536c => generated 1315 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:05:13.659896 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-34a78347-314c-4466-922f-a4261edc8d48 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:05:13.663211 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-34a78347-314c-4466-922f-a4261edc8d48 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:05:13.683966 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-34a78347-314c-4466-922f-a4261edc8d48 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:13.685191 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-34a78347-314c-4466-922f-a4261edc8d48 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:13.686056 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-34a78347-314c-4466-922f-a4261edc8d48 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:13.692290 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-34a78347-314c-4466-922f-a4261edc8d48 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:13.694194 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-34a78347-314c-4466-922f-a4261edc8d48 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:13.695881 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-34a78347-314c-4466-922f-a4261edc8d48 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:13.840949 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-83fdcc58-cd81-4b3a-a84a-af3c3f7d5955 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:05:13.852731 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-83fdcc58-cd81-4b3a-a84a-af3c3f7d5955 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1366 microversion: 2.1 time: 0.841513 Oct 20 06:05:13.865196 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 44/110] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:05:13 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1366 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:05:13.873709 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-bcea332a-0fd4-46c5-a2f4-f5ec6ecb7275 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:05:13.874586 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-bcea332a-0fd4-46c5-a2f4-f5ec6ecb7275 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] [instance: e8e2c461-4b15-42ea-bfc7-1daf1fe15f7f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:05:13.882422 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-bcea332a-0fd4-46c5-a2f4-f5ec6ecb7275 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:13.883156 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-bcea332a-0fd4-46c5-a2f4-f5ec6ecb7275 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:13.883807 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-bcea332a-0fd4-46c5-a2f4-f5ec6ecb7275 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:13.887098 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-bcea332a-0fd4-46c5-a2f4-f5ec6ecb7275 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:13.888174 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-bcea332a-0fd4-46c5-a2f4-f5ec6ecb7275 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:13.889093 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-bcea332a-0fd4-46c5-a2f4-f5ec6ecb7275 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:14.106711 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-34a78347-314c-4466-922f-a4261edc8d48 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:05:14.123326 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-34a78347-314c-4466-922f-a4261edc8d48 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1361 microversion: 2.1 time: 0.475547 Oct 20 06:05:14.136725 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 67/111] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:05:13 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1361 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:05:14.136725 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-4d378aa0-b9b2-4eba-8932-9dba12a08799 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:05:14.136725 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-4d378aa0-b9b2-4eba-8932-9dba12a08799 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:05:14.142471 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4d378aa0-b9b2-4eba-8932-9dba12a08799 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:14.144039 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4d378aa0-b9b2-4eba-8932-9dba12a08799 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:14.148303 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4d378aa0-b9b2-4eba-8932-9dba12a08799 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:14.149342 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4d378aa0-b9b2-4eba-8932-9dba12a08799 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:14.150004 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4d378aa0-b9b2-4eba-8932-9dba12a08799 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:14.150622 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4d378aa0-b9b2-4eba-8932-9dba12a08799 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:14.365038 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-4d378aa0-b9b2-4eba-8932-9dba12a08799 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:05:14.375757 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-4d378aa0-b9b2-4eba-8932-9dba12a08799 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:05:14.377738 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-4d378aa0-b9b2-4eba-8932-9dba12a08799 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:05:14.380153 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-4d378aa0-b9b2-4eba-8932-9dba12a08799 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1406 microversion: 2.20 time: 0.254701 Oct 20 06:05:14.393326 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 68/112] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:05:14 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1406 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:05:14.457725 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-bcea332a-0fd4-46c5-a2f4-f5ec6ecb7275 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d4cbd2a2154e5d925462df7c77815a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0d80988ca941acb8ad4318338dfbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:05:14.465641 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-bcea332a-0fd4-46c5-a2f4-f5ec6ecb7275 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] 10.222.0.20 "GET /compute/v2.1/servers/e8e2c461-4b15-42ea-bfc7-1daf1fe15f7f" status: 200 len: 1322 microversion: 2.1 time: 0.599233 Oct 20 06:05:14.466515 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 45/113] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:05:13 2022] GET /compute/v2.1/servers/e8e2c461-4b15-42ea-bfc7-1daf1fe15f7f => generated 1322 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:05:14.662257 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-4403cd0a-99a1-49d8-85b6-7839cff3eae8 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:05:14.662855 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-4403cd0a-99a1-49d8-85b6-7839cff3eae8 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] [instance: ab6b2605-695c-4ee9-ae33-6234ef22536c] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:05:14.669802 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4403cd0a-99a1-49d8-85b6-7839cff3eae8 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:14.670295 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4403cd0a-99a1-49d8-85b6-7839cff3eae8 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:14.670733 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4403cd0a-99a1-49d8-85b6-7839cff3eae8 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:14.671441 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4403cd0a-99a1-49d8-85b6-7839cff3eae8 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:14.671893 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4403cd0a-99a1-49d8-85b6-7839cff3eae8 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:14.672320 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4403cd0a-99a1-49d8-85b6-7839cff3eae8 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:14.809343 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-4403cd0a-99a1-49d8-85b6-7839cff3eae8 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85953d8e7394fb0a6f425ce51420325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72e1785381dd4bdaa2803fa7ef711dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:05:14.817515 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-4403cd0a-99a1-49d8-85b6-7839cff3eae8 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] 10.222.0.20 "GET /compute/v2.1/servers/ab6b2605-695c-4ee9-ae33-6234ef22536c" status: 200 len: 1315 microversion: 2.1 time: 0.159869 Oct 20 06:05:14.818075 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 69/114] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:05:14 2022] GET /compute/v2.1/servers/ab6b2605-695c-4ee9-ae33-6234ef22536c => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:05:14.876788 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-042a625a-4693-4750-a0a6-90811498ba87 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:05:14.877494 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-042a625a-4693-4750-a0a6-90811498ba87 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:05:14.883752 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-042a625a-4693-4750-a0a6-90811498ba87 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:14.884559 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-042a625a-4693-4750-a0a6-90811498ba87 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:14.885089 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-042a625a-4693-4750-a0a6-90811498ba87 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:14.885849 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-042a625a-4693-4750-a0a6-90811498ba87 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:14.886389 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-042a625a-4693-4750-a0a6-90811498ba87 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:14.886883 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-042a625a-4693-4750-a0a6-90811498ba87 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:15.152331 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-e3811d16-f7d0-4540-8482-d16043cf2ba3 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:05:15.153355 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-e3811d16-f7d0-4540-8482-d16043cf2ba3 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:05:15.164402 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e3811d16-f7d0-4540-8482-d16043cf2ba3 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:15.166219 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e3811d16-f7d0-4540-8482-d16043cf2ba3 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:15.167035 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e3811d16-f7d0-4540-8482-d16043cf2ba3 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:15.167999 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e3811d16-f7d0-4540-8482-d16043cf2ba3 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:15.168748 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e3811d16-f7d0-4540-8482-d16043cf2ba3 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:15.169567 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e3811d16-f7d0-4540-8482-d16043cf2ba3 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:15.179788 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-042a625a-4693-4750-a0a6-90811498ba87 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:05:15.190435 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-042a625a-4693-4750-a0a6-90811498ba87 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1366 microversion: 2.1 time: 0.317044 Oct 20 06:05:15.205886 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 46/115] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:05:14 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1366 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:05:15.232589 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [req-eba17a3b-fe07-45de-a537-fa475aeebd5c req-04b77493-8a58-46bc-aad3-a6bf4522da7e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "42fc4539-f891-4ab5-b30a-4bfe5033db86", "tag": "ee7bae4d-a4a0-4251-a372-fbe0545d8c6e"}]} {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 06:05:15.242898 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [req-eba17a3b-fe07-45de-a537-fa475aeebd5c req-04b77493-8a58-46bc-aad3-a6bf4522da7e service nova] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:15.243389 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [req-eba17a3b-fe07-45de-a537-fa475aeebd5c req-04b77493-8a58-46bc-aad3-a6bf4522da7e service nova] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:15.243824 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [req-eba17a3b-fe07-45de-a537-fa475aeebd5c req-04b77493-8a58-46bc-aad3-a6bf4522da7e service nova] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:15.255412 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.compute.server_external_events [req-eba17a3b-fe07-45de-a537-fa475aeebd5c req-04b77493-8a58-46bc-aad3-a6bf4522da7e service nova] Creating event network-changed:ee7bae4d-a4a0-4251-a372-fbe0545d8c6e for instance 42fc4539-f891-4ab5-b30a-4bfe5033db86 on hv-cinder-86156 Oct 20 06:05:15.260810 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [req-eba17a3b-fe07-45de-a537-fa475aeebd5c req-04b77493-8a58-46bc-aad3-a6bf4522da7e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033679 Oct 20 06:05:15.261412 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 47/116] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 20 06:05:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 20 06:05:15.348052 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-e3811d16-f7d0-4540-8482-d16043cf2ba3 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:05:15.351757 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG dbcounter [-] [118861] Writing DB stats nova_cell1:SELECT=100 {{(pid=118861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:05:15.357045 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-e3811d16-f7d0-4540-8482-d16043cf2ba3 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1361 microversion: 2.1 time: 0.209321 Oct 20 06:05:15.357618 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 70/117] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:05:15 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1361 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:05:15.407859 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-58bf7d6e-f852-4d43-8c3a-1186fb38d93e tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:05:15.408550 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-58bf7d6e-f852-4d43-8c3a-1186fb38d93e tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:05:15.415148 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-58bf7d6e-f852-4d43-8c3a-1186fb38d93e tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:15.415630 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-58bf7d6e-f852-4d43-8c3a-1186fb38d93e tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:15.416065 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-58bf7d6e-f852-4d43-8c3a-1186fb38d93e tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:15.416775 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-58bf7d6e-f852-4d43-8c3a-1186fb38d93e tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:15.417227 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-58bf7d6e-f852-4d43-8c3a-1186fb38d93e tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:15.417649 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-58bf7d6e-f852-4d43-8c3a-1186fb38d93e tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:15.487647 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-e9c8207f-5460-4386-b114-3096614405ed tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:05:15.488732 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-e9c8207f-5460-4386-b114-3096614405ed tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] [instance: e8e2c461-4b15-42ea-bfc7-1daf1fe15f7f] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:05:15.494721 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e9c8207f-5460-4386-b114-3096614405ed tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:15.495206 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e9c8207f-5460-4386-b114-3096614405ed tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:15.495630 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e9c8207f-5460-4386-b114-3096614405ed tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:15.496321 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e9c8207f-5460-4386-b114-3096614405ed tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:15.496832 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e9c8207f-5460-4386-b114-3096614405ed tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:15.497274 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e9c8207f-5460-4386-b114-3096614405ed tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:15.647005 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-58bf7d6e-f852-4d43-8c3a-1186fb38d93e tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:05:15.661780 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-58bf7d6e-f852-4d43-8c3a-1186fb38d93e tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:05:15.663774 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-58bf7d6e-f852-4d43-8c3a-1186fb38d93e tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:05:15.665163 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-58bf7d6e-f852-4d43-8c3a-1186fb38d93e tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1406 microversion: 2.20 time: 0.261504 Oct 20 06:05:15.666817 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 48/118] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:05:15 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1406 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:05:15.688912 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-e9c8207f-5460-4386-b114-3096614405ed tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d4cbd2a2154e5d925462df7c77815a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0d80988ca941acb8ad4318338dfbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:05:15.697932 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-e9c8207f-5460-4386-b114-3096614405ed tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] 10.222.0.20 "GET /compute/v2.1/servers/e8e2c461-4b15-42ea-bfc7-1daf1fe15f7f" status: 200 len: 1322 microversion: 2.1 time: 0.214298 Oct 20 06:05:15.698710 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 71/119] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:05:15 2022] GET /compute/v2.1/servers/e8e2c461-4b15-42ea-bfc7-1daf1fe15f7f => generated 1322 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 06:05:15.840299 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-4eeb5840-ce25-46dd-8e3f-fc9fc946a05b tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:05:15.841133 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-4eeb5840-ce25-46dd-8e3f-fc9fc946a05b tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] [instance: ab6b2605-695c-4ee9-ae33-6234ef22536c] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:05:15.847736 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-4eeb5840-ce25-46dd-8e3f-fc9fc946a05b tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:15.848243 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-4eeb5840-ce25-46dd-8e3f-fc9fc946a05b tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:15.848886 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-4eeb5840-ce25-46dd-8e3f-fc9fc946a05b tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:15.849739 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-4eeb5840-ce25-46dd-8e3f-fc9fc946a05b tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:15.850192 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-4eeb5840-ce25-46dd-8e3f-fc9fc946a05b tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:15.850615 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-4eeb5840-ce25-46dd-8e3f-fc9fc946a05b tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:16.003292 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-4eeb5840-ce25-46dd-8e3f-fc9fc946a05b tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85953d8e7394fb0a6f425ce51420325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72e1785381dd4bdaa2803fa7ef711dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:05:16.012267 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-4eeb5840-ce25-46dd-8e3f-fc9fc946a05b tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] 10.222.0.20 "GET /compute/v2.1/servers/ab6b2605-695c-4ee9-ae33-6234ef22536c" status: 200 len: 1315 microversion: 2.1 time: 0.175702 Oct 20 06:05:16.013148 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 49/120] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:05:15 2022] GET /compute/v2.1/servers/ab6b2605-695c-4ee9-ae33-6234ef22536c => generated 1315 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:05:16.214063 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-5572ffab-ebf1-4925-bd74-870d2c304414 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:05:16.214746 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-5572ffab-ebf1-4925-bd74-870d2c304414 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:05:16.220859 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5572ffab-ebf1-4925-bd74-870d2c304414 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:16.221423 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5572ffab-ebf1-4925-bd74-870d2c304414 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:16.222641 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5572ffab-ebf1-4925-bd74-870d2c304414 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:16.223351 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5572ffab-ebf1-4925-bd74-870d2c304414 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:16.223863 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5572ffab-ebf1-4925-bd74-870d2c304414 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:16.224451 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5572ffab-ebf1-4925-bd74-870d2c304414 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:16.382473 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-850cd8a3-1fad-4a9a-91be-c1b29b24766c tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:05:16.384173 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-850cd8a3-1fad-4a9a-91be-c1b29b24766c tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:05:16.390433 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-850cd8a3-1fad-4a9a-91be-c1b29b24766c tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:16.391140 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-850cd8a3-1fad-4a9a-91be-c1b29b24766c tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:16.391492 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-850cd8a3-1fad-4a9a-91be-c1b29b24766c tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:16.392188 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-850cd8a3-1fad-4a9a-91be-c1b29b24766c tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:16.392639 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-850cd8a3-1fad-4a9a-91be-c1b29b24766c tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:16.393527 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-850cd8a3-1fad-4a9a-91be-c1b29b24766c tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:16.428611 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-5572ffab-ebf1-4925-bd74-870d2c304414 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:05:16.436356 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-5572ffab-ebf1-4925-bd74-870d2c304414 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1366 microversion: 2.1 time: 0.226300 Oct 20 06:05:16.436947 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 72/121] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:05:16 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1366 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:05:16.561719 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-850cd8a3-1fad-4a9a-91be-c1b29b24766c tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:05:16.575796 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-850cd8a3-1fad-4a9a-91be-c1b29b24766c tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1361 microversion: 2.1 time: 0.198245 Oct 20 06:05:16.585424 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 50/122] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:05:16 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1361 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:05:16.691688 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-61dd2305-37cb-4273-a8c3-4909d1051d0a tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:05:16.692449 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-61dd2305-37cb-4273-a8c3-4909d1051d0a tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:05:16.699229 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-61dd2305-37cb-4273-a8c3-4909d1051d0a tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:16.699715 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-61dd2305-37cb-4273-a8c3-4909d1051d0a tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:16.700154 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-61dd2305-37cb-4273-a8c3-4909d1051d0a tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:16.700890 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-61dd2305-37cb-4273-a8c3-4909d1051d0a tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:16.701349 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-61dd2305-37cb-4273-a8c3-4909d1051d0a tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:16.701771 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-61dd2305-37cb-4273-a8c3-4909d1051d0a tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:16.724525 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-1e3df8d3-b4e3-453c-9084-df8fd3c30eb1 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:05:16.725298 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-1e3df8d3-b4e3-453c-9084-df8fd3c30eb1 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] [instance: e8e2c461-4b15-42ea-bfc7-1daf1fe15f7f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:05:16.737466 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1e3df8d3-b4e3-453c-9084-df8fd3c30eb1 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:16.737466 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1e3df8d3-b4e3-453c-9084-df8fd3c30eb1 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:16.737466 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1e3df8d3-b4e3-453c-9084-df8fd3c30eb1 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:16.737466 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1e3df8d3-b4e3-453c-9084-df8fd3c30eb1 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:16.738310 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1e3df8d3-b4e3-453c-9084-df8fd3c30eb1 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:16.738310 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1e3df8d3-b4e3-453c-9084-df8fd3c30eb1 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:16.743447 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG dbcounter [-] [118860] Writing DB stats nova_cell1:SELECT=100 {{(pid=118860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:05:16.879854 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-61dd2305-37cb-4273-a8c3-4909d1051d0a tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:05:16.889577 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-61dd2305-37cb-4273-a8c3-4909d1051d0a tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:05:16.891584 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-61dd2305-37cb-4273-a8c3-4909d1051d0a tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:05:16.892987 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-61dd2305-37cb-4273-a8c3-4909d1051d0a tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1406 microversion: 2.20 time: 0.206189 Oct 20 06:05:16.893972 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 73/123] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:05:16 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1406 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:05:16.904314 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-1e3df8d3-b4e3-453c-9084-df8fd3c30eb1 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d4cbd2a2154e5d925462df7c77815a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0d80988ca941acb8ad4318338dfbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:05:16.913172 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-1e3df8d3-b4e3-453c-9084-df8fd3c30eb1 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] 10.222.0.20 "GET /compute/v2.1/servers/e8e2c461-4b15-42ea-bfc7-1daf1fe15f7f" status: 200 len: 1322 microversion: 2.1 time: 0.194475 Oct 20 06:05:16.926331 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 51/124] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:05:16 2022] GET /compute/v2.1/servers/e8e2c461-4b15-42ea-bfc7-1daf1fe15f7f => generated 1322 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:05:17.038576 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-cce41cf3-7dfd-4d41-9c5a-0fc6a4130ac8 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:05:17.039382 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-cce41cf3-7dfd-4d41-9c5a-0fc6a4130ac8 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] [instance: ab6b2605-695c-4ee9-ae33-6234ef22536c] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:05:17.047342 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-cce41cf3-7dfd-4d41-9c5a-0fc6a4130ac8 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:17.047997 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-cce41cf3-7dfd-4d41-9c5a-0fc6a4130ac8 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:17.048604 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-cce41cf3-7dfd-4d41-9c5a-0fc6a4130ac8 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:17.049539 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-cce41cf3-7dfd-4d41-9c5a-0fc6a4130ac8 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:17.050787 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-cce41cf3-7dfd-4d41-9c5a-0fc6a4130ac8 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:17.051390 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-cce41cf3-7dfd-4d41-9c5a-0fc6a4130ac8 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:17.211069 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-cce41cf3-7dfd-4d41-9c5a-0fc6a4130ac8 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85953d8e7394fb0a6f425ce51420325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72e1785381dd4bdaa2803fa7ef711dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:05:17.219528 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-cce41cf3-7dfd-4d41-9c5a-0fc6a4130ac8 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] 10.222.0.20 "GET /compute/v2.1/servers/ab6b2605-695c-4ee9-ae33-6234ef22536c" status: 200 len: 1315 microversion: 2.1 time: 0.186528 Oct 20 06:05:17.226218 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 74/125] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:05:17 2022] GET /compute/v2.1/servers/ab6b2605-695c-4ee9-ae33-6234ef22536c => generated 1315 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:05:17.462840 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-e08f55d9-bffa-4e38-bcce-ac816097e9dc tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:05:17.463506 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-e08f55d9-bffa-4e38-bcce-ac816097e9dc tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:05:17.479438 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e08f55d9-bffa-4e38-bcce-ac816097e9dc tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:17.482081 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e08f55d9-bffa-4e38-bcce-ac816097e9dc tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:17.483082 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e08f55d9-bffa-4e38-bcce-ac816097e9dc tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:17.485414 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e08f55d9-bffa-4e38-bcce-ac816097e9dc tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:17.487274 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e08f55d9-bffa-4e38-bcce-ac816097e9dc tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:17.487787 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e08f55d9-bffa-4e38-bcce-ac816097e9dc tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:17.600984 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-c45983a9-c7ea-4490-9322-a4c94bd90f5b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:05:17.601849 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-c45983a9-c7ea-4490-9322-a4c94bd90f5b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:05:17.615398 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c45983a9-c7ea-4490-9322-a4c94bd90f5b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:17.616116 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c45983a9-c7ea-4490-9322-a4c94bd90f5b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:17.616849 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c45983a9-c7ea-4490-9322-a4c94bd90f5b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:17.617846 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c45983a9-c7ea-4490-9322-a4c94bd90f5b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:17.621028 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c45983a9-c7ea-4490-9322-a4c94bd90f5b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:17.621715 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c45983a9-c7ea-4490-9322-a4c94bd90f5b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:17.843732 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-c45983a9-c7ea-4490-9322-a4c94bd90f5b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:05:17.857336 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-c45983a9-c7ea-4490-9322-a4c94bd90f5b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1361 microversion: 2.1 time: 0.261008 Oct 20 06:05:17.860582 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 75/126] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:05:17 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1361 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:05:17.919608 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-21adc383-4cb8-4fbe-a6a4-a99f8cc5ae1d tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:05:17.920214 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-21adc383-4cb8-4fbe-a6a4-a99f8cc5ae1d tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:05:17.933924 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-21adc383-4cb8-4fbe-a6a4-a99f8cc5ae1d tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:17.934791 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-21adc383-4cb8-4fbe-a6a4-a99f8cc5ae1d tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:17.935265 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-21adc383-4cb8-4fbe-a6a4-a99f8cc5ae1d tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:17.936079 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-21adc383-4cb8-4fbe-a6a4-a99f8cc5ae1d tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:17.936531 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-21adc383-4cb8-4fbe-a6a4-a99f8cc5ae1d tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:17.937010 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-21adc383-4cb8-4fbe-a6a4-a99f8cc5ae1d tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:18.028741 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-e08f55d9-bffa-4e38-bcce-ac816097e9dc tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:05:18.040640 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-e08f55d9-bffa-4e38-bcce-ac816097e9dc tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1366 microversion: 2.1 time: 0.584651 Oct 20 06:05:18.041680 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 52/127] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:05:17 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1366 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:05:18.047244 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-98cd0f54-26a0-432b-8da9-b92995983ff8 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:05:18.048149 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-98cd0f54-26a0-432b-8da9-b92995983ff8 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] [instance: e8e2c461-4b15-42ea-bfc7-1daf1fe15f7f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:05:18.058962 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-98cd0f54-26a0-432b-8da9-b92995983ff8 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:18.060008 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-98cd0f54-26a0-432b-8da9-b92995983ff8 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:18.060724 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-98cd0f54-26a0-432b-8da9-b92995983ff8 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:18.062954 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-98cd0f54-26a0-432b-8da9-b92995983ff8 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:18.063516 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-98cd0f54-26a0-432b-8da9-b92995983ff8 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:18.064011 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-98cd0f54-26a0-432b-8da9-b92995983ff8 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:18.211264 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-21adc383-4cb8-4fbe-a6a4-a99f8cc5ae1d tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:05:18.221488 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-21adc383-4cb8-4fbe-a6a4-a99f8cc5ae1d tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:05:18.223536 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-21adc383-4cb8-4fbe-a6a4-a99f8cc5ae1d tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:05:18.224678 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-21adc383-4cb8-4fbe-a6a4-a99f8cc5ae1d tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1406 microversion: 2.20 time: 0.308926 Oct 20 06:05:18.250003 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 76/128] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:05:17 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1406 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:05:18.256548 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-4e559100-ef48-4b70-9b1c-b0e7bfe26c9f tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:05:18.257032 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-98cd0f54-26a0-432b-8da9-b92995983ff8 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d4cbd2a2154e5d925462df7c77815a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0d80988ca941acb8ad4318338dfbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:05:18.257457 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-4e559100-ef48-4b70-9b1c-b0e7bfe26c9f tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] [instance: ab6b2605-695c-4ee9-ae33-6234ef22536c] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:05:18.269059 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-98cd0f54-26a0-432b-8da9-b92995983ff8 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] 10.222.0.20 "GET /compute/v2.1/servers/e8e2c461-4b15-42ea-bfc7-1daf1fe15f7f" status: 200 len: 1322 microversion: 2.1 time: 0.226006 Oct 20 06:05:18.269818 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 53/129] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:05:18 2022] GET /compute/v2.1/servers/e8e2c461-4b15-42ea-bfc7-1daf1fe15f7f => generated 1322 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:05:18.274613 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4e559100-ef48-4b70-9b1c-b0e7bfe26c9f tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:18.275743 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4e559100-ef48-4b70-9b1c-b0e7bfe26c9f tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:18.276530 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4e559100-ef48-4b70-9b1c-b0e7bfe26c9f tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:18.287286 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4e559100-ef48-4b70-9b1c-b0e7bfe26c9f tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:18.287286 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4e559100-ef48-4b70-9b1c-b0e7bfe26c9f tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:18.287286 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4e559100-ef48-4b70-9b1c-b0e7bfe26c9f tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:18.446387 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-4e559100-ef48-4b70-9b1c-b0e7bfe26c9f tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85953d8e7394fb0a6f425ce51420325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72e1785381dd4bdaa2803fa7ef711dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:05:18.454563 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-4e559100-ef48-4b70-9b1c-b0e7bfe26c9f tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] 10.222.0.20 "GET /compute/v2.1/servers/ab6b2605-695c-4ee9-ae33-6234ef22536c" status: 200 len: 1315 microversion: 2.1 time: 0.203176 Oct 20 06:05:18.455301 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 77/130] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:05:18 2022] GET /compute/v2.1/servers/ab6b2605-695c-4ee9-ae33-6234ef22536c => generated 1315 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:05:18.880073 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-6886985f-908c-4ecf-a8c6-48c2ce67750d tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:05:18.880673 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-6886985f-908c-4ecf-a8c6-48c2ce67750d tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:05:18.898196 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-6886985f-908c-4ecf-a8c6-48c2ce67750d tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:18.898681 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-6886985f-908c-4ecf-a8c6-48c2ce67750d tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:18.899267 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-6886985f-908c-4ecf-a8c6-48c2ce67750d tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:18.899969 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-6886985f-908c-4ecf-a8c6-48c2ce67750d tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:18.900561 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-6886985f-908c-4ecf-a8c6-48c2ce67750d tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:18.901141 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-6886985f-908c-4ecf-a8c6-48c2ce67750d tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:19.068393 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-5cbac293-d4d6-4edf-99d9-1a9111081cc2 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:05:19.069667 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-5cbac293-d4d6-4edf-99d9-1a9111081cc2 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:05:19.081733 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5cbac293-d4d6-4edf-99d9-1a9111081cc2 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:19.082224 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5cbac293-d4d6-4edf-99d9-1a9111081cc2 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:19.086352 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5cbac293-d4d6-4edf-99d9-1a9111081cc2 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:19.089225 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5cbac293-d4d6-4edf-99d9-1a9111081cc2 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:19.089942 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5cbac293-d4d6-4edf-99d9-1a9111081cc2 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:19.090388 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5cbac293-d4d6-4edf-99d9-1a9111081cc2 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:19.121197 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-6886985f-908c-4ecf-a8c6-48c2ce67750d tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:05:19.134182 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-6886985f-908c-4ecf-a8c6-48c2ce67750d tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1361 microversion: 2.1 time: 0.258131 Oct 20 06:05:19.139760 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 54/131] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:05:18 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1361 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:05:19.254080 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-1221eb2c-e79b-4a26-8d43-9d3e7c3a81d5 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:05:19.254812 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-1221eb2c-e79b-4a26-8d43-9d3e7c3a81d5 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:05:19.261302 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1221eb2c-e79b-4a26-8d43-9d3e7c3a81d5 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:19.261780 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1221eb2c-e79b-4a26-8d43-9d3e7c3a81d5 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:19.262201 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1221eb2c-e79b-4a26-8d43-9d3e7c3a81d5 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:19.263076 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1221eb2c-e79b-4a26-8d43-9d3e7c3a81d5 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:19.263522 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1221eb2c-e79b-4a26-8d43-9d3e7c3a81d5 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:19.263945 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1221eb2c-e79b-4a26-8d43-9d3e7c3a81d5 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:19.266929 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-5cbac293-d4d6-4edf-99d9-1a9111081cc2 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:05:19.280455 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-5cbac293-d4d6-4edf-99d9-1a9111081cc2 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1366 microversion: 2.1 time: 0.217101 Oct 20 06:05:19.281346 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 78/132] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:05:19 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1366 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:05:19.307375 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-6513b964-2ff3-4e2e-a897-8263d9e3d99e tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:05:19.308341 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-6513b964-2ff3-4e2e-a897-8263d9e3d99e tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] [instance: e8e2c461-4b15-42ea-bfc7-1daf1fe15f7f] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:05:19.321252 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-6513b964-2ff3-4e2e-a897-8263d9e3d99e tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:19.322789 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-6513b964-2ff3-4e2e-a897-8263d9e3d99e tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:19.323887 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-6513b964-2ff3-4e2e-a897-8263d9e3d99e tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:19.325358 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-6513b964-2ff3-4e2e-a897-8263d9e3d99e tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:19.326223 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-6513b964-2ff3-4e2e-a897-8263d9e3d99e tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:19.326657 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-6513b964-2ff3-4e2e-a897-8263d9e3d99e tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:19.554060 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-6513b964-2ff3-4e2e-a897-8263d9e3d99e tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d4cbd2a2154e5d925462df7c77815a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0d80988ca941acb8ad4318338dfbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:05:19.561926 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-6513b964-2ff3-4e2e-a897-8263d9e3d99e tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] 10.222.0.20 "GET /compute/v2.1/servers/e8e2c461-4b15-42ea-bfc7-1daf1fe15f7f" status: 200 len: 1322 microversion: 2.1 time: 0.259573 Oct 20 06:05:19.562754 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 79/133] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:05:19 2022] GET /compute/v2.1/servers/e8e2c461-4b15-42ea-bfc7-1daf1fe15f7f => generated 1322 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:05:19.568394 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-9c4e906b-c091-4f9a-b240-3fc4e2939a19 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:05:19.569345 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-9c4e906b-c091-4f9a-b240-3fc4e2939a19 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] [instance: ab6b2605-695c-4ee9-ae33-6234ef22536c] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:05:19.575442 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-9c4e906b-c091-4f9a-b240-3fc4e2939a19 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:19.576146 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-9c4e906b-c091-4f9a-b240-3fc4e2939a19 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:19.576812 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-9c4e906b-c091-4f9a-b240-3fc4e2939a19 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:19.577708 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-9c4e906b-c091-4f9a-b240-3fc4e2939a19 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:19.578452 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-9c4e906b-c091-4f9a-b240-3fc4e2939a19 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:19.579072 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-9c4e906b-c091-4f9a-b240-3fc4e2939a19 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:19.605485 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-1221eb2c-e79b-4a26-8d43-9d3e7c3a81d5 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:05:19.618129 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-1221eb2c-e79b-4a26-8d43-9d3e7c3a81d5 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:05:19.622582 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-1221eb2c-e79b-4a26-8d43-9d3e7c3a81d5 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:05:19.624275 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-1221eb2c-e79b-4a26-8d43-9d3e7c3a81d5 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1406 microversion: 2.20 time: 0.374088 Oct 20 06:05:19.627368 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 55/134] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:05:19 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1406 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 20 06:05:19.801624 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-9c4e906b-c091-4f9a-b240-3fc4e2939a19 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85953d8e7394fb0a6f425ce51420325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72e1785381dd4bdaa2803fa7ef711dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:05:19.817770 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-9c4e906b-c091-4f9a-b240-3fc4e2939a19 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] 10.222.0.20 "GET /compute/v2.1/servers/ab6b2605-695c-4ee9-ae33-6234ef22536c" status: 200 len: 1315 microversion: 2.1 time: 0.251960 Oct 20 06:05:19.819846 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 80/135] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:05:19 2022] GET /compute/v2.1/servers/ab6b2605-695c-4ee9-ae33-6234ef22536c => generated 1315 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:05:20.001966 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [req-681f88be-ffc1-46c5-90ff-b11e685b5702 req-37be0ee5-00ed-4763-8e32-bae9081a0a15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d38a019f-4bfc-4845-900b-a9e4e6397373", "name": "network-vif-plugged", "status": "completed", "tag": "96706f05-eb97-4530-8210-9800d1f1d106"}]} {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 06:05:20.014886 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [req-681f88be-ffc1-46c5-90ff-b11e685b5702 req-37be0ee5-00ed-4763-8e32-bae9081a0a15 service nova] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:20.015936 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [req-681f88be-ffc1-46c5-90ff-b11e685b5702 req-37be0ee5-00ed-4763-8e32-bae9081a0a15 service nova] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:20.016301 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [req-681f88be-ffc1-46c5-90ff-b11e685b5702 req-37be0ee5-00ed-4763-8e32-bae9081a0a15 service nova] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:20.030461 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.compute.server_external_events [req-681f88be-ffc1-46c5-90ff-b11e685b5702 req-37be0ee5-00ed-4763-8e32-bae9081a0a15 service nova] Creating event network-vif-plugged:96706f05-eb97-4530-8210-9800d1f1d106 for instance d38a019f-4bfc-4845-900b-a9e4e6397373 on hv-cinder-86156 Oct 20 06:05:20.037050 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [req-681f88be-ffc1-46c5-90ff-b11e685b5702 req-37be0ee5-00ed-4763-8e32-bae9081a0a15 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040445 Oct 20 06:05:20.038132 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 56/136] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 20 06:05:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:05:20.166640 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-0391f0fd-f869-4c71-989c-0f7aaf86b4ec tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:05:20.167347 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-0391f0fd-f869-4c71-989c-0f7aaf86b4ec tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:05:20.176743 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-0391f0fd-f869-4c71-989c-0f7aaf86b4ec tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:20.177672 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-0391f0fd-f869-4c71-989c-0f7aaf86b4ec tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:20.178418 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-0391f0fd-f869-4c71-989c-0f7aaf86b4ec tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:20.179367 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-0391f0fd-f869-4c71-989c-0f7aaf86b4ec tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:20.180520 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-0391f0fd-f869-4c71-989c-0f7aaf86b4ec tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:20.181186 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-0391f0fd-f869-4c71-989c-0f7aaf86b4ec tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:20.307943 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-50ef8f8f-29d8-4740-a9da-54590b70af2c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:05:20.308721 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-50ef8f8f-29d8-4740-a9da-54590b70af2c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:05:20.322991 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-50ef8f8f-29d8-4740-a9da-54590b70af2c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:20.323640 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-50ef8f8f-29d8-4740-a9da-54590b70af2c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:20.324118 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-50ef8f8f-29d8-4740-a9da-54590b70af2c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:20.324856 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-50ef8f8f-29d8-4740-a9da-54590b70af2c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:20.325317 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-50ef8f8f-29d8-4740-a9da-54590b70af2c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:20.325747 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-50ef8f8f-29d8-4740-a9da-54590b70af2c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:20.352900 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-0391f0fd-f869-4c71-989c-0f7aaf86b4ec tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:05:20.360940 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-0391f0fd-f869-4c71-989c-0f7aaf86b4ec tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1361 microversion: 2.1 time: 0.201246 Oct 20 06:05:20.369593 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 81/137] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:05:20 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1361 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:05:20.541141 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-50ef8f8f-29d8-4740-a9da-54590b70af2c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:05:20.553179 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-50ef8f8f-29d8-4740-a9da-54590b70af2c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1556 microversion: 2.1 time: 0.252878 Oct 20 06:05:20.570856 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 57/138] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:05:20 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1556 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:05:20.583818 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-abfc79cd-80ca-44a4-a1fe-29e1fa40ae92 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:05:20.584263 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-abfc79cd-80ca-44a4-a1fe-29e1fa40ae92 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:05:20.588411 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-7443d493-49b7-4aac-b870-c6e489eef53d tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:05:20.589413 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-7443d493-49b7-4aac-b870-c6e489eef53d tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] [instance: e8e2c461-4b15-42ea-bfc7-1daf1fe15f7f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:05:20.590285 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-abfc79cd-80ca-44a4-a1fe-29e1fa40ae92 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:20.591009 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-abfc79cd-80ca-44a4-a1fe-29e1fa40ae92 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:20.591822 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-abfc79cd-80ca-44a4-a1fe-29e1fa40ae92 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:20.592771 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-abfc79cd-80ca-44a4-a1fe-29e1fa40ae92 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:20.593455 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-abfc79cd-80ca-44a4-a1fe-29e1fa40ae92 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:20.594117 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-abfc79cd-80ca-44a4-a1fe-29e1fa40ae92 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:20.595615 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7443d493-49b7-4aac-b870-c6e489eef53d tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:20.596535 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7443d493-49b7-4aac-b870-c6e489eef53d tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:20.597772 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7443d493-49b7-4aac-b870-c6e489eef53d tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:20.598793 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7443d493-49b7-4aac-b870-c6e489eef53d tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:20.599413 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7443d493-49b7-4aac-b870-c6e489eef53d tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:20.600088 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7443d493-49b7-4aac-b870-c6e489eef53d tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:20.747432 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-abfc79cd-80ca-44a4-a1fe-29e1fa40ae92 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.168736 Oct 20 06:05:20.748448 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 82/139] 10.222.0.20 () {58 vars in 1275 bytes} [Thu Oct 20 06:05:20 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-interface => generated 284 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:05:20.753820 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-ffbba443-39de-4825-98aa-fee4c0903add tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:05:20.754832 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-ffbba443-39de-4825-98aa-fee4c0903add tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:05:20.764131 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ffbba443-39de-4825-98aa-fee4c0903add tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:20.764956 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ffbba443-39de-4825-98aa-fee4c0903add tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:20.765752 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ffbba443-39de-4825-98aa-fee4c0903add tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:20.766682 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ffbba443-39de-4825-98aa-fee4c0903add tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:20.767646 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ffbba443-39de-4825-98aa-fee4c0903add tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:20.768312 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ffbba443-39de-4825-98aa-fee4c0903add tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:20.787648 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-7443d493-49b7-4aac-b870-c6e489eef53d tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d4cbd2a2154e5d925462df7c77815a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0d80988ca941acb8ad4318338dfbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:05:20.797507 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-7443d493-49b7-4aac-b870-c6e489eef53d tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] 10.222.0.20 "GET /compute/v2.1/servers/e8e2c461-4b15-42ea-bfc7-1daf1fe15f7f" status: 200 len: 1322 microversion: 2.1 time: 0.216945 Oct 20 06:05:20.798237 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 58/140] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:05:20 2022] GET /compute/v2.1/servers/e8e2c461-4b15-42ea-bfc7-1daf1fe15f7f => generated 1322 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:05:20.848203 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-f5f55836-088a-4c90-88e0-2f3cf81f9966 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:05:20.848865 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-f5f55836-088a-4c90-88e0-2f3cf81f9966 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] [instance: ab6b2605-695c-4ee9-ae33-6234ef22536c] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:05:20.858695 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f5f55836-088a-4c90-88e0-2f3cf81f9966 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:20.860246 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f5f55836-088a-4c90-88e0-2f3cf81f9966 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:20.861526 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f5f55836-088a-4c90-88e0-2f3cf81f9966 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:20.862596 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f5f55836-088a-4c90-88e0-2f3cf81f9966 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:20.865239 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f5f55836-088a-4c90-88e0-2f3cf81f9966 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:20.865836 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f5f55836-088a-4c90-88e0-2f3cf81f9966 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:21.315442 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-f5f55836-088a-4c90-88e0-2f3cf81f9966 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85953d8e7394fb0a6f425ce51420325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72e1785381dd4bdaa2803fa7ef711dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:05:21.324184 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-f5f55836-088a-4c90-88e0-2f3cf81f9966 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] 10.222.0.20 "GET /compute/v2.1/servers/ab6b2605-695c-4ee9-ae33-6234ef22536c" status: 200 len: 1315 microversion: 2.1 time: 0.481836 Oct 20 06:05:21.328744 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 59/141] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:05:20 2022] GET /compute/v2.1/servers/ab6b2605-695c-4ee9-ae33-6234ef22536c => generated 1315 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:05:21.385591 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-bc73408f-da58-4f5c-8185-3230cebc3164 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:05:21.386452 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-bc73408f-da58-4f5c-8185-3230cebc3164 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:05:21.392464 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-bc73408f-da58-4f5c-8185-3230cebc3164 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:21.393215 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-bc73408f-da58-4f5c-8185-3230cebc3164 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:21.393867 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-bc73408f-da58-4f5c-8185-3230cebc3164 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:21.394865 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-bc73408f-da58-4f5c-8185-3230cebc3164 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:21.395493 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-bc73408f-da58-4f5c-8185-3230cebc3164 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:21.396058 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-bc73408f-da58-4f5c-8185-3230cebc3164 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:21.492578 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-ffbba443-39de-4825-98aa-fee4c0903add tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:05:21.502216 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-ffbba443-39de-4825-98aa-fee4c0903add tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:05:21.505092 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-ffbba443-39de-4825-98aa-fee4c0903add tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:05:21.506547 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-ffbba443-39de-4825-98aa-fee4c0903add tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1406 microversion: 2.20 time: 0.756618 Oct 20 06:05:21.510115 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 83/142] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:05:20 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1406 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:05:21.553880 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-bc73408f-da58-4f5c-8185-3230cebc3164 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:05:21.563272 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-bc73408f-da58-4f5c-8185-3230cebc3164 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1361 microversion: 2.1 time: 0.181499 Oct 20 06:05:21.564586 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 60/143] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:05:21 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1361 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:05:21.829808 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-2e1a44aa-fc26-466a-badb-268a38e2c43d tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:05:21.833644 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-2e1a44aa-fc26-466a-badb-268a38e2c43d tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] [instance: e8e2c461-4b15-42ea-bfc7-1daf1fe15f7f] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:05:21.851357 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG dbcounter [-] [118861] Writing DB stats nova_api:SELECT=100 {{(pid=118861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:05:21.855289 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-2e1a44aa-fc26-466a-badb-268a38e2c43d tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:21.857682 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-2e1a44aa-fc26-466a-badb-268a38e2c43d tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:21.858830 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-2e1a44aa-fc26-466a-badb-268a38e2c43d tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:21.862968 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-2e1a44aa-fc26-466a-badb-268a38e2c43d tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:21.863766 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-2e1a44aa-fc26-466a-badb-268a38e2c43d tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:21.864911 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-2e1a44aa-fc26-466a-badb-268a38e2c43d tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:22.092204 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [req-439bce5d-1c69-4c8c-862f-f9bdf50149ea req-d1278678-3b8d-454f-a35d-d163ee0ac138 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8e2c461-4b15-42ea-bfc7-1daf1fe15f7f", "name": "network-vif-plugged", "status": "completed", "tag": "c9ce8d7f-24b9-4d6f-ac5d-3049f7eed554"}, {"server_uuid": "ab6b2605-695c-4ee9-ae33-6234ef22536c", "name": "network-vif-plugged", "status": "completed", "tag": "e8a81f7e-ee04-474a-9073-057e1d862c26"}]} {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 06:05:22.114588 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [req-439bce5d-1c69-4c8c-862f-f9bdf50149ea req-d1278678-3b8d-454f-a35d-d163ee0ac138 service nova] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:22.118216 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [req-439bce5d-1c69-4c8c-862f-f9bdf50149ea req-d1278678-3b8d-454f-a35d-d163ee0ac138 service nova] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:22.118677 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [req-439bce5d-1c69-4c8c-862f-f9bdf50149ea req-d1278678-3b8d-454f-a35d-d163ee0ac138 service nova] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:22.148742 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.compute.server_external_events [req-439bce5d-1c69-4c8c-862f-f9bdf50149ea req-d1278678-3b8d-454f-a35d-d163ee0ac138 service nova] Creating event network-vif-plugged:c9ce8d7f-24b9-4d6f-ac5d-3049f7eed554 for instance e8e2c461-4b15-42ea-bfc7-1daf1fe15f7f on hv-cinder-86156 Oct 20 06:05:22.149326 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.compute.server_external_events [req-439bce5d-1c69-4c8c-862f-f9bdf50149ea req-d1278678-3b8d-454f-a35d-d163ee0ac138 service nova] Creating event network-vif-plugged:e8a81f7e-ee04-474a-9073-057e1d862c26 for instance ab6b2605-695c-4ee9-ae33-6234ef22536c on hv-cinder-86156 Oct 20 06:05:22.166030 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [req-439bce5d-1c69-4c8c-862f-f9bdf50149ea req-d1278678-3b8d-454f-a35d-d163ee0ac138 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.077959 Oct 20 06:05:22.168559 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 61/144] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 20 06:05:22 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 20 06:05:22.280769 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-2e1a44aa-fc26-466a-badb-268a38e2c43d tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d4cbd2a2154e5d925462df7c77815a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0d80988ca941acb8ad4318338dfbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:05:22.293241 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-2e1a44aa-fc26-466a-badb-268a38e2c43d tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] 10.222.0.20 "GET /compute/v2.1/servers/e8e2c461-4b15-42ea-bfc7-1daf1fe15f7f" status: 200 len: 1322 microversion: 2.1 time: 0.470913 Oct 20 06:05:22.293852 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 84/145] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:05:21 2022] GET /compute/v2.1/servers/e8e2c461-4b15-42ea-bfc7-1daf1fe15f7f => generated 1322 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 06:05:22.351121 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-664d730f-9af7-41b4-b2d2-b18c0878848e tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:05:22.353606 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-664d730f-9af7-41b4-b2d2-b18c0878848e tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] [instance: ab6b2605-695c-4ee9-ae33-6234ef22536c] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:05:22.372428 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-664d730f-9af7-41b4-b2d2-b18c0878848e tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:22.373827 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-664d730f-9af7-41b4-b2d2-b18c0878848e tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:22.375865 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-664d730f-9af7-41b4-b2d2-b18c0878848e tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:22.380124 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-664d730f-9af7-41b4-b2d2-b18c0878848e tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:22.382350 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-664d730f-9af7-41b4-b2d2-b18c0878848e tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:22.383492 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-664d730f-9af7-41b4-b2d2-b18c0878848e tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:22.532369 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-fc8307a7-c3cb-495e-b2d0-4b7b1ca78d58 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:05:22.533753 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-fc8307a7-c3cb-495e-b2d0-4b7b1ca78d58 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:05:22.545943 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-fc8307a7-c3cb-495e-b2d0-4b7b1ca78d58 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:22.546397 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-fc8307a7-c3cb-495e-b2d0-4b7b1ca78d58 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:22.546828 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-fc8307a7-c3cb-495e-b2d0-4b7b1ca78d58 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:22.547545 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-fc8307a7-c3cb-495e-b2d0-4b7b1ca78d58 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:22.547984 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-fc8307a7-c3cb-495e-b2d0-4b7b1ca78d58 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:22.548732 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-fc8307a7-c3cb-495e-b2d0-4b7b1ca78d58 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:22.609335 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-664d730f-9af7-41b4-b2d2-b18c0878848e tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85953d8e7394fb0a6f425ce51420325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72e1785381dd4bdaa2803fa7ef711dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:05:22.618935 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-664d730f-9af7-41b4-b2d2-b18c0878848e tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] 10.222.0.20 "GET /compute/v2.1/servers/ab6b2605-695c-4ee9-ae33-6234ef22536c" status: 200 len: 1315 microversion: 2.1 time: 0.274971 Oct 20 06:05:22.619512 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 62/146] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:05:22 2022] GET /compute/v2.1/servers/ab6b2605-695c-4ee9-ae33-6234ef22536c => generated 1315 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:05:22.624135 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-c3224ed6-cee5-4f29-bf57-feffa8f4ec61 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:05:22.624754 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-c3224ed6-cee5-4f29-bf57-feffa8f4ec61 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:05:22.631566 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c3224ed6-cee5-4f29-bf57-feffa8f4ec61 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:22.632056 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c3224ed6-cee5-4f29-bf57-feffa8f4ec61 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:22.632493 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c3224ed6-cee5-4f29-bf57-feffa8f4ec61 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:22.633208 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c3224ed6-cee5-4f29-bf57-feffa8f4ec61 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:22.634109 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c3224ed6-cee5-4f29-bf57-feffa8f4ec61 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:22.634913 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c3224ed6-cee5-4f29-bf57-feffa8f4ec61 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:22.890371 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-fc8307a7-c3cb-495e-b2d0-4b7b1ca78d58 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:05:22.902291 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-fc8307a7-c3cb-495e-b2d0-4b7b1ca78d58 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:05:22.906276 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-fc8307a7-c3cb-495e-b2d0-4b7b1ca78d58 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:05:22.911009 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-fc8307a7-c3cb-495e-b2d0-4b7b1ca78d58 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1406 microversion: 2.20 time: 0.381000 Oct 20 06:05:22.914568 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 85/147] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:05:22 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1406 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 20 06:05:23.097858 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-c3224ed6-cee5-4f29-bf57-feffa8f4ec61 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:05:23.110850 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-c3224ed6-cee5-4f29-bf57-feffa8f4ec61 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1361 microversion: 2.1 time: 0.490160 Oct 20 06:05:23.111677 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 63/148] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:05:22 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1361 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:05:23.289223 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [req-ac03ebb1-4419-4686-9579-c2a7ccc00df8 req-06bb180a-1e44-4260-a3e4-0fa054291492 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4ba366c-2f51-44e0-b5da-c838e4672533", "tag": "943f88da-f813-40be-a9ed-2fe73f75124f"}]} {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 06:05:23.310888 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [req-ac03ebb1-4419-4686-9579-c2a7ccc00df8 req-06bb180a-1e44-4260-a3e4-0fa054291492 service nova] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:23.312534 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [req-ac03ebb1-4419-4686-9579-c2a7ccc00df8 req-06bb180a-1e44-4260-a3e4-0fa054291492 service nova] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:23.313014 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [req-ac03ebb1-4419-4686-9579-c2a7ccc00df8 req-06bb180a-1e44-4260-a3e4-0fa054291492 service nova] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:23.317873 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-b0d4264b-cf3e-4f7d-b86d-dbc1c0e6b557 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:05:23.319669 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-b0d4264b-cf3e-4f7d-b86d-dbc1c0e6b557 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] [instance: e8e2c461-4b15-42ea-bfc7-1daf1fe15f7f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:05:23.322295 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG dbcounter [-] [118860] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=118860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:05:23.327721 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.compute.server_external_events [req-ac03ebb1-4419-4686-9579-c2a7ccc00df8 req-06bb180a-1e44-4260-a3e4-0fa054291492 service nova] Creating event network-changed:943f88da-f813-40be-a9ed-2fe73f75124f for instance d4ba366c-2f51-44e0-b5da-c838e4672533 on hv-cinder-86156 Oct 20 06:05:23.330104 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b0d4264b-cf3e-4f7d-b86d-dbc1c0e6b557 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:23.330854 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b0d4264b-cf3e-4f7d-b86d-dbc1c0e6b557 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:23.332405 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b0d4264b-cf3e-4f7d-b86d-dbc1c0e6b557 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:23.334356 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b0d4264b-cf3e-4f7d-b86d-dbc1c0e6b557 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:23.334684 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [req-ac03ebb1-4419-4686-9579-c2a7ccc00df8 req-06bb180a-1e44-4260-a3e4-0fa054291492 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051873 Oct 20 06:05:23.335286 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 86/149] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 20 06:05:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 20 06:05:23.338754 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b0d4264b-cf3e-4f7d-b86d-dbc1c0e6b557 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:23.339315 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b0d4264b-cf3e-4f7d-b86d-dbc1c0e6b557 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:23.525363 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-b0d4264b-cf3e-4f7d-b86d-dbc1c0e6b557 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d4cbd2a2154e5d925462df7c77815a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0d80988ca941acb8ad4318338dfbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:05:23.562361 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-b0d4264b-cf3e-4f7d-b86d-dbc1c0e6b557 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] 10.222.0.20 "GET /compute/v2.1/servers/e8e2c461-4b15-42ea-bfc7-1daf1fe15f7f" status: 200 len: 1322 microversion: 2.1 time: 0.249664 Oct 20 06:05:23.576953 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 64/150] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:05:23 2022] GET /compute/v2.1/servers/e8e2c461-4b15-42ea-bfc7-1daf1fe15f7f => generated 1322 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 06:05:23.653536 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-44c84fa5-604f-4278-887e-43f53ecb5656 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:05:23.654229 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-44c84fa5-604f-4278-887e-43f53ecb5656 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] [instance: ab6b2605-695c-4ee9-ae33-6234ef22536c] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:05:23.661400 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-44c84fa5-604f-4278-887e-43f53ecb5656 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:23.661883 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-44c84fa5-604f-4278-887e-43f53ecb5656 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:23.662312 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-44c84fa5-604f-4278-887e-43f53ecb5656 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:23.663006 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-44c84fa5-604f-4278-887e-43f53ecb5656 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:23.663451 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-44c84fa5-604f-4278-887e-43f53ecb5656 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:23.663865 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-44c84fa5-604f-4278-887e-43f53ecb5656 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:23.839280 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-44c84fa5-604f-4278-887e-43f53ecb5656 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85953d8e7394fb0a6f425ce51420325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72e1785381dd4bdaa2803fa7ef711dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:05:23.848964 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-44c84fa5-604f-4278-887e-43f53ecb5656 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] 10.222.0.20 "GET /compute/v2.1/servers/ab6b2605-695c-4ee9-ae33-6234ef22536c" status: 200 len: 1315 microversion: 2.1 time: 0.199739 Oct 20 06:05:23.849525 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 87/151] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:05:23 2022] GET /compute/v2.1/servers/ab6b2605-695c-4ee9-ae33-6234ef22536c => generated 1315 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:05:23.940034 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-80d501dc-b577-47a1-b3c4-d4e7b79564e6 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:05:23.941180 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-80d501dc-b577-47a1-b3c4-d4e7b79564e6 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:05:23.950993 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-80d501dc-b577-47a1-b3c4-d4e7b79564e6 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:23.950993 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-80d501dc-b577-47a1-b3c4-d4e7b79564e6 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:23.950993 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-80d501dc-b577-47a1-b3c4-d4e7b79564e6 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:23.950993 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-80d501dc-b577-47a1-b3c4-d4e7b79564e6 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:23.951505 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-80d501dc-b577-47a1-b3c4-d4e7b79564e6 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:23.951505 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-80d501dc-b577-47a1-b3c4-d4e7b79564e6 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:24.107856 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-80d501dc-b577-47a1-b3c4-d4e7b79564e6 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:05:24.118007 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-80d501dc-b577-47a1-b3c4-d4e7b79564e6 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:05:24.119644 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-80d501dc-b577-47a1-b3c4-d4e7b79564e6 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:05:24.121165 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-80d501dc-b577-47a1-b3c4-d4e7b79564e6 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1406 microversion: 2.20 time: 0.185208 Oct 20 06:05:24.121973 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 65/152] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:05:23 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1406 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:05:24.135886 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-6f6227b8-775a-4b76-a670-87021352b393 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:05:24.136850 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-6f6227b8-775a-4b76-a670-87021352b393 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:05:24.144210 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-6f6227b8-775a-4b76-a670-87021352b393 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:24.144731 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-6f6227b8-775a-4b76-a670-87021352b393 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:24.145171 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-6f6227b8-775a-4b76-a670-87021352b393 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:24.145867 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-6f6227b8-775a-4b76-a670-87021352b393 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:24.146469 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-6f6227b8-775a-4b76-a670-87021352b393 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:24.147193 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-6f6227b8-775a-4b76-a670-87021352b393 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:24.166951 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG dbcounter [-] [118861] Writing DB stats nova_cell1:SELECT=100 {{(pid=118861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:05:24.597976 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-189ac07c-a22d-4471-a152-9fef575776cd tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:05:24.599097 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-189ac07c-a22d-4471-a152-9fef575776cd tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] [instance: e8e2c461-4b15-42ea-bfc7-1daf1fe15f7f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:05:24.612852 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-189ac07c-a22d-4471-a152-9fef575776cd tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:24.613669 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-189ac07c-a22d-4471-a152-9fef575776cd tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:24.614896 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-189ac07c-a22d-4471-a152-9fef575776cd tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:24.631318 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-189ac07c-a22d-4471-a152-9fef575776cd tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:24.633543 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-189ac07c-a22d-4471-a152-9fef575776cd tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:24.650096 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-189ac07c-a22d-4471-a152-9fef575776cd tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:24.728410 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-6f6227b8-775a-4b76-a670-87021352b393 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:05:24.741145 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-6f6227b8-775a-4b76-a670-87021352b393 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1361 microversion: 2.1 time: 0.610300 Oct 20 06:05:24.742300 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 88/153] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:05:24 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1361 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:05:24.747611 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [req-94c7897e-1b84-435a-b52c-3c737760dfa0 req-04ba36b4-7917-4f97-be84-dfae92008036 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42fc4539-f891-4ab5-b30a-4bfe5033db86", "name": "network-vif-plugged", "status": "completed", "tag": "ee7bae4d-a4a0-4251-a372-fbe0545d8c6e"}]} {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 06:05:24.759093 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [req-94c7897e-1b84-435a-b52c-3c737760dfa0 req-04ba36b4-7917-4f97-be84-dfae92008036 service nova] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:24.759575 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [req-94c7897e-1b84-435a-b52c-3c737760dfa0 req-04ba36b4-7917-4f97-be84-dfae92008036 service nova] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:24.760002 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [req-94c7897e-1b84-435a-b52c-3c737760dfa0 req-04ba36b4-7917-4f97-be84-dfae92008036 service nova] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:24.774230 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.compute.server_external_events [req-94c7897e-1b84-435a-b52c-3c737760dfa0 req-04ba36b4-7917-4f97-be84-dfae92008036 service nova] Creating event network-vif-plugged:ee7bae4d-a4a0-4251-a372-fbe0545d8c6e for instance 42fc4539-f891-4ab5-b30a-4bfe5033db86 on hv-cinder-86156 Oct 20 06:05:24.782841 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [req-94c7897e-1b84-435a-b52c-3c737760dfa0 req-04ba36b4-7917-4f97-be84-dfae92008036 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039193 Oct 20 06:05:24.783889 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 89/154] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 20 06:05:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:05:24.875112 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-6bd100bb-19f6-4378-83b0-bbc65833d77e tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:05:24.876139 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-6bd100bb-19f6-4378-83b0-bbc65833d77e tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] [instance: ab6b2605-695c-4ee9-ae33-6234ef22536c] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:05:24.892976 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-6bd100bb-19f6-4378-83b0-bbc65833d77e tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:24.895127 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-6bd100bb-19f6-4378-83b0-bbc65833d77e tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:24.895586 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-6bd100bb-19f6-4378-83b0-bbc65833d77e tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:24.899695 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-6bd100bb-19f6-4378-83b0-bbc65833d77e tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:24.900368 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-6bd100bb-19f6-4378-83b0-bbc65833d77e tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:24.901538 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-6bd100bb-19f6-4378-83b0-bbc65833d77e tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:25.154873 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-189ac07c-a22d-4471-a152-9fef575776cd tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d4cbd2a2154e5d925462df7c77815a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0d80988ca941acb8ad4318338dfbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:05:25.168463 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-189ac07c-a22d-4471-a152-9fef575776cd tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] 10.222.0.20 "GET /compute/v2.1/servers/e8e2c461-4b15-42ea-bfc7-1daf1fe15f7f" status: 200 len: 1322 microversion: 2.1 time: 0.575672 Oct 20 06:05:25.169391 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 66/155] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:05:24 2022] GET /compute/v2.1/servers/e8e2c461-4b15-42ea-bfc7-1daf1fe15f7f => generated 1322 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:05:25.185358 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-b7ef2b3c-24df-4b11-8f40-a5512c0c784d tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:05:25.186709 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-b7ef2b3c-24df-4b11-8f40-a5512c0c784d tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:05:25.199819 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b7ef2b3c-24df-4b11-8f40-a5512c0c784d tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:25.201616 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b7ef2b3c-24df-4b11-8f40-a5512c0c784d tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:25.203461 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b7ef2b3c-24df-4b11-8f40-a5512c0c784d tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:25.205026 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b7ef2b3c-24df-4b11-8f40-a5512c0c784d tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:25.207119 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b7ef2b3c-24df-4b11-8f40-a5512c0c784d tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:25.209873 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b7ef2b3c-24df-4b11-8f40-a5512c0c784d tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:25.220554 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-6bd100bb-19f6-4378-83b0-bbc65833d77e tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85953d8e7394fb0a6f425ce51420325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72e1785381dd4bdaa2803fa7ef711dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:05:25.233454 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-6bd100bb-19f6-4378-83b0-bbc65833d77e tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] 10.222.0.20 "GET /compute/v2.1/servers/ab6b2605-695c-4ee9-ae33-6234ef22536c" status: 200 len: 1503 microversion: 2.1 time: 0.363508 Oct 20 06:05:25.234925 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 90/156] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:05:24 2022] GET /compute/v2.1/servers/ab6b2605-695c-4ee9-ae33-6234ef22536c => generated 1503 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 06:05:25.589097 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-b7ef2b3c-24df-4b11-8f40-a5512c0c784d tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:05:25.600898 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-b7ef2b3c-24df-4b11-8f40-a5512c0c784d tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:05:25.603869 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-b7ef2b3c-24df-4b11-8f40-a5512c0c784d tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:05:25.606593 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-b7ef2b3c-24df-4b11-8f40-a5512c0c784d tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1406 microversion: 2.20 time: 0.436055 Oct 20 06:05:25.607482 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 67/157] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:05:25 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1406 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:05:25.772946 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-23019c30-32a2-4342-bced-f55dd588043e tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:05:25.773571 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-23019c30-32a2-4342-bced-f55dd588043e tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:05:25.781606 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-23019c30-32a2-4342-bced-f55dd588043e tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:25.782100 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-23019c30-32a2-4342-bced-f55dd588043e tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:25.783269 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-23019c30-32a2-4342-bced-f55dd588043e tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:25.783985 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-23019c30-32a2-4342-bced-f55dd588043e tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:25.785738 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-23019c30-32a2-4342-bced-f55dd588043e tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:25.786393 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-23019c30-32a2-4342-bced-f55dd588043e tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:26.042647 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-23019c30-32a2-4342-bced-f55dd588043e tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:05:26.051908 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-23019c30-32a2-4342-bced-f55dd588043e tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1361 microversion: 2.1 time: 0.287772 Oct 20 06:05:26.067337 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 91/158] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:05:25 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1361 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:05:26.195989 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-ec454bec-9a4b-4163-b2ce-5dac90d2fc17 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:05:26.197394 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-ec454bec-9a4b-4163-b2ce-5dac90d2fc17 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] [instance: e8e2c461-4b15-42ea-bfc7-1daf1fe15f7f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:05:26.204136 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-ec454bec-9a4b-4163-b2ce-5dac90d2fc17 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:26.204668 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-ec454bec-9a4b-4163-b2ce-5dac90d2fc17 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:26.205316 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-ec454bec-9a4b-4163-b2ce-5dac90d2fc17 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:26.206268 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-ec454bec-9a4b-4163-b2ce-5dac90d2fc17 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:26.207169 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-ec454bec-9a4b-4163-b2ce-5dac90d2fc17 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:26.207801 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-ec454bec-9a4b-4163-b2ce-5dac90d2fc17 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:26.428162 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-ec454bec-9a4b-4163-b2ce-5dac90d2fc17 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d4cbd2a2154e5d925462df7c77815a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0d80988ca941acb8ad4318338dfbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:05:26.437061 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-ec454bec-9a4b-4163-b2ce-5dac90d2fc17 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] 10.222.0.20 "GET /compute/v2.1/servers/e8e2c461-4b15-42ea-bfc7-1daf1fe15f7f" status: 200 len: 1516 microversion: 2.1 time: 0.244905 Oct 20 06:05:26.437629 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 68/159] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:05:26 2022] GET /compute/v2.1/servers/e8e2c461-4b15-42ea-bfc7-1daf1fe15f7f => generated 1516 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:05:26.461786 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-615c57e3-a9fe-4822-88d3-04d27c35baa4 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 06:05:26.464006 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-615c57e3-a9fe-4822-88d3-04d27c35baa4 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] [instance: e8e2c461-4b15-42ea-bfc7-1daf1fe15f7f] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:05:26.470031 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-615c57e3-a9fe-4822-88d3-04d27c35baa4 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:26.470516 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-615c57e3-a9fe-4822-88d3-04d27c35baa4 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:26.470951 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-615c57e3-a9fe-4822-88d3-04d27c35baa4 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:26.472242 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-615c57e3-a9fe-4822-88d3-04d27c35baa4 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:26.472811 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-615c57e3-a9fe-4822-88d3-04d27c35baa4 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:26.473233 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-615c57e3-a9fe-4822-88d3-04d27c35baa4 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:26.496497 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.objects.instance [None req-615c57e3-a9fe-4822-88d3-04d27c35baa4 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lazy-loading 'flavor' on Instance uuid e8e2c461-4b15-42ea-bfc7-1daf1fe15f7f {{(pid=118861) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 20 06:05:26.623080 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-615c57e3-a9fe-4822-88d3-04d27c35baa4 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] 10.222.0.20 "POST /compute/v2.1/servers/e8e2c461-4b15-42ea-bfc7-1daf1fe15f7f/action" status: 200 len: 32 microversion: 2.1 time: 0.165747 Oct 20 06:05:26.623717 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 92/160] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Oct 20 06:05:26 2022] POST /compute/v2.1/servers/e8e2c461-4b15-42ea-bfc7-1daf1fe15f7f/action => generated 32 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 20 06:05:26.634473 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-1a75cae2-71a6-4a83-8893-640215abf985 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:05:26.635071 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-1a75cae2-71a6-4a83-8893-640215abf985 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] [instance: e8e2c461-4b15-42ea-bfc7-1daf1fe15f7f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:05:26.637886 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-95327b91-fece-4c72-be4b-bb844c11cb54 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:05:26.638573 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-95327b91-fece-4c72-be4b-bb844c11cb54 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:05:26.641077 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1a75cae2-71a6-4a83-8893-640215abf985 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:26.641554 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1a75cae2-71a6-4a83-8893-640215abf985 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:26.641983 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1a75cae2-71a6-4a83-8893-640215abf985 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:26.642664 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1a75cae2-71a6-4a83-8893-640215abf985 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:26.643110 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1a75cae2-71a6-4a83-8893-640215abf985 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:26.644123 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1a75cae2-71a6-4a83-8893-640215abf985 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:26.645213 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-95327b91-fece-4c72-be4b-bb844c11cb54 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:26.645691 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-95327b91-fece-4c72-be4b-bb844c11cb54 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:26.646123 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-95327b91-fece-4c72-be4b-bb844c11cb54 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:26.646801 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-95327b91-fece-4c72-be4b-bb844c11cb54 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:26.647249 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-95327b91-fece-4c72-be4b-bb844c11cb54 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:26.647668 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-95327b91-fece-4c72-be4b-bb844c11cb54 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:26.647999 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG dbcounter [-] [118860] Writing DB stats nova_cell1:SELECT=100 {{(pid=118860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:05:26.792899 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-95327b91-fece-4c72-be4b-bb844c11cb54 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:05:26.803265 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-95327b91-fece-4c72-be4b-bb844c11cb54 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:05:26.805112 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-95327b91-fece-4c72-be4b-bb844c11cb54 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:05:26.806312 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-95327b91-fece-4c72-be4b-bb844c11cb54 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1406 microversion: 2.20 time: 0.172844 Oct 20 06:05:26.807061 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 93/161] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:05:26 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1406 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 20 06:05:26.812236 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-1a75cae2-71a6-4a83-8893-640215abf985 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d4cbd2a2154e5d925462df7c77815a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0d80988ca941acb8ad4318338dfbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:05:26.823568 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-1a75cae2-71a6-4a83-8893-640215abf985 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] 10.222.0.20 "GET /compute/v2.1/servers/e8e2c461-4b15-42ea-bfc7-1daf1fe15f7f" status: 200 len: 1522 microversion: 2.1 time: 0.193395 Oct 20 06:05:26.824477 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 69/162] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:05:26 2022] GET /compute/v2.1/servers/e8e2c461-4b15-42ea-bfc7-1daf1fe15f7f => generated 1522 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:05:26.835897 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-8eec8bfc-a9fe-4af4-aa1e-6a83c85452fa tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "78daa4e4-f1ac-4d6e-8b42-982cd45243fe"}} {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 06:05:26.839429 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-8eec8bfc-a9fe-4af4-aa1e-6a83c85452fa tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] [instance: ab6b2605-695c-4ee9-ae33-6234ef22536c] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:05:26.845372 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-8eec8bfc-a9fe-4af4-aa1e-6a83c85452fa tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:26.845852 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-8eec8bfc-a9fe-4af4-aa1e-6a83c85452fa tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:26.846281 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-8eec8bfc-a9fe-4af4-aa1e-6a83c85452fa tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:26.847538 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-8eec8bfc-a9fe-4af4-aa1e-6a83c85452fa tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:26.848427 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-8eec8bfc-a9fe-4af4-aa1e-6a83c85452fa tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:26.848427 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-8eec8bfc-a9fe-4af4-aa1e-6a83c85452fa tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:26.858113 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [req-3f7f8a96-3a5a-4159-895d-38705454ed3c req-e97c771a-6d6f-4b6f-909d-c4d25ed9e578 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71be459d-e948-4a17-b379-182f4196411d", "name": "network-vif-plugged", "status": "completed", "tag": "eb253026-482c-4675-acce-8325c21757fd"}]} {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 06:05:26.867454 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [req-3f7f8a96-3a5a-4159-895d-38705454ed3c req-e97c771a-6d6f-4b6f-909d-c4d25ed9e578 service nova] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:26.868144 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [req-3f7f8a96-3a5a-4159-895d-38705454ed3c req-e97c771a-6d6f-4b6f-909d-c4d25ed9e578 service nova] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:26.868768 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [req-3f7f8a96-3a5a-4159-895d-38705454ed3c req-e97c771a-6d6f-4b6f-909d-c4d25ed9e578 service nova] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:26.882402 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.compute.server_external_events [req-3f7f8a96-3a5a-4159-895d-38705454ed3c req-e97c771a-6d6f-4b6f-909d-c4d25ed9e578 service nova] Creating event network-vif-plugged:eb253026-482c-4675-acce-8325c21757fd for instance 71be459d-e948-4a17-b379-182f4196411d on hv-cinder-86156 Oct 20 06:05:26.888065 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [req-3f7f8a96-3a5a-4159-895d-38705454ed3c req-e97c771a-6d6f-4b6f-909d-c4d25ed9e578 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033459 Oct 20 06:05:26.889252 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 70/163] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 20 06:05:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 20 06:05:27.075795 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-78a3070a-050c-4e9a-a777-b4a639418129 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:05:27.076475 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-78a3070a-050c-4e9a-a777-b4a639418129 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:05:27.082616 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-78a3070a-050c-4e9a-a777-b4a639418129 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:27.083088 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-78a3070a-050c-4e9a-a777-b4a639418129 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:27.083510 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-78a3070a-050c-4e9a-a777-b4a639418129 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:27.084234 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-78a3070a-050c-4e9a-a777-b4a639418129 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:27.084679 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-78a3070a-050c-4e9a-a777-b4a639418129 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:27.085120 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-78a3070a-050c-4e9a-a777-b4a639418129 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:27.218148 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-78a3070a-050c-4e9a-a777-b4a639418129 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:05:27.225892 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-78a3070a-050c-4e9a-a777-b4a639418129 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1361 microversion: 2.1 time: 0.154383 Oct 20 06:05:27.226450 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 71/164] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:05:27 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1361 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 06:05:27.769900 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-8eec8bfc-a9fe-4af4-aa1e-6a83c85452fa tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] 10.222.0.20 "POST /compute/v2.1/servers/ab6b2605-695c-4ee9-ae33-6234ef22536c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.937157 Oct 20 06:05:27.776001 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 94/165] 10.222.0.20 () {60 vars in 1323 bytes} [Thu Oct 20 06:05:26 2022] POST /compute/v2.1/servers/ab6b2605-695c-4ee9-ae33-6234ef22536c/os-volume_attachments => generated 194 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 20 06:05:27.841326 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-da0bca54-145f-4b1c-873d-f044c3f0d5d8 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:05:27.852585 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-da0bca54-145f-4b1c-873d-f044c3f0d5d8 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:05:27.858639 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-e1a36e02-c448-4d2f-9022-7dc93c7b4599 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:05:27.859342 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-e1a36e02-c448-4d2f-9022-7dc93c7b4599 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] [instance: e8e2c461-4b15-42ea-bfc7-1daf1fe15f7f] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:05:27.864020 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-da0bca54-145f-4b1c-873d-f044c3f0d5d8 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:27.864020 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-da0bca54-145f-4b1c-873d-f044c3f0d5d8 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:27.864020 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-da0bca54-145f-4b1c-873d-f044c3f0d5d8 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:27.864020 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-da0bca54-145f-4b1c-873d-f044c3f0d5d8 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:27.864389 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-da0bca54-145f-4b1c-873d-f044c3f0d5d8 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:27.864607 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-da0bca54-145f-4b1c-873d-f044c3f0d5d8 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:27.867375 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e1a36e02-c448-4d2f-9022-7dc93c7b4599 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:27.867853 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e1a36e02-c448-4d2f-9022-7dc93c7b4599 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:27.868447 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e1a36e02-c448-4d2f-9022-7dc93c7b4599 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:27.869913 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e1a36e02-c448-4d2f-9022-7dc93c7b4599 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:27.872423 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e1a36e02-c448-4d2f-9022-7dc93c7b4599 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:27.873176 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e1a36e02-c448-4d2f-9022-7dc93c7b4599 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:28.122894 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-e1a36e02-c448-4d2f-9022-7dc93c7b4599 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d4cbd2a2154e5d925462df7c77815a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0d80988ca941acb8ad4318338dfbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:05:28.131379 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-e1a36e02-c448-4d2f-9022-7dc93c7b4599 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] 10.222.0.20 "GET /compute/v2.1/servers/e8e2c461-4b15-42ea-bfc7-1daf1fe15f7f" status: 200 len: 1522 microversion: 2.1 time: 0.287207 Oct 20 06:05:28.131811 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 95/166] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:05:27 2022] GET /compute/v2.1/servers/e8e2c461-4b15-42ea-bfc7-1daf1fe15f7f => generated 1522 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:05:28.249339 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-77e91738-f3db-422c-82ee-de44665b5176 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:05:28.250171 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-77e91738-f3db-422c-82ee-de44665b5176 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:05:28.256621 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-77e91738-f3db-422c-82ee-de44665b5176 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:28.257140 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-77e91738-f3db-422c-82ee-de44665b5176 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:28.257575 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-77e91738-f3db-422c-82ee-de44665b5176 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:28.258269 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-77e91738-f3db-422c-82ee-de44665b5176 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:28.259199 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-77e91738-f3db-422c-82ee-de44665b5176 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:28.259831 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-77e91738-f3db-422c-82ee-de44665b5176 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:28.394279 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-da0bca54-145f-4b1c-873d-f044c3f0d5d8 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:05:28.403615 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-da0bca54-145f-4b1c-873d-f044c3f0d5d8 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:05:28.406298 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-da0bca54-145f-4b1c-873d-f044c3f0d5d8 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:05:28.407308 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-da0bca54-145f-4b1c-873d-f044c3f0d5d8 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1406 microversion: 2.20 time: 0.575018 Oct 20 06:05:28.408577 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 72/167] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:05:27 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1406 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:05:28.433819 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-77e91738-f3db-422c-82ee-de44665b5176 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:05:28.442139 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-77e91738-f3db-422c-82ee-de44665b5176 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1547 microversion: 2.1 time: 0.196514 Oct 20 06:05:28.442917 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 96/168] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:05:28 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1547 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:05:28.466914 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-12e2f85c-64ee-4a00-bca6-1cdd16093447 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:05:28.467547 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-12e2f85c-64ee-4a00-bca6-1cdd16093447 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:05:28.474298 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-12e2f85c-64ee-4a00-bca6-1cdd16093447 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:28.474785 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-12e2f85c-64ee-4a00-bca6-1cdd16093447 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:28.475212 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-12e2f85c-64ee-4a00-bca6-1cdd16093447 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:28.476104 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-12e2f85c-64ee-4a00-bca6-1cdd16093447 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:28.476549 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-12e2f85c-64ee-4a00-bca6-1cdd16093447 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:28.477103 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-12e2f85c-64ee-4a00-bca6-1cdd16093447 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:28.610346 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-12e2f85c-64ee-4a00-bca6-1cdd16093447 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.147930 Oct 20 06:05:28.610995 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 73/169] 10.222.0.20 () {58 vars in 1275 bytes} [Thu Oct 20 06:05:28 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-interface => generated 284 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:05:29.157362 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-904513b3-543a-4ff8-b7cd-dfbd01a14556 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:05:29.159721 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-904513b3-543a-4ff8-b7cd-dfbd01a14556 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] [instance: e8e2c461-4b15-42ea-bfc7-1daf1fe15f7f] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:05:29.169714 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-904513b3-543a-4ff8-b7cd-dfbd01a14556 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:29.170491 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-904513b3-543a-4ff8-b7cd-dfbd01a14556 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:29.171151 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-904513b3-543a-4ff8-b7cd-dfbd01a14556 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:29.172415 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-904513b3-543a-4ff8-b7cd-dfbd01a14556 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:29.173205 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-904513b3-543a-4ff8-b7cd-dfbd01a14556 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:29.173841 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-904513b3-543a-4ff8-b7cd-dfbd01a14556 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:29.381165 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-904513b3-543a-4ff8-b7cd-dfbd01a14556 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d4cbd2a2154e5d925462df7c77815a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0d80988ca941acb8ad4318338dfbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:05:29.391017 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-904513b3-543a-4ff8-b7cd-dfbd01a14556 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] 10.222.0.20 "GET /compute/v2.1/servers/e8e2c461-4b15-42ea-bfc7-1daf1fe15f7f" status: 200 len: 1522 microversion: 2.1 time: 0.240215 Oct 20 06:05:29.391598 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 97/170] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:05:29 2022] GET /compute/v2.1/servers/e8e2c461-4b15-42ea-bfc7-1daf1fe15f7f => generated 1522 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:05:29.436625 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-5265b7a7-616e-45ae-8be0-6efc868589bc tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:05:29.437431 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-5265b7a7-616e-45ae-8be0-6efc868589bc tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:05:29.447158 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5265b7a7-616e-45ae-8be0-6efc868589bc tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:29.447650 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5265b7a7-616e-45ae-8be0-6efc868589bc tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:29.448466 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5265b7a7-616e-45ae-8be0-6efc868589bc tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:29.449756 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5265b7a7-616e-45ae-8be0-6efc868589bc tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:29.450681 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5265b7a7-616e-45ae-8be0-6efc868589bc tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:29.451336 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5265b7a7-616e-45ae-8be0-6efc868589bc tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:29.688662 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-5265b7a7-616e-45ae-8be0-6efc868589bc tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:05:29.704801 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-5265b7a7-616e-45ae-8be0-6efc868589bc tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:05:29.707811 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-5265b7a7-616e-45ae-8be0-6efc868589bc tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:05:29.716732 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-5265b7a7-616e-45ae-8be0-6efc868589bc tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1598 microversion: 2.20 time: 0.285276 Oct 20 06:05:29.717616 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 74/171] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:05:29 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1598 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:05:29.746566 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-8425fe06-10dd-4004-8f4e-6a72b1613bd0 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:05:29.747056 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-8425fe06-10dd-4004-8f4e-6a72b1613bd0 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:05:29.753890 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-8425fe06-10dd-4004-8f4e-6a72b1613bd0 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:29.754388 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-8425fe06-10dd-4004-8f4e-6a72b1613bd0 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:29.754824 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-8425fe06-10dd-4004-8f4e-6a72b1613bd0 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:29.768014 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-8425fe06-10dd-4004-8f4e-6a72b1613bd0 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:29.778256 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-8425fe06-10dd-4004-8f4e-6a72b1613bd0 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:29.779289 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-8425fe06-10dd-4004-8f4e-6a72b1613bd0 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:29.922851 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-8425fe06-10dd-4004-8f4e-6a72b1613bd0 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.179793 Oct 20 06:05:29.924145 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 98/172] 10.222.0.20 () {60 vars in 1316 bytes} [Thu Oct 20 06:05:29 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d/os-interface => generated 284 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 20 06:05:30.389042 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [req-0a861462-5655-4aff-87ae-5709d392c7b5 req-bc078ea4-9c0d-40af-8247-32e31b32f20c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "42fc4539-f891-4ab5-b30a-4bfe5033db86", "tag": "ee7bae4d-a4a0-4251-a372-fbe0545d8c6e"}]} {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 06:05:30.407580 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [req-0a861462-5655-4aff-87ae-5709d392c7b5 req-bc078ea4-9c0d-40af-8247-32e31b32f20c service nova] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:30.408630 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [req-0a861462-5655-4aff-87ae-5709d392c7b5 req-bc078ea4-9c0d-40af-8247-32e31b32f20c service nova] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:30.410070 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [req-0a861462-5655-4aff-87ae-5709d392c7b5 req-bc078ea4-9c0d-40af-8247-32e31b32f20c service nova] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:30.420500 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-1312994d-8a7e-4345-adcf-b094257dd42b tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:05:30.421845 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-1312994d-8a7e-4345-adcf-b094257dd42b tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] [instance: e8e2c461-4b15-42ea-bfc7-1daf1fe15f7f] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:05:30.442328 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1312994d-8a7e-4345-adcf-b094257dd42b tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:30.444554 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1312994d-8a7e-4345-adcf-b094257dd42b tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:30.445099 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1312994d-8a7e-4345-adcf-b094257dd42b tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:30.447372 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1312994d-8a7e-4345-adcf-b094257dd42b tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:30.448518 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1312994d-8a7e-4345-adcf-b094257dd42b tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:30.450566 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1312994d-8a7e-4345-adcf-b094257dd42b tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:30.462438 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.compute.server_external_events [req-0a861462-5655-4aff-87ae-5709d392c7b5 req-bc078ea4-9c0d-40af-8247-32e31b32f20c service nova] Creating event network-changed:ee7bae4d-a4a0-4251-a372-fbe0545d8c6e for instance 42fc4539-f891-4ab5-b30a-4bfe5033db86 on hv-cinder-86156 Oct 20 06:05:30.483084 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [req-0a861462-5655-4aff-87ae-5709d392c7b5 req-bc078ea4-9c0d-40af-8247-32e31b32f20c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100633 Oct 20 06:05:30.483701 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 75/173] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 20 06:05:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:05:30.706963 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-1312994d-8a7e-4345-adcf-b094257dd42b tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d4cbd2a2154e5d925462df7c77815a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0d80988ca941acb8ad4318338dfbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:05:30.722172 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-1312994d-8a7e-4345-adcf-b094257dd42b tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] 10.222.0.20 "GET /compute/v2.1/servers/e8e2c461-4b15-42ea-bfc7-1daf1fe15f7f" status: 200 len: 1522 microversion: 2.1 time: 0.308771 Oct 20 06:05:30.730291 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 99/174] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:05:30 2022] GET /compute/v2.1/servers/e8e2c461-4b15-42ea-bfc7-1daf1fe15f7f => generated 1522 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 06:05:31.463120 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [req-b5d7bdf4-7fb4-46d6-8efe-8c37b6ebb23d req-0183794f-a118-4bc7-93d3-f2c53e219f77 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71be459d-e948-4a17-b379-182f4196411d", "tag": "eb253026-482c-4675-acce-8325c21757fd"}]} {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 06:05:31.474506 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [req-b5d7bdf4-7fb4-46d6-8efe-8c37b6ebb23d req-0183794f-a118-4bc7-93d3-f2c53e219f77 service nova] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:31.475218 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [req-b5d7bdf4-7fb4-46d6-8efe-8c37b6ebb23d req-0183794f-a118-4bc7-93d3-f2c53e219f77 service nova] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:31.475881 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [req-b5d7bdf4-7fb4-46d6-8efe-8c37b6ebb23d req-0183794f-a118-4bc7-93d3-f2c53e219f77 service nova] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:31.544899 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.compute.server_external_events [req-b5d7bdf4-7fb4-46d6-8efe-8c37b6ebb23d req-0183794f-a118-4bc7-93d3-f2c53e219f77 service nova] Creating event network-changed:eb253026-482c-4675-acce-8325c21757fd for instance 71be459d-e948-4a17-b379-182f4196411d on hv-cinder-86156 Oct 20 06:05:31.556357 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [req-b5d7bdf4-7fb4-46d6-8efe-8c37b6ebb23d req-0183794f-a118-4bc7-93d3-f2c53e219f77 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098354 Oct 20 06:05:31.559868 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 76/175] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 20 06:05:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 20 06:05:31.748001 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-224f1b6a-252b-4fc2-bf6b-57ab61ee57dd tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:05:31.748873 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-224f1b6a-252b-4fc2-bf6b-57ab61ee57dd tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] [instance: e8e2c461-4b15-42ea-bfc7-1daf1fe15f7f] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:05:31.770199 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-224f1b6a-252b-4fc2-bf6b-57ab61ee57dd tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:31.771269 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-224f1b6a-252b-4fc2-bf6b-57ab61ee57dd tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:31.772015 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-224f1b6a-252b-4fc2-bf6b-57ab61ee57dd tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:31.773085 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-224f1b6a-252b-4fc2-bf6b-57ab61ee57dd tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:31.773794 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-224f1b6a-252b-4fc2-bf6b-57ab61ee57dd tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:31.774479 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-224f1b6a-252b-4fc2-bf6b-57ab61ee57dd tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:32.110382 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-224f1b6a-252b-4fc2-bf6b-57ab61ee57dd tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d4cbd2a2154e5d925462df7c77815a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0d80988ca941acb8ad4318338dfbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:05:32.119891 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-224f1b6a-252b-4fc2-bf6b-57ab61ee57dd tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] 10.222.0.20 "GET /compute/v2.1/servers/e8e2c461-4b15-42ea-bfc7-1daf1fe15f7f" status: 200 len: 1522 microversion: 2.1 time: 0.377052 Oct 20 06:05:32.120822 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 100/176] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:05:31 2022] GET /compute/v2.1/servers/e8e2c461-4b15-42ea-bfc7-1daf1fe15f7f => generated 1522 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:05:33.151632 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-c4d944ac-d4e4-4400-ba55-19082746c987 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:05:33.153261 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-c4d944ac-d4e4-4400-ba55-19082746c987 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] [instance: e8e2c461-4b15-42ea-bfc7-1daf1fe15f7f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:05:33.161317 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c4d944ac-d4e4-4400-ba55-19082746c987 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:33.162887 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c4d944ac-d4e4-4400-ba55-19082746c987 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:33.163512 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c4d944ac-d4e4-4400-ba55-19082746c987 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:33.164396 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c4d944ac-d4e4-4400-ba55-19082746c987 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:33.165239 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c4d944ac-d4e4-4400-ba55-19082746c987 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:33.165871 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c4d944ac-d4e4-4400-ba55-19082746c987 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:33.412176 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-c4d944ac-d4e4-4400-ba55-19082746c987 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d4cbd2a2154e5d925462df7c77815a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0d80988ca941acb8ad4318338dfbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:05:33.420096 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-c4d944ac-d4e4-4400-ba55-19082746c987 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] 10.222.0.20 "GET /compute/v2.1/servers/e8e2c461-4b15-42ea-bfc7-1daf1fe15f7f" status: 200 len: 1522 microversion: 2.1 time: 0.275679 Oct 20 06:05:33.420668 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 77/177] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:05:33 2022] GET /compute/v2.1/servers/e8e2c461-4b15-42ea-bfc7-1daf1fe15f7f => generated 1522 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:05:34.445390 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-0b44b965-f295-4900-a85b-ba90f87a6eae tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:05:34.446675 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-0b44b965-f295-4900-a85b-ba90f87a6eae tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] [instance: e8e2c461-4b15-42ea-bfc7-1daf1fe15f7f] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:05:34.456982 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-0b44b965-f295-4900-a85b-ba90f87a6eae tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:34.457607 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-0b44b965-f295-4900-a85b-ba90f87a6eae tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:34.458140 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-0b44b965-f295-4900-a85b-ba90f87a6eae tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:34.458960 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-0b44b965-f295-4900-a85b-ba90f87a6eae tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:34.459416 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-0b44b965-f295-4900-a85b-ba90f87a6eae tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:34.460238 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-0b44b965-f295-4900-a85b-ba90f87a6eae tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:34.610217 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-0b44b965-f295-4900-a85b-ba90f87a6eae tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d4cbd2a2154e5d925462df7c77815a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0d80988ca941acb8ad4318338dfbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:05:34.621208 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-0b44b965-f295-4900-a85b-ba90f87a6eae tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] 10.222.0.20 "GET /compute/v2.1/servers/e8e2c461-4b15-42ea-bfc7-1daf1fe15f7f" status: 200 len: 1522 microversion: 2.1 time: 0.181354 Oct 20 06:05:34.621826 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 101/178] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:05:34 2022] GET /compute/v2.1/servers/e8e2c461-4b15-42ea-bfc7-1daf1fe15f7f => generated 1522 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:05:35.646937 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-9b4d839f-1372-496c-8009-2e7dd1f25e7a tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:05:35.648051 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-9b4d839f-1372-496c-8009-2e7dd1f25e7a tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] [instance: e8e2c461-4b15-42ea-bfc7-1daf1fe15f7f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:05:35.655285 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-9b4d839f-1372-496c-8009-2e7dd1f25e7a tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:35.655970 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-9b4d839f-1372-496c-8009-2e7dd1f25e7a tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:35.656559 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-9b4d839f-1372-496c-8009-2e7dd1f25e7a tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:35.657428 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-9b4d839f-1372-496c-8009-2e7dd1f25e7a tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:35.658023 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-9b4d839f-1372-496c-8009-2e7dd1f25e7a tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:35.659609 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-9b4d839f-1372-496c-8009-2e7dd1f25e7a tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:35.855542 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-9b4d839f-1372-496c-8009-2e7dd1f25e7a tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d4cbd2a2154e5d925462df7c77815a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0d80988ca941acb8ad4318338dfbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:05:35.864457 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-9b4d839f-1372-496c-8009-2e7dd1f25e7a tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] 10.222.0.20 "GET /compute/v2.1/servers/e8e2c461-4b15-42ea-bfc7-1daf1fe15f7f" status: 200 len: 1522 microversion: 2.1 time: 0.221669 Oct 20 06:05:35.878082 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 78/179] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:05:35 2022] GET /compute/v2.1/servers/e8e2c461-4b15-42ea-bfc7-1daf1fe15f7f => generated 1522 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:05:36.890395 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-a0eea1f2-f755-4453-88a5-325f693c8344 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:05:36.891101 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-a0eea1f2-f755-4453-88a5-325f693c8344 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] [instance: e8e2c461-4b15-42ea-bfc7-1daf1fe15f7f] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:05:36.898755 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a0eea1f2-f755-4453-88a5-325f693c8344 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:36.899333 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a0eea1f2-f755-4453-88a5-325f693c8344 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:36.899774 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a0eea1f2-f755-4453-88a5-325f693c8344 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:36.900475 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a0eea1f2-f755-4453-88a5-325f693c8344 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:36.900978 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a0eea1f2-f755-4453-88a5-325f693c8344 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:36.901728 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a0eea1f2-f755-4453-88a5-325f693c8344 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:37.105692 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-a0eea1f2-f755-4453-88a5-325f693c8344 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d4cbd2a2154e5d925462df7c77815a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0d80988ca941acb8ad4318338dfbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:05:37.109480 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG dbcounter [-] [118861] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=118861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:05:37.115476 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-a0eea1f2-f755-4453-88a5-325f693c8344 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] 10.222.0.20 "GET /compute/v2.1/servers/e8e2c461-4b15-42ea-bfc7-1daf1fe15f7f" status: 200 len: 1522 microversion: 2.1 time: 0.229547 Oct 20 06:05:37.116240 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 102/180] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:05:36 2022] GET /compute/v2.1/servers/e8e2c461-4b15-42ea-bfc7-1daf1fe15f7f => generated 1522 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:05:37.732192 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-565c5d8d-838c-4c1c-911f-3a4f88584650 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:05:37.732854 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-565c5d8d-838c-4c1c-911f-3a4f88584650 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] [instance: ab6b2605-695c-4ee9-ae33-6234ef22536c] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:05:37.740789 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-565c5d8d-838c-4c1c-911f-3a4f88584650 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:37.741438 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-565c5d8d-838c-4c1c-911f-3a4f88584650 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:37.742046 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-565c5d8d-838c-4c1c-911f-3a4f88584650 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:37.742899 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-565c5d8d-838c-4c1c-911f-3a4f88584650 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:37.743488 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-565c5d8d-838c-4c1c-911f-3a4f88584650 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:37.744518 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-565c5d8d-838c-4c1c-911f-3a4f88584650 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:37.772936 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-565c5d8d-838c-4c1c-911f-3a4f88584650 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] [instance: ab6b2605-695c-4ee9-ae33-6234ef22536c] Going to try to terminate instance {{(pid=118860) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 20 06:05:37.876077 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-565c5d8d-838c-4c1c-911f-3a4f88584650 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] 10.222.0.20 "DELETE /compute/v2.1/servers/ab6b2605-695c-4ee9-ae33-6234ef22536c" status: 204 len: 0 microversion: 2.1 time: 0.148648 Oct 20 06:05:37.876980 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 79/181] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 20 06:05:37 2022] DELETE /compute/v2.1/servers/ab6b2605-695c-4ee9-ae33-6234ef22536c => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 20 06:05:37.886001 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-1bf9878e-135b-4e72-9e8e-0f8f36491a89 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:05:37.886713 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-1bf9878e-135b-4e72-9e8e-0f8f36491a89 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] [instance: ab6b2605-695c-4ee9-ae33-6234ef22536c] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:05:37.893224 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1bf9878e-135b-4e72-9e8e-0f8f36491a89 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:37.893838 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1bf9878e-135b-4e72-9e8e-0f8f36491a89 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:37.894128 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1bf9878e-135b-4e72-9e8e-0f8f36491a89 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:37.894810 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1bf9878e-135b-4e72-9e8e-0f8f36491a89 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:37.895252 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1bf9878e-135b-4e72-9e8e-0f8f36491a89 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:37.895666 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1bf9878e-135b-4e72-9e8e-0f8f36491a89 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:38.058730 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-1bf9878e-135b-4e72-9e8e-0f8f36491a89 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85953d8e7394fb0a6f425ce51420325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72e1785381dd4bdaa2803fa7ef711dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:05:38.068651 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-1bf9878e-135b-4e72-9e8e-0f8f36491a89 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] 10.222.0.20 "GET /compute/v2.1/servers/ab6b2605-695c-4ee9-ae33-6234ef22536c" status: 200 len: 1555 microversion: 2.1 time: 0.186717 Oct 20 06:05:38.073056 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 103/182] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:05:37 2022] GET /compute/v2.1/servers/ab6b2605-695c-4ee9-ae33-6234ef22536c => generated 1555 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:05:38.142214 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-04811f40-5528-4354-a929-49aeddd06965 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:05:38.142960 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-04811f40-5528-4354-a929-49aeddd06965 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] [instance: e8e2c461-4b15-42ea-bfc7-1daf1fe15f7f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:05:38.149901 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-04811f40-5528-4354-a929-49aeddd06965 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:38.150383 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-04811f40-5528-4354-a929-49aeddd06965 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:38.150813 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-04811f40-5528-4354-a929-49aeddd06965 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:38.151500 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-04811f40-5528-4354-a929-49aeddd06965 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:38.151949 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-04811f40-5528-4354-a929-49aeddd06965 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:38.152374 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-04811f40-5528-4354-a929-49aeddd06965 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:38.286476 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-04811f40-5528-4354-a929-49aeddd06965 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d4cbd2a2154e5d925462df7c77815a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0d80988ca941acb8ad4318338dfbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:05:38.294350 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-04811f40-5528-4354-a929-49aeddd06965 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] 10.222.0.20 "GET /compute/v2.1/servers/e8e2c461-4b15-42ea-bfc7-1daf1fe15f7f" status: 200 len: 1522 microversion: 2.1 time: 0.156451 Oct 20 06:05:38.294912 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 80/183] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:05:38 2022] GET /compute/v2.1/servers/e8e2c461-4b15-42ea-bfc7-1daf1fe15f7f => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:05:39.092869 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-54f0ffa1-d29b-4874-a170-8ee3112ff0f1 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:05:39.093483 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-54f0ffa1-d29b-4874-a170-8ee3112ff0f1 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] [instance: ab6b2605-695c-4ee9-ae33-6234ef22536c] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:05:39.100478 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-54f0ffa1-d29b-4874-a170-8ee3112ff0f1 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:39.101310 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-54f0ffa1-d29b-4874-a170-8ee3112ff0f1 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:39.101741 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-54f0ffa1-d29b-4874-a170-8ee3112ff0f1 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:39.102598 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-54f0ffa1-d29b-4874-a170-8ee3112ff0f1 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:39.103049 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-54f0ffa1-d29b-4874-a170-8ee3112ff0f1 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:39.103467 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-54f0ffa1-d29b-4874-a170-8ee3112ff0f1 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:39.224044 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-57c9a886-beab-4093-8951-bcebf189bf6b tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-788790453", "imageRef": "9fcec276-734d-41d9-905b-10d2bbcbfba5", "flavorRef": "452", "networks": [{"uuid": "a9945269-0bba-4903-bfb8-3099586c6a42"}]}} {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 06:05:39.245506 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-54f0ffa1-d29b-4874-a170-8ee3112ff0f1 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85953d8e7394fb0a6f425ce51420325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72e1785381dd4bdaa2803fa7ef711dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:05:39.253797 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-54f0ffa1-d29b-4874-a170-8ee3112ff0f1 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] 10.222.0.20 "GET /compute/v2.1/servers/ab6b2605-695c-4ee9-ae33-6234ef22536c" status: 200 len: 1555 microversion: 2.1 time: 0.164838 Oct 20 06:05:39.254373 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 104/184] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:05:39 2022] GET /compute/v2.1/servers/ab6b2605-695c-4ee9-ae33-6234ef22536c => generated 1555 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:05:39.283657 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.network.neutron [None req-57c9a886-beab-4093-8951-bcebf189bf6b tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] validate_networks() for [('a9945269-0bba-4903-bfb8-3099586c6a42', None, None, None, None, None)] {{(pid=118860) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 20 06:05:39.318178 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-c5c3e497-725c-436e-8009-a8fc4bee45b3 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:05:39.318907 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-c5c3e497-725c-436e-8009-a8fc4bee45b3 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] [instance: e8e2c461-4b15-42ea-bfc7-1daf1fe15f7f] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:05:39.325165 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c5c3e497-725c-436e-8009-a8fc4bee45b3 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:39.325838 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c5c3e497-725c-436e-8009-a8fc4bee45b3 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:39.326284 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c5c3e497-725c-436e-8009-a8fc4bee45b3 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:39.326974 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c5c3e497-725c-436e-8009-a8fc4bee45b3 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:39.327419 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c5c3e497-725c-436e-8009-a8fc4bee45b3 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:39.327843 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c5c3e497-725c-436e-8009-a8fc4bee45b3 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:39.468977 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-c5c3e497-725c-436e-8009-a8fc4bee45b3 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d4cbd2a2154e5d925462df7c77815a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0d80988ca941acb8ad4318338dfbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:05:39.477800 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-c5c3e497-725c-436e-8009-a8fc4bee45b3 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] 10.222.0.20 "GET /compute/v2.1/servers/e8e2c461-4b15-42ea-bfc7-1daf1fe15f7f" status: 200 len: 1522 microversion: 2.1 time: 0.163766 Oct 20 06:05:39.493153 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 105/185] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:05:39 2022] GET /compute/v2.1/servers/e8e2c461-4b15-42ea-bfc7-1daf1fe15f7f => generated 1522 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 06:05:39.858649 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.virt.hardware [None req-57c9a886-beab-4093-8951-bcebf189bf6b tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Flavor limits 0:0:0 {{(pid=118860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 20 06:05:39.859073 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.virt.hardware [None req-57c9a886-beab-4093-8951-bcebf189bf6b tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Image limits 0:0:0 {{(pid=118860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 20 06:05:39.859548 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.virt.hardware [None req-57c9a886-beab-4093-8951-bcebf189bf6b tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Flavor pref 0:0:0 {{(pid=118860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 20 06:05:39.859957 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.virt.hardware [None req-57c9a886-beab-4093-8951-bcebf189bf6b tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Image pref 0:0:0 {{(pid=118860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 20 06:05:39.860369 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.virt.hardware [None req-57c9a886-beab-4093-8951-bcebf189bf6b tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 20 06:05:39.869934 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-57c9a886-beab-4093-8951-bcebf189bf6b tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:39.870415 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-57c9a886-beab-4093-8951-bcebf189bf6b tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:39.870845 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-57c9a886-beab-4093-8951-bcebf189bf6b tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:39.871835 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-57c9a886-beab-4093-8951-bcebf189bf6b tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:39.872295 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-57c9a886-beab-4093-8951-bcebf189bf6b tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:39.872741 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-57c9a886-beab-4093-8951-bcebf189bf6b tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:39.889719 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.quota [None req-57c9a886-beab-4093-8951-bcebf189bf6b tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Getting quotas for project 3de3d03dde2d4ef6a8b925a0a5391d0b. Resources: {'cores', 'ram', 'instances'} {{(pid=118860) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 20 06:05:39.893663 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.quota [None req-57c9a886-beab-4093-8951-bcebf189bf6b tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Getting quotas for user 7935a2a80f054f699983e5e2f3e64a28 and project 3de3d03dde2d4ef6a8b925a0a5391d0b. Resources: {'cores', 'ram', 'instances'} {{(pid=118860) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 20 06:05:39.904449 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-57c9a886-beab-4093-8951-bcebf189bf6b tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Going to run 1 instances... {{(pid=118860) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 20 06:05:39.906734 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-57c9a886-beab-4093-8951-bcebf189bf6b tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9fcec276-734d-41d9-905b-10d2bbcbfba5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118860) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 20 06:05:39.955889 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-57c9a886-beab-4093-8951-bcebf189bf6b tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.735633 Oct 20 06:05:39.956533 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 81/186] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Oct 20 06:05:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 737 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 20 06:05:39.967551 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-701406c0-9738-44af-b5c5-10e07318f9ef tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:05:39.968272 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-701406c0-9738-44af-b5c5-10e07318f9ef tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:05:40.021460 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-701406c0-9738-44af-b5c5-10e07318f9ef tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:05:40.028824 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-701406c0-9738-44af-b5c5-10e07318f9ef tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1218 microversion: 2.1 time: 0.065041 Oct 20 06:05:40.029696 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 106/187] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:05:39 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1218 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:05:40.278142 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-1260fb21-ef43-4a81-bdcc-e1dd845a81f0 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:05:40.278776 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-1260fb21-ef43-4a81-bdcc-e1dd845a81f0 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] [instance: ab6b2605-695c-4ee9-ae33-6234ef22536c] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:05:40.286684 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1260fb21-ef43-4a81-bdcc-e1dd845a81f0 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:40.287180 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1260fb21-ef43-4a81-bdcc-e1dd845a81f0 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:40.287619 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1260fb21-ef43-4a81-bdcc-e1dd845a81f0 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:40.288321 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1260fb21-ef43-4a81-bdcc-e1dd845a81f0 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:40.288975 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1260fb21-ef43-4a81-bdcc-e1dd845a81f0 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:40.289408 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1260fb21-ef43-4a81-bdcc-e1dd845a81f0 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:40.500651 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-1b196581-2f99-49d6-bfe5-bac0f3ce3764 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:05:40.502132 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-1b196581-2f99-49d6-bfe5-bac0f3ce3764 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] [instance: e8e2c461-4b15-42ea-bfc7-1daf1fe15f7f] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:05:40.503177 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-1260fb21-ef43-4a81-bdcc-e1dd845a81f0 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85953d8e7394fb0a6f425ce51420325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72e1785381dd4bdaa2803fa7ef711dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:05:40.512146 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-1260fb21-ef43-4a81-bdcc-e1dd845a81f0 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] 10.222.0.20 "GET /compute/v2.1/servers/ab6b2605-695c-4ee9-ae33-6234ef22536c" status: 200 len: 1555 microversion: 2.1 time: 0.238224 Oct 20 06:05:40.512328 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1b196581-2f99-49d6-bfe5-bac0f3ce3764 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:40.512907 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 82/188] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:05:40 2022] GET /compute/v2.1/servers/ab6b2605-695c-4ee9-ae33-6234ef22536c => generated 1555 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:05:40.517312 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1b196581-2f99-49d6-bfe5-bac0f3ce3764 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:40.517944 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1b196581-2f99-49d6-bfe5-bac0f3ce3764 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:40.519296 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1b196581-2f99-49d6-bfe5-bac0f3ce3764 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:40.519850 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1b196581-2f99-49d6-bfe5-bac0f3ce3764 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:40.520370 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1b196581-2f99-49d6-bfe5-bac0f3ce3764 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:40.670435 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-1b196581-2f99-49d6-bfe5-bac0f3ce3764 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d4cbd2a2154e5d925462df7c77815a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0d80988ca941acb8ad4318338dfbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:05:40.694785 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-1b196581-2f99-49d6-bfe5-bac0f3ce3764 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] 10.222.0.20 "GET /compute/v2.1/servers/e8e2c461-4b15-42ea-bfc7-1daf1fe15f7f" status: 200 len: 1522 microversion: 2.1 time: 0.198220 Oct 20 06:05:40.695407 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 107/189] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:05:40 2022] GET /compute/v2.1/servers/e8e2c461-4b15-42ea-bfc7-1daf1fe15f7f => generated 1522 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 06:05:40.808536 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [req-4bb143c0-71f1-416a-a33a-68747aa69bc7 req-225c3c93-dda9-487b-a4c5-4c8f0d368c1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab6b2605-695c-4ee9-ae33-6234ef22536c", "name": "network-vif-deleted", "tag": "e8a81f7e-ee04-474a-9073-057e1d862c26"}]} {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 06:05:40.831798 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [req-4bb143c0-71f1-416a-a33a-68747aa69bc7 req-225c3c93-dda9-487b-a4c5-4c8f0d368c1f service nova] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:40.832286 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [req-4bb143c0-71f1-416a-a33a-68747aa69bc7 req-225c3c93-dda9-487b-a4c5-4c8f0d368c1f service nova] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:40.832802 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [req-4bb143c0-71f1-416a-a33a-68747aa69bc7 req-225c3c93-dda9-487b-a4c5-4c8f0d368c1f service nova] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:40.852901 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.compute.server_external_events [req-4bb143c0-71f1-416a-a33a-68747aa69bc7 req-225c3c93-dda9-487b-a4c5-4c8f0d368c1f service nova] Creating event network-vif-deleted:e8a81f7e-ee04-474a-9073-057e1d862c26 for instance ab6b2605-695c-4ee9-ae33-6234ef22536c on hv-cinder-86156 Oct 20 06:05:40.860043 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [req-4bb143c0-71f1-416a-a33a-68747aa69bc7 req-225c3c93-dda9-487b-a4c5-4c8f0d368c1f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054939 Oct 20 06:05:40.860738 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 83/190] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 20 06:05:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:05:41.053000 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-7ab118f0-be64-4c31-8ca2-6aa5b747762e tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:05:41.053609 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-7ab118f0-be64-4c31-8ca2-6aa5b747762e tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:05:41.059458 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7ab118f0-be64-4c31-8ca2-6aa5b747762e tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:41.059941 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7ab118f0-be64-4c31-8ca2-6aa5b747762e tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:41.060378 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7ab118f0-be64-4c31-8ca2-6aa5b747762e tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:41.061115 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7ab118f0-be64-4c31-8ca2-6aa5b747762e tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:41.061590 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7ab118f0-be64-4c31-8ca2-6aa5b747762e tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:41.061992 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7ab118f0-be64-4c31-8ca2-6aa5b747762e tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:41.125073 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-7ab118f0-be64-4c31-8ca2-6aa5b747762e tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:05:41.133250 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-7ab118f0-be64-4c31-8ca2-6aa5b747762e tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1270 microversion: 2.1 time: 0.085017 Oct 20 06:05:41.134367 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 108/191] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:05:41 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1270 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:05:41.536839 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-b6198528-6010-41b3-9510-48bb42cb9cc1 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:05:41.537559 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-b6198528-6010-41b3-9510-48bb42cb9cc1 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] [instance: ab6b2605-695c-4ee9-ae33-6234ef22536c] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:05:41.545393 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b6198528-6010-41b3-9510-48bb42cb9cc1 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:41.546150 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b6198528-6010-41b3-9510-48bb42cb9cc1 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:41.546577 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b6198528-6010-41b3-9510-48bb42cb9cc1 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:41.547260 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b6198528-6010-41b3-9510-48bb42cb9cc1 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:41.547707 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b6198528-6010-41b3-9510-48bb42cb9cc1 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:41.548127 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b6198528-6010-41b3-9510-48bb42cb9cc1 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:41.588035 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b6198528-6010-41b3-9510-48bb42cb9cc1 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:41.588713 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b6198528-6010-41b3-9510-48bb42cb9cc1 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:41.589288 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b6198528-6010-41b3-9510-48bb42cb9cc1 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:41.589886 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.objects.instance [None req-b6198528-6010-41b3-9510-48bb42cb9cc1 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Lazy-loading 'fault' on Instance uuid ab6b2605-695c-4ee9-ae33-6234ef22536c {{(pid=118860) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 20 06:05:41.667622 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-b6198528-6010-41b3-9510-48bb42cb9cc1 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85953d8e7394fb0a6f425ce51420325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72e1785381dd4bdaa2803fa7ef711dcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:05:41.677159 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-b6198528-6010-41b3-9510-48bb42cb9cc1 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] 10.222.0.20 "GET /compute/v2.1/servers/ab6b2605-695c-4ee9-ae33-6234ef22536c" status: 200 len: 1351 microversion: 2.1 time: 0.145348 Oct 20 06:05:41.678024 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 84/192] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:05:41 2022] GET /compute/v2.1/servers/ab6b2605-695c-4ee9-ae33-6234ef22536c => generated 1351 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:05:41.719212 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-f9e767ec-6b66-4566-afbe-dc8b8bc947f1 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:05:41.719821 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-f9e767ec-6b66-4566-afbe-dc8b8bc947f1 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] [instance: e8e2c461-4b15-42ea-bfc7-1daf1fe15f7f] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:05:41.727146 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f9e767ec-6b66-4566-afbe-dc8b8bc947f1 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:41.727639 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f9e767ec-6b66-4566-afbe-dc8b8bc947f1 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:41.728077 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f9e767ec-6b66-4566-afbe-dc8b8bc947f1 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:41.728806 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f9e767ec-6b66-4566-afbe-dc8b8bc947f1 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:41.729271 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f9e767ec-6b66-4566-afbe-dc8b8bc947f1 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:41.729685 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f9e767ec-6b66-4566-afbe-dc8b8bc947f1 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:41.871809 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-f9e767ec-6b66-4566-afbe-dc8b8bc947f1 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d4cbd2a2154e5d925462df7c77815a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0d80988ca941acb8ad4318338dfbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:05:41.879743 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-f9e767ec-6b66-4566-afbe-dc8b8bc947f1 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] 10.222.0.20 "GET /compute/v2.1/servers/e8e2c461-4b15-42ea-bfc7-1daf1fe15f7f" status: 200 len: 1522 microversion: 2.1 time: 0.164447 Oct 20 06:05:41.880322 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 109/193] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:05:41 2022] GET /compute/v2.1/servers/e8e2c461-4b15-42ea-bfc7-1daf1fe15f7f => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:05:42.159884 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-dccc5bd8-b6b0-4c10-bc72-1eb45508c38d tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:05:42.160738 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-dccc5bd8-b6b0-4c10-bc72-1eb45508c38d tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:05:42.167590 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-dccc5bd8-b6b0-4c10-bc72-1eb45508c38d tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:42.168298 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-dccc5bd8-b6b0-4c10-bc72-1eb45508c38d tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:42.168769 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-dccc5bd8-b6b0-4c10-bc72-1eb45508c38d tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:42.169917 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-dccc5bd8-b6b0-4c10-bc72-1eb45508c38d tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:42.170650 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-dccc5bd8-b6b0-4c10-bc72-1eb45508c38d tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:42.171460 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-dccc5bd8-b6b0-4c10-bc72-1eb45508c38d tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:42.439015 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-dccc5bd8-b6b0-4c10-bc72-1eb45508c38d tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:05:42.450425 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-dccc5bd8-b6b0-4c10-bc72-1eb45508c38d tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1318 microversion: 2.1 time: 0.295646 Oct 20 06:05:42.450991 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 85/194] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:05:42 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1318 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 06:05:42.701999 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-9c3886db-6ea1-4f38-9725-b303e5978524 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:05:42.702608 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-9c3886db-6ea1-4f38-9725-b303e5978524 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] [instance: ab6b2605-695c-4ee9-ae33-6234ef22536c] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:05:42.715642 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-9c3886db-6ea1-4f38-9725-b303e5978524 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:42.716135 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-9c3886db-6ea1-4f38-9725-b303e5978524 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:42.716571 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-9c3886db-6ea1-4f38-9725-b303e5978524 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:42.717299 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-9c3886db-6ea1-4f38-9725-b303e5978524 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:42.717751 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-9c3886db-6ea1-4f38-9725-b303e5978524 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:42.718164 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-9c3886db-6ea1-4f38-9725-b303e5978524 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:42.732551 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.wsgi [None req-9c3886db-6ea1-4f38-9725-b303e5978524 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] HTTP exception thrown: Instance ab6b2605-695c-4ee9-ae33-6234ef22536c could not be found. Oct 20 06:05:42.738266 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-9c3886db-6ea1-4f38-9725-b303e5978524 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Request method failure captured: Oct 20 06:05:42.738266 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: request: GET /compute/v2.1/servers/ab6b2605-695c-4ee9-ae33-6234ef22536c HTTP/1.1 Oct 20 06:05:42.738266 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: Accept: application/json Oct 20 06:05:42.738266 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: Accept-Encoding: identity Oct 20 06:05:42.738266 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: Connection: close Oct 20 06:05:42.738266 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: Content-Length: 0 Oct 20 06:05:42.738266 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: Content-Type: application/json Oct 20 06:05:42.738266 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: Host: 10.222.0.20 Oct 20 06:05:42.738266 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: Openstack-System-Scope: None Oct 20 06:05:42.738266 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: User-Agent: python-urllib3/1.26.12 Oct 20 06:05:42.738266 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Auth-Token: gAAAAABjUOT6FJU-ynu9RIkoQSOBE8zqYsh3UK_Dn1DYJ5o2w33nWJL7U8LB7YknbZ4ieBd6dwaq-skAjrSvjbo6z0FkGnn1fWw6z1yah_V8dLfK8nadBnqqaXUoMuHGgPAP41YS3k6MwrTLYLv50Z_j0pt5jCp8lmxeYv_bwZeLz8oaArIRCsA Oct 20 06:05:42.738266 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Domain-Id: None Oct 20 06:05:42.738266 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Domain-Name: None Oct 20 06:05:42.738266 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Identity-Status: Confirmed Oct 20 06:05:42.738266 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Is-Admin-Project: True Oct 20 06:05:42.738266 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Project-Domain-Id: default Oct 20 06:05:42.738266 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Project-Domain-Name: Default Oct 20 06:05:42.738266 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Project-Id: 72e1785381dd4bdaa2803fa7ef711dcb Oct 20 06:05:42.738266 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Project-Name: tempest-DeleteServersTestJSON-690993269 Oct 20 06:05:42.738266 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Role: reader,member Oct 20 06:05:42.738266 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Roles: reader,member Oct 20 06:05:42.739713 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/72e1785381dd4bdaa2803fa7ef711dcb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_72e1785381dd4bdaa2803fa7ef711dcb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/72e1785381dd4bdaa2803fa7ef711dcb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/72e1785381dd4bdaa2803fa7ef711dcb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 20 06:05:42.739713 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Tenant: tempest-DeleteServersTestJSON-690993269 Oct 20 06:05:42.739713 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Tenant-Id: 72e1785381dd4bdaa2803fa7ef711dcb Oct 20 06:05:42.739713 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Tenant-Name: tempest-DeleteServersTestJSON-690993269 Oct 20 06:05:42.739713 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-User: tempest-DeleteServersTestJSON-690993269-project Oct 20 06:05:42.739713 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-User-Domain-Id: default Oct 20 06:05:42.739713 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-User-Domain-Name: Default Oct 20 06:05:42.739713 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-User-Id: c85953d8e7394fb0a6f425ce51420325 Oct 20 06:05:42.739713 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-User-Name: tempest-DeleteServersTestJSON-690993269-project Oct 20 06:05:42.739713 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: method: > Oct 20 06:05:42.739713 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: exception: Instance ab6b2605-695c-4ee9-ae33-6234ef22536c could not be found. Oct 20 06:05:42.739713 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: action_args: {'id': 'ab6b2605-695c-4ee9-ae33-6234ef22536c'} Oct 20 06:05:42.740513 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 20 06:05:42.740513 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 06:05:42.740513 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 20 06:05:42.740513 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 20 06:05:42.740513 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 20 06:05:42.740513 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 20 06:05:42.740513 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 20 06:05:42.740513 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 20 06:05:42.740513 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 20 06:05:42.740513 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 20 06:05:42.740513 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ab6b2605-695c-4ee9-ae33-6234ef22536c could not be found. Oct 20 06:05:42.740513 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi Oct 20 06:05:42.740513 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 06:05:42.740513 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi Oct 20 06:05:42.740513 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 06:05:42.740513 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 06:05:42.740513 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 06:05:42.740513 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 20 06:05:42.740513 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 20 06:05:42.740513 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 20 06:05:42.741823 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 20 06:05:42.741823 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 20 06:05:42.741823 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 20 06:05:42.741823 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 20 06:05:42.741823 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 20 06:05:42.741823 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 20 06:05:42.741823 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 20 06:05:42.741823 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ab6b2605-695c-4ee9-ae33-6234ef22536c could not be found. Oct 20 06:05:42.741823 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi Oct 20 06:05:42.741823 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 06:05:42.741823 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi Oct 20 06:05:42.741823 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 06:05:42.741823 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 06:05:42.741823 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 06:05:42.741823 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 20 06:05:42.741823 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 20 06:05:42.741823 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ab6b2605-695c-4ee9-ae33-6234ef22536c could not be found. Oct 20 06:05:42.741823 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi Oct 20 06:05:42.744448 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-9c3886db-6ea1-4f38-9725-b303e5978524 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Returning 404 to user: Instance ab6b2605-695c-4ee9-ae33-6234ef22536c could not be found. {{(pid=118861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 20 06:05:42.745474 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-9c3886db-6ea1-4f38-9725-b303e5978524 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] 10.222.0.20 "GET /compute/v2.1/servers/ab6b2605-695c-4ee9-ae33-6234ef22536c" status: 404 len: 111 microversion: 2.1 time: 0.047936 Oct 20 06:05:42.746178 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 110/195] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:05:42 2022] GET /compute/v2.1/servers/ab6b2605-695c-4ee9-ae33-6234ef22536c => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 20 06:05:42.882748 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-aaa1d78e-1cf9-4eca-9f88-559922e5ef05 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:05:42.886896 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-aaa1d78e-1cf9-4eca-9f88-559922e5ef05 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] [instance: ab6b2605-695c-4ee9-ae33-6234ef22536c] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:05:42.894835 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-aaa1d78e-1cf9-4eca-9f88-559922e5ef05 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:42.895328 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-aaa1d78e-1cf9-4eca-9f88-559922e5ef05 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:42.896038 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-aaa1d78e-1cf9-4eca-9f88-559922e5ef05 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:42.896966 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-aaa1d78e-1cf9-4eca-9f88-559922e5ef05 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:42.897426 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-aaa1d78e-1cf9-4eca-9f88-559922e5ef05 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:42.897859 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-aaa1d78e-1cf9-4eca-9f88-559922e5ef05 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:42.905198 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-12581779-03d4-43ad-999e-4549a20bfe2b tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:05:42.906541 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-12581779-03d4-43ad-999e-4549a20bfe2b tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] [instance: e8e2c461-4b15-42ea-bfc7-1daf1fe15f7f] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:05:42.915520 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.wsgi [None req-aaa1d78e-1cf9-4eca-9f88-559922e5ef05 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] HTTP exception thrown: Instance ab6b2605-695c-4ee9-ae33-6234ef22536c could not be found. Oct 20 06:05:42.920310 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-aaa1d78e-1cf9-4eca-9f88-559922e5ef05 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Request method failure captured: Oct 20 06:05:42.920310 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: request: GET /compute/v2.1/servers/ab6b2605-695c-4ee9-ae33-6234ef22536c/os-volume_attachments HTTP/1.1 Oct 20 06:05:42.920310 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: Accept: application/json Oct 20 06:05:42.920310 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: Accept-Encoding: identity Oct 20 06:05:42.920310 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: Connection: close Oct 20 06:05:42.920310 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: Content-Length: 0 Oct 20 06:05:42.920310 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: Content-Type: application/json Oct 20 06:05:42.920310 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: Host: 10.222.0.20 Oct 20 06:05:42.920310 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: Openstack-System-Scope: None Oct 20 06:05:42.920310 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: User-Agent: python-urllib3/1.26.12 Oct 20 06:05:42.920310 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Auth-Token: gAAAAABjUOT6FJU-ynu9RIkoQSOBE8zqYsh3UK_Dn1DYJ5o2w33nWJL7U8LB7YknbZ4ieBd6dwaq-skAjrSvjbo6z0FkGnn1fWw6z1yah_V8dLfK8nadBnqqaXUoMuHGgPAP41YS3k6MwrTLYLv50Z_j0pt5jCp8lmxeYv_bwZeLz8oaArIRCsA Oct 20 06:05:42.920310 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Domain-Id: None Oct 20 06:05:42.920310 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Domain-Name: None Oct 20 06:05:42.920310 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Identity-Status: Confirmed Oct 20 06:05:42.920310 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Is-Admin-Project: True Oct 20 06:05:42.920310 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Project-Domain-Id: default Oct 20 06:05:42.920310 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Project-Domain-Name: Default Oct 20 06:05:42.920310 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Project-Id: 72e1785381dd4bdaa2803fa7ef711dcb Oct 20 06:05:42.920310 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Project-Name: tempest-DeleteServersTestJSON-690993269 Oct 20 06:05:42.920310 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Role: reader,member Oct 20 06:05:42.920310 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Roles: reader,member Oct 20 06:05:42.921979 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/72e1785381dd4bdaa2803fa7ef711dcb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_72e1785381dd4bdaa2803fa7ef711dcb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/72e1785381dd4bdaa2803fa7ef711dcb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/72e1785381dd4bdaa2803fa7ef711dcb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 20 06:05:42.921979 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Tenant: tempest-DeleteServersTestJSON-690993269 Oct 20 06:05:42.921979 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Tenant-Id: 72e1785381dd4bdaa2803fa7ef711dcb Oct 20 06:05:42.921979 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Tenant-Name: tempest-DeleteServersTestJSON-690993269 Oct 20 06:05:42.921979 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-User: tempest-DeleteServersTestJSON-690993269-project Oct 20 06:05:42.921979 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-User-Domain-Id: default Oct 20 06:05:42.921979 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-User-Domain-Name: Default Oct 20 06:05:42.921979 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-User-Id: c85953d8e7394fb0a6f425ce51420325 Oct 20 06:05:42.921979 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-User-Name: tempest-DeleteServersTestJSON-690993269-project Oct 20 06:05:42.921979 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: method: > Oct 20 06:05:42.921979 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: exception: Instance ab6b2605-695c-4ee9-ae33-6234ef22536c could not be found. Oct 20 06:05:42.921979 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: action_args: {'server_id': 'ab6b2605-695c-4ee9-ae33-6234ef22536c'} Oct 20 06:05:42.922841 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 20 06:05:42.922841 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 06:05:42.922841 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 20 06:05:42.922841 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 20 06:05:42.922841 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 20 06:05:42.922841 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 20 06:05:42.922841 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 20 06:05:42.922841 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 20 06:05:42.922841 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 20 06:05:42.922841 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 20 06:05:42.922841 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ab6b2605-695c-4ee9-ae33-6234ef22536c could not be found. Oct 20 06:05:42.922841 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi Oct 20 06:05:42.922841 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 06:05:42.922841 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi Oct 20 06:05:42.922841 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 06:05:42.922841 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 06:05:42.922841 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 06:05:42.922841 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 20 06:05:42.922841 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 20 06:05:42.922841 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 20 06:05:42.924773 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 20 06:05:42.924773 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 20 06:05:42.924773 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 20 06:05:42.924773 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 20 06:05:42.924773 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 20 06:05:42.924773 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Oct 20 06:05:42.924773 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Oct 20 06:05:42.924773 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 20 06:05:42.924773 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 20 06:05:42.924773 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ab6b2605-695c-4ee9-ae33-6234ef22536c could not be found. Oct 20 06:05:42.924773 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi Oct 20 06:05:42.924773 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 06:05:42.924773 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi Oct 20 06:05:42.924773 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 06:05:42.924773 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 06:05:42.924773 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 06:05:42.924773 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 20 06:05:42.924773 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 20 06:05:42.924773 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ab6b2605-695c-4ee9-ae33-6234ef22536c could not be found. Oct 20 06:05:42.924773 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi Oct 20 06:05:42.926034 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-12581779-03d4-43ad-999e-4549a20bfe2b tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:42.926034 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-12581779-03d4-43ad-999e-4549a20bfe2b tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:42.926034 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-12581779-03d4-43ad-999e-4549a20bfe2b tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:42.926034 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-12581779-03d4-43ad-999e-4549a20bfe2b tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:42.927312 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-aaa1d78e-1cf9-4eca-9f88-559922e5ef05 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Returning 404 to user: Instance ab6b2605-695c-4ee9-ae33-6234ef22536c could not be found. {{(pid=118860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 20 06:05:42.928573 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-12581779-03d4-43ad-999e-4549a20bfe2b tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:42.929059 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-aaa1d78e-1cf9-4eca-9f88-559922e5ef05 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] 10.222.0.20 "GET /compute/v2.1/servers/ab6b2605-695c-4ee9-ae33-6234ef22536c/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.050538 Oct 20 06:05:42.929217 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-12581779-03d4-43ad-999e-4549a20bfe2b tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:42.934392 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 86/196] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:05:42 2022] GET /compute/v2.1/servers/ab6b2605-695c-4ee9-ae33-6234ef22536c/os-volume_attachments => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 20 06:05:42.942111 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [req-5678bdb4-5547-4af9-9ab5-19eea4349a5c req-4ee102bb-256e-4b3a-bff5-d694c2c0b102 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0247d13a-779d-4301-ba85-6cbcbf12252f", "tag": "418af13b-a918-48be-b332-3b304b1004cc"}]} {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 06:05:42.960236 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [req-5678bdb4-5547-4af9-9ab5-19eea4349a5c req-4ee102bb-256e-4b3a-bff5-d694c2c0b102 service nova] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:42.961004 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [req-5678bdb4-5547-4af9-9ab5-19eea4349a5c req-4ee102bb-256e-4b3a-bff5-d694c2c0b102 service nova] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:42.961585 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [req-5678bdb4-5547-4af9-9ab5-19eea4349a5c req-4ee102bb-256e-4b3a-bff5-d694c2c0b102 service nova] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:42.990133 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.compute.server_external_events [req-5678bdb4-5547-4af9-9ab5-19eea4349a5c req-4ee102bb-256e-4b3a-bff5-d694c2c0b102 service nova] Creating event network-changed:418af13b-a918-48be-b332-3b304b1004cc for instance 0247d13a-779d-4301-ba85-6cbcbf12252f on hv-cinder-86156 Oct 20 06:05:43.017610 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [req-5678bdb4-5547-4af9-9ab5-19eea4349a5c req-4ee102bb-256e-4b3a-bff5-d694c2c0b102 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069066 Oct 20 06:05:43.021427 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 87/197] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 20 06:05:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:05:43.153900 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-12581779-03d4-43ad-999e-4549a20bfe2b tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d4cbd2a2154e5d925462df7c77815a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0d80988ca941acb8ad4318338dfbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:05:43.162555 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-12581779-03d4-43ad-999e-4549a20bfe2b tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] 10.222.0.20 "GET /compute/v2.1/servers/e8e2c461-4b15-42ea-bfc7-1daf1fe15f7f" status: 200 len: 1522 microversion: 2.1 time: 0.262907 Oct 20 06:05:43.163118 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 111/198] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:05:42 2022] GET /compute/v2.1/servers/e8e2c461-4b15-42ea-bfc7-1daf1fe15f7f => generated 1522 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 06:05:43.475099 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-693efe32-b909-4da7-aae2-ffd39977a1cc tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:05:43.475965 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-693efe32-b909-4da7-aae2-ffd39977a1cc tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:05:43.482858 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-693efe32-b909-4da7-aae2-ffd39977a1cc tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:43.483431 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-693efe32-b909-4da7-aae2-ffd39977a1cc tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:43.484046 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-693efe32-b909-4da7-aae2-ffd39977a1cc tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:43.485003 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-693efe32-b909-4da7-aae2-ffd39977a1cc tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:43.485559 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-693efe32-b909-4da7-aae2-ffd39977a1cc tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:43.486123 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-693efe32-b909-4da7-aae2-ffd39977a1cc tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:43.619091 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-693efe32-b909-4da7-aae2-ffd39977a1cc tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:05:43.622864 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG dbcounter [-] [118860] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:05:43.638508 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-693efe32-b909-4da7-aae2-ffd39977a1cc tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1318 microversion: 2.1 time: 0.168871 Oct 20 06:05:43.639494 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 88/199] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:05:43 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1318 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 06:05:44.187073 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-0ed8f943-ab32-48f6-9a68-49b1135fb955 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:05:44.187681 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-0ed8f943-ab32-48f6-9a68-49b1135fb955 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] [instance: e8e2c461-4b15-42ea-bfc7-1daf1fe15f7f] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:05:44.199321 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-0ed8f943-ab32-48f6-9a68-49b1135fb955 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:44.199810 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-0ed8f943-ab32-48f6-9a68-49b1135fb955 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:44.200251 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-0ed8f943-ab32-48f6-9a68-49b1135fb955 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:44.200984 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-0ed8f943-ab32-48f6-9a68-49b1135fb955 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:44.201870 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-0ed8f943-ab32-48f6-9a68-49b1135fb955 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:44.202305 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-0ed8f943-ab32-48f6-9a68-49b1135fb955 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:44.222748 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-14ef2dcc-5617-4d1a-8d9e-aaad30c73986 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:05:44.223324 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-14ef2dcc-5617-4d1a-8d9e-aaad30c73986 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] [instance: ab6b2605-695c-4ee9-ae33-6234ef22536c] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:05:44.230204 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-14ef2dcc-5617-4d1a-8d9e-aaad30c73986 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:44.230791 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-14ef2dcc-5617-4d1a-8d9e-aaad30c73986 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:44.231315 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-14ef2dcc-5617-4d1a-8d9e-aaad30c73986 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:44.232085 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-14ef2dcc-5617-4d1a-8d9e-aaad30c73986 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:44.232616 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-14ef2dcc-5617-4d1a-8d9e-aaad30c73986 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:44.233147 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-14ef2dcc-5617-4d1a-8d9e-aaad30c73986 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:44.248133 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.wsgi [None req-14ef2dcc-5617-4d1a-8d9e-aaad30c73986 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] HTTP exception thrown: Instance ab6b2605-695c-4ee9-ae33-6234ef22536c could not be found. Oct 20 06:05:44.250784 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-14ef2dcc-5617-4d1a-8d9e-aaad30c73986 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Request method failure captured: Oct 20 06:05:44.250784 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: request: DELETE /compute/v2.1/servers/ab6b2605-695c-4ee9-ae33-6234ef22536c HTTP/1.1 Oct 20 06:05:44.250784 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: Accept: application/json Oct 20 06:05:44.250784 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: Accept-Encoding: identity Oct 20 06:05:44.250784 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: Connection: close Oct 20 06:05:44.250784 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: Content-Length: 0 Oct 20 06:05:44.250784 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: Content-Type: application/json Oct 20 06:05:44.250784 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: Host: 10.222.0.20 Oct 20 06:05:44.250784 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: Openstack-System-Scope: None Oct 20 06:05:44.250784 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: User-Agent: python-urllib3/1.26.12 Oct 20 06:05:44.250784 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Auth-Token: gAAAAABjUOT6FJU-ynu9RIkoQSOBE8zqYsh3UK_Dn1DYJ5o2w33nWJL7U8LB7YknbZ4ieBd6dwaq-skAjrSvjbo6z0FkGnn1fWw6z1yah_V8dLfK8nadBnqqaXUoMuHGgPAP41YS3k6MwrTLYLv50Z_j0pt5jCp8lmxeYv_bwZeLz8oaArIRCsA Oct 20 06:05:44.250784 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Domain-Id: None Oct 20 06:05:44.250784 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Domain-Name: None Oct 20 06:05:44.250784 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Identity-Status: Confirmed Oct 20 06:05:44.250784 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Is-Admin-Project: True Oct 20 06:05:44.250784 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Project-Domain-Id: default Oct 20 06:05:44.250784 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Project-Domain-Name: Default Oct 20 06:05:44.250784 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Project-Id: 72e1785381dd4bdaa2803fa7ef711dcb Oct 20 06:05:44.250784 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Project-Name: tempest-DeleteServersTestJSON-690993269 Oct 20 06:05:44.250784 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Role: reader,member Oct 20 06:05:44.250784 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Roles: reader,member Oct 20 06:05:44.251941 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/72e1785381dd4bdaa2803fa7ef711dcb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_72e1785381dd4bdaa2803fa7ef711dcb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/72e1785381dd4bdaa2803fa7ef711dcb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/72e1785381dd4bdaa2803fa7ef711dcb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 20 06:05:44.251941 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Tenant: tempest-DeleteServersTestJSON-690993269 Oct 20 06:05:44.251941 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Tenant-Id: 72e1785381dd4bdaa2803fa7ef711dcb Oct 20 06:05:44.251941 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Tenant-Name: tempest-DeleteServersTestJSON-690993269 Oct 20 06:05:44.251941 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-User: tempest-DeleteServersTestJSON-690993269-project Oct 20 06:05:44.251941 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-User-Domain-Id: default Oct 20 06:05:44.251941 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-User-Domain-Name: Default Oct 20 06:05:44.251941 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-User-Id: c85953d8e7394fb0a6f425ce51420325 Oct 20 06:05:44.251941 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-User-Name: tempest-DeleteServersTestJSON-690993269-project Oct 20 06:05:44.251941 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: method: > Oct 20 06:05:44.251941 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: exception: Instance ab6b2605-695c-4ee9-ae33-6234ef22536c could not be found. Oct 20 06:05:44.251941 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: action_args: {'id': 'ab6b2605-695c-4ee9-ae33-6234ef22536c'} Oct 20 06:05:44.253090 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 20 06:05:44.253090 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 06:05:44.253090 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 20 06:05:44.253090 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 20 06:05:44.253090 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 20 06:05:44.253090 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 20 06:05:44.253090 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 20 06:05:44.253090 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 20 06:05:44.253090 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 20 06:05:44.253090 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 20 06:05:44.253090 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ab6b2605-695c-4ee9-ae33-6234ef22536c could not be found. Oct 20 06:05:44.253090 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi Oct 20 06:05:44.253090 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 06:05:44.253090 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi Oct 20 06:05:44.253090 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 06:05:44.253090 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 06:05:44.253090 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 06:05:44.253090 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 20 06:05:44.253090 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 20 06:05:44.253090 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 20 06:05:44.254246 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 20 06:05:44.254246 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 20 06:05:44.254246 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 20 06:05:44.254246 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 20 06:05:44.254246 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 20 06:05:44.254246 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 20 06:05:44.254246 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 20 06:05:44.254246 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 20 06:05:44.254246 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 20 06:05:44.254246 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ab6b2605-695c-4ee9-ae33-6234ef22536c could not be found. Oct 20 06:05:44.254246 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi Oct 20 06:05:44.254246 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 06:05:44.254246 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi Oct 20 06:05:44.254246 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 06:05:44.254246 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 06:05:44.254246 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 06:05:44.254246 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 20 06:05:44.254246 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 20 06:05:44.254246 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ab6b2605-695c-4ee9-ae33-6234ef22536c could not be found. Oct 20 06:05:44.254246 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi Oct 20 06:05:44.255358 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-14ef2dcc-5617-4d1a-8d9e-aaad30c73986 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Returning 404 to user: Instance ab6b2605-695c-4ee9-ae33-6234ef22536c could not be found. {{(pid=118860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 20 06:05:44.255358 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-14ef2dcc-5617-4d1a-8d9e-aaad30c73986 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] 10.222.0.20 "DELETE /compute/v2.1/servers/ab6b2605-695c-4ee9-ae33-6234ef22536c" status: 404 len: 111 microversion: 2.1 time: 0.035123 Oct 20 06:05:44.255358 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 89/200] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 20 06:05:44 2022] DELETE /compute/v2.1/servers/ab6b2605-695c-4ee9-ae33-6234ef22536c => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 20 06:05:44.261149 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-4c98a78a-e9fb-4eb4-8687-f2a98df95734 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:05:44.261875 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-4c98a78a-e9fb-4eb4-8687-f2a98df95734 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] [instance: ab6b2605-695c-4ee9-ae33-6234ef22536c] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:05:44.268799 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-4c98a78a-e9fb-4eb4-8687-f2a98df95734 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:44.269381 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-4c98a78a-e9fb-4eb4-8687-f2a98df95734 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:44.269948 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-4c98a78a-e9fb-4eb4-8687-f2a98df95734 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:44.270747 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-4c98a78a-e9fb-4eb4-8687-f2a98df95734 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:44.271303 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-4c98a78a-e9fb-4eb4-8687-f2a98df95734 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:44.272139 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-4c98a78a-e9fb-4eb4-8687-f2a98df95734 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:44.286718 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.wsgi [None req-4c98a78a-e9fb-4eb4-8687-f2a98df95734 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] HTTP exception thrown: Instance ab6b2605-695c-4ee9-ae33-6234ef22536c could not be found. Oct 20 06:05:44.288339 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-4c98a78a-e9fb-4eb4-8687-f2a98df95734 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Request method failure captured: Oct 20 06:05:44.288339 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: request: GET /compute/v2.1/servers/ab6b2605-695c-4ee9-ae33-6234ef22536c HTTP/1.1 Oct 20 06:05:44.288339 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: Accept: application/json Oct 20 06:05:44.288339 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: Accept-Encoding: identity Oct 20 06:05:44.288339 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: Connection: close Oct 20 06:05:44.288339 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: Content-Length: 0 Oct 20 06:05:44.288339 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: Content-Type: application/json Oct 20 06:05:44.288339 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: Host: 10.222.0.20 Oct 20 06:05:44.288339 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: Openstack-System-Scope: None Oct 20 06:05:44.288339 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: User-Agent: python-urllib3/1.26.12 Oct 20 06:05:44.288339 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Auth-Token: gAAAAABjUOT6FJU-ynu9RIkoQSOBE8zqYsh3UK_Dn1DYJ5o2w33nWJL7U8LB7YknbZ4ieBd6dwaq-skAjrSvjbo6z0FkGnn1fWw6z1yah_V8dLfK8nadBnqqaXUoMuHGgPAP41YS3k6MwrTLYLv50Z_j0pt5jCp8lmxeYv_bwZeLz8oaArIRCsA Oct 20 06:05:44.288339 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Domain-Id: None Oct 20 06:05:44.288339 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Domain-Name: None Oct 20 06:05:44.288339 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Identity-Status: Confirmed Oct 20 06:05:44.288339 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Is-Admin-Project: True Oct 20 06:05:44.288339 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Project-Domain-Id: default Oct 20 06:05:44.288339 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Project-Domain-Name: Default Oct 20 06:05:44.288339 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Project-Id: 72e1785381dd4bdaa2803fa7ef711dcb Oct 20 06:05:44.288339 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Project-Name: tempest-DeleteServersTestJSON-690993269 Oct 20 06:05:44.288339 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Role: reader,member Oct 20 06:05:44.288339 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Roles: reader,member Oct 20 06:05:44.289749 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/72e1785381dd4bdaa2803fa7ef711dcb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_72e1785381dd4bdaa2803fa7ef711dcb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/72e1785381dd4bdaa2803fa7ef711dcb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/72e1785381dd4bdaa2803fa7ef711dcb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 20 06:05:44.289749 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Tenant: tempest-DeleteServersTestJSON-690993269 Oct 20 06:05:44.289749 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Tenant-Id: 72e1785381dd4bdaa2803fa7ef711dcb Oct 20 06:05:44.289749 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Tenant-Name: tempest-DeleteServersTestJSON-690993269 Oct 20 06:05:44.289749 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-User: tempest-DeleteServersTestJSON-690993269-project Oct 20 06:05:44.289749 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-User-Domain-Id: default Oct 20 06:05:44.289749 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-User-Domain-Name: Default Oct 20 06:05:44.289749 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-User-Id: c85953d8e7394fb0a6f425ce51420325 Oct 20 06:05:44.289749 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-User-Name: tempest-DeleteServersTestJSON-690993269-project Oct 20 06:05:44.289749 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: method: > Oct 20 06:05:44.289749 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: exception: Instance ab6b2605-695c-4ee9-ae33-6234ef22536c could not be found. Oct 20 06:05:44.289749 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: action_args: {'id': 'ab6b2605-695c-4ee9-ae33-6234ef22536c'} Oct 20 06:05:44.290516 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 20 06:05:44.290516 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 06:05:44.290516 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 20 06:05:44.290516 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 20 06:05:44.290516 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 20 06:05:44.290516 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 20 06:05:44.290516 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 20 06:05:44.290516 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 20 06:05:44.290516 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 20 06:05:44.290516 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 20 06:05:44.290516 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ab6b2605-695c-4ee9-ae33-6234ef22536c could not be found. Oct 20 06:05:44.290516 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi Oct 20 06:05:44.290516 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 06:05:44.290516 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi Oct 20 06:05:44.290516 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 06:05:44.290516 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 06:05:44.290516 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 06:05:44.290516 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 20 06:05:44.290516 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 20 06:05:44.290516 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 20 06:05:44.292586 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 20 06:05:44.292586 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 20 06:05:44.292586 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 20 06:05:44.292586 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 20 06:05:44.292586 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 20 06:05:44.292586 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 20 06:05:44.292586 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 20 06:05:44.292586 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ab6b2605-695c-4ee9-ae33-6234ef22536c could not be found. Oct 20 06:05:44.292586 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi Oct 20 06:05:44.292586 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 06:05:44.292586 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi Oct 20 06:05:44.292586 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 06:05:44.292586 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 06:05:44.292586 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 06:05:44.292586 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 20 06:05:44.292586 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 20 06:05:44.292586 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ab6b2605-695c-4ee9-ae33-6234ef22536c could not be found. Oct 20 06:05:44.292586 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi Oct 20 06:05:44.294165 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-4c98a78a-e9fb-4eb4-8687-f2a98df95734 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] Returning 404 to user: Instance ab6b2605-695c-4ee9-ae33-6234ef22536c could not be found. {{(pid=118860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 20 06:05:44.294165 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-4c98a78a-e9fb-4eb4-8687-f2a98df95734 tempest-DeleteServersTestJSON-690993269 tempest-DeleteServersTestJSON-690993269-project] 10.222.0.20 "GET /compute/v2.1/servers/ab6b2605-695c-4ee9-ae33-6234ef22536c" status: 404 len: 111 microversion: 2.1 time: 0.033567 Oct 20 06:05:44.294165 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 90/201] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:05:44 2022] GET /compute/v2.1/servers/ab6b2605-695c-4ee9-ae33-6234ef22536c => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 20 06:05:44.341426 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-0ed8f943-ab32-48f6-9a68-49b1135fb955 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d4cbd2a2154e5d925462df7c77815a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0d80988ca941acb8ad4318338dfbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:05:44.350374 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-0ed8f943-ab32-48f6-9a68-49b1135fb955 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] 10.222.0.20 "GET /compute/v2.1/servers/e8e2c461-4b15-42ea-bfc7-1daf1fe15f7f" status: 200 len: 1522 microversion: 2.1 time: 0.167289 Oct 20 06:05:44.351520 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 112/202] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:05:44 2022] GET /compute/v2.1/servers/e8e2c461-4b15-42ea-bfc7-1daf1fe15f7f => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:05:44.663746 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-7fd413c1-a65b-46db-ad19-dbfff31ad6b7 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:05:44.664358 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-7fd413c1-a65b-46db-ad19-dbfff31ad6b7 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:05:44.673614 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7fd413c1-a65b-46db-ad19-dbfff31ad6b7 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:44.674735 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7fd413c1-a65b-46db-ad19-dbfff31ad6b7 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:44.675167 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7fd413c1-a65b-46db-ad19-dbfff31ad6b7 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:44.675862 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7fd413c1-a65b-46db-ad19-dbfff31ad6b7 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:44.676316 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7fd413c1-a65b-46db-ad19-dbfff31ad6b7 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:44.676759 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7fd413c1-a65b-46db-ad19-dbfff31ad6b7 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:45.029832 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-7fd413c1-a65b-46db-ad19-dbfff31ad6b7 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:05:45.037610 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-7fd413c1-a65b-46db-ad19-dbfff31ad6b7 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1318 microversion: 2.1 time: 0.377883 Oct 20 06:05:45.038175 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 91/203] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:05:44 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1318 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:05:45.373875 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-693b8717-c8a1-41e4-9975-17bc149be042 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:05:45.374487 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-693b8717-c8a1-41e4-9975-17bc149be042 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] [instance: e8e2c461-4b15-42ea-bfc7-1daf1fe15f7f] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:05:45.382167 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-693b8717-c8a1-41e4-9975-17bc149be042 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:45.382656 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-693b8717-c8a1-41e4-9975-17bc149be042 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:45.383099 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-693b8717-c8a1-41e4-9975-17bc149be042 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:45.384073 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-693b8717-c8a1-41e4-9975-17bc149be042 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:45.384528 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-693b8717-c8a1-41e4-9975-17bc149be042 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:45.384983 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-693b8717-c8a1-41e4-9975-17bc149be042 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:45.515425 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-693b8717-c8a1-41e4-9975-17bc149be042 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d4cbd2a2154e5d925462df7c77815a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0d80988ca941acb8ad4318338dfbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:05:45.524849 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-693b8717-c8a1-41e4-9975-17bc149be042 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] 10.222.0.20 "GET /compute/v2.1/servers/e8e2c461-4b15-42ea-bfc7-1daf1fe15f7f" status: 200 len: 1522 microversion: 2.1 time: 0.154708 Oct 20 06:05:45.525758 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 113/204] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:05:45 2022] GET /compute/v2.1/servers/e8e2c461-4b15-42ea-bfc7-1daf1fe15f7f => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:05:46.066665 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-e75d3376-dd99-43b8-a34b-1940fe9c90d2 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:05:46.068977 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-e75d3376-dd99-43b8-a34b-1940fe9c90d2 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:05:46.080629 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e75d3376-dd99-43b8-a34b-1940fe9c90d2 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:46.082239 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e75d3376-dd99-43b8-a34b-1940fe9c90d2 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:46.083097 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e75d3376-dd99-43b8-a34b-1940fe9c90d2 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:46.084201 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e75d3376-dd99-43b8-a34b-1940fe9c90d2 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:46.086238 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e75d3376-dd99-43b8-a34b-1940fe9c90d2 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:46.087137 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e75d3376-dd99-43b8-a34b-1940fe9c90d2 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:46.282865 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-e75d3376-dd99-43b8-a34b-1940fe9c90d2 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:05:46.291553 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-e75d3376-dd99-43b8-a34b-1940fe9c90d2 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1318 microversion: 2.1 time: 0.233813 Oct 20 06:05:46.292125 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 92/205] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:05:46 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1318 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:05:46.547352 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-93229c90-29f0-4592-9d4b-3f67148fa5c2 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:05:46.548023 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-93229c90-29f0-4592-9d4b-3f67148fa5c2 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] [instance: e8e2c461-4b15-42ea-bfc7-1daf1fe15f7f] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:05:46.554495 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-93229c90-29f0-4592-9d4b-3f67148fa5c2 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:46.555311 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-93229c90-29f0-4592-9d4b-3f67148fa5c2 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:46.555956 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-93229c90-29f0-4592-9d4b-3f67148fa5c2 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:46.556893 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-93229c90-29f0-4592-9d4b-3f67148fa5c2 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:46.557557 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-93229c90-29f0-4592-9d4b-3f67148fa5c2 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:46.558231 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-93229c90-29f0-4592-9d4b-3f67148fa5c2 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:46.911830 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-93229c90-29f0-4592-9d4b-3f67148fa5c2 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d4cbd2a2154e5d925462df7c77815a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0d80988ca941acb8ad4318338dfbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:05:46.920592 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-93229c90-29f0-4592-9d4b-3f67148fa5c2 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] 10.222.0.20 "GET /compute/v2.1/servers/e8e2c461-4b15-42ea-bfc7-1daf1fe15f7f" status: 200 len: 1522 microversion: 2.1 time: 0.376941 Oct 20 06:05:46.921595 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 114/206] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:05:46 2022] GET /compute/v2.1/servers/e8e2c461-4b15-42ea-bfc7-1daf1fe15f7f => generated 1522 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:05:47.317922 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-2f1468da-af2c-48fe-b72e-ff6345bd80b1 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:05:47.319102 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-2f1468da-af2c-48fe-b72e-ff6345bd80b1 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:05:47.327573 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2f1468da-af2c-48fe-b72e-ff6345bd80b1 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:47.328080 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2f1468da-af2c-48fe-b72e-ff6345bd80b1 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:47.328511 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2f1468da-af2c-48fe-b72e-ff6345bd80b1 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:47.329417 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2f1468da-af2c-48fe-b72e-ff6345bd80b1 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:47.329875 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2f1468da-af2c-48fe-b72e-ff6345bd80b1 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:47.330849 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2f1468da-af2c-48fe-b72e-ff6345bd80b1 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:47.582023 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-2f1468da-af2c-48fe-b72e-ff6345bd80b1 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:05:47.589837 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-2f1468da-af2c-48fe-b72e-ff6345bd80b1 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1318 microversion: 2.1 time: 0.276508 Oct 20 06:05:47.590404 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 93/207] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:05:47 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1318 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:05:47.944021 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-968d7095-bb7c-4128-a546-e61f439e22cb tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:05:47.944633 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-968d7095-bb7c-4128-a546-e61f439e22cb tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] [instance: e8e2c461-4b15-42ea-bfc7-1daf1fe15f7f] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:05:47.951538 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-968d7095-bb7c-4128-a546-e61f439e22cb tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:47.952036 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-968d7095-bb7c-4128-a546-e61f439e22cb tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:47.952477 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-968d7095-bb7c-4128-a546-e61f439e22cb tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:47.953205 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-968d7095-bb7c-4128-a546-e61f439e22cb tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:47.953661 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-968d7095-bb7c-4128-a546-e61f439e22cb tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:47.954083 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-968d7095-bb7c-4128-a546-e61f439e22cb tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:48.418823 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-968d7095-bb7c-4128-a546-e61f439e22cb tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d4cbd2a2154e5d925462df7c77815a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0d80988ca941acb8ad4318338dfbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:05:48.427202 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-968d7095-bb7c-4128-a546-e61f439e22cb tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] 10.222.0.20 "GET /compute/v2.1/servers/e8e2c461-4b15-42ea-bfc7-1daf1fe15f7f" status: 200 len: 1522 microversion: 2.1 time: 0.487571 Oct 20 06:05:48.427854 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 115/208] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:05:47 2022] GET /compute/v2.1/servers/e8e2c461-4b15-42ea-bfc7-1daf1fe15f7f => generated 1522 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:05:48.614178 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-b737080b-267e-40cb-a408-b1c2e21f5bb5 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:05:48.614795 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-b737080b-267e-40cb-a408-b1c2e21f5bb5 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:05:48.622439 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b737080b-267e-40cb-a408-b1c2e21f5bb5 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:48.623462 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b737080b-267e-40cb-a408-b1c2e21f5bb5 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:48.624233 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b737080b-267e-40cb-a408-b1c2e21f5bb5 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:48.625139 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b737080b-267e-40cb-a408-b1c2e21f5bb5 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:48.625727 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b737080b-267e-40cb-a408-b1c2e21f5bb5 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:48.626291 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b737080b-267e-40cb-a408-b1c2e21f5bb5 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:48.766827 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-b737080b-267e-40cb-a408-b1c2e21f5bb5 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:05:48.775142 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-b737080b-267e-40cb-a408-b1c2e21f5bb5 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1318 microversion: 2.1 time: 0.164989 Oct 20 06:05:48.775721 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 94/209] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:05:48 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1318 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:05:49.450209 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-87a428e9-fe05-4639-a26e-c93fb5082781 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:05:49.450811 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-87a428e9-fe05-4639-a26e-c93fb5082781 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] [instance: e8e2c461-4b15-42ea-bfc7-1daf1fe15f7f] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:05:49.457870 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-87a428e9-fe05-4639-a26e-c93fb5082781 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:49.458353 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-87a428e9-fe05-4639-a26e-c93fb5082781 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:49.458784 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-87a428e9-fe05-4639-a26e-c93fb5082781 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:49.459466 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-87a428e9-fe05-4639-a26e-c93fb5082781 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:49.459909 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-87a428e9-fe05-4639-a26e-c93fb5082781 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:49.460336 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-87a428e9-fe05-4639-a26e-c93fb5082781 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:49.596413 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-87a428e9-fe05-4639-a26e-c93fb5082781 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d4cbd2a2154e5d925462df7c77815a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0d80988ca941acb8ad4318338dfbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:05:49.604436 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-87a428e9-fe05-4639-a26e-c93fb5082781 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] 10.222.0.20 "GET /compute/v2.1/servers/e8e2c461-4b15-42ea-bfc7-1daf1fe15f7f" status: 200 len: 1522 microversion: 2.1 time: 0.158021 Oct 20 06:05:49.605051 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 116/210] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:05:49 2022] GET /compute/v2.1/servers/e8e2c461-4b15-42ea-bfc7-1daf1fe15f7f => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:05:49.798192 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-de7632ee-0b13-44c4-b434-a362639ddc1b tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:05:49.799901 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-de7632ee-0b13-44c4-b434-a362639ddc1b tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:05:49.805839 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-de7632ee-0b13-44c4-b434-a362639ddc1b tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:49.806317 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-de7632ee-0b13-44c4-b434-a362639ddc1b tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:49.806750 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-de7632ee-0b13-44c4-b434-a362639ddc1b tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:49.807448 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-de7632ee-0b13-44c4-b434-a362639ddc1b tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:49.807894 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-de7632ee-0b13-44c4-b434-a362639ddc1b tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:49.808328 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-de7632ee-0b13-44c4-b434-a362639ddc1b tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:49.881078 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG dbcounter [-] [118860] Writing DB stats nova_cell0:SELECT=2 {{(pid=118860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:05:49.900845 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG dbcounter [-] [118860] Writing DB stats nova_cell0:SELECT=6 {{(pid=118860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:05:49.943170 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-de7632ee-0b13-44c4-b434-a362639ddc1b tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:05:49.951090 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-de7632ee-0b13-44c4-b434-a362639ddc1b tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1318 microversion: 2.1 time: 0.156691 Oct 20 06:05:49.952123 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 95/211] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:05:49 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:05:50.628221 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-e43f8ec1-1b0a-4242-8cfb-e7fd9089727c tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:05:50.628865 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-e43f8ec1-1b0a-4242-8cfb-e7fd9089727c tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] [instance: e8e2c461-4b15-42ea-bfc7-1daf1fe15f7f] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:05:50.630689 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG dbcounter [-] [118861] Writing DB stats nova_cell0:SELECT=2 {{(pid=118861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:05:50.636458 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e43f8ec1-1b0a-4242-8cfb-e7fd9089727c tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:50.636963 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e43f8ec1-1b0a-4242-8cfb-e7fd9089727c tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:50.637402 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e43f8ec1-1b0a-4242-8cfb-e7fd9089727c tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:50.638088 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e43f8ec1-1b0a-4242-8cfb-e7fd9089727c tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:50.638537 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e43f8ec1-1b0a-4242-8cfb-e7fd9089727c tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:50.638955 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e43f8ec1-1b0a-4242-8cfb-e7fd9089727c tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:50.763342 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-e43f8ec1-1b0a-4242-8cfb-e7fd9089727c tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d4cbd2a2154e5d925462df7c77815a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0d80988ca941acb8ad4318338dfbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:05:50.771141 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-e43f8ec1-1b0a-4242-8cfb-e7fd9089727c tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] 10.222.0.20 "GET /compute/v2.1/servers/e8e2c461-4b15-42ea-bfc7-1daf1fe15f7f" status: 200 len: 1522 microversion: 2.1 time: 0.147715 Oct 20 06:05:50.771707 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 117/212] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:05:50 2022] GET /compute/v2.1/servers/e8e2c461-4b15-42ea-bfc7-1daf1fe15f7f => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:05:50.975023 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-053de4b9-e16d-4e71-b035-361605eff8a2 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:05:50.975738 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-053de4b9-e16d-4e71-b035-361605eff8a2 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:05:50.981704 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-053de4b9-e16d-4e71-b035-361605eff8a2 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:50.982172 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-053de4b9-e16d-4e71-b035-361605eff8a2 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:50.982606 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-053de4b9-e16d-4e71-b035-361605eff8a2 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:50.983279 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-053de4b9-e16d-4e71-b035-361605eff8a2 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:50.983720 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-053de4b9-e16d-4e71-b035-361605eff8a2 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:50.984138 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-053de4b9-e16d-4e71-b035-361605eff8a2 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:51.110221 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-053de4b9-e16d-4e71-b035-361605eff8a2 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:05:51.117747 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-053de4b9-e16d-4e71-b035-361605eff8a2 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1318 microversion: 2.1 time: 0.147018 Oct 20 06:05:51.118303 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 96/213] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:05:50 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1318 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:05:51.794279 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-e8ca568a-4761-4075-a170-f470ef1d2340 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:05:51.794987 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-e8ca568a-4761-4075-a170-f470ef1d2340 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] [instance: e8e2c461-4b15-42ea-bfc7-1daf1fe15f7f] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:05:51.802117 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e8ca568a-4761-4075-a170-f470ef1d2340 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:51.802601 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e8ca568a-4761-4075-a170-f470ef1d2340 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:51.803034 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e8ca568a-4761-4075-a170-f470ef1d2340 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:51.803762 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e8ca568a-4761-4075-a170-f470ef1d2340 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:51.804173 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e8ca568a-4761-4075-a170-f470ef1d2340 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:51.804630 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e8ca568a-4761-4075-a170-f470ef1d2340 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:51.949579 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-e8ca568a-4761-4075-a170-f470ef1d2340 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d4cbd2a2154e5d925462df7c77815a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0d80988ca941acb8ad4318338dfbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:05:51.957711 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-e8ca568a-4761-4075-a170-f470ef1d2340 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] 10.222.0.20 "GET /compute/v2.1/servers/e8e2c461-4b15-42ea-bfc7-1daf1fe15f7f" status: 200 len: 1522 microversion: 2.1 time: 0.167417 Oct 20 06:05:51.958309 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 118/214] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:05:51 2022] GET /compute/v2.1/servers/e8e2c461-4b15-42ea-bfc7-1daf1fe15f7f => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:05:52.140479 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-1c24c5a4-f2ec-4cd8-9d07-0e41d264bb1d tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:05:52.141122 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-1c24c5a4-f2ec-4cd8-9d07-0e41d264bb1d tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:05:52.147185 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1c24c5a4-f2ec-4cd8-9d07-0e41d264bb1d tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:52.147668 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1c24c5a4-f2ec-4cd8-9d07-0e41d264bb1d tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:52.148102 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1c24c5a4-f2ec-4cd8-9d07-0e41d264bb1d tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:52.148819 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1c24c5a4-f2ec-4cd8-9d07-0e41d264bb1d tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:52.149274 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1c24c5a4-f2ec-4cd8-9d07-0e41d264bb1d tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:52.149700 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1c24c5a4-f2ec-4cd8-9d07-0e41d264bb1d tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:52.305517 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-1c24c5a4-f2ec-4cd8-9d07-0e41d264bb1d tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:05:52.314110 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-1c24c5a4-f2ec-4cd8-9d07-0e41d264bb1d tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1318 microversion: 2.1 time: 0.177214 Oct 20 06:05:52.315353 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 97/215] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:05:52 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1318 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:05:52.334584 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [req-869aa0e2-811b-4bb4-accb-fec3fdffa916 req-339b9fde-9996-44bf-8a8a-3655da1fa25a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0247d13a-779d-4301-ba85-6cbcbf12252f", "name": "network-vif-plugged", "status": "completed", "tag": "418af13b-a918-48be-b332-3b304b1004cc"}]} {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 06:05:52.340592 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG dbcounter [-] [118861] Writing DB stats nova_api:SELECT=71 {{(pid=118861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:05:52.346037 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [req-869aa0e2-811b-4bb4-accb-fec3fdffa916 req-339b9fde-9996-44bf-8a8a-3655da1fa25a service nova] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:52.347178 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [req-869aa0e2-811b-4bb4-accb-fec3fdffa916 req-339b9fde-9996-44bf-8a8a-3655da1fa25a service nova] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:52.347621 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [req-869aa0e2-811b-4bb4-accb-fec3fdffa916 req-339b9fde-9996-44bf-8a8a-3655da1fa25a service nova] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:52.360107 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.compute.server_external_events [req-869aa0e2-811b-4bb4-accb-fec3fdffa916 req-339b9fde-9996-44bf-8a8a-3655da1fa25a service nova] Creating event network-vif-plugged:418af13b-a918-48be-b332-3b304b1004cc for instance 0247d13a-779d-4301-ba85-6cbcbf12252f on hv-cinder-86156 Oct 20 06:05:52.365865 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [req-869aa0e2-811b-4bb4-accb-fec3fdffa916 req-339b9fde-9996-44bf-8a8a-3655da1fa25a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037228 Oct 20 06:05:52.366553 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 119/216] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 20 06:05:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:05:52.980658 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-fe74e36f-ef04-41dd-8412-a6196706f43f tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:05:52.981286 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-fe74e36f-ef04-41dd-8412-a6196706f43f tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] [instance: e8e2c461-4b15-42ea-bfc7-1daf1fe15f7f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:05:52.987455 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-fe74e36f-ef04-41dd-8412-a6196706f43f tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:52.987934 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-fe74e36f-ef04-41dd-8412-a6196706f43f tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:52.988369 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-fe74e36f-ef04-41dd-8412-a6196706f43f tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:52.989081 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-fe74e36f-ef04-41dd-8412-a6196706f43f tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:52.989530 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-fe74e36f-ef04-41dd-8412-a6196706f43f tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:52.989950 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-fe74e36f-ef04-41dd-8412-a6196706f43f tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:53.121986 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-fe74e36f-ef04-41dd-8412-a6196706f43f tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d4cbd2a2154e5d925462df7c77815a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0d80988ca941acb8ad4318338dfbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:05:53.130328 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-fe74e36f-ef04-41dd-8412-a6196706f43f tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] 10.222.0.20 "GET /compute/v2.1/servers/e8e2c461-4b15-42ea-bfc7-1daf1fe15f7f" status: 200 len: 1522 microversion: 2.1 time: 0.153470 Oct 20 06:05:53.130939 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 98/217] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:05:52 2022] GET /compute/v2.1/servers/e8e2c461-4b15-42ea-bfc7-1daf1fe15f7f => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 06:05:53.341695 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-fb67242b-15ba-4249-87e1-a9dda0283323 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:05:53.342450 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-fb67242b-15ba-4249-87e1-a9dda0283323 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:05:53.348985 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-fb67242b-15ba-4249-87e1-a9dda0283323 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:53.349478 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-fb67242b-15ba-4249-87e1-a9dda0283323 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:53.349920 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-fb67242b-15ba-4249-87e1-a9dda0283323 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:53.350660 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-fb67242b-15ba-4249-87e1-a9dda0283323 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:53.351117 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-fb67242b-15ba-4249-87e1-a9dda0283323 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:53.351573 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-fb67242b-15ba-4249-87e1-a9dda0283323 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:53.487872 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-fb67242b-15ba-4249-87e1-a9dda0283323 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:05:53.495502 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-fb67242b-15ba-4249-87e1-a9dda0283323 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1318 microversion: 2.1 time: 0.158553 Oct 20 06:05:53.496065 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 120/218] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:05:53 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:05:54.154192 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-cc0fc12b-9f70-4bb6-90b9-b5bec0f7aabe tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:05:54.154917 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-cc0fc12b-9f70-4bb6-90b9-b5bec0f7aabe tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] [instance: e8e2c461-4b15-42ea-bfc7-1daf1fe15f7f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:05:54.156780 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG dbcounter [-] [118860] Writing DB stats nova_api:SELECT=88,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=118860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:05:54.162153 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-cc0fc12b-9f70-4bb6-90b9-b5bec0f7aabe tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:54.162643 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-cc0fc12b-9f70-4bb6-90b9-b5bec0f7aabe tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:54.163081 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-cc0fc12b-9f70-4bb6-90b9-b5bec0f7aabe tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:54.163780 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-cc0fc12b-9f70-4bb6-90b9-b5bec0f7aabe tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:54.164267 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-cc0fc12b-9f70-4bb6-90b9-b5bec0f7aabe tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:54.164706 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-cc0fc12b-9f70-4bb6-90b9-b5bec0f7aabe tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:54.309915 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-cc0fc12b-9f70-4bb6-90b9-b5bec0f7aabe tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d4cbd2a2154e5d925462df7c77815a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0d80988ca941acb8ad4318338dfbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:05:54.322983 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-cc0fc12b-9f70-4bb6-90b9-b5bec0f7aabe tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] 10.222.0.20 "GET /compute/v2.1/servers/e8e2c461-4b15-42ea-bfc7-1daf1fe15f7f" status: 200 len: 1522 microversion: 2.1 time: 0.172746 Oct 20 06:05:54.323560 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 99/219] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:05:54 2022] GET /compute/v2.1/servers/e8e2c461-4b15-42ea-bfc7-1daf1fe15f7f => generated 1522 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:05:54.518875 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-a6a50188-fd58-448a-b7d7-853e426c8afc tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:05:54.519479 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-a6a50188-fd58-448a-b7d7-853e426c8afc tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:05:54.526173 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a6a50188-fd58-448a-b7d7-853e426c8afc tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:54.526660 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a6a50188-fd58-448a-b7d7-853e426c8afc tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:54.527091 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a6a50188-fd58-448a-b7d7-853e426c8afc tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:54.527775 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a6a50188-fd58-448a-b7d7-853e426c8afc tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:54.528221 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a6a50188-fd58-448a-b7d7-853e426c8afc tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:54.528637 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a6a50188-fd58-448a-b7d7-853e426c8afc tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:54.658672 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-a6a50188-fd58-448a-b7d7-853e426c8afc tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:05:54.663476 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG dbcounter [-] [118861] Writing DB stats nova_cell1:SELECT=100 {{(pid=118861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:05:54.666990 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-a6a50188-fd58-448a-b7d7-853e426c8afc tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1318 microversion: 2.1 time: 0.152094 Oct 20 06:05:54.667579 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 121/220] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:05:54 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:05:55.346281 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-e671c961-a0e0-419c-9afe-a8862f0e68d0 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:05:55.346987 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-e671c961-a0e0-419c-9afe-a8862f0e68d0 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] [instance: e8e2c461-4b15-42ea-bfc7-1daf1fe15f7f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:05:55.352925 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e671c961-a0e0-419c-9afe-a8862f0e68d0 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:55.353419 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e671c961-a0e0-419c-9afe-a8862f0e68d0 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:55.353854 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e671c961-a0e0-419c-9afe-a8862f0e68d0 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:55.354541 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e671c961-a0e0-419c-9afe-a8862f0e68d0 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:55.354993 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e671c961-a0e0-419c-9afe-a8862f0e68d0 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:55.355418 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e671c961-a0e0-419c-9afe-a8862f0e68d0 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:55.487840 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-e671c961-a0e0-419c-9afe-a8862f0e68d0 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d4cbd2a2154e5d925462df7c77815a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0d80988ca941acb8ad4318338dfbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:05:55.495575 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-e671c961-a0e0-419c-9afe-a8862f0e68d0 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] 10.222.0.20 "GET /compute/v2.1/servers/e8e2c461-4b15-42ea-bfc7-1daf1fe15f7f" status: 200 len: 1522 microversion: 2.1 time: 0.153186 Oct 20 06:05:55.496137 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 100/221] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:05:55 2022] GET /compute/v2.1/servers/e8e2c461-4b15-42ea-bfc7-1daf1fe15f7f => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:05:55.691470 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-9ce4b748-6b0c-49b0-a7b6-8646bb1f6875 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:05:55.692077 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-9ce4b748-6b0c-49b0-a7b6-8646bb1f6875 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:05:55.698590 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-9ce4b748-6b0c-49b0-a7b6-8646bb1f6875 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:55.699064 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-9ce4b748-6b0c-49b0-a7b6-8646bb1f6875 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:55.699490 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-9ce4b748-6b0c-49b0-a7b6-8646bb1f6875 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:55.700174 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-9ce4b748-6b0c-49b0-a7b6-8646bb1f6875 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:55.700623 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-9ce4b748-6b0c-49b0-a7b6-8646bb1f6875 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:55.701078 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-9ce4b748-6b0c-49b0-a7b6-8646bb1f6875 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:55.830554 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-9ce4b748-6b0c-49b0-a7b6-8646bb1f6875 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:05:55.838046 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-9ce4b748-6b0c-49b0-a7b6-8646bb1f6875 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1318 microversion: 2.1 time: 0.151475 Oct 20 06:05:55.838606 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 122/222] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:05:55 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:05:56.519977 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-ceb3fdcb-a77f-400c-88ca-18a9286977d8 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:05:56.520734 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-ceb3fdcb-a77f-400c-88ca-18a9286977d8 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] [instance: e8e2c461-4b15-42ea-bfc7-1daf1fe15f7f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:05:56.526622 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-ceb3fdcb-a77f-400c-88ca-18a9286977d8 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:56.527103 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-ceb3fdcb-a77f-400c-88ca-18a9286977d8 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:56.527542 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-ceb3fdcb-a77f-400c-88ca-18a9286977d8 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:56.528229 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-ceb3fdcb-a77f-400c-88ca-18a9286977d8 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:56.528679 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-ceb3fdcb-a77f-400c-88ca-18a9286977d8 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:56.529124 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-ceb3fdcb-a77f-400c-88ca-18a9286977d8 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:56.656800 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-ceb3fdcb-a77f-400c-88ca-18a9286977d8 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d4cbd2a2154e5d925462df7c77815a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0d80988ca941acb8ad4318338dfbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:05:56.664409 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-ceb3fdcb-a77f-400c-88ca-18a9286977d8 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] 10.222.0.20 "GET /compute/v2.1/servers/e8e2c461-4b15-42ea-bfc7-1daf1fe15f7f" status: 200 len: 1522 microversion: 2.1 time: 0.148891 Oct 20 06:05:56.665003 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 101/223] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:05:56 2022] GET /compute/v2.1/servers/e8e2c461-4b15-42ea-bfc7-1daf1fe15f7f => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:05:56.860666 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-b36699b2-d945-4f0c-9f9c-49c5768df3a1 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:05:56.861453 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-b36699b2-d945-4f0c-9f9c-49c5768df3a1 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:05:56.867752 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b36699b2-d945-4f0c-9f9c-49c5768df3a1 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:56.868216 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b36699b2-d945-4f0c-9f9c-49c5768df3a1 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:56.868662 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b36699b2-d945-4f0c-9f9c-49c5768df3a1 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:56.869355 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b36699b2-d945-4f0c-9f9c-49c5768df3a1 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:56.869805 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b36699b2-d945-4f0c-9f9c-49c5768df3a1 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:56.870226 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b36699b2-d945-4f0c-9f9c-49c5768df3a1 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:57.140868 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-b36699b2-d945-4f0c-9f9c-49c5768df3a1 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:05:57.148377 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-b36699b2-d945-4f0c-9f9c-49c5768df3a1 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1318 microversion: 2.1 time: 0.291625 Oct 20 06:05:57.148964 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 123/224] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:05:56 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1318 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:05:57.686941 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-7a2fbeda-065f-4882-a51a-c1afbb09537e tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:05:57.687529 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-7a2fbeda-065f-4882-a51a-c1afbb09537e tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] [instance: e8e2c461-4b15-42ea-bfc7-1daf1fe15f7f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:05:57.694827 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7a2fbeda-065f-4882-a51a-c1afbb09537e tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:57.695313 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7a2fbeda-065f-4882-a51a-c1afbb09537e tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:57.695860 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7a2fbeda-065f-4882-a51a-c1afbb09537e tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:57.696573 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7a2fbeda-065f-4882-a51a-c1afbb09537e tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:57.697083 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7a2fbeda-065f-4882-a51a-c1afbb09537e tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:57.697511 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7a2fbeda-065f-4882-a51a-c1afbb09537e tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:57.845977 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-7a2fbeda-065f-4882-a51a-c1afbb09537e tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d4cbd2a2154e5d925462df7c77815a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0d80988ca941acb8ad4318338dfbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:05:57.853920 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-7a2fbeda-065f-4882-a51a-c1afbb09537e tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] 10.222.0.20 "GET /compute/v2.1/servers/e8e2c461-4b15-42ea-bfc7-1daf1fe15f7f" status: 200 len: 1522 microversion: 2.1 time: 0.170977 Oct 20 06:05:57.868881 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 102/225] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:05:57 2022] GET /compute/v2.1/servers/e8e2c461-4b15-42ea-bfc7-1daf1fe15f7f => generated 1522 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 06:05:58.170487 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-655896ca-9edc-4ad6-a87f-5900b449615d tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:05:58.171172 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-655896ca-9edc-4ad6-a87f-5900b449615d tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:05:58.178607 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-655896ca-9edc-4ad6-a87f-5900b449615d tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:58.179103 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-655896ca-9edc-4ad6-a87f-5900b449615d tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:58.179577 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-655896ca-9edc-4ad6-a87f-5900b449615d tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:58.180266 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-655896ca-9edc-4ad6-a87f-5900b449615d tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:58.180740 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-655896ca-9edc-4ad6-a87f-5900b449615d tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:58.181167 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-655896ca-9edc-4ad6-a87f-5900b449615d tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:58.319202 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-655896ca-9edc-4ad6-a87f-5900b449615d tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:05:58.326883 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-655896ca-9edc-4ad6-a87f-5900b449615d tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1508 microversion: 2.1 time: 0.160601 Oct 20 06:05:58.327453 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 124/226] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:05:58 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1508 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 06:05:58.877454 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-1032b4a5-0e68-4638-92f6-391bf3c33bb1 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:05:58.878146 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-1032b4a5-0e68-4638-92f6-391bf3c33bb1 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] [instance: e8e2c461-4b15-42ea-bfc7-1daf1fe15f7f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:05:58.884207 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1032b4a5-0e68-4638-92f6-391bf3c33bb1 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:58.884688 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1032b4a5-0e68-4638-92f6-391bf3c33bb1 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:58.885140 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1032b4a5-0e68-4638-92f6-391bf3c33bb1 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:58.886087 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1032b4a5-0e68-4638-92f6-391bf3c33bb1 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:05:58.886500 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1032b4a5-0e68-4638-92f6-391bf3c33bb1 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:05:58.886918 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1032b4a5-0e68-4638-92f6-391bf3c33bb1 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:05:59.073216 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-1032b4a5-0e68-4638-92f6-391bf3c33bb1 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d4cbd2a2154e5d925462df7c77815a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0d80988ca941acb8ad4318338dfbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:05:59.084240 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-1032b4a5-0e68-4638-92f6-391bf3c33bb1 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] 10.222.0.20 "GET /compute/v2.1/servers/e8e2c461-4b15-42ea-bfc7-1daf1fe15f7f" status: 200 len: 1522 microversion: 2.1 time: 0.210309 Oct 20 06:05:59.084933 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 103/227] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:05:58 2022] GET /compute/v2.1/servers/e8e2c461-4b15-42ea-bfc7-1daf1fe15f7f => generated 1522 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:06:00.109337 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-3b0ac1e0-6095-42ca-9234-19083c094a1c tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:06:00.110641 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-3b0ac1e0-6095-42ca-9234-19083c094a1c tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] [instance: e8e2c461-4b15-42ea-bfc7-1daf1fe15f7f] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:06:00.118691 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-3b0ac1e0-6095-42ca-9234-19083c094a1c tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:06:00.119660 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-3b0ac1e0-6095-42ca-9234-19083c094a1c tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:06:00.120902 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-3b0ac1e0-6095-42ca-9234-19083c094a1c tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:06:00.121950 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-3b0ac1e0-6095-42ca-9234-19083c094a1c tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:06:00.122562 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-3b0ac1e0-6095-42ca-9234-19083c094a1c tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:06:00.123006 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-3b0ac1e0-6095-42ca-9234-19083c094a1c tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:06:00.279403 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-3b0ac1e0-6095-42ca-9234-19083c094a1c tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d4cbd2a2154e5d925462df7c77815a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0d80988ca941acb8ad4318338dfbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:06:00.288595 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-3b0ac1e0-6095-42ca-9234-19083c094a1c tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] 10.222.0.20 "GET /compute/v2.1/servers/e8e2c461-4b15-42ea-bfc7-1daf1fe15f7f" status: 200 len: 1522 microversion: 2.1 time: 0.182602 Oct 20 06:06:00.289999 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 125/228] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:06:00 2022] GET /compute/v2.1/servers/e8e2c461-4b15-42ea-bfc7-1daf1fe15f7f => generated 1522 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:06:01.317669 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-c7d4bf2a-8516-44dd-b18b-a926d8e3642e tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:06:01.318302 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-c7d4bf2a-8516-44dd-b18b-a926d8e3642e tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] [instance: e8e2c461-4b15-42ea-bfc7-1daf1fe15f7f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:06:01.324296 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c7d4bf2a-8516-44dd-b18b-a926d8e3642e tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:06:01.324810 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c7d4bf2a-8516-44dd-b18b-a926d8e3642e tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:06:01.325285 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c7d4bf2a-8516-44dd-b18b-a926d8e3642e tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:06:01.325975 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c7d4bf2a-8516-44dd-b18b-a926d8e3642e tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:06:01.326434 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c7d4bf2a-8516-44dd-b18b-a926d8e3642e tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:06:01.326861 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c7d4bf2a-8516-44dd-b18b-a926d8e3642e tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:06:01.466203 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-c7d4bf2a-8516-44dd-b18b-a926d8e3642e tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d4cbd2a2154e5d925462df7c77815a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0d80988ca941acb8ad4318338dfbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:06:01.474343 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-c7d4bf2a-8516-44dd-b18b-a926d8e3642e tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] 10.222.0.20 "GET /compute/v2.1/servers/e8e2c461-4b15-42ea-bfc7-1daf1fe15f7f" status: 200 len: 1522 microversion: 2.1 time: 0.161403 Oct 20 06:06:01.474935 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 104/229] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:06:01 2022] GET /compute/v2.1/servers/e8e2c461-4b15-42ea-bfc7-1daf1fe15f7f => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:06:02.498233 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-b5f6765a-dbdb-49ff-8fff-556ab5736e49 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:06:02.498864 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-b5f6765a-dbdb-49ff-8fff-556ab5736e49 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] [instance: e8e2c461-4b15-42ea-bfc7-1daf1fe15f7f] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:06:02.506073 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b5f6765a-dbdb-49ff-8fff-556ab5736e49 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:06:02.506548 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b5f6765a-dbdb-49ff-8fff-556ab5736e49 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:06:02.506977 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b5f6765a-dbdb-49ff-8fff-556ab5736e49 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:06:02.507657 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b5f6765a-dbdb-49ff-8fff-556ab5736e49 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:06:02.508102 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b5f6765a-dbdb-49ff-8fff-556ab5736e49 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:06:02.508787 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b5f6765a-dbdb-49ff-8fff-556ab5736e49 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:06:02.640169 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-b5f6765a-dbdb-49ff-8fff-556ab5736e49 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d4cbd2a2154e5d925462df7c77815a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0d80988ca941acb8ad4318338dfbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:06:02.647950 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-b5f6765a-dbdb-49ff-8fff-556ab5736e49 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] 10.222.0.20 "GET /compute/v2.1/servers/e8e2c461-4b15-42ea-bfc7-1daf1fe15f7f" status: 200 len: 1522 microversion: 2.1 time: 0.153632 Oct 20 06:06:02.648505 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 126/230] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:06:02 2022] GET /compute/v2.1/servers/e8e2c461-4b15-42ea-bfc7-1daf1fe15f7f => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:06:03.671051 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-5daeb2dc-98b8-48dc-bf08-157f145493f2 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:06:03.671659 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-5daeb2dc-98b8-48dc-bf08-157f145493f2 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] [instance: e8e2c461-4b15-42ea-bfc7-1daf1fe15f7f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:06:03.677810 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5daeb2dc-98b8-48dc-bf08-157f145493f2 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:06:03.678314 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5daeb2dc-98b8-48dc-bf08-157f145493f2 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:06:03.678744 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5daeb2dc-98b8-48dc-bf08-157f145493f2 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:06:03.679437 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5daeb2dc-98b8-48dc-bf08-157f145493f2 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:06:03.679893 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5daeb2dc-98b8-48dc-bf08-157f145493f2 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:06:03.680329 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5daeb2dc-98b8-48dc-bf08-157f145493f2 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:06:03.818716 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-5daeb2dc-98b8-48dc-bf08-157f145493f2 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d4cbd2a2154e5d925462df7c77815a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0d80988ca941acb8ad4318338dfbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:06:03.826439 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-5daeb2dc-98b8-48dc-bf08-157f145493f2 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] 10.222.0.20 "GET /compute/v2.1/servers/e8e2c461-4b15-42ea-bfc7-1daf1fe15f7f" status: 200 len: 1522 microversion: 2.1 time: 0.159407 Oct 20 06:06:03.827003 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 105/231] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:06:03 2022] GET /compute/v2.1/servers/e8e2c461-4b15-42ea-bfc7-1daf1fe15f7f => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:06:04.851728 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-40629267-541e-4886-8436-7472db1aea59 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:06:04.852472 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-40629267-541e-4886-8436-7472db1aea59 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] [instance: e8e2c461-4b15-42ea-bfc7-1daf1fe15f7f] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:06:04.858963 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-40629267-541e-4886-8436-7472db1aea59 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:06:04.859454 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-40629267-541e-4886-8436-7472db1aea59 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:06:04.859899 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-40629267-541e-4886-8436-7472db1aea59 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:06:04.860604 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-40629267-541e-4886-8436-7472db1aea59 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:06:04.861095 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-40629267-541e-4886-8436-7472db1aea59 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:06:04.861521 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-40629267-541e-4886-8436-7472db1aea59 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:06:05.004074 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-40629267-541e-4886-8436-7472db1aea59 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d4cbd2a2154e5d925462df7c77815a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0d80988ca941acb8ad4318338dfbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:06:05.013489 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-40629267-541e-4886-8436-7472db1aea59 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] 10.222.0.20 "GET /compute/v2.1/servers/e8e2c461-4b15-42ea-bfc7-1daf1fe15f7f" status: 200 len: 1522 microversion: 2.1 time: 0.166345 Oct 20 06:06:05.014436 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 127/232] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:06:04 2022] GET /compute/v2.1/servers/e8e2c461-4b15-42ea-bfc7-1daf1fe15f7f => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:06:06.039437 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-53dbcc7f-75b7-4d57-8282-2ea6a747bd3a tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:06:06.040178 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-53dbcc7f-75b7-4d57-8282-2ea6a747bd3a tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] [instance: e8e2c461-4b15-42ea-bfc7-1daf1fe15f7f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:06:06.046115 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-53dbcc7f-75b7-4d57-8282-2ea6a747bd3a tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:06:06.046598 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-53dbcc7f-75b7-4d57-8282-2ea6a747bd3a tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:06:06.047038 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-53dbcc7f-75b7-4d57-8282-2ea6a747bd3a tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:06:06.048351 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-53dbcc7f-75b7-4d57-8282-2ea6a747bd3a tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:06:06.048950 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-53dbcc7f-75b7-4d57-8282-2ea6a747bd3a tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:06:06.049386 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-53dbcc7f-75b7-4d57-8282-2ea6a747bd3a tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:06:06.195078 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-53dbcc7f-75b7-4d57-8282-2ea6a747bd3a tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d4cbd2a2154e5d925462df7c77815a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0d80988ca941acb8ad4318338dfbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:06:06.199123 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG dbcounter [-] [118860] Writing DB stats nova_cell1:SELECT=100 {{(pid=118860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:06:06.211980 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-53dbcc7f-75b7-4d57-8282-2ea6a747bd3a tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] 10.222.0.20 "GET /compute/v2.1/servers/e8e2c461-4b15-42ea-bfc7-1daf1fe15f7f" status: 200 len: 1522 microversion: 2.1 time: 0.170526 Oct 20 06:06:06.211980 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 106/233] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:06:06 2022] GET /compute/v2.1/servers/e8e2c461-4b15-42ea-bfc7-1daf1fe15f7f => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:06:07.230555 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-131c2164-6203-4434-a131-3cd9d750ad9f tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:06:07.231929 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-131c2164-6203-4434-a131-3cd9d750ad9f tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] [instance: e8e2c461-4b15-42ea-bfc7-1daf1fe15f7f] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:06:07.239891 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-131c2164-6203-4434-a131-3cd9d750ad9f tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:06:07.241003 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-131c2164-6203-4434-a131-3cd9d750ad9f tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:06:07.241453 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-131c2164-6203-4434-a131-3cd9d750ad9f tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:06:07.242620 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-131c2164-6203-4434-a131-3cd9d750ad9f tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:06:07.243296 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-131c2164-6203-4434-a131-3cd9d750ad9f tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:06:07.244435 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-131c2164-6203-4434-a131-3cd9d750ad9f tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:06:07.398576 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-131c2164-6203-4434-a131-3cd9d750ad9f tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d4cbd2a2154e5d925462df7c77815a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0d80988ca941acb8ad4318338dfbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:06:07.406766 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-131c2164-6203-4434-a131-3cd9d750ad9f tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] 10.222.0.20 "GET /compute/v2.1/servers/e8e2c461-4b15-42ea-bfc7-1daf1fe15f7f" status: 200 len: 1522 microversion: 2.1 time: 0.180189 Oct 20 06:06:07.407349 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 128/234] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:06:07 2022] GET /compute/v2.1/servers/e8e2c461-4b15-42ea-bfc7-1daf1fe15f7f => generated 1522 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:06:08.432436 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-3541e1c8-80cc-4827-858d-a834542fd5db tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:06:08.433071 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-3541e1c8-80cc-4827-858d-a834542fd5db tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] [instance: e8e2c461-4b15-42ea-bfc7-1daf1fe15f7f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:06:08.440859 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3541e1c8-80cc-4827-858d-a834542fd5db tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:06:08.441365 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3541e1c8-80cc-4827-858d-a834542fd5db tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:06:08.442349 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3541e1c8-80cc-4827-858d-a834542fd5db tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:06:08.443255 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3541e1c8-80cc-4827-858d-a834542fd5db tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:06:08.443945 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3541e1c8-80cc-4827-858d-a834542fd5db tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:06:08.444582 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3541e1c8-80cc-4827-858d-a834542fd5db tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:06:08.601944 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-3541e1c8-80cc-4827-858d-a834542fd5db tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d4cbd2a2154e5d925462df7c77815a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0d80988ca941acb8ad4318338dfbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:06:08.614667 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-3541e1c8-80cc-4827-858d-a834542fd5db tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] 10.222.0.20 "GET /compute/v2.1/servers/e8e2c461-4b15-42ea-bfc7-1daf1fe15f7f" status: 200 len: 1502 microversion: 2.1 time: 0.186694 Oct 20 06:06:08.630380 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 107/235] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:06:08 2022] GET /compute/v2.1/servers/e8e2c461-4b15-42ea-bfc7-1daf1fe15f7f => generated 1502 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:06:08.639045 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-a3c29b36-30de-4480-bb93-aa3d869b7b8d tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:06:08.639656 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-a3c29b36-30de-4480-bb93-aa3d869b7b8d tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] [instance: d38a019f-4bfc-4845-900b-a9e4e6397373] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:06:08.647128 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a3c29b36-30de-4480-bb93-aa3d869b7b8d tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:06:08.647723 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a3c29b36-30de-4480-bb93-aa3d869b7b8d tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:06:08.648032 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a3c29b36-30de-4480-bb93-aa3d869b7b8d tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:06:08.648753 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a3c29b36-30de-4480-bb93-aa3d869b7b8d tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:06:08.649206 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a3c29b36-30de-4480-bb93-aa3d869b7b8d tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:06:08.649623 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a3c29b36-30de-4480-bb93-aa3d869b7b8d tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:06:08.858298 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-a3c29b36-30de-4480-bb93-aa3d869b7b8d tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d4cbd2a2154e5d925462df7c77815a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0d80988ca941acb8ad4318338dfbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:06:08.867391 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-a3c29b36-30de-4480-bb93-aa3d869b7b8d tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] 10.222.0.20 "GET /compute/v2.1/servers/d38a019f-4bfc-4845-900b-a9e4e6397373" status: 200 len: 1516 microversion: 2.1 time: 0.232622 Oct 20 06:06:08.868345 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 129/236] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:06:08 2022] GET /compute/v2.1/servers/d38a019f-4bfc-4845-900b-a9e4e6397373 => generated 1516 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 06:06:10.336587 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-2de71fd2-1524-4d69-be62-90c4ceed87dd tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 06:06:10.339065 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-2de71fd2-1524-4d69-be62-90c4ceed87dd tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] [instance: d38a019f-4bfc-4845-900b-a9e4e6397373] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:06:10.345043 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2de71fd2-1524-4d69-be62-90c4ceed87dd tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:06:10.345541 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2de71fd2-1524-4d69-be62-90c4ceed87dd tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:06:10.345984 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2de71fd2-1524-4d69-be62-90c4ceed87dd tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:06:10.346681 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2de71fd2-1524-4d69-be62-90c4ceed87dd tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:06:10.347134 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2de71fd2-1524-4d69-be62-90c4ceed87dd tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:06:10.347562 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2de71fd2-1524-4d69-be62-90c4ceed87dd tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:06:10.372307 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.objects.instance [None req-2de71fd2-1524-4d69-be62-90c4ceed87dd tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lazy-loading 'flavor' on Instance uuid d38a019f-4bfc-4845-900b-a9e4e6397373 {{(pid=118860) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 20 06:06:10.508871 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-2de71fd2-1524-4d69-be62-90c4ceed87dd tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] 10.222.0.20 "POST /compute/v2.1/servers/d38a019f-4bfc-4845-900b-a9e4e6397373/action" status: 200 len: 32 microversion: 2.1 time: 0.176312 Oct 20 06:06:10.509730 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 108/237] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Oct 20 06:06:10 2022] POST /compute/v2.1/servers/d38a019f-4bfc-4845-900b-a9e4e6397373/action => generated 32 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 20 06:06:10.525560 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-142fe7e8-521d-49e2-81fd-e3676cb5e376 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:06:10.526916 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-142fe7e8-521d-49e2-81fd-e3676cb5e376 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] [instance: d38a019f-4bfc-4845-900b-a9e4e6397373] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:06:10.535237 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-142fe7e8-521d-49e2-81fd-e3676cb5e376 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:06:10.535673 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-142fe7e8-521d-49e2-81fd-e3676cb5e376 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:06:10.536131 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-142fe7e8-521d-49e2-81fd-e3676cb5e376 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:06:10.536959 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-142fe7e8-521d-49e2-81fd-e3676cb5e376 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:06:10.548081 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-142fe7e8-521d-49e2-81fd-e3676cb5e376 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:06:10.551753 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-142fe7e8-521d-49e2-81fd-e3676cb5e376 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:06:10.745117 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-142fe7e8-521d-49e2-81fd-e3676cb5e376 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d4cbd2a2154e5d925462df7c77815a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0d80988ca941acb8ad4318338dfbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:06:10.750410 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-142fe7e8-521d-49e2-81fd-e3676cb5e376 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] 10.222.0.20 "GET /compute/v2.1/servers/d38a019f-4bfc-4845-900b-a9e4e6397373" status: 200 len: 1522 microversion: 2.1 time: 0.234844 Oct 20 06:06:10.751677 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 130/238] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:06:10 2022] GET /compute/v2.1/servers/d38a019f-4bfc-4845-900b-a9e4e6397373 => generated 1522 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:06:11.776329 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-4b5d97df-a711-442a-aadf-affc2684f703 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:06:11.777052 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-4b5d97df-a711-442a-aadf-affc2684f703 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] [instance: d38a019f-4bfc-4845-900b-a9e4e6397373] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:06:11.783441 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-4b5d97df-a711-442a-aadf-affc2684f703 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:06:11.783928 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-4b5d97df-a711-442a-aadf-affc2684f703 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:06:11.784514 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-4b5d97df-a711-442a-aadf-affc2684f703 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:06:11.785238 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-4b5d97df-a711-442a-aadf-affc2684f703 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:06:11.785697 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-4b5d97df-a711-442a-aadf-affc2684f703 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:06:11.786114 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-4b5d97df-a711-442a-aadf-affc2684f703 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:06:11.945929 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-4b5d97df-a711-442a-aadf-affc2684f703 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d4cbd2a2154e5d925462df7c77815a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0d80988ca941acb8ad4318338dfbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:06:11.954912 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-4b5d97df-a711-442a-aadf-affc2684f703 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] 10.222.0.20 "GET /compute/v2.1/servers/d38a019f-4bfc-4845-900b-a9e4e6397373" status: 200 len: 1522 microversion: 2.1 time: 0.182930 Oct 20 06:06:11.955571 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 109/239] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:06:11 2022] GET /compute/v2.1/servers/d38a019f-4bfc-4845-900b-a9e4e6397373 => generated 1522 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:06:12.977229 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-97846c68-768a-4678-ba16-18127a1170d4 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:06:12.977840 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-97846c68-768a-4678-ba16-18127a1170d4 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] [instance: d38a019f-4bfc-4845-900b-a9e4e6397373] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:06:12.984854 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-97846c68-768a-4678-ba16-18127a1170d4 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:06:12.985343 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-97846c68-768a-4678-ba16-18127a1170d4 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:06:12.985778 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-97846c68-768a-4678-ba16-18127a1170d4 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:06:12.986480 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-97846c68-768a-4678-ba16-18127a1170d4 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:06:12.986931 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-97846c68-768a-4678-ba16-18127a1170d4 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:06:12.987364 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-97846c68-768a-4678-ba16-18127a1170d4 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:06:13.132658 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-97846c68-768a-4678-ba16-18127a1170d4 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d4cbd2a2154e5d925462df7c77815a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0d80988ca941acb8ad4318338dfbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:06:13.140507 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-97846c68-768a-4678-ba16-18127a1170d4 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] 10.222.0.20 "GET /compute/v2.1/servers/d38a019f-4bfc-4845-900b-a9e4e6397373" status: 200 len: 1522 microversion: 2.1 time: 0.167622 Oct 20 06:06:13.141230 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 131/240] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:06:12 2022] GET /compute/v2.1/servers/d38a019f-4bfc-4845-900b-a9e4e6397373 => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:06:14.163581 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-f5e08125-1033-45ea-ace6-f18cd86e200c tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:06:14.164195 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-f5e08125-1033-45ea-ace6-f18cd86e200c tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] [instance: d38a019f-4bfc-4845-900b-a9e4e6397373] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:06:14.170470 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f5e08125-1033-45ea-ace6-f18cd86e200c tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:06:14.170959 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f5e08125-1033-45ea-ace6-f18cd86e200c tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:06:14.171396 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f5e08125-1033-45ea-ace6-f18cd86e200c tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:06:14.172095 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f5e08125-1033-45ea-ace6-f18cd86e200c tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:06:14.172549 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f5e08125-1033-45ea-ace6-f18cd86e200c tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:06:14.173007 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f5e08125-1033-45ea-ace6-f18cd86e200c tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:06:14.326519 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-f5e08125-1033-45ea-ace6-f18cd86e200c tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d4cbd2a2154e5d925462df7c77815a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0d80988ca941acb8ad4318338dfbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:06:14.335017 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-f5e08125-1033-45ea-ace6-f18cd86e200c tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] 10.222.0.20 "GET /compute/v2.1/servers/d38a019f-4bfc-4845-900b-a9e4e6397373" status: 200 len: 1522 microversion: 2.1 time: 0.175489 Oct 20 06:06:14.335819 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 110/241] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:06:14 2022] GET /compute/v2.1/servers/d38a019f-4bfc-4845-900b-a9e4e6397373 => generated 1522 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:06:15.358453 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-19a61ed1-5121-4dc6-96da-f6cd490f35c6 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:06:15.359210 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-19a61ed1-5121-4dc6-96da-f6cd490f35c6 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] [instance: d38a019f-4bfc-4845-900b-a9e4e6397373] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:06:15.366133 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-19a61ed1-5121-4dc6-96da-f6cd490f35c6 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:06:15.366622 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-19a61ed1-5121-4dc6-96da-f6cd490f35c6 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:06:15.367060 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-19a61ed1-5121-4dc6-96da-f6cd490f35c6 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:06:15.367765 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-19a61ed1-5121-4dc6-96da-f6cd490f35c6 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:06:15.368216 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-19a61ed1-5121-4dc6-96da-f6cd490f35c6 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:06:15.368978 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-19a61ed1-5121-4dc6-96da-f6cd490f35c6 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:06:15.561661 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-19a61ed1-5121-4dc6-96da-f6cd490f35c6 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d4cbd2a2154e5d925462df7c77815a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0d80988ca941acb8ad4318338dfbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:06:15.581955 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-19a61ed1-5121-4dc6-96da-f6cd490f35c6 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] 10.222.0.20 "GET /compute/v2.1/servers/d38a019f-4bfc-4845-900b-a9e4e6397373" status: 200 len: 1522 microversion: 2.1 time: 0.227200 Oct 20 06:06:15.583388 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 132/242] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:06:15 2022] GET /compute/v2.1/servers/d38a019f-4bfc-4845-900b-a9e4e6397373 => generated 1522 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:06:16.609673 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-785c2250-9a5d-4c76-a1ad-2e3b91e4375f tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:06:16.610318 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-785c2250-9a5d-4c76-a1ad-2e3b91e4375f tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] [instance: d38a019f-4bfc-4845-900b-a9e4e6397373] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:06:16.616228 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-785c2250-9a5d-4c76-a1ad-2e3b91e4375f tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:06:16.616739 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-785c2250-9a5d-4c76-a1ad-2e3b91e4375f tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:06:16.617184 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-785c2250-9a5d-4c76-a1ad-2e3b91e4375f tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:06:16.617877 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-785c2250-9a5d-4c76-a1ad-2e3b91e4375f tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:06:16.618331 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-785c2250-9a5d-4c76-a1ad-2e3b91e4375f tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:06:16.618758 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-785c2250-9a5d-4c76-a1ad-2e3b91e4375f tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:06:16.747471 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-785c2250-9a5d-4c76-a1ad-2e3b91e4375f tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d4cbd2a2154e5d925462df7c77815a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0d80988ca941acb8ad4318338dfbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:06:16.755367 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-785c2250-9a5d-4c76-a1ad-2e3b91e4375f tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] 10.222.0.20 "GET /compute/v2.1/servers/d38a019f-4bfc-4845-900b-a9e4e6397373" status: 200 len: 1522 microversion: 2.1 time: 0.149506 Oct 20 06:06:16.755932 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 111/243] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:06:16 2022] GET /compute/v2.1/servers/d38a019f-4bfc-4845-900b-a9e4e6397373 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 06:06:17.778754 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-fad1268a-257a-491d-a870-814ea2d3fd65 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:06:17.779365 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-fad1268a-257a-491d-a870-814ea2d3fd65 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] [instance: d38a019f-4bfc-4845-900b-a9e4e6397373] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:06:17.786664 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-fad1268a-257a-491d-a870-814ea2d3fd65 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:06:17.787142 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-fad1268a-257a-491d-a870-814ea2d3fd65 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:06:17.787577 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-fad1268a-257a-491d-a870-814ea2d3fd65 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:06:17.788275 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-fad1268a-257a-491d-a870-814ea2d3fd65 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:06:17.788814 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-fad1268a-257a-491d-a870-814ea2d3fd65 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:06:17.789245 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-fad1268a-257a-491d-a870-814ea2d3fd65 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:06:17.922357 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-fad1268a-257a-491d-a870-814ea2d3fd65 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d4cbd2a2154e5d925462df7c77815a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0d80988ca941acb8ad4318338dfbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:06:17.931668 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-fad1268a-257a-491d-a870-814ea2d3fd65 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] 10.222.0.20 "GET /compute/v2.1/servers/d38a019f-4bfc-4845-900b-a9e4e6397373" status: 200 len: 1522 microversion: 2.1 time: 0.156566 Oct 20 06:06:17.932383 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 133/244] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:06:17 2022] GET /compute/v2.1/servers/d38a019f-4bfc-4845-900b-a9e4e6397373 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:06:18.956768 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-ae778f21-5958-4de6-a731-4123a9183d24 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:06:18.957325 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-ae778f21-5958-4de6-a731-4123a9183d24 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] [instance: d38a019f-4bfc-4845-900b-a9e4e6397373] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:06:18.963184 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-ae778f21-5958-4de6-a731-4123a9183d24 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:06:18.963722 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-ae778f21-5958-4de6-a731-4123a9183d24 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:06:18.964178 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-ae778f21-5958-4de6-a731-4123a9183d24 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:06:18.964819 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-ae778f21-5958-4de6-a731-4123a9183d24 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:06:18.965260 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-ae778f21-5958-4de6-a731-4123a9183d24 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:06:18.965679 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-ae778f21-5958-4de6-a731-4123a9183d24 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:06:19.038619 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-1c75d240-d946-4ca3-a9cc-c887d9f1d54f tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2d33053a-13ce-4db6-a68a-0e03d774ad0b", "device": "/dev/sdb"}} {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 06:06:19.041634 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-1c75d240-d946-4ca3-a9cc-c887d9f1d54f tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:06:19.048271 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1c75d240-d946-4ca3-a9cc-c887d9f1d54f tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:06:19.048722 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1c75d240-d946-4ca3-a9cc-c887d9f1d54f tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:06:19.049346 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1c75d240-d946-4ca3-a9cc-c887d9f1d54f tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:06:19.050046 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1c75d240-d946-4ca3-a9cc-c887d9f1d54f tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:06:19.050497 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1c75d240-d946-4ca3-a9cc-c887d9f1d54f tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:06:19.051454 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1c75d240-d946-4ca3-a9cc-c887d9f1d54f tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:06:19.100830 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-ae778f21-5958-4de6-a731-4123a9183d24 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d4cbd2a2154e5d925462df7c77815a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0d80988ca941acb8ad4318338dfbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:06:19.108483 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-ae778f21-5958-4de6-a731-4123a9183d24 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] 10.222.0.20 "GET /compute/v2.1/servers/d38a019f-4bfc-4845-900b-a9e4e6397373" status: 200 len: 1522 microversion: 2.1 time: 0.155587 Oct 20 06:06:19.109080 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 112/245] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:06:18 2022] GET /compute/v2.1/servers/d38a019f-4bfc-4845-900b-a9e4e6397373 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:06:19.321916 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-1c75d240-d946-4ca3-a9cc-c887d9f1d54f tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "POST /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.287121 Oct 20 06:06:19.323078 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 134/246] 10.222.0.20 () {60 vars in 1323 bytes} [Thu Oct 20 06:06:19 2022] POST /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f/os-volume_attachments => generated 194 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 20 06:06:19.369122 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-160ef5e5-6d96-401c-8afb-782d582b9216 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:06:19.369607 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-160ef5e5-6d96-401c-8afb-782d582b9216 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:06:19.375490 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-160ef5e5-6d96-401c-8afb-782d582b9216 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:06:19.376395 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-160ef5e5-6d96-401c-8afb-782d582b9216 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:06:19.377032 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-160ef5e5-6d96-401c-8afb-782d582b9216 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:06:19.378097 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-160ef5e5-6d96-401c-8afb-782d582b9216 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:06:19.379349 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-160ef5e5-6d96-401c-8afb-782d582b9216 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:06:19.379953 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-160ef5e5-6d96-401c-8afb-782d582b9216 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:06:19.406834 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-160ef5e5-6d96-401c-8afb-782d582b9216 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/ips" status: 200 len: 150 microversion: 2.1 time: 0.041568 Oct 20 06:06:19.407402 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 113/247] 10.222.0.20 () {58 vars in 1248 bytes} [Thu Oct 20 06:06:19 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/ips => generated 150 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:06:20.134172 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-a1bbd756-4cf6-4cd1-9420-af578f7b6fd4 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:06:20.134901 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-a1bbd756-4cf6-4cd1-9420-af578f7b6fd4 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] [instance: d38a019f-4bfc-4845-900b-a9e4e6397373] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:06:20.140919 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a1bbd756-4cf6-4cd1-9420-af578f7b6fd4 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:06:20.141403 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a1bbd756-4cf6-4cd1-9420-af578f7b6fd4 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:06:20.141841 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a1bbd756-4cf6-4cd1-9420-af578f7b6fd4 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:06:20.142534 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a1bbd756-4cf6-4cd1-9420-af578f7b6fd4 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:06:20.142986 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a1bbd756-4cf6-4cd1-9420-af578f7b6fd4 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:06:20.143411 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a1bbd756-4cf6-4cd1-9420-af578f7b6fd4 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:06:20.279815 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-a1bbd756-4cf6-4cd1-9420-af578f7b6fd4 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d4cbd2a2154e5d925462df7c77815a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0d80988ca941acb8ad4318338dfbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:06:20.288193 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-a1bbd756-4cf6-4cd1-9420-af578f7b6fd4 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] 10.222.0.20 "GET /compute/v2.1/servers/d38a019f-4bfc-4845-900b-a9e4e6397373" status: 200 len: 1522 microversion: 2.1 time: 0.160096 Oct 20 06:06:20.288776 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 135/248] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:06:20 2022] GET /compute/v2.1/servers/d38a019f-4bfc-4845-900b-a9e4e6397373 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:06:20.787371 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-e0f3d484-1ef6-48f0-8a51-68e5801deaa7 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2d55ac41-e07d-4ad7-8598-c94ac2d4ee84"}} {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 06:06:20.789796 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-e0f3d484-1ef6-48f0-8a51-68e5801deaa7 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:06:20.795875 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e0f3d484-1ef6-48f0-8a51-68e5801deaa7 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:06:20.796396 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e0f3d484-1ef6-48f0-8a51-68e5801deaa7 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:06:20.796980 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e0f3d484-1ef6-48f0-8a51-68e5801deaa7 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:06:20.797680 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e0f3d484-1ef6-48f0-8a51-68e5801deaa7 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:06:20.798723 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e0f3d484-1ef6-48f0-8a51-68e5801deaa7 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:06:20.799155 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e0f3d484-1ef6-48f0-8a51-68e5801deaa7 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:06:21.103059 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-e0f3d484-1ef6-48f0-8a51-68e5801deaa7 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "POST /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.319918 Oct 20 06:06:21.103694 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 114/249] 10.222.0.20 () {60 vars in 1323 bytes} [Thu Oct 20 06:06:20 2022] POST /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 194 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:06:21.315080 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-364b3a66-143b-4a31-9f3d-255cc43f65c5 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:06:21.315776 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-364b3a66-143b-4a31-9f3d-255cc43f65c5 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] [instance: d38a019f-4bfc-4845-900b-a9e4e6397373] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:06:21.323805 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-364b3a66-143b-4a31-9f3d-255cc43f65c5 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:06:21.324392 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-364b3a66-143b-4a31-9f3d-255cc43f65c5 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:06:21.324926 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-364b3a66-143b-4a31-9f3d-255cc43f65c5 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:06:21.325871 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-364b3a66-143b-4a31-9f3d-255cc43f65c5 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:06:21.326362 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-364b3a66-143b-4a31-9f3d-255cc43f65c5 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:06:21.326993 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-364b3a66-143b-4a31-9f3d-255cc43f65c5 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:06:21.483587 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-364b3a66-143b-4a31-9f3d-255cc43f65c5 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d4cbd2a2154e5d925462df7c77815a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0d80988ca941acb8ad4318338dfbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:06:21.496293 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-364b3a66-143b-4a31-9f3d-255cc43f65c5 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] 10.222.0.20 "GET /compute/v2.1/servers/d38a019f-4bfc-4845-900b-a9e4e6397373" status: 200 len: 1522 microversion: 2.1 time: 0.186671 Oct 20 06:06:21.497505 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 136/250] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:06:21 2022] GET /compute/v2.1/servers/d38a019f-4bfc-4845-900b-a9e4e6397373 => generated 1522 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:06:22.522618 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-5b20593c-9ff1-417d-a5e9-54e0d407193a tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:06:22.523347 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-5b20593c-9ff1-417d-a5e9-54e0d407193a tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] [instance: d38a019f-4bfc-4845-900b-a9e4e6397373] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:06:22.529495 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5b20593c-9ff1-417d-a5e9-54e0d407193a tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:06:22.530230 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5b20593c-9ff1-417d-a5e9-54e0d407193a tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:06:22.530898 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5b20593c-9ff1-417d-a5e9-54e0d407193a tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:06:22.533005 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5b20593c-9ff1-417d-a5e9-54e0d407193a tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:06:22.533332 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5b20593c-9ff1-417d-a5e9-54e0d407193a tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:06:22.537156 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5b20593c-9ff1-417d-a5e9-54e0d407193a tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:06:22.674327 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-5b20593c-9ff1-417d-a5e9-54e0d407193a tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d4cbd2a2154e5d925462df7c77815a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0d80988ca941acb8ad4318338dfbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:06:22.682449 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-5b20593c-9ff1-417d-a5e9-54e0d407193a tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] 10.222.0.20 "GET /compute/v2.1/servers/d38a019f-4bfc-4845-900b-a9e4e6397373" status: 200 len: 1522 microversion: 2.1 time: 0.165039 Oct 20 06:06:22.683013 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 115/251] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:06:22 2022] GET /compute/v2.1/servers/d38a019f-4bfc-4845-900b-a9e4e6397373 => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:06:23.705098 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-72399ecc-9a39-433b-bc47-91bb376992b0 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:06:23.705796 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-72399ecc-9a39-433b-bc47-91bb376992b0 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] [instance: d38a019f-4bfc-4845-900b-a9e4e6397373] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:06:23.708930 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG dbcounter [-] [118861] Writing DB stats nova_api:SELECT=36 {{(pid=118861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:06:23.714509 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-72399ecc-9a39-433b-bc47-91bb376992b0 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:06:23.715004 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-72399ecc-9a39-433b-bc47-91bb376992b0 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:06:23.715593 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-72399ecc-9a39-433b-bc47-91bb376992b0 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:06:23.716361 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-72399ecc-9a39-433b-bc47-91bb376992b0 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:06:23.716972 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-72399ecc-9a39-433b-bc47-91bb376992b0 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:06:23.717404 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-72399ecc-9a39-433b-bc47-91bb376992b0 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:06:23.721594 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG dbcounter [-] [118861] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:06:23.851460 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-72399ecc-9a39-433b-bc47-91bb376992b0 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d4cbd2a2154e5d925462df7c77815a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0d80988ca941acb8ad4318338dfbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:06:23.859507 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-72399ecc-9a39-433b-bc47-91bb376992b0 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] 10.222.0.20 "GET /compute/v2.1/servers/d38a019f-4bfc-4845-900b-a9e4e6397373" status: 200 len: 1522 microversion: 2.1 time: 0.158250 Oct 20 06:06:23.875702 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 137/252] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:06:23 2022] GET /compute/v2.1/servers/d38a019f-4bfc-4845-900b-a9e4e6397373 => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:06:24.882786 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-412acdb9-a61e-45cc-bd3d-1589e8d3bd67 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:06:24.883645 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-412acdb9-a61e-45cc-bd3d-1589e8d3bd67 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] [instance: d38a019f-4bfc-4845-900b-a9e4e6397373] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:06:24.886052 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG dbcounter [-] [118860] Writing DB stats nova_api:SELECT=34 {{(pid=118860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:06:24.891242 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-412acdb9-a61e-45cc-bd3d-1589e8d3bd67 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:06:24.891729 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-412acdb9-a61e-45cc-bd3d-1589e8d3bd67 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:06:24.892167 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-412acdb9-a61e-45cc-bd3d-1589e8d3bd67 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:06:24.892900 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-412acdb9-a61e-45cc-bd3d-1589e8d3bd67 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:06:24.893355 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-412acdb9-a61e-45cc-bd3d-1589e8d3bd67 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:06:24.893786 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-412acdb9-a61e-45cc-bd3d-1589e8d3bd67 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:06:25.026677 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-412acdb9-a61e-45cc-bd3d-1589e8d3bd67 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d4cbd2a2154e5d925462df7c77815a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0d80988ca941acb8ad4318338dfbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:06:25.034267 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-412acdb9-a61e-45cc-bd3d-1589e8d3bd67 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] 10.222.0.20 "GET /compute/v2.1/servers/d38a019f-4bfc-4845-900b-a9e4e6397373" status: 200 len: 1522 microversion: 2.1 time: 0.155437 Oct 20 06:06:25.034837 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 116/253] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:06:24 2022] GET /compute/v2.1/servers/d38a019f-4bfc-4845-900b-a9e4e6397373 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:06:25.818443 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-00adc94a-da27-47d5-a820-4e83e83ca441 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:06:25.818938 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-00adc94a-da27-47d5-a820-4e83e83ca441 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:06:25.825282 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-00adc94a-da27-47d5-a820-4e83e83ca441 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:06:25.825764 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-00adc94a-da27-47d5-a820-4e83e83ca441 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:06:25.826201 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-00adc94a-da27-47d5-a820-4e83e83ca441 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:06:25.826891 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-00adc94a-da27-47d5-a820-4e83e83ca441 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:06:25.827345 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-00adc94a-da27-47d5-a820-4e83e83ca441 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:06:25.827772 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-00adc94a-da27-47d5-a820-4e83e83ca441 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:06:25.850645 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-00adc94a-da27-47d5-a820-4e83e83ca441 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/ips" status: 200 len: 146 microversion: 2.1 time: 0.036241 Oct 20 06:06:25.851195 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 138/254] 10.222.0.20 () {58 vars in 1248 bytes} [Thu Oct 20 06:06:25 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/ips => generated 146 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:06:26.057778 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-5a9ccb48-3983-478d-9445-504c7955fd0b tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:06:26.058381 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-5a9ccb48-3983-478d-9445-504c7955fd0b tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] [instance: d38a019f-4bfc-4845-900b-a9e4e6397373] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:06:26.064716 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5a9ccb48-3983-478d-9445-504c7955fd0b tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:06:26.065194 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5a9ccb48-3983-478d-9445-504c7955fd0b tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:06:26.065904 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5a9ccb48-3983-478d-9445-504c7955fd0b tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:06:26.066594 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5a9ccb48-3983-478d-9445-504c7955fd0b tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:06:26.067037 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5a9ccb48-3983-478d-9445-504c7955fd0b tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:06:26.067460 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5a9ccb48-3983-478d-9445-504c7955fd0b tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:06:26.197985 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-5a9ccb48-3983-478d-9445-504c7955fd0b tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d4cbd2a2154e5d925462df7c77815a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0d80988ca941acb8ad4318338dfbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:06:26.205855 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-5a9ccb48-3983-478d-9445-504c7955fd0b tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] 10.222.0.20 "GET /compute/v2.1/servers/d38a019f-4bfc-4845-900b-a9e4e6397373" status: 200 len: 1522 microversion: 2.1 time: 0.152276 Oct 20 06:06:26.206414 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 117/255] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:06:26 2022] GET /compute/v2.1/servers/d38a019f-4bfc-4845-900b-a9e4e6397373 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:06:27.230104 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-0b49090a-f1c2-4c0b-b55c-a590eb1c3171 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:06:27.230543 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-0b49090a-f1c2-4c0b-b55c-a590eb1c3171 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] [instance: d38a019f-4bfc-4845-900b-a9e4e6397373] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:06:27.237307 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-0b49090a-f1c2-4c0b-b55c-a590eb1c3171 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:06:27.237785 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-0b49090a-f1c2-4c0b-b55c-a590eb1c3171 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:06:27.238192 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-0b49090a-f1c2-4c0b-b55c-a590eb1c3171 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:06:27.238931 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-0b49090a-f1c2-4c0b-b55c-a590eb1c3171 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:06:27.239327 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-0b49090a-f1c2-4c0b-b55c-a590eb1c3171 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:06:27.239746 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-0b49090a-f1c2-4c0b-b55c-a590eb1c3171 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:06:27.410342 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-0b49090a-f1c2-4c0b-b55c-a590eb1c3171 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d4cbd2a2154e5d925462df7c77815a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0d80988ca941acb8ad4318338dfbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:06:27.420167 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-0b49090a-f1c2-4c0b-b55c-a590eb1c3171 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] 10.222.0.20 "GET /compute/v2.1/servers/d38a019f-4bfc-4845-900b-a9e4e6397373" status: 200 len: 1522 microversion: 2.1 time: 0.194584 Oct 20 06:06:27.420842 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 139/256] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:06:27 2022] GET /compute/v2.1/servers/d38a019f-4bfc-4845-900b-a9e4e6397373 => generated 1522 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:06:27.637704 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-5599e47d-8057-4363-a144-54bd480f234e tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:06:27.638261 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-5599e47d-8057-4363-a144-54bd480f234e tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:06:27.645121 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5599e47d-8057-4363-a144-54bd480f234e tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:06:27.645785 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5599e47d-8057-4363-a144-54bd480f234e tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:06:27.646285 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5599e47d-8057-4363-a144-54bd480f234e tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:06:27.647124 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5599e47d-8057-4363-a144-54bd480f234e tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:06:27.648126 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5599e47d-8057-4363-a144-54bd480f234e tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:06:27.648598 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5599e47d-8057-4363-a144-54bd480f234e tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:06:27.674469 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-5599e47d-8057-4363-a144-54bd480f234e tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d/ips" status: 200 len: 151 microversion: 2.20 time: 0.040663 Oct 20 06:06:27.675109 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 118/257] 10.222.0.20 () {60 vars in 1289 bytes} [Thu Oct 20 06:06:27 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d/ips => generated 151 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 20 06:06:28.443732 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-f2867eac-05c8-4210-9ef4-6a22fcb9ef19 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:06:28.445122 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-f2867eac-05c8-4210-9ef4-6a22fcb9ef19 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] [instance: d38a019f-4bfc-4845-900b-a9e4e6397373] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:06:28.451585 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f2867eac-05c8-4210-9ef4-6a22fcb9ef19 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:06:28.452072 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f2867eac-05c8-4210-9ef4-6a22fcb9ef19 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:06:28.452513 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f2867eac-05c8-4210-9ef4-6a22fcb9ef19 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:06:28.453264 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f2867eac-05c8-4210-9ef4-6a22fcb9ef19 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:06:28.453721 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f2867eac-05c8-4210-9ef4-6a22fcb9ef19 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:06:28.454147 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f2867eac-05c8-4210-9ef4-6a22fcb9ef19 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:06:28.592845 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-f2867eac-05c8-4210-9ef4-6a22fcb9ef19 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d4cbd2a2154e5d925462df7c77815a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0d80988ca941acb8ad4318338dfbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:06:28.601687 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-f2867eac-05c8-4210-9ef4-6a22fcb9ef19 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] 10.222.0.20 "GET /compute/v2.1/servers/d38a019f-4bfc-4845-900b-a9e4e6397373" status: 200 len: 1522 microversion: 2.1 time: 0.161132 Oct 20 06:06:28.603161 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 140/258] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:06:28 2022] GET /compute/v2.1/servers/d38a019f-4bfc-4845-900b-a9e4e6397373 => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:06:28.909788 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-2f5792b2-3bc3-4817-92c6-ed6ccb747880 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "11ccc208-d7ea-44f8-a1f9-baf6327b112f"}} {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 06:06:28.912262 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-2f5792b2-3bc3-4817-92c6-ed6ccb747880 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:06:28.919034 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2f5792b2-3bc3-4817-92c6-ed6ccb747880 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:06:28.919519 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2f5792b2-3bc3-4817-92c6-ed6ccb747880 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:06:28.919955 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2f5792b2-3bc3-4817-92c6-ed6ccb747880 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:06:28.920648 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2f5792b2-3bc3-4817-92c6-ed6ccb747880 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:06:28.921128 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2f5792b2-3bc3-4817-92c6-ed6ccb747880 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:06:28.921552 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2f5792b2-3bc3-4817-92c6-ed6ccb747880 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:06:29.623713 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-3932cf10-c29c-4d8d-a847-60956530d6ad tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:06:29.624312 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-3932cf10-c29c-4d8d-a847-60956530d6ad tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] [instance: d38a019f-4bfc-4845-900b-a9e4e6397373] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:06:29.630927 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-3932cf10-c29c-4d8d-a847-60956530d6ad tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:06:29.631403 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-3932cf10-c29c-4d8d-a847-60956530d6ad tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:06:29.632379 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-3932cf10-c29c-4d8d-a847-60956530d6ad tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:06:29.633095 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-3932cf10-c29c-4d8d-a847-60956530d6ad tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:06:29.633802 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-3932cf10-c29c-4d8d-a847-60956530d6ad tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:06:29.634219 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-3932cf10-c29c-4d8d-a847-60956530d6ad tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:06:29.776425 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-3932cf10-c29c-4d8d-a847-60956530d6ad tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d4cbd2a2154e5d925462df7c77815a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0d80988ca941acb8ad4318338dfbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:06:29.784067 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-3932cf10-c29c-4d8d-a847-60956530d6ad tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] 10.222.0.20 "GET /compute/v2.1/servers/d38a019f-4bfc-4845-900b-a9e4e6397373" status: 200 len: 1522 microversion: 2.1 time: 0.164293 Oct 20 06:06:29.784623 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 141/259] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:06:29 2022] GET /compute/v2.1/servers/d38a019f-4bfc-4845-900b-a9e4e6397373 => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 06:06:30.806253 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-abad3ac1-11a3-4462-96c0-1ff92361c9b9 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:06:30.806839 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-abad3ac1-11a3-4462-96c0-1ff92361c9b9 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] [instance: d38a019f-4bfc-4845-900b-a9e4e6397373] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:06:30.813195 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-abad3ac1-11a3-4462-96c0-1ff92361c9b9 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:06:30.813672 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-abad3ac1-11a3-4462-96c0-1ff92361c9b9 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:06:30.814111 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-abad3ac1-11a3-4462-96c0-1ff92361c9b9 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:06:30.814795 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-abad3ac1-11a3-4462-96c0-1ff92361c9b9 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:06:30.815243 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-abad3ac1-11a3-4462-96c0-1ff92361c9b9 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:06:30.815663 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-abad3ac1-11a3-4462-96c0-1ff92361c9b9 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:06:30.941976 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-abad3ac1-11a3-4462-96c0-1ff92361c9b9 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d4cbd2a2154e5d925462df7c77815a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0d80988ca941acb8ad4318338dfbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:06:30.950028 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-abad3ac1-11a3-4462-96c0-1ff92361c9b9 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] 10.222.0.20 "GET /compute/v2.1/servers/d38a019f-4bfc-4845-900b-a9e4e6397373" status: 200 len: 1522 microversion: 2.1 time: 0.147712 Oct 20 06:06:30.950594 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 142/260] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:06:30 2022] GET /compute/v2.1/servers/d38a019f-4bfc-4845-900b-a9e4e6397373 => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 06:06:31.295087 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG dbcounter [-] [118860] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=6,nova_cell1:INSERT=2 {{(pid=118860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:06:31.314105 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-2f5792b2-3bc3-4817-92c6-ed6ccb747880 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "POST /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.408153 Oct 20 06:06:31.314659 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 119/261] 10.222.0.20 () {60 vars in 1323 bytes} [Thu Oct 20 06:06:28 2022] POST /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 194 bytes in 2410 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:06:31.972955 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-17913d73-0e3d-45a9-b337-d1b02a3673e0 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:06:31.973557 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-17913d73-0e3d-45a9-b337-d1b02a3673e0 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] [instance: d38a019f-4bfc-4845-900b-a9e4e6397373] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:06:31.980333 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-17913d73-0e3d-45a9-b337-d1b02a3673e0 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:06:31.980861 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-17913d73-0e3d-45a9-b337-d1b02a3673e0 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:06:31.981295 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-17913d73-0e3d-45a9-b337-d1b02a3673e0 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:06:31.981983 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-17913d73-0e3d-45a9-b337-d1b02a3673e0 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:06:31.982429 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-17913d73-0e3d-45a9-b337-d1b02a3673e0 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:06:31.982850 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-17913d73-0e3d-45a9-b337-d1b02a3673e0 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:06:32.113525 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-17913d73-0e3d-45a9-b337-d1b02a3673e0 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d4cbd2a2154e5d925462df7c77815a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0d80988ca941acb8ad4318338dfbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:06:32.121654 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-17913d73-0e3d-45a9-b337-d1b02a3673e0 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] 10.222.0.20 "GET /compute/v2.1/servers/d38a019f-4bfc-4845-900b-a9e4e6397373" status: 200 len: 1522 microversion: 2.1 time: 0.152447 Oct 20 06:06:32.122220 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 143/262] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:06:31 2022] GET /compute/v2.1/servers/d38a019f-4bfc-4845-900b-a9e4e6397373 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:06:33.144951 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-8f7f5e0b-4545-432e-8622-86358037dc9b tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:06:33.145657 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-8f7f5e0b-4545-432e-8622-86358037dc9b tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] [instance: d38a019f-4bfc-4845-900b-a9e4e6397373] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:06:33.152914 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-8f7f5e0b-4545-432e-8622-86358037dc9b tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:06:33.153397 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-8f7f5e0b-4545-432e-8622-86358037dc9b tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:06:33.153831 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-8f7f5e0b-4545-432e-8622-86358037dc9b tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:06:33.154522 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-8f7f5e0b-4545-432e-8622-86358037dc9b tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:06:33.154982 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-8f7f5e0b-4545-432e-8622-86358037dc9b tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:06:33.155411 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-8f7f5e0b-4545-432e-8622-86358037dc9b tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:06:33.289235 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-8f7f5e0b-4545-432e-8622-86358037dc9b tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d4cbd2a2154e5d925462df7c77815a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0d80988ca941acb8ad4318338dfbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:06:33.296786 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-8f7f5e0b-4545-432e-8622-86358037dc9b tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] 10.222.0.20 "GET /compute/v2.1/servers/d38a019f-4bfc-4845-900b-a9e4e6397373" status: 200 len: 1522 microversion: 2.1 time: 0.156023 Oct 20 06:06:33.297350 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 120/263] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:06:33 2022] GET /compute/v2.1/servers/d38a019f-4bfc-4845-900b-a9e4e6397373 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 06:06:34.319408 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-b149a75d-a621-42fc-a5f4-ce05e65aa842 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:06:34.320049 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-b149a75d-a621-42fc-a5f4-ce05e65aa842 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] [instance: d38a019f-4bfc-4845-900b-a9e4e6397373] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:06:34.326616 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b149a75d-a621-42fc-a5f4-ce05e65aa842 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:06:34.327101 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b149a75d-a621-42fc-a5f4-ce05e65aa842 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:06:34.327539 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b149a75d-a621-42fc-a5f4-ce05e65aa842 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:06:34.328239 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b149a75d-a621-42fc-a5f4-ce05e65aa842 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:06:34.328715 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b149a75d-a621-42fc-a5f4-ce05e65aa842 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:06:34.329148 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b149a75d-a621-42fc-a5f4-ce05e65aa842 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:06:34.464416 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-b149a75d-a621-42fc-a5f4-ce05e65aa842 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d4cbd2a2154e5d925462df7c77815a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0d80988ca941acb8ad4318338dfbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:06:34.472728 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-b149a75d-a621-42fc-a5f4-ce05e65aa842 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] 10.222.0.20 "GET /compute/v2.1/servers/d38a019f-4bfc-4845-900b-a9e4e6397373" status: 200 len: 1522 microversion: 2.1 time: 0.157185 Oct 20 06:06:34.473312 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 144/264] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:06:34 2022] GET /compute/v2.1/servers/d38a019f-4bfc-4845-900b-a9e4e6397373 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:06:35.496137 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-76eaad11-31f2-4dce-a2ce-f8478f704104 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:06:35.496798 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-76eaad11-31f2-4dce-a2ce-f8478f704104 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] [instance: d38a019f-4bfc-4845-900b-a9e4e6397373] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:06:35.503149 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-76eaad11-31f2-4dce-a2ce-f8478f704104 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:06:35.503634 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-76eaad11-31f2-4dce-a2ce-f8478f704104 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:06:35.504075 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-76eaad11-31f2-4dce-a2ce-f8478f704104 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:06:35.504789 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-76eaad11-31f2-4dce-a2ce-f8478f704104 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:06:35.505244 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-76eaad11-31f2-4dce-a2ce-f8478f704104 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:06:35.505665 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-76eaad11-31f2-4dce-a2ce-f8478f704104 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:06:35.657578 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-76eaad11-31f2-4dce-a2ce-f8478f704104 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d4cbd2a2154e5d925462df7c77815a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0d80988ca941acb8ad4318338dfbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:06:35.668633 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-76eaad11-31f2-4dce-a2ce-f8478f704104 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] 10.222.0.20 "GET /compute/v2.1/servers/d38a019f-4bfc-4845-900b-a9e4e6397373" status: 200 len: 1522 microversion: 2.1 time: 0.175763 Oct 20 06:06:35.669244 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 121/265] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:06:35 2022] GET /compute/v2.1/servers/d38a019f-4bfc-4845-900b-a9e4e6397373 => generated 1522 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:06:36.054107 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-4d048e48-d407-4df3-9a3f-4456b6c294c3 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 06:06:36.054673 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-4d048e48-d407-4df3-9a3f-4456b6c294c3 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:06:36.061110 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4d048e48-d407-4df3-9a3f-4456b6c294c3 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:06:36.061601 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4d048e48-d407-4df3-9a3f-4456b6c294c3 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:06:36.062041 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4d048e48-d407-4df3-9a3f-4456b6c294c3 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:06:36.062737 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4d048e48-d407-4df3-9a3f-4456b6c294c3 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:06:36.063195 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4d048e48-d407-4df3-9a3f-4456b6c294c3 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:06:36.063623 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4d048e48-d407-4df3-9a3f-4456b6c294c3 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:06:36.086486 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.objects.instance [None req-4d048e48-d407-4df3-9a3f-4456b6c294c3 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lazy-loading 'flavor' on Instance uuid 71be459d-e948-4a17-b379-182f4196411d {{(pid=118861) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 20 06:06:36.293521 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-4d048e48-d407-4df3-9a3f-4456b6c294c3 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "POST /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d/action" status: 202 len: 0 microversion: 2.20 time: 0.243304 Oct 20 06:06:36.294113 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 145/266] 10.222.0.20 () {62 vars in 1319 bytes} [Thu Oct 20 06:06:36 2022] POST /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d/action => generated 0 bytes in 245 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 20 06:06:36.302983 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-952eebb3-0a6e-4f2b-85b1-c139f3d254c8 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:06:36.304039 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-952eebb3-0a6e-4f2b-85b1-c139f3d254c8 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:06:36.310080 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-952eebb3-0a6e-4f2b-85b1-c139f3d254c8 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:06:36.310563 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-952eebb3-0a6e-4f2b-85b1-c139f3d254c8 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:06:36.311026 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-952eebb3-0a6e-4f2b-85b1-c139f3d254c8 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:06:36.311718 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-952eebb3-0a6e-4f2b-85b1-c139f3d254c8 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:06:36.312170 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-952eebb3-0a6e-4f2b-85b1-c139f3d254c8 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:06:36.312589 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-952eebb3-0a6e-4f2b-85b1-c139f3d254c8 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:06:36.442255 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-952eebb3-0a6e-4f2b-85b1-c139f3d254c8 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:06:36.450653 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-952eebb3-0a6e-4f2b-85b1-c139f3d254c8 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:06:36.452090 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-952eebb3-0a6e-4f2b-85b1-c139f3d254c8 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:06:36.453275 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-952eebb3-0a6e-4f2b-85b1-c139f3d254c8 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1722 microversion: 2.20 time: 0.154900 Oct 20 06:06:36.453824 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 122/267] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:06:36 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:06:36.693662 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-4136193f-b368-4f9f-8367-9f36318bca3d tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:06:36.694663 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-4136193f-b368-4f9f-8367-9f36318bca3d tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] [instance: d38a019f-4bfc-4845-900b-a9e4e6397373] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:06:36.700832 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4136193f-b368-4f9f-8367-9f36318bca3d tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:06:36.701311 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4136193f-b368-4f9f-8367-9f36318bca3d tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:06:36.701744 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4136193f-b368-4f9f-8367-9f36318bca3d tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:06:36.702423 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4136193f-b368-4f9f-8367-9f36318bca3d tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:06:36.702886 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4136193f-b368-4f9f-8367-9f36318bca3d tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:06:36.703290 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4136193f-b368-4f9f-8367-9f36318bca3d tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:06:36.829782 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-4136193f-b368-4f9f-8367-9f36318bca3d tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d4cbd2a2154e5d925462df7c77815a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0d80988ca941acb8ad4318338dfbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:06:36.838204 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-4136193f-b368-4f9f-8367-9f36318bca3d tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] 10.222.0.20 "GET /compute/v2.1/servers/d38a019f-4bfc-4845-900b-a9e4e6397373" status: 200 len: 1522 microversion: 2.1 time: 0.148822 Oct 20 06:06:36.838770 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 146/268] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:06:36 2022] GET /compute/v2.1/servers/d38a019f-4bfc-4845-900b-a9e4e6397373 => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:06:37.478813 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-4d2bf008-cd6d-46d7-8178-6d43fdfdcecc tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:06:37.479363 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-4d2bf008-cd6d-46d7-8178-6d43fdfdcecc tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:06:37.486475 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-4d2bf008-cd6d-46d7-8178-6d43fdfdcecc tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:06:37.486965 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-4d2bf008-cd6d-46d7-8178-6d43fdfdcecc tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:06:37.487404 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-4d2bf008-cd6d-46d7-8178-6d43fdfdcecc tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:06:37.488103 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-4d2bf008-cd6d-46d7-8178-6d43fdfdcecc tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:06:37.488557 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-4d2bf008-cd6d-46d7-8178-6d43fdfdcecc tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:06:37.489012 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-4d2bf008-cd6d-46d7-8178-6d43fdfdcecc tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:06:37.618051 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-4d2bf008-cd6d-46d7-8178-6d43fdfdcecc tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:06:37.625936 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-4d2bf008-cd6d-46d7-8178-6d43fdfdcecc tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:06:37.627353 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-4d2bf008-cd6d-46d7-8178-6d43fdfdcecc tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:06:37.628489 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-4d2bf008-cd6d-46d7-8178-6d43fdfdcecc tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1722 microversion: 2.20 time: 0.153726 Oct 20 06:06:37.629089 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 123/269] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:06:37 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:06:37.860425 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-f1cf4994-5833-40db-a538-6761b2ebc8ea tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:06:37.861054 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-f1cf4994-5833-40db-a538-6761b2ebc8ea tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] [instance: d38a019f-4bfc-4845-900b-a9e4e6397373] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:06:37.867370 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f1cf4994-5833-40db-a538-6761b2ebc8ea tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:06:37.867839 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f1cf4994-5833-40db-a538-6761b2ebc8ea tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:06:37.868271 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f1cf4994-5833-40db-a538-6761b2ebc8ea tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:06:37.868992 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f1cf4994-5833-40db-a538-6761b2ebc8ea tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:06:37.869441 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f1cf4994-5833-40db-a538-6761b2ebc8ea tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:06:37.869861 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f1cf4994-5833-40db-a538-6761b2ebc8ea tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:06:37.999309 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-f1cf4994-5833-40db-a538-6761b2ebc8ea tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d4cbd2a2154e5d925462df7c77815a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0d80988ca941acb8ad4318338dfbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:06:38.007495 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-f1cf4994-5833-40db-a538-6761b2ebc8ea tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] 10.222.0.20 "GET /compute/v2.1/servers/d38a019f-4bfc-4845-900b-a9e4e6397373" status: 200 len: 1522 microversion: 2.1 time: 0.150859 Oct 20 06:06:38.008065 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 147/270] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:06:37 2022] GET /compute/v2.1/servers/d38a019f-4bfc-4845-900b-a9e4e6397373 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:06:38.434224 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-6b6e5b11-b715-462f-aa60-d470faf2fdac tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Action: 'create', calling method: .version_select at 0x7fbe4ac30a60>, body: {"keypair": {"name": "tempest-keypair-512168868", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLzEAtCyKlveDJ1DbDlzig66AWXpCmrFzPi29RfdHGDqYdtsps40urX0/7V25nv1R4J3EbtjkCQquyuj5iDuvUItga5m3hyygyi1CfgW3lj1TFL67gqq0VIUUyzpFk5Xrg=="}} {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 06:06:38.450039 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.quota [None req-6b6e5b11-b715-462f-aa60-d470faf2fdac tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Getting quotas for project b90087118fe040389f291d846461c0a7. Resources: {'key_pairs'} {{(pid=118860) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 20 06:06:38.453783 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.quota [None req-6b6e5b11-b715-462f-aa60-d470faf2fdac tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Getting quotas for user 2c6be23065c643939055a3de375187d5 and project b90087118fe040389f291d846461c0a7. Resources: {'key_pairs'} {{(pid=118860) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 20 06:06:38.476469 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-6b6e5b11-b715-462f-aa60-d470faf2fdac tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.045868 Oct 20 06:06:38.478549 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 124/271] 10.222.0.20 () {60 vars in 1159 bytes} [Thu Oct 20 06:06:38 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:06:38.655890 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-08a4a94d-11a8-49ad-af35-2baafd216cb0 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:06:38.656421 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-08a4a94d-11a8-49ad-af35-2baafd216cb0 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:06:38.663229 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-08a4a94d-11a8-49ad-af35-2baafd216cb0 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:06:38.663763 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-08a4a94d-11a8-49ad-af35-2baafd216cb0 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:06:38.664228 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-08a4a94d-11a8-49ad-af35-2baafd216cb0 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:06:38.664969 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-08a4a94d-11a8-49ad-af35-2baafd216cb0 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:06:38.665424 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-08a4a94d-11a8-49ad-af35-2baafd216cb0 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:06:38.665846 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-08a4a94d-11a8-49ad-af35-2baafd216cb0 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:06:38.853582 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-08a4a94d-11a8-49ad-af35-2baafd216cb0 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:06:38.857659 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-08a4a94d-11a8-49ad-af35-2baafd216cb0 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:06:38.857659 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-08a4a94d-11a8-49ad-af35-2baafd216cb0 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:06:38.858339 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-08a4a94d-11a8-49ad-af35-2baafd216cb0 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1722 microversion: 2.20 time: 0.206947 Oct 20 06:06:38.858898 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 148/272] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:06:38 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1722 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:06:39.031911 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-196b2c9e-cf02-4382-93ad-c5a7037132f5 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:06:39.034123 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-196b2c9e-cf02-4382-93ad-c5a7037132f5 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] [instance: d38a019f-4bfc-4845-900b-a9e4e6397373] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:06:39.039850 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-196b2c9e-cf02-4382-93ad-c5a7037132f5 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:06:39.040347 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-196b2c9e-cf02-4382-93ad-c5a7037132f5 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:06:39.040791 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-196b2c9e-cf02-4382-93ad-c5a7037132f5 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:06:39.041659 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-196b2c9e-cf02-4382-93ad-c5a7037132f5 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:06:39.042289 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-196b2c9e-cf02-4382-93ad-c5a7037132f5 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:06:39.042906 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-196b2c9e-cf02-4382-93ad-c5a7037132f5 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:06:39.253776 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-196b2c9e-cf02-4382-93ad-c5a7037132f5 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d4cbd2a2154e5d925462df7c77815a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0d80988ca941acb8ad4318338dfbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:06:39.263574 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-196b2c9e-cf02-4382-93ad-c5a7037132f5 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] 10.222.0.20 "GET /compute/v2.1/servers/d38a019f-4bfc-4845-900b-a9e4e6397373" status: 200 len: 1522 microversion: 2.1 time: 0.235983 Oct 20 06:06:39.264283 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 125/273] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:06:39 2022] GET /compute/v2.1/servers/d38a019f-4bfc-4845-900b-a9e4e6397373 => generated 1522 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:06:39.885432 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-7f841833-1965-4ab7-b1e8-52e6df62396a tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:06:39.886041 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-7f841833-1965-4ab7-b1e8-52e6df62396a tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:06:39.895427 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7f841833-1965-4ab7-b1e8-52e6df62396a tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:06:39.896587 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-954d27d6-dbd2-4604-a1ba-4ac7cd8ef777 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-656872825", "imageRef": "9fcec276-734d-41d9-905b-10d2bbcbfba5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "25101033-a54e-4dc6-a6b0-89acf3ee0337"}], "security_groups": [{"name": "tempest-securitygroup--774539099"}], "key_name": "tempest-keypair-512168868", "user_data": "}} {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 06:06:39.900993 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7f841833-1965-4ab7-b1e8-52e6df62396a tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:06:39.901532 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7f841833-1965-4ab7-b1e8-52e6df62396a tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:06:39.902387 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7f841833-1965-4ab7-b1e8-52e6df62396a tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:06:39.902912 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7f841833-1965-4ab7-b1e8-52e6df62396a tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:06:39.903403 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7f841833-1965-4ab7-b1e8-52e6df62396a tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:06:40.024377 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.network.neutron [None req-954d27d6-dbd2-4604-a1ba-4ac7cd8ef777 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] validate_networks() for [('25101033-a54e-4dc6-a6b0-89acf3ee0337', None, None, None, None, None)] {{(pid=118860) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 20 06:06:40.047992 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-7f841833-1965-4ab7-b1e8-52e6df62396a tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:06:40.056393 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-7f841833-1965-4ab7-b1e8-52e6df62396a tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:06:40.057870 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-7f841833-1965-4ab7-b1e8-52e6df62396a tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:06:40.059034 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-7f841833-1965-4ab7-b1e8-52e6df62396a tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1722 microversion: 2.20 time: 0.178146 Oct 20 06:06:40.059594 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 149/274] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:06:39 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1722 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:06:40.287634 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-176ce860-dadd-46ae-906e-5e62a3f69f95 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:06:40.288175 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-176ce860-dadd-46ae-906e-5e62a3f69f95 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] [instance: d38a019f-4bfc-4845-900b-a9e4e6397373] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:06:40.294119 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-176ce860-dadd-46ae-906e-5e62a3f69f95 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:06:40.294611 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-176ce860-dadd-46ae-906e-5e62a3f69f95 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:06:40.295050 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-176ce860-dadd-46ae-906e-5e62a3f69f95 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:06:40.295758 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-176ce860-dadd-46ae-906e-5e62a3f69f95 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:06:40.296216 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-176ce860-dadd-46ae-906e-5e62a3f69f95 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:06:40.296886 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-176ce860-dadd-46ae-906e-5e62a3f69f95 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:06:40.396409 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.virt.hardware [None req-954d27d6-dbd2-4604-a1ba-4ac7cd8ef777 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Flavor limits 0:0:0 {{(pid=118860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 20 06:06:40.397478 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.virt.hardware [None req-954d27d6-dbd2-4604-a1ba-4ac7cd8ef777 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Image limits 0:0:0 {{(pid=118860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 20 06:06:40.397824 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.virt.hardware [None req-954d27d6-dbd2-4604-a1ba-4ac7cd8ef777 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Flavor pref 0:0:0 {{(pid=118860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 20 06:06:40.398412 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.virt.hardware [None req-954d27d6-dbd2-4604-a1ba-4ac7cd8ef777 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Image pref 0:0:0 {{(pid=118860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 20 06:06:40.399001 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.virt.hardware [None req-954d27d6-dbd2-4604-a1ba-4ac7cd8ef777 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 20 06:06:40.407529 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-954d27d6-dbd2-4604-a1ba-4ac7cd8ef777 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:06:40.408003 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-954d27d6-dbd2-4604-a1ba-4ac7cd8ef777 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:06:40.408433 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-954d27d6-dbd2-4604-a1ba-4ac7cd8ef777 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:06:40.409209 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-954d27d6-dbd2-4604-a1ba-4ac7cd8ef777 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:06:40.409657 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-954d27d6-dbd2-4604-a1ba-4ac7cd8ef777 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:06:40.410073 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-954d27d6-dbd2-4604-a1ba-4ac7cd8ef777 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:06:40.426461 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.quota [None req-954d27d6-dbd2-4604-a1ba-4ac7cd8ef777 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Getting quotas for project b90087118fe040389f291d846461c0a7. Resources: {'cores', 'ram', 'instances'} {{(pid=118860) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 20 06:06:40.430830 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-176ce860-dadd-46ae-906e-5e62a3f69f95 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d4cbd2a2154e5d925462df7c77815a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0d80988ca941acb8ad4318338dfbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:06:40.431008 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.quota [None req-954d27d6-dbd2-4604-a1ba-4ac7cd8ef777 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Getting quotas for user 2c6be23065c643939055a3de375187d5 and project b90087118fe040389f291d846461c0a7. Resources: {'cores', 'ram', 'instances'} {{(pid=118860) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 20 06:06:40.438629 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-176ce860-dadd-46ae-906e-5e62a3f69f95 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] 10.222.0.20 "GET /compute/v2.1/servers/d38a019f-4bfc-4845-900b-a9e4e6397373" status: 200 len: 1522 microversion: 2.1 time: 0.154991 Oct 20 06:06:40.439211 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 150/275] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:06:40 2022] GET /compute/v2.1/servers/d38a019f-4bfc-4845-900b-a9e4e6397373 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 06:06:40.441824 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-954d27d6-dbd2-4604-a1ba-4ac7cd8ef777 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Going to run 1 instances... {{(pid=118860) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 20 06:06:40.444168 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-954d27d6-dbd2-4604-a1ba-4ac7cd8ef777 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: 5a669c5b-898f-4fef-8508-254ccd998571] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9fcec276-734d-41d9-905b-10d2bbcbfba5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118860) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 20 06:06:40.488356 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-954d27d6-dbd2-4604-a1ba-4ac7cd8ef777 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.595964 Oct 20 06:06:40.489022 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 126/276] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Oct 20 06:06:39 2022] POST /compute/v2.1/servers => generated 401 bytes in 597 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 20 06:06:40.500251 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-d7cead6b-8fb5-430c-a9e4-eefbc336fd14 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:06:40.501074 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-d7cead6b-8fb5-430c-a9e4-eefbc336fd14 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: 5a669c5b-898f-4fef-8508-254ccd998571] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:06:40.556903 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-d7cead6b-8fb5-430c-a9e4-eefbc336fd14 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:06:40.563698 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-d7cead6b-8fb5-430c-a9e4-eefbc336fd14 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/5a669c5b-898f-4fef-8508-254ccd998571" status: 200 len: 1240 microversion: 2.1 time: 0.067416 Oct 20 06:06:40.564420 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 151/277] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:06:40 2022] GET /compute/v2.1/servers/5a669c5b-898f-4fef-8508-254ccd998571 => generated 1240 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:06:41.086232 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-64048cf9-6e93-41f8-866b-4210207b69be tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:06:41.086788 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-64048cf9-6e93-41f8-866b-4210207b69be tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:06:41.093382 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-64048cf9-6e93-41f8-866b-4210207b69be tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:06:41.093859 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-64048cf9-6e93-41f8-866b-4210207b69be tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:06:41.094299 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-64048cf9-6e93-41f8-866b-4210207b69be tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:06:41.094986 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-64048cf9-6e93-41f8-866b-4210207b69be tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:06:41.095433 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-64048cf9-6e93-41f8-866b-4210207b69be tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:06:41.095853 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-64048cf9-6e93-41f8-866b-4210207b69be tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:06:41.225549 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-64048cf9-6e93-41f8-866b-4210207b69be tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:06:41.233539 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-64048cf9-6e93-41f8-866b-4210207b69be tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:06:41.234963 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-64048cf9-6e93-41f8-866b-4210207b69be tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:06:41.236099 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-64048cf9-6e93-41f8-866b-4210207b69be tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1722 microversion: 2.20 time: 0.154757 Oct 20 06:06:41.236661 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 127/278] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:06:41 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:06:41.462383 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-2a6ec665-8509-45e2-b267-acf07bd4ca61 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:06:41.463027 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-2a6ec665-8509-45e2-b267-acf07bd4ca61 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] [instance: d38a019f-4bfc-4845-900b-a9e4e6397373] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:06:41.470839 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-2a6ec665-8509-45e2-b267-acf07bd4ca61 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:06:41.471324 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-2a6ec665-8509-45e2-b267-acf07bd4ca61 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:06:41.471762 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-2a6ec665-8509-45e2-b267-acf07bd4ca61 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:06:41.472458 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-2a6ec665-8509-45e2-b267-acf07bd4ca61 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:06:41.472953 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-2a6ec665-8509-45e2-b267-acf07bd4ca61 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:06:41.473436 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-2a6ec665-8509-45e2-b267-acf07bd4ca61 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:06:41.586749 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-05ff8253-b574-43c2-8653-10536dab763f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:06:41.587474 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-05ff8253-b574-43c2-8653-10536dab763f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: 5a669c5b-898f-4fef-8508-254ccd998571] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:06:41.594231 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-05ff8253-b574-43c2-8653-10536dab763f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:06:41.594761 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-05ff8253-b574-43c2-8653-10536dab763f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:06:41.595383 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-05ff8253-b574-43c2-8653-10536dab763f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:06:41.596108 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-05ff8253-b574-43c2-8653-10536dab763f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:06:41.597055 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-05ff8253-b574-43c2-8653-10536dab763f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:06:41.597189 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-05ff8253-b574-43c2-8653-10536dab763f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:06:41.606908 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-2a6ec665-8509-45e2-b267-acf07bd4ca61 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d4cbd2a2154e5d925462df7c77815a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0d80988ca941acb8ad4318338dfbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:06:41.616663 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-2a6ec665-8509-45e2-b267-acf07bd4ca61 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] 10.222.0.20 "GET /compute/v2.1/servers/d38a019f-4bfc-4845-900b-a9e4e6397373" status: 200 len: 1522 microversion: 2.1 time: 0.159035 Oct 20 06:06:41.625293 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 152/279] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:06:41 2022] GET /compute/v2.1/servers/d38a019f-4bfc-4845-900b-a9e4e6397373 => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:06:41.673209 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-05ff8253-b574-43c2-8653-10536dab763f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:06:41.681817 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-05ff8253-b574-43c2-8653-10536dab763f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/5a669c5b-898f-4fef-8508-254ccd998571" status: 200 len: 1244 microversion: 2.1 time: 0.099752 Oct 20 06:06:41.682511 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 128/280] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:06:41 2022] GET /compute/v2.1/servers/5a669c5b-898f-4fef-8508-254ccd998571 => generated 1244 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 06:06:42.262449 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-1ba13c2c-a746-428d-9cb8-2b42e272e533 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:06:42.263300 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-1ba13c2c-a746-428d-9cb8-2b42e272e533 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:06:42.272141 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1ba13c2c-a746-428d-9cb8-2b42e272e533 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:06:42.273277 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1ba13c2c-a746-428d-9cb8-2b42e272e533 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:06:42.273971 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1ba13c2c-a746-428d-9cb8-2b42e272e533 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:06:42.275816 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1ba13c2c-a746-428d-9cb8-2b42e272e533 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:06:42.276559 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1ba13c2c-a746-428d-9cb8-2b42e272e533 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:06:42.278096 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1ba13c2c-a746-428d-9cb8-2b42e272e533 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:06:42.283453 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG dbcounter [-] [118861] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:06:42.441241 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-1ba13c2c-a746-428d-9cb8-2b42e272e533 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:06:42.451820 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-1ba13c2c-a746-428d-9cb8-2b42e272e533 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:06:42.453337 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-1ba13c2c-a746-428d-9cb8-2b42e272e533 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:06:42.455716 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-1ba13c2c-a746-428d-9cb8-2b42e272e533 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1722 microversion: 2.20 time: 0.197410 Oct 20 06:06:42.456785 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 153/281] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:06:42 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1722 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:06:42.648498 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-9659ad82-0d5c-44eb-9f17-3b04667686a1 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:06:42.649141 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-9659ad82-0d5c-44eb-9f17-3b04667686a1 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] [instance: d38a019f-4bfc-4845-900b-a9e4e6397373] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:06:42.657124 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-9659ad82-0d5c-44eb-9f17-3b04667686a1 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:06:42.657614 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-9659ad82-0d5c-44eb-9f17-3b04667686a1 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:06:42.658230 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-9659ad82-0d5c-44eb-9f17-3b04667686a1 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:06:42.658941 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-9659ad82-0d5c-44eb-9f17-3b04667686a1 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:06:42.659395 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-9659ad82-0d5c-44eb-9f17-3b04667686a1 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:06:42.660161 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-9659ad82-0d5c-44eb-9f17-3b04667686a1 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:06:42.706740 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-dd77fed7-0fb7-4b66-a7ec-f7101ab3e6b6 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:06:42.707488 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-dd77fed7-0fb7-4b66-a7ec-f7101ab3e6b6 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: 5a669c5b-898f-4fef-8508-254ccd998571] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:06:42.714649 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-dd77fed7-0fb7-4b66-a7ec-f7101ab3e6b6 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:06:42.715501 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-dd77fed7-0fb7-4b66-a7ec-f7101ab3e6b6 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:06:42.716050 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-dd77fed7-0fb7-4b66-a7ec-f7101ab3e6b6 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:06:42.716910 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-dd77fed7-0fb7-4b66-a7ec-f7101ab3e6b6 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:06:42.718527 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-dd77fed7-0fb7-4b66-a7ec-f7101ab3e6b6 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:06:42.719045 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-dd77fed7-0fb7-4b66-a7ec-f7101ab3e6b6 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:06:42.816640 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-9659ad82-0d5c-44eb-9f17-3b04667686a1 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d4cbd2a2154e5d925462df7c77815a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0d80988ca941acb8ad4318338dfbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:06:42.828156 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-9659ad82-0d5c-44eb-9f17-3b04667686a1 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] 10.222.0.20 "GET /compute/v2.1/servers/d38a019f-4bfc-4845-900b-a9e4e6397373" status: 200 len: 1522 microversion: 2.1 time: 0.183560 Oct 20 06:06:42.841190 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 129/282] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:06:42 2022] GET /compute/v2.1/servers/d38a019f-4bfc-4845-900b-a9e4e6397373 => generated 1522 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:06:42.852998 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-dd77fed7-0fb7-4b66-a7ec-f7101ab3e6b6 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:06:42.861050 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-dd77fed7-0fb7-4b66-a7ec-f7101ab3e6b6 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/5a669c5b-898f-4fef-8508-254ccd998571" status: 200 len: 1292 microversion: 2.1 time: 0.158575 Oct 20 06:06:42.861856 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 154/283] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:06:42 2022] GET /compute/v2.1/servers/5a669c5b-898f-4fef-8508-254ccd998571 => generated 1292 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 06:06:43.482112 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-45e1275b-3a0d-4593-b2dd-b639654a8744 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:06:43.482717 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-45e1275b-3a0d-4593-b2dd-b639654a8744 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:06:43.488777 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-45e1275b-3a0d-4593-b2dd-b639654a8744 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:06:43.489267 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-45e1275b-3a0d-4593-b2dd-b639654a8744 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:06:43.489702 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-45e1275b-3a0d-4593-b2dd-b639654a8744 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:06:43.490985 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-45e1275b-3a0d-4593-b2dd-b639654a8744 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:06:43.491476 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-45e1275b-3a0d-4593-b2dd-b639654a8744 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:06:43.491905 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-45e1275b-3a0d-4593-b2dd-b639654a8744 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:06:43.637428 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-45e1275b-3a0d-4593-b2dd-b639654a8744 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:06:43.646210 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-45e1275b-3a0d-4593-b2dd-b639654a8744 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:06:43.648156 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-45e1275b-3a0d-4593-b2dd-b639654a8744 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:06:43.649356 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-45e1275b-3a0d-4593-b2dd-b639654a8744 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1722 microversion: 2.20 time: 0.171335 Oct 20 06:06:43.651045 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 130/284] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:06:43 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1722 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:06:43.851890 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-fb4a01f3-425e-4ff0-8755-118c474a3043 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:06:43.852502 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-fb4a01f3-425e-4ff0-8755-118c474a3043 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] [instance: d38a019f-4bfc-4845-900b-a9e4e6397373] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:06:43.858966 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-fb4a01f3-425e-4ff0-8755-118c474a3043 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:06:43.859458 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-fb4a01f3-425e-4ff0-8755-118c474a3043 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:06:43.859897 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-fb4a01f3-425e-4ff0-8755-118c474a3043 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:06:43.861099 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-fb4a01f3-425e-4ff0-8755-118c474a3043 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:06:43.861099 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-fb4a01f3-425e-4ff0-8755-118c474a3043 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:06:43.861489 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-fb4a01f3-425e-4ff0-8755-118c474a3043 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:06:43.885168 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-f0a5e2fc-808b-40d3-a229-d9e479b93fa9 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:06:43.885780 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-f0a5e2fc-808b-40d3-a229-d9e479b93fa9 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: 5a669c5b-898f-4fef-8508-254ccd998571] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:06:43.892305 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f0a5e2fc-808b-40d3-a229-d9e479b93fa9 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:06:43.893045 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f0a5e2fc-808b-40d3-a229-d9e479b93fa9 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:06:43.893483 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f0a5e2fc-808b-40d3-a229-d9e479b93fa9 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:06:43.894705 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f0a5e2fc-808b-40d3-a229-d9e479b93fa9 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:06:43.895164 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f0a5e2fc-808b-40d3-a229-d9e479b93fa9 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:06:43.895777 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f0a5e2fc-808b-40d3-a229-d9e479b93fa9 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:06:43.962381 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-f0a5e2fc-808b-40d3-a229-d9e479b93fa9 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:06:43.970396 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-f0a5e2fc-808b-40d3-a229-d9e479b93fa9 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/5a669c5b-898f-4fef-8508-254ccd998571" status: 200 len: 1300 microversion: 2.1 time: 0.089776 Oct 20 06:06:43.971193 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 131/285] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:06:43 2022] GET /compute/v2.1/servers/5a669c5b-898f-4fef-8508-254ccd998571 => generated 1300 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 06:06:44.038610 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-fb4a01f3-425e-4ff0-8755-118c474a3043 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d4cbd2a2154e5d925462df7c77815a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0d80988ca941acb8ad4318338dfbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:06:44.046956 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-fb4a01f3-425e-4ff0-8755-118c474a3043 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] 10.222.0.20 "GET /compute/v2.1/servers/d38a019f-4bfc-4845-900b-a9e4e6397373" status: 200 len: 1502 microversion: 2.1 time: 0.199408 Oct 20 06:06:44.047596 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 155/286] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:06:43 2022] GET /compute/v2.1/servers/d38a019f-4bfc-4845-900b-a9e4e6397373 => generated 1502 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:06:44.072876 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-86b1d6f8-e383-426e-87b7-4acbff14866a tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "547d79a1-59d6-45b8-a4d8-47557ee9846d"}} {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 06:06:44.075656 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-86b1d6f8-e383-426e-87b7-4acbff14866a tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] [instance: d38a019f-4bfc-4845-900b-a9e4e6397373] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:06:44.081641 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-86b1d6f8-e383-426e-87b7-4acbff14866a tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:06:44.082045 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-86b1d6f8-e383-426e-87b7-4acbff14866a tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:06:44.082488 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-86b1d6f8-e383-426e-87b7-4acbff14866a tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:06:44.083864 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-86b1d6f8-e383-426e-87b7-4acbff14866a tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:06:44.084802 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-86b1d6f8-e383-426e-87b7-4acbff14866a tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:06:44.085454 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-86b1d6f8-e383-426e-87b7-4acbff14866a tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:06:44.110700 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.wsgi [None req-86b1d6f8-e383-426e-87b7-4acbff14866a tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] HTTP exception thrown: Cannot 'attach_volume' instance d38a019f-4bfc-4845-900b-a9e4e6397373 while it is in vm_state rescued Oct 20 06:06:44.112380 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-86b1d6f8-e383-426e-87b7-4acbff14866a tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Request method failure captured: Oct 20 06:06:44.112380 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: request: POST /compute/v2.1/servers/d38a019f-4bfc-4845-900b-a9e4e6397373/os-volume_attachments HTTP/1.1 Oct 20 06:06:44.112380 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: Accept: application/json Oct 20 06:06:44.112380 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: Accept-Encoding: identity Oct 20 06:06:44.112380 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: Connection: close Oct 20 06:06:44.112380 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: Content-Length: 74 Oct 20 06:06:44.112380 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: Content-Type: application/json Oct 20 06:06:44.112380 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: Host: 10.222.0.20 Oct 20 06:06:44.112380 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: Openstack-System-Scope: None Oct 20 06:06:44.112380 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: User-Agent: python-urllib3/1.26.12 Oct 20 06:06:44.112380 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Auth-Token: gAAAAABjUOT2-FglyAobdOsIoXa2I6DRznal3Iq7fMTF8HI6G5YcCfomknnkPo7EFjjdZsTl7BVv0timK8MTu7wRa_roYL42t_YgASBwpM-lJk_PzcQvsocgThAGpTckdZz7QuynujWgj5fAj0dQo7xS5NqQC90KvEfG5PqmAbr7F9s3OXF4swA Oct 20 06:06:44.112380 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Domain-Id: None Oct 20 06:06:44.112380 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Domain-Name: None Oct 20 06:06:44.112380 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Identity-Status: Confirmed Oct 20 06:06:44.112380 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Is-Admin-Project: True Oct 20 06:06:44.112380 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Project-Domain-Id: default Oct 20 06:06:44.112380 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Project-Domain-Name: Default Oct 20 06:06:44.112380 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Project-Id: 9f0d80988ca941acb8ad4318338dfbea Oct 20 06:06:44.112380 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-647211481 Oct 20 06:06:44.112380 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Role: reader,member Oct 20 06:06:44.112380 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Roles: reader,member Oct 20 06:06:44.113670 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/9f0d80988ca941acb8ad4318338dfbea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_9f0d80988ca941acb8ad4318338dfbea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9f0d80988ca941acb8ad4318338dfbea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9f0d80988ca941acb8ad4318338dfbea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 20 06:06:44.113670 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Tenant: tempest-ServerRescueNegativeTestJSON-647211481 Oct 20 06:06:44.113670 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Tenant-Id: 9f0d80988ca941acb8ad4318338dfbea Oct 20 06:06:44.113670 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-647211481 Oct 20 06:06:44.113670 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-User: tempest-ServerRescueNegativeTestJSON-647211481-project Oct 20 06:06:44.113670 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-User-Domain-Id: default Oct 20 06:06:44.113670 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-User-Domain-Name: Default Oct 20 06:06:44.113670 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-User-Id: 57d4cbd2a2154e5d925462df7c77815a Oct 20 06:06:44.113670 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-User-Name: tempest-ServerRescueNegativeTestJSON-647211481-project Oct 20 06:06:44.113670 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: Oct 20 06:06:44.113670 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: {"volumeAttachment": {"volumeId": "547d79a1-59d6-45b8-a4d8-47557ee9846d"}} Oct 20 06:06:44.113670 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: method: > Oct 20 06:06:44.114356 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: exception: Cannot 'attach_volume' instance d38a019f-4bfc-4845-900b-a9e4e6397373 while it is in vm_state rescued Oct 20 06:06:44.114356 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: action_args: {'server_id': 'd38a019f-4bfc-4845-900b-a9e4e6397373', 'body': {'volumeAttachment': {'volumeId': '547d79a1-59d6-45b8-a4d8-47557ee9846d'}}} Oct 20 06:06:44.114356 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 20 06:06:44.114356 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 06:06:44.114356 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 20 06:06:44.114356 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 20 06:06:44.114356 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 20 06:06:44.114356 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 20 06:06:44.114356 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 20 06:06:44.114356 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 20 06:06:44.114356 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance d38a019f-4bfc-4845-900b-a9e4e6397373 in vm_state rescued. Cannot attach_volume while the instance is in this state. Oct 20 06:06:44.114356 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi Oct 20 06:06:44.114356 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 06:06:44.114356 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi Oct 20 06:06:44.114356 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 06:06:44.114356 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 06:06:44.114356 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 06:06:44.114356 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 20 06:06:44.114356 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 20 06:06:44.116071 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 20 06:06:44.116071 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 20 06:06:44.116071 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 20 06:06:44.116071 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 20 06:06:44.116071 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 20 06:06:44.116071 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 20 06:06:44.116071 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 20 06:06:44.116071 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 20 06:06:44.116071 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Oct 20 06:06:44.116071 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 20 06:06:44.116071 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 20 06:06:44.116071 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 20 06:06:44.116071 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance d38a019f-4bfc-4845-900b-a9e4e6397373 while it is in vm_state rescued Oct 20 06:06:44.116071 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi Oct 20 06:06:44.116071 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 06:06:44.116071 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi Oct 20 06:06:44.116071 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 06:06:44.116071 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 06:06:44.116071 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 06:06:44.117192 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 20 06:06:44.117192 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 20 06:06:44.117192 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance d38a019f-4bfc-4845-900b-a9e4e6397373 while it is in vm_state rescued Oct 20 06:06:44.117192 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi Oct 20 06:06:44.117192 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-86b1d6f8-e383-426e-87b7-4acbff14866a tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Returning 409 to user: Cannot 'attach_volume' instance d38a019f-4bfc-4845-900b-a9e4e6397373 while it is in vm_state rescued {{(pid=118860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 20 06:06:44.117192 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-86b1d6f8-e383-426e-87b7-4acbff14866a tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] 10.222.0.20 "POST /compute/v2.1/servers/d38a019f-4bfc-4845-900b-a9e4e6397373/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.046989 Oct 20 06:06:44.117192 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 132/287] 10.222.0.20 () {60 vars in 1323 bytes} [Thu Oct 20 06:06:44 2022] POST /compute/v2.1/servers/d38a019f-4bfc-4845-900b-a9e4e6397373/os-volume_attachments => generated 152 bytes in 48 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Oct 20 06:06:44.123318 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-5c7b1b30-4047-4070-a8fc-10ceeeb664a8 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 06:06:44.123849 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-5c7b1b30-4047-4070-a8fc-10ceeeb664a8 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] [instance: d38a019f-4bfc-4845-900b-a9e4e6397373] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:06:44.130334 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5c7b1b30-4047-4070-a8fc-10ceeeb664a8 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:06:44.132642 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5c7b1b30-4047-4070-a8fc-10ceeeb664a8 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:06:44.132642 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5c7b1b30-4047-4070-a8fc-10ceeeb664a8 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:06:44.132642 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5c7b1b30-4047-4070-a8fc-10ceeeb664a8 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:06:44.132642 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5c7b1b30-4047-4070-a8fc-10ceeeb664a8 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:06:44.133050 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5c7b1b30-4047-4070-a8fc-10ceeeb664a8 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:06:44.207432 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-5c7b1b30-4047-4070-a8fc-10ceeeb664a8 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] 10.222.0.20 "POST /compute/v2.1/servers/d38a019f-4bfc-4845-900b-a9e4e6397373/action" status: 202 len: 0 microversion: 2.1 time: 0.087742 Oct 20 06:06:44.208054 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 156/288] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Oct 20 06:06:44 2022] POST /compute/v2.1/servers/d38a019f-4bfc-4845-900b-a9e4e6397373/action => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 20 06:06:44.217515 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-16af8f11-2360-4fc4-b4a6-73e2a9b8f120 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:06:44.218140 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-16af8f11-2360-4fc4-b4a6-73e2a9b8f120 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] [instance: d38a019f-4bfc-4845-900b-a9e4e6397373] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:06:44.223956 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-16af8f11-2360-4fc4-b4a6-73e2a9b8f120 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:06:44.224629 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-16af8f11-2360-4fc4-b4a6-73e2a9b8f120 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:06:44.225727 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-16af8f11-2360-4fc4-b4a6-73e2a9b8f120 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:06:44.226738 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-16af8f11-2360-4fc4-b4a6-73e2a9b8f120 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:06:44.227192 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-16af8f11-2360-4fc4-b4a6-73e2a9b8f120 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:06:44.227610 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-16af8f11-2360-4fc4-b4a6-73e2a9b8f120 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:06:44.496177 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-16af8f11-2360-4fc4-b4a6-73e2a9b8f120 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d4cbd2a2154e5d925462df7c77815a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0d80988ca941acb8ad4318338dfbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:06:44.506527 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-16af8f11-2360-4fc4-b4a6-73e2a9b8f120 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] 10.222.0.20 "GET /compute/v2.1/servers/d38a019f-4bfc-4845-900b-a9e4e6397373" status: 200 len: 1510 microversion: 2.1 time: 0.292025 Oct 20 06:06:44.507727 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 133/289] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:06:44 2022] GET /compute/v2.1/servers/d38a019f-4bfc-4845-900b-a9e4e6397373 => generated 1510 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:06:44.677392 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-fdbdb419-f96b-45ee-bb7a-344d2fca13ab tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:06:44.678528 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-fdbdb419-f96b-45ee-bb7a-344d2fca13ab tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:06:44.691161 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-fdbdb419-f96b-45ee-bb7a-344d2fca13ab tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:06:44.694840 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-fdbdb419-f96b-45ee-bb7a-344d2fca13ab tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:06:44.695319 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-fdbdb419-f96b-45ee-bb7a-344d2fca13ab tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:06:44.699443 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-fdbdb419-f96b-45ee-bb7a-344d2fca13ab tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:06:44.699974 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-fdbdb419-f96b-45ee-bb7a-344d2fca13ab tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:06:44.700413 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-fdbdb419-f96b-45ee-bb7a-344d2fca13ab tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:06:44.928624 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-fdbdb419-f96b-45ee-bb7a-344d2fca13ab tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:06:44.937041 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-fdbdb419-f96b-45ee-bb7a-344d2fca13ab tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:06:44.938700 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-fdbdb419-f96b-45ee-bb7a-344d2fca13ab tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:06:44.939906 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-fdbdb419-f96b-45ee-bb7a-344d2fca13ab tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1722 microversion: 2.20 time: 0.267814 Oct 20 06:06:44.940622 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 157/290] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:06:44 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1722 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:06:44.994156 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-131218ee-0529-4103-8512-843c2a7833d8 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:06:44.994762 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-131218ee-0529-4103-8512-843c2a7833d8 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: 5a669c5b-898f-4fef-8508-254ccd998571] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:06:45.001367 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-131218ee-0529-4103-8512-843c2a7833d8 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:06:45.001852 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-131218ee-0529-4103-8512-843c2a7833d8 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:06:45.002307 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-131218ee-0529-4103-8512-843c2a7833d8 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:06:45.003002 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-131218ee-0529-4103-8512-843c2a7833d8 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:06:45.003453 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-131218ee-0529-4103-8512-843c2a7833d8 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:06:45.004096 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-131218ee-0529-4103-8512-843c2a7833d8 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:06:45.104163 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-131218ee-0529-4103-8512-843c2a7833d8 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:06:45.112203 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-131218ee-0529-4103-8512-843c2a7833d8 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/5a669c5b-898f-4fef-8508-254ccd998571" status: 200 len: 1298 microversion: 2.1 time: 0.121891 Oct 20 06:06:45.112890 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 134/291] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:06:44 2022] GET /compute/v2.1/servers/5a669c5b-898f-4fef-8508-254ccd998571 => generated 1298 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:06:45.530863 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-eba4b99f-da84-42e6-8fcb-2dba1c5a6a1a tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:06:45.531472 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-eba4b99f-da84-42e6-8fcb-2dba1c5a6a1a tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] [instance: d38a019f-4bfc-4845-900b-a9e4e6397373] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:06:45.539816 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-eba4b99f-da84-42e6-8fcb-2dba1c5a6a1a tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:06:45.540184 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-eba4b99f-da84-42e6-8fcb-2dba1c5a6a1a tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:06:45.540622 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-eba4b99f-da84-42e6-8fcb-2dba1c5a6a1a tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:06:45.541356 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-eba4b99f-da84-42e6-8fcb-2dba1c5a6a1a tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:06:45.541801 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-eba4b99f-da84-42e6-8fcb-2dba1c5a6a1a tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:06:45.547110 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-eba4b99f-da84-42e6-8fcb-2dba1c5a6a1a tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:06:45.703778 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-eba4b99f-da84-42e6-8fcb-2dba1c5a6a1a tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d4cbd2a2154e5d925462df7c77815a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0d80988ca941acb8ad4318338dfbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:06:45.715198 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-eba4b99f-da84-42e6-8fcb-2dba1c5a6a1a tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] 10.222.0.20 "GET /compute/v2.1/servers/d38a019f-4bfc-4845-900b-a9e4e6397373" status: 200 len: 1510 microversion: 2.1 time: 0.188088 Oct 20 06:06:45.716031 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 158/292] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:06:45 2022] GET /compute/v2.1/servers/d38a019f-4bfc-4845-900b-a9e4e6397373 => generated 1510 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:06:45.964186 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-e54daa50-6360-404c-9265-67f82a3ebc87 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:06:45.965045 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-e54daa50-6360-404c-9265-67f82a3ebc87 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:06:45.971578 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e54daa50-6360-404c-9265-67f82a3ebc87 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:06:45.972136 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e54daa50-6360-404c-9265-67f82a3ebc87 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:06:45.972831 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e54daa50-6360-404c-9265-67f82a3ebc87 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:06:45.973669 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e54daa50-6360-404c-9265-67f82a3ebc87 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:06:45.974200 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e54daa50-6360-404c-9265-67f82a3ebc87 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:06:45.975425 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e54daa50-6360-404c-9265-67f82a3ebc87 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:06:46.136514 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-b7c0df9b-4c13-4ab9-a616-dd612f7bc699 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:06:46.137312 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-b7c0df9b-4c13-4ab9-a616-dd612f7bc699 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: 5a669c5b-898f-4fef-8508-254ccd998571] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:06:46.144021 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b7c0df9b-4c13-4ab9-a616-dd612f7bc699 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:06:46.144870 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b7c0df9b-4c13-4ab9-a616-dd612f7bc699 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:06:46.145404 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b7c0df9b-4c13-4ab9-a616-dd612f7bc699 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:06:46.146507 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b7c0df9b-4c13-4ab9-a616-dd612f7bc699 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:06:46.147597 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b7c0df9b-4c13-4ab9-a616-dd612f7bc699 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:06:46.148121 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b7c0df9b-4c13-4ab9-a616-dd612f7bc699 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:06:46.217031 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-e54daa50-6360-404c-9265-67f82a3ebc87 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:06:46.233814 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-e54daa50-6360-404c-9265-67f82a3ebc87 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:06:46.235461 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-e54daa50-6360-404c-9265-67f82a3ebc87 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:06:46.237065 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-e54daa50-6360-404c-9265-67f82a3ebc87 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1722 microversion: 2.20 time: 0.276719 Oct 20 06:06:46.238094 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 135/293] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:06:45 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1722 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:06:46.317913 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-b7c0df9b-4c13-4ab9-a616-dd612f7bc699 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:06:46.327024 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-b7c0df9b-4c13-4ab9-a616-dd612f7bc699 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/5a669c5b-898f-4fef-8508-254ccd998571" status: 200 len: 1365 microversion: 2.1 time: 0.194810 Oct 20 06:06:46.327630 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 159/294] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:06:46 2022] GET /compute/v2.1/servers/5a669c5b-898f-4fef-8508-254ccd998571 => generated 1365 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 06:06:46.739304 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-bf9fb9f5-ebf1-408c-b9cf-d455277aa18f tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:06:46.739907 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-bf9fb9f5-ebf1-408c-b9cf-d455277aa18f tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] [instance: d38a019f-4bfc-4845-900b-a9e4e6397373] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:06:46.746099 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-bf9fb9f5-ebf1-408c-b9cf-d455277aa18f tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:06:46.746520 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-bf9fb9f5-ebf1-408c-b9cf-d455277aa18f tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:06:46.746958 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-bf9fb9f5-ebf1-408c-b9cf-d455277aa18f tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:06:46.747648 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-bf9fb9f5-ebf1-408c-b9cf-d455277aa18f tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:06:46.748100 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-bf9fb9f5-ebf1-408c-b9cf-d455277aa18f tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:06:46.748529 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-bf9fb9f5-ebf1-408c-b9cf-d455277aa18f tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:06:46.876767 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-bf9fb9f5-ebf1-408c-b9cf-d455277aa18f tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d4cbd2a2154e5d925462df7c77815a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0d80988ca941acb8ad4318338dfbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:06:46.885337 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-bf9fb9f5-ebf1-408c-b9cf-d455277aa18f tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] 10.222.0.20 "GET /compute/v2.1/servers/d38a019f-4bfc-4845-900b-a9e4e6397373" status: 200 len: 1510 microversion: 2.1 time: 0.149826 Oct 20 06:06:46.885912 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 136/295] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:06:46 2022] GET /compute/v2.1/servers/d38a019f-4bfc-4845-900b-a9e4e6397373 => generated 1510 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 06:06:47.263391 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-b39206c8-5ac1-4055-a02d-02dfb9851dc0 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:06:47.263993 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-b39206c8-5ac1-4055-a02d-02dfb9851dc0 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:06:47.270286 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b39206c8-5ac1-4055-a02d-02dfb9851dc0 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:06:47.270763 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b39206c8-5ac1-4055-a02d-02dfb9851dc0 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:06:47.271190 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b39206c8-5ac1-4055-a02d-02dfb9851dc0 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:06:47.272394 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b39206c8-5ac1-4055-a02d-02dfb9851dc0 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:06:47.272870 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b39206c8-5ac1-4055-a02d-02dfb9851dc0 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:06:47.273290 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b39206c8-5ac1-4055-a02d-02dfb9851dc0 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:06:47.353756 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-18f24c81-ada3-4a5b-a60c-877a6d0f74c9 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:06:47.354370 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-18f24c81-ada3-4a5b-a60c-877a6d0f74c9 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: 5a669c5b-898f-4fef-8508-254ccd998571] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:06:47.360948 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-18f24c81-ada3-4a5b-a60c-877a6d0f74c9 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:06:47.361437 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-18f24c81-ada3-4a5b-a60c-877a6d0f74c9 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:06:47.361874 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-18f24c81-ada3-4a5b-a60c-877a6d0f74c9 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:06:47.362749 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-18f24c81-ada3-4a5b-a60c-877a6d0f74c9 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:06:47.363205 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-18f24c81-ada3-4a5b-a60c-877a6d0f74c9 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:06:47.363803 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-18f24c81-ada3-4a5b-a60c-877a6d0f74c9 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:06:47.409011 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-b39206c8-5ac1-4055-a02d-02dfb9851dc0 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:06:47.417837 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-b39206c8-5ac1-4055-a02d-02dfb9851dc0 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:06:47.419288 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-b39206c8-5ac1-4055-a02d-02dfb9851dc0 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:06:47.420445 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-b39206c8-5ac1-4055-a02d-02dfb9851dc0 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1722 microversion: 2.20 time: 0.160931 Oct 20 06:06:47.421029 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 160/296] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:06:47 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:06:47.507458 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-18f24c81-ada3-4a5b-a60c-877a6d0f74c9 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:06:47.515602 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-18f24c81-ada3-4a5b-a60c-877a6d0f74c9 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/5a669c5b-898f-4fef-8508-254ccd998571" status: 200 len: 1365 microversion: 2.1 time: 0.166472 Oct 20 06:06:47.516159 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 137/297] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:06:47 2022] GET /compute/v2.1/servers/5a669c5b-898f-4fef-8508-254ccd998571 => generated 1365 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 06:06:47.907389 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-d7841a88-c368-48e4-882f-1cdee3ad36f6 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:06:47.908100 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-d7841a88-c368-48e4-882f-1cdee3ad36f6 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] [instance: d38a019f-4bfc-4845-900b-a9e4e6397373] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:06:47.914148 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d7841a88-c368-48e4-882f-1cdee3ad36f6 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:06:47.914574 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d7841a88-c368-48e4-882f-1cdee3ad36f6 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:06:47.915011 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d7841a88-c368-48e4-882f-1cdee3ad36f6 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:06:47.915709 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d7841a88-c368-48e4-882f-1cdee3ad36f6 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:06:47.916162 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d7841a88-c368-48e4-882f-1cdee3ad36f6 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:06:47.916590 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d7841a88-c368-48e4-882f-1cdee3ad36f6 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:06:48.047690 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-d7841a88-c368-48e4-882f-1cdee3ad36f6 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d4cbd2a2154e5d925462df7c77815a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0d80988ca941acb8ad4318338dfbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:06:48.055325 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-d7841a88-c368-48e4-882f-1cdee3ad36f6 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] 10.222.0.20 "GET /compute/v2.1/servers/d38a019f-4bfc-4845-900b-a9e4e6397373" status: 200 len: 1510 microversion: 2.1 time: 0.151863 Oct 20 06:06:48.055881 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 161/298] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:06:47 2022] GET /compute/v2.1/servers/d38a019f-4bfc-4845-900b-a9e4e6397373 => generated 1510 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:06:48.446613 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-7c6aac42-f652-4bb2-ae78-7b45c1515bd2 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:06:48.447843 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-7c6aac42-f652-4bb2-ae78-7b45c1515bd2 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:06:48.458951 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7c6aac42-f652-4bb2-ae78-7b45c1515bd2 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:06:48.459436 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7c6aac42-f652-4bb2-ae78-7b45c1515bd2 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:06:48.459868 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7c6aac42-f652-4bb2-ae78-7b45c1515bd2 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:06:48.460570 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7c6aac42-f652-4bb2-ae78-7b45c1515bd2 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:06:48.461054 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7c6aac42-f652-4bb2-ae78-7b45c1515bd2 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:06:48.461478 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7c6aac42-f652-4bb2-ae78-7b45c1515bd2 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:06:48.465652 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG dbcounter [-] [118860] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=118860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:06:48.539569 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-ef852533-0c7b-43cb-a568-30e862569f66 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:06:48.540558 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-ef852533-0c7b-43cb-a568-30e862569f66 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: 5a669c5b-898f-4fef-8508-254ccd998571] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:06:48.546739 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ef852533-0c7b-43cb-a568-30e862569f66 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:06:48.547155 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ef852533-0c7b-43cb-a568-30e862569f66 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:06:48.547586 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ef852533-0c7b-43cb-a568-30e862569f66 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:06:48.548279 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ef852533-0c7b-43cb-a568-30e862569f66 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:06:48.548747 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ef852533-0c7b-43cb-a568-30e862569f66 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:06:48.549171 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ef852533-0c7b-43cb-a568-30e862569f66 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:06:48.593576 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-7c6aac42-f652-4bb2-ae78-7b45c1515bd2 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:06:48.602461 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-7c6aac42-f652-4bb2-ae78-7b45c1515bd2 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:06:48.603921 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-7c6aac42-f652-4bb2-ae78-7b45c1515bd2 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:06:48.605117 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-7c6aac42-f652-4bb2-ae78-7b45c1515bd2 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1722 microversion: 2.20 time: 0.162815 Oct 20 06:06:48.605672 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 138/299] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:06:48 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:06:48.675563 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-ef852533-0c7b-43cb-a568-30e862569f66 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:06:48.683008 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-ef852533-0c7b-43cb-a568-30e862569f66 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/5a669c5b-898f-4fef-8508-254ccd998571" status: 200 len: 1365 microversion: 2.1 time: 0.148373 Oct 20 06:06:48.683565 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 162/300] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:06:48 2022] GET /compute/v2.1/servers/5a669c5b-898f-4fef-8508-254ccd998571 => generated 1365 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 06:06:49.077351 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-cfec3f3c-3130-41c6-b963-b032f929cda5 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:06:49.077959 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-cfec3f3c-3130-41c6-b963-b032f929cda5 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] [instance: d38a019f-4bfc-4845-900b-a9e4e6397373] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:06:49.084403 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-cfec3f3c-3130-41c6-b963-b032f929cda5 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:06:49.085092 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-cfec3f3c-3130-41c6-b963-b032f929cda5 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:06:49.085526 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-cfec3f3c-3130-41c6-b963-b032f929cda5 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:06:49.086208 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-cfec3f3c-3130-41c6-b963-b032f929cda5 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:06:49.086655 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-cfec3f3c-3130-41c6-b963-b032f929cda5 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:06:49.087075 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-cfec3f3c-3130-41c6-b963-b032f929cda5 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:06:49.216740 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-cfec3f3c-3130-41c6-b963-b032f929cda5 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d4cbd2a2154e5d925462df7c77815a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0d80988ca941acb8ad4318338dfbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:06:49.224280 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-cfec3f3c-3130-41c6-b963-b032f929cda5 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] 10.222.0.20 "GET /compute/v2.1/servers/d38a019f-4bfc-4845-900b-a9e4e6397373" status: 200 len: 1510 microversion: 2.1 time: 0.151089 Oct 20 06:06:49.225642 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 139/301] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:06:49 2022] GET /compute/v2.1/servers/d38a019f-4bfc-4845-900b-a9e4e6397373 => generated 1510 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:06:49.631853 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-def5001d-ea23-499b-8f44-6d287775c51c tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:06:49.632457 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-def5001d-ea23-499b-8f44-6d287775c51c tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:06:49.639024 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-def5001d-ea23-499b-8f44-6d287775c51c tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:06:49.639495 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-def5001d-ea23-499b-8f44-6d287775c51c tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:06:49.639926 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-def5001d-ea23-499b-8f44-6d287775c51c tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:06:49.640611 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-def5001d-ea23-499b-8f44-6d287775c51c tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:06:49.641082 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-def5001d-ea23-499b-8f44-6d287775c51c tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:06:49.641674 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-def5001d-ea23-499b-8f44-6d287775c51c tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:06:49.704792 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-49b6794e-4db2-4159-8024-15897522ba47 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:06:49.705460 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-49b6794e-4db2-4159-8024-15897522ba47 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: 5a669c5b-898f-4fef-8508-254ccd998571] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:06:49.712939 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-49b6794e-4db2-4159-8024-15897522ba47 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:06:49.713428 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-49b6794e-4db2-4159-8024-15897522ba47 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:06:49.713870 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-49b6794e-4db2-4159-8024-15897522ba47 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:06:49.714626 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-49b6794e-4db2-4159-8024-15897522ba47 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:06:49.715090 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-49b6794e-4db2-4159-8024-15897522ba47 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:06:49.715513 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-49b6794e-4db2-4159-8024-15897522ba47 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:06:49.778138 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-def5001d-ea23-499b-8f44-6d287775c51c tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:06:49.789629 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-def5001d-ea23-499b-8f44-6d287775c51c tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:06:49.791083 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-def5001d-ea23-499b-8f44-6d287775c51c tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:06:49.792263 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-def5001d-ea23-499b-8f44-6d287775c51c tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1722 microversion: 2.20 time: 0.165122 Oct 20 06:06:49.792998 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 163/302] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:06:49 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:06:49.854607 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-49b6794e-4db2-4159-8024-15897522ba47 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:06:49.862273 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-49b6794e-4db2-4159-8024-15897522ba47 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/5a669c5b-898f-4fef-8508-254ccd998571" status: 200 len: 1365 microversion: 2.1 time: 0.161422 Oct 20 06:06:49.862832 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 140/303] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:06:49 2022] GET /compute/v2.1/servers/5a669c5b-898f-4fef-8508-254ccd998571 => generated 1365 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 06:06:50.247308 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-2696c95a-e544-48d8-9134-77b1d061ec2c tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:06:50.247816 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-2696c95a-e544-48d8-9134-77b1d061ec2c tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] [instance: d38a019f-4bfc-4845-900b-a9e4e6397373] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:06:50.253697 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-2696c95a-e544-48d8-9134-77b1d061ec2c tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:06:50.254180 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-2696c95a-e544-48d8-9134-77b1d061ec2c tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:06:50.254615 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-2696c95a-e544-48d8-9134-77b1d061ec2c tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:06:50.255304 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-2696c95a-e544-48d8-9134-77b1d061ec2c tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:06:50.256882 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-2696c95a-e544-48d8-9134-77b1d061ec2c tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:06:50.257315 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-2696c95a-e544-48d8-9134-77b1d061ec2c tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:06:50.386948 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-2696c95a-e544-48d8-9134-77b1d061ec2c tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d4cbd2a2154e5d925462df7c77815a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0d80988ca941acb8ad4318338dfbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:06:50.394484 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-2696c95a-e544-48d8-9134-77b1d061ec2c tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] 10.222.0.20 "GET /compute/v2.1/servers/d38a019f-4bfc-4845-900b-a9e4e6397373" status: 200 len: 1510 microversion: 2.1 time: 0.151194 Oct 20 06:06:50.395035 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 164/304] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:06:50 2022] GET /compute/v2.1/servers/d38a019f-4bfc-4845-900b-a9e4e6397373 => generated 1510 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:06:50.818089 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-c59a7f77-c2e4-4c1d-8aa1-1dc474e190d9 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:06:50.818694 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-c59a7f77-c2e4-4c1d-8aa1-1dc474e190d9 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:06:50.820723 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG dbcounter [-] [118860] Writing DB stats nova_cell0:SELECT=2 {{(pid=118860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:06:50.821361 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG dbcounter [-] [118860] Writing DB stats nova_cell0:SELECT=10 {{(pid=118860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:06:50.828127 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c59a7f77-c2e4-4c1d-8aa1-1dc474e190d9 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:06:50.828610 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c59a7f77-c2e4-4c1d-8aa1-1dc474e190d9 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:06:50.829073 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c59a7f77-c2e4-4c1d-8aa1-1dc474e190d9 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:06:50.829765 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c59a7f77-c2e4-4c1d-8aa1-1dc474e190d9 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:06:50.830215 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c59a7f77-c2e4-4c1d-8aa1-1dc474e190d9 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:06:50.830646 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c59a7f77-c2e4-4c1d-8aa1-1dc474e190d9 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:06:50.885969 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-3939aa93-5d28-4a7a-971f-81d71413b7fa tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:06:50.886579 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-3939aa93-5d28-4a7a-971f-81d71413b7fa tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: 5a669c5b-898f-4fef-8508-254ccd998571] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:06:50.888508 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG dbcounter [-] [118861] Writing DB stats nova_cell0:SELECT=2 {{(pid=118861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:06:50.894360 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-3939aa93-5d28-4a7a-971f-81d71413b7fa tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:06:50.894840 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-3939aa93-5d28-4a7a-971f-81d71413b7fa tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:06:50.895277 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-3939aa93-5d28-4a7a-971f-81d71413b7fa tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:06:50.895968 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-3939aa93-5d28-4a7a-971f-81d71413b7fa tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:06:50.896418 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-3939aa93-5d28-4a7a-971f-81d71413b7fa tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:06:50.896868 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-3939aa93-5d28-4a7a-971f-81d71413b7fa tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:06:50.967992 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-c59a7f77-c2e4-4c1d-8aa1-1dc474e190d9 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:06:50.977036 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-c59a7f77-c2e4-4c1d-8aa1-1dc474e190d9 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:06:50.978558 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-c59a7f77-c2e4-4c1d-8aa1-1dc474e190d9 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:06:50.979728 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-c59a7f77-c2e4-4c1d-8aa1-1dc474e190d9 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1722 microversion: 2.20 time: 0.165604 Oct 20 06:06:50.980278 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 141/305] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:06:50 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1722 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:06:51.026767 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-3939aa93-5d28-4a7a-971f-81d71413b7fa tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:06:51.034405 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-3939aa93-5d28-4a7a-971f-81d71413b7fa tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/5a669c5b-898f-4fef-8508-254ccd998571" status: 200 len: 1365 microversion: 2.1 time: 0.152839 Oct 20 06:06:51.034972 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 165/306] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:06:50 2022] GET /compute/v2.1/servers/5a669c5b-898f-4fef-8508-254ccd998571 => generated 1365 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 06:06:51.417699 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-45d85c92-c55f-433a-bd4e-6dac218b9878 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:06:51.418327 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-45d85c92-c55f-433a-bd4e-6dac218b9878 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] [instance: d38a019f-4bfc-4845-900b-a9e4e6397373] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:06:51.424210 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-45d85c92-c55f-433a-bd4e-6dac218b9878 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:06:51.424686 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-45d85c92-c55f-433a-bd4e-6dac218b9878 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:06:51.425142 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-45d85c92-c55f-433a-bd4e-6dac218b9878 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:06:51.425822 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-45d85c92-c55f-433a-bd4e-6dac218b9878 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:06:51.426270 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-45d85c92-c55f-433a-bd4e-6dac218b9878 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:06:51.426692 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-45d85c92-c55f-433a-bd4e-6dac218b9878 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:06:51.560931 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-45d85c92-c55f-433a-bd4e-6dac218b9878 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d4cbd2a2154e5d925462df7c77815a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0d80988ca941acb8ad4318338dfbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:06:51.568648 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-45d85c92-c55f-433a-bd4e-6dac218b9878 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] 10.222.0.20 "GET /compute/v2.1/servers/d38a019f-4bfc-4845-900b-a9e4e6397373" status: 200 len: 1510 microversion: 2.1 time: 0.155327 Oct 20 06:06:51.569263 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 142/307] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:06:51 2022] GET /compute/v2.1/servers/d38a019f-4bfc-4845-900b-a9e4e6397373 => generated 1510 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:06:52.005250 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-4224202a-af40-459d-8177-3c3f6fb0ffb4 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:06:52.005864 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-4224202a-af40-459d-8177-3c3f6fb0ffb4 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:06:52.013092 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4224202a-af40-459d-8177-3c3f6fb0ffb4 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:06:52.013579 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4224202a-af40-459d-8177-3c3f6fb0ffb4 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:06:52.014020 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4224202a-af40-459d-8177-3c3f6fb0ffb4 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:06:52.014714 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4224202a-af40-459d-8177-3c3f6fb0ffb4 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:06:52.015168 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4224202a-af40-459d-8177-3c3f6fb0ffb4 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:06:52.015594 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4224202a-af40-459d-8177-3c3f6fb0ffb4 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:06:52.057039 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-6e0fdc39-dd0c-4b18-8d93-9efdaeab031c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:06:52.058283 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-6e0fdc39-dd0c-4b18-8d93-9efdaeab031c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: 5a669c5b-898f-4fef-8508-254ccd998571] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:06:52.064780 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-6e0fdc39-dd0c-4b18-8d93-9efdaeab031c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:06:52.065264 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-6e0fdc39-dd0c-4b18-8d93-9efdaeab031c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:06:52.065694 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-6e0fdc39-dd0c-4b18-8d93-9efdaeab031c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:06:52.066390 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-6e0fdc39-dd0c-4b18-8d93-9efdaeab031c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:06:52.066836 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-6e0fdc39-dd0c-4b18-8d93-9efdaeab031c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:06:52.067256 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-6e0fdc39-dd0c-4b18-8d93-9efdaeab031c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:06:52.152145 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-4224202a-af40-459d-8177-3c3f6fb0ffb4 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:06:52.160435 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-4224202a-af40-459d-8177-3c3f6fb0ffb4 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:06:52.161904 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-4224202a-af40-459d-8177-3c3f6fb0ffb4 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:06:52.163092 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-4224202a-af40-459d-8177-3c3f6fb0ffb4 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1722 microversion: 2.20 time: 0.161722 Oct 20 06:06:52.163720 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 166/308] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:06:52 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:06:52.203311 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-6e0fdc39-dd0c-4b18-8d93-9efdaeab031c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:06:52.211827 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-6e0fdc39-dd0c-4b18-8d93-9efdaeab031c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/5a669c5b-898f-4fef-8508-254ccd998571" status: 200 len: 1365 microversion: 2.1 time: 0.158855 Oct 20 06:06:52.212390 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 143/309] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:06:52 2022] GET /compute/v2.1/servers/5a669c5b-898f-4fef-8508-254ccd998571 => generated 1365 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 06:06:52.594959 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-ebcba02a-928d-46a1-8ced-b542e3815e9d tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:06:52.595689 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-ebcba02a-928d-46a1-8ced-b542e3815e9d tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] [instance: d38a019f-4bfc-4845-900b-a9e4e6397373] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:06:52.602351 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ebcba02a-928d-46a1-8ced-b542e3815e9d tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:06:52.602806 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ebcba02a-928d-46a1-8ced-b542e3815e9d tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:06:52.603229 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ebcba02a-928d-46a1-8ced-b542e3815e9d tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:06:52.603930 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ebcba02a-928d-46a1-8ced-b542e3815e9d tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:06:52.604374 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ebcba02a-928d-46a1-8ced-b542e3815e9d tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:06:52.604818 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ebcba02a-928d-46a1-8ced-b542e3815e9d tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:06:52.760496 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-ebcba02a-928d-46a1-8ced-b542e3815e9d tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d4cbd2a2154e5d925462df7c77815a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0d80988ca941acb8ad4318338dfbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:06:52.772288 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-ebcba02a-928d-46a1-8ced-b542e3815e9d tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] 10.222.0.20 "GET /compute/v2.1/servers/d38a019f-4bfc-4845-900b-a9e4e6397373" status: 200 len: 1510 microversion: 2.1 time: 0.183896 Oct 20 06:06:52.773156 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 167/310] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:06:52 2022] GET /compute/v2.1/servers/d38a019f-4bfc-4845-900b-a9e4e6397373 => generated 1510 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:06:53.188075 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-7d116031-4c97-442d-9b30-5a1e9b136bc4 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:06:53.188765 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-7d116031-4c97-442d-9b30-5a1e9b136bc4 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:06:53.195703 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7d116031-4c97-442d-9b30-5a1e9b136bc4 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:06:53.196185 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7d116031-4c97-442d-9b30-5a1e9b136bc4 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:06:53.196650 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7d116031-4c97-442d-9b30-5a1e9b136bc4 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:06:53.197376 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7d116031-4c97-442d-9b30-5a1e9b136bc4 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:06:53.197831 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7d116031-4c97-442d-9b30-5a1e9b136bc4 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:06:53.198257 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7d116031-4c97-442d-9b30-5a1e9b136bc4 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:06:53.234149 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-772f3f01-d005-48cd-a5d6-1e05e52ff20a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:06:53.234755 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-772f3f01-d005-48cd-a5d6-1e05e52ff20a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: 5a669c5b-898f-4fef-8508-254ccd998571] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:06:53.241417 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-772f3f01-d005-48cd-a5d6-1e05e52ff20a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:06:53.242225 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-772f3f01-d005-48cd-a5d6-1e05e52ff20a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:06:53.242682 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-772f3f01-d005-48cd-a5d6-1e05e52ff20a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:06:53.243396 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-772f3f01-d005-48cd-a5d6-1e05e52ff20a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:06:53.243851 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-772f3f01-d005-48cd-a5d6-1e05e52ff20a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:06:53.244277 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-772f3f01-d005-48cd-a5d6-1e05e52ff20a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:06:53.338101 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-7d116031-4c97-442d-9b30-5a1e9b136bc4 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:06:53.346234 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-7d116031-4c97-442d-9b30-5a1e9b136bc4 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:06:53.347673 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-7d116031-4c97-442d-9b30-5a1e9b136bc4 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:06:53.348855 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-7d116031-4c97-442d-9b30-5a1e9b136bc4 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1722 microversion: 2.20 time: 0.164721 Oct 20 06:06:53.349412 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 144/311] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:06:53 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:06:53.380844 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-772f3f01-d005-48cd-a5d6-1e05e52ff20a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:06:53.384554 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG dbcounter [-] [118861] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:06:53.390142 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-772f3f01-d005-48cd-a5d6-1e05e52ff20a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/5a669c5b-898f-4fef-8508-254ccd998571" status: 200 len: 1365 microversion: 2.1 time: 0.159341 Oct 20 06:06:53.391049 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 168/312] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:06:53 2022] GET /compute/v2.1/servers/5a669c5b-898f-4fef-8508-254ccd998571 => generated 1365 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 06:06:53.798918 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-084d036d-aba4-4929-a98f-45fa3267fa65 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:06:53.799523 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-084d036d-aba4-4929-a98f-45fa3267fa65 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] [instance: d38a019f-4bfc-4845-900b-a9e4e6397373] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:06:53.806522 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-084d036d-aba4-4929-a98f-45fa3267fa65 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:06:53.807038 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-084d036d-aba4-4929-a98f-45fa3267fa65 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:06:53.807474 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-084d036d-aba4-4929-a98f-45fa3267fa65 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:06:53.808169 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-084d036d-aba4-4929-a98f-45fa3267fa65 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:06:53.808624 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-084d036d-aba4-4929-a98f-45fa3267fa65 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:06:53.809080 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-084d036d-aba4-4929-a98f-45fa3267fa65 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:06:53.935631 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-084d036d-aba4-4929-a98f-45fa3267fa65 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d4cbd2a2154e5d925462df7c77815a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0d80988ca941acb8ad4318338dfbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:06:53.943177 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-084d036d-aba4-4929-a98f-45fa3267fa65 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] 10.222.0.20 "GET /compute/v2.1/servers/d38a019f-4bfc-4845-900b-a9e4e6397373" status: 200 len: 1510 microversion: 2.1 time: 0.148124 Oct 20 06:06:53.943732 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 145/313] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:06:53 2022] GET /compute/v2.1/servers/d38a019f-4bfc-4845-900b-a9e4e6397373 => generated 1510 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:06:54.375341 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-67fafed8-1486-4948-89c0-5bbef522c213 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:06:54.375997 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-67fafed8-1486-4948-89c0-5bbef522c213 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:06:54.378304 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG dbcounter [-] [118861] Writing DB stats nova_api:SELECT=66 {{(pid=118861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:06:54.384400 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-67fafed8-1486-4948-89c0-5bbef522c213 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:06:54.384908 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-67fafed8-1486-4948-89c0-5bbef522c213 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:06:54.385361 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-67fafed8-1486-4948-89c0-5bbef522c213 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:06:54.386031 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-67fafed8-1486-4948-89c0-5bbef522c213 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:06:54.386478 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-67fafed8-1486-4948-89c0-5bbef522c213 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:06:54.386898 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-67fafed8-1486-4948-89c0-5bbef522c213 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:06:54.414088 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-e54db69e-db43-498d-a223-822200eb11cf tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:06:54.415181 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-e54db69e-db43-498d-a223-822200eb11cf tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: 5a669c5b-898f-4fef-8508-254ccd998571] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:06:54.422139 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e54db69e-db43-498d-a223-822200eb11cf tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:06:54.422619 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e54db69e-db43-498d-a223-822200eb11cf tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:06:54.423054 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e54db69e-db43-498d-a223-822200eb11cf tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:06:54.423747 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e54db69e-db43-498d-a223-822200eb11cf tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:06:54.424202 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e54db69e-db43-498d-a223-822200eb11cf tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:06:54.424625 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e54db69e-db43-498d-a223-822200eb11cf tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:06:54.529565 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-67fafed8-1486-4948-89c0-5bbef522c213 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:06:54.537696 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-67fafed8-1486-4948-89c0-5bbef522c213 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:06:54.539130 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-67fafed8-1486-4948-89c0-5bbef522c213 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:06:54.540411 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-67fafed8-1486-4948-89c0-5bbef522c213 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1722 microversion: 2.20 time: 0.169246 Oct 20 06:06:54.541302 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 169/314] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:06:54 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1722 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:06:54.559233 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-e54db69e-db43-498d-a223-822200eb11cf tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:06:54.566794 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-e54db69e-db43-498d-a223-822200eb11cf tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/5a669c5b-898f-4fef-8508-254ccd998571" status: 200 len: 1365 microversion: 2.1 time: 0.156490 Oct 20 06:06:54.567350 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 146/315] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:06:54 2022] GET /compute/v2.1/servers/5a669c5b-898f-4fef-8508-254ccd998571 => generated 1365 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 06:06:54.966737 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-71950fdc-79cb-44bb-8b3c-5b9b1584db45 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:06:54.967342 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-71950fdc-79cb-44bb-8b3c-5b9b1584db45 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] [instance: d38a019f-4bfc-4845-900b-a9e4e6397373] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:06:54.973360 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-71950fdc-79cb-44bb-8b3c-5b9b1584db45 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:06:54.973837 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-71950fdc-79cb-44bb-8b3c-5b9b1584db45 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:06:54.974270 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-71950fdc-79cb-44bb-8b3c-5b9b1584db45 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:06:54.974950 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-71950fdc-79cb-44bb-8b3c-5b9b1584db45 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:06:54.975399 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-71950fdc-79cb-44bb-8b3c-5b9b1584db45 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:06:54.975819 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-71950fdc-79cb-44bb-8b3c-5b9b1584db45 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:06:55.106776 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-71950fdc-79cb-44bb-8b3c-5b9b1584db45 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d4cbd2a2154e5d925462df7c77815a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0d80988ca941acb8ad4318338dfbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:06:55.114483 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-71950fdc-79cb-44bb-8b3c-5b9b1584db45 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] 10.222.0.20 "GET /compute/v2.1/servers/d38a019f-4bfc-4845-900b-a9e4e6397373" status: 200 len: 1510 microversion: 2.1 time: 0.151528 Oct 20 06:06:55.115043 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 170/316] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:06:54 2022] GET /compute/v2.1/servers/d38a019f-4bfc-4845-900b-a9e4e6397373 => generated 1510 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:06:55.566117 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-44ae0649-081c-487b-a0cc-18ecdbe24fcf tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:06:55.566716 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-44ae0649-081c-487b-a0cc-18ecdbe24fcf tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:06:55.569024 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG dbcounter [-] [118860] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=4 {{(pid=118860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:06:55.574690 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-44ae0649-081c-487b-a0cc-18ecdbe24fcf tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:06:55.575170 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-44ae0649-081c-487b-a0cc-18ecdbe24fcf tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:06:55.575598 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-44ae0649-081c-487b-a0cc-18ecdbe24fcf tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:06:55.576287 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-44ae0649-081c-487b-a0cc-18ecdbe24fcf tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:06:55.576877 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-44ae0649-081c-487b-a0cc-18ecdbe24fcf tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:06:55.577317 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-44ae0649-081c-487b-a0cc-18ecdbe24fcf tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:06:55.590905 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-7dc98237-7707-42a9-9549-8e33f27b752d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:06:55.591531 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-7dc98237-7707-42a9-9549-8e33f27b752d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: 5a669c5b-898f-4fef-8508-254ccd998571] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:06:55.597783 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7dc98237-7707-42a9-9549-8e33f27b752d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:06:55.598291 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7dc98237-7707-42a9-9549-8e33f27b752d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:06:55.598726 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7dc98237-7707-42a9-9549-8e33f27b752d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:06:55.599421 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7dc98237-7707-42a9-9549-8e33f27b752d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:06:55.599875 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7dc98237-7707-42a9-9549-8e33f27b752d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:06:55.600299 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7dc98237-7707-42a9-9549-8e33f27b752d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:06:55.706941 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-44ae0649-081c-487b-a0cc-18ecdbe24fcf tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:06:55.715047 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-44ae0649-081c-487b-a0cc-18ecdbe24fcf tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:06:55.716489 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-44ae0649-081c-487b-a0cc-18ecdbe24fcf tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:06:55.717788 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-44ae0649-081c-487b-a0cc-18ecdbe24fcf tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1722 microversion: 2.20 time: 0.155432 Oct 20 06:06:55.718339 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 147/317] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:06:55 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:06:55.734298 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-7dc98237-7707-42a9-9549-8e33f27b752d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:06:55.741867 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-7dc98237-7707-42a9-9549-8e33f27b752d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/5a669c5b-898f-4fef-8508-254ccd998571" status: 200 len: 1365 microversion: 2.1 time: 0.155850 Oct 20 06:06:55.742431 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 171/318] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:06:55 2022] GET /compute/v2.1/servers/5a669c5b-898f-4fef-8508-254ccd998571 => generated 1365 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 06:06:56.138728 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-4258a86a-521b-471d-988e-bb415fd912ac tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:06:56.139340 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-4258a86a-521b-471d-988e-bb415fd912ac tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] [instance: d38a019f-4bfc-4845-900b-a9e4e6397373] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:06:56.145361 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-4258a86a-521b-471d-988e-bb415fd912ac tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:06:56.145852 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-4258a86a-521b-471d-988e-bb415fd912ac tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:06:56.146320 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-4258a86a-521b-471d-988e-bb415fd912ac tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:06:56.147056 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-4258a86a-521b-471d-988e-bb415fd912ac tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:06:56.147516 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-4258a86a-521b-471d-988e-bb415fd912ac tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:06:56.147948 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-4258a86a-521b-471d-988e-bb415fd912ac tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:06:56.277908 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-4258a86a-521b-471d-988e-bb415fd912ac tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d4cbd2a2154e5d925462df7c77815a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0d80988ca941acb8ad4318338dfbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:06:56.285495 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-4258a86a-521b-471d-988e-bb415fd912ac tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] 10.222.0.20 "GET /compute/v2.1/servers/d38a019f-4bfc-4845-900b-a9e4e6397373" status: 200 len: 1510 microversion: 2.1 time: 0.150633 Oct 20 06:06:56.286050 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 148/319] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:06:56 2022] GET /compute/v2.1/servers/d38a019f-4bfc-4845-900b-a9e4e6397373 => generated 1510 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:06:56.744019 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-6d9f7af6-df42-4984-af55-9d5af41977f1 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:06:56.744626 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-6d9f7af6-df42-4984-af55-9d5af41977f1 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:06:56.751025 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-6d9f7af6-df42-4984-af55-9d5af41977f1 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:06:56.751514 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-6d9f7af6-df42-4984-af55-9d5af41977f1 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:06:56.751954 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-6d9f7af6-df42-4984-af55-9d5af41977f1 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:06:56.752653 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-6d9f7af6-df42-4984-af55-9d5af41977f1 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:06:56.753135 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-6d9f7af6-df42-4984-af55-9d5af41977f1 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:06:56.753566 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-6d9f7af6-df42-4984-af55-9d5af41977f1 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:06:56.763525 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-8b4195c7-5578-45c4-90ec-8333688713ff tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:06:56.764151 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-8b4195c7-5578-45c4-90ec-8333688713ff tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: 5a669c5b-898f-4fef-8508-254ccd998571] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:06:56.770506 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-8b4195c7-5578-45c4-90ec-8333688713ff tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:06:56.770980 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-8b4195c7-5578-45c4-90ec-8333688713ff tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:06:56.771411 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-8b4195c7-5578-45c4-90ec-8333688713ff tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:06:56.772093 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-8b4195c7-5578-45c4-90ec-8333688713ff tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:06:56.772548 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-8b4195c7-5578-45c4-90ec-8333688713ff tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:06:56.773008 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-8b4195c7-5578-45c4-90ec-8333688713ff tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:06:56.885238 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-6d9f7af6-df42-4984-af55-9d5af41977f1 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:06:56.893842 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-6d9f7af6-df42-4984-af55-9d5af41977f1 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:06:56.895335 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-6d9f7af6-df42-4984-af55-9d5af41977f1 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:06:56.896619 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-6d9f7af6-df42-4984-af55-9d5af41977f1 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1722 microversion: 2.20 time: 0.157060 Oct 20 06:06:56.897497 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 172/320] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:06:56 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:06:56.916357 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-8b4195c7-5578-45c4-90ec-8333688713ff tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:06:56.924120 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-8b4195c7-5578-45c4-90ec-8333688713ff tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/5a669c5b-898f-4fef-8508-254ccd998571" status: 200 len: 1365 microversion: 2.1 time: 0.164397 Oct 20 06:06:56.924678 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 149/321] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:06:56 2022] GET /compute/v2.1/servers/5a669c5b-898f-4fef-8508-254ccd998571 => generated 1365 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:06:57.307679 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-1e6cdd29-aeed-4bf4-b003-9baef5306af0 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:06:57.308284 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-1e6cdd29-aeed-4bf4-b003-9baef5306af0 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] [instance: d38a019f-4bfc-4845-900b-a9e4e6397373] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:06:57.314348 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1e6cdd29-aeed-4bf4-b003-9baef5306af0 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:06:57.314826 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1e6cdd29-aeed-4bf4-b003-9baef5306af0 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:06:57.315255 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1e6cdd29-aeed-4bf4-b003-9baef5306af0 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:06:57.315939 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1e6cdd29-aeed-4bf4-b003-9baef5306af0 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:06:57.316384 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1e6cdd29-aeed-4bf4-b003-9baef5306af0 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:06:57.316832 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1e6cdd29-aeed-4bf4-b003-9baef5306af0 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:06:57.448275 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-1e6cdd29-aeed-4bf4-b003-9baef5306af0 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d4cbd2a2154e5d925462df7c77815a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0d80988ca941acb8ad4318338dfbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:06:57.455948 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-1e6cdd29-aeed-4bf4-b003-9baef5306af0 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] 10.222.0.20 "GET /compute/v2.1/servers/d38a019f-4bfc-4845-900b-a9e4e6397373" status: 200 len: 1510 microversion: 2.1 time: 0.152306 Oct 20 06:06:57.456501 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 173/322] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:06:57 2022] GET /compute/v2.1/servers/d38a019f-4bfc-4845-900b-a9e4e6397373 => generated 1510 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:06:57.923290 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-9b084ab1-78f0-433b-a756-c7e94e8b5ffe tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:06:57.923894 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-9b084ab1-78f0-433b-a756-c7e94e8b5ffe tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:06:57.933128 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-9b084ab1-78f0-433b-a756-c7e94e8b5ffe tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:06:57.933223 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-9b084ab1-78f0-433b-a756-c7e94e8b5ffe tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:06:57.933618 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-9b084ab1-78f0-433b-a756-c7e94e8b5ffe tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:06:57.934320 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-9b084ab1-78f0-433b-a756-c7e94e8b5ffe tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:06:57.934768 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-9b084ab1-78f0-433b-a756-c7e94e8b5ffe tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:06:57.935192 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-9b084ab1-78f0-433b-a756-c7e94e8b5ffe tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:06:57.955138 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-e7d0114b-8cfd-4f47-a671-166e2280382a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:06:57.956398 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-e7d0114b-8cfd-4f47-a671-166e2280382a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: 5a669c5b-898f-4fef-8508-254ccd998571] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:06:57.963400 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e7d0114b-8cfd-4f47-a671-166e2280382a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:06:57.963770 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e7d0114b-8cfd-4f47-a671-166e2280382a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:06:57.964206 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e7d0114b-8cfd-4f47-a671-166e2280382a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:06:57.964933 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e7d0114b-8cfd-4f47-a671-166e2280382a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:06:57.965377 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e7d0114b-8cfd-4f47-a671-166e2280382a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:06:57.965795 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e7d0114b-8cfd-4f47-a671-166e2280382a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:06:58.088373 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-9b084ab1-78f0-433b-a756-c7e94e8b5ffe tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:06:58.097449 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-9b084ab1-78f0-433b-a756-c7e94e8b5ffe tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:06:58.098902 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-9b084ab1-78f0-433b-a756-c7e94e8b5ffe tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:06:58.100078 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-9b084ab1-78f0-433b-a756-c7e94e8b5ffe tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1722 microversion: 2.20 time: 0.180750 Oct 20 06:06:58.100991 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 150/323] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:06:57 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1722 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 20 06:06:58.105648 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-e7d0114b-8cfd-4f47-a671-166e2280382a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:06:58.113420 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-e7d0114b-8cfd-4f47-a671-166e2280382a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/5a669c5b-898f-4fef-8508-254ccd998571" status: 200 len: 1365 microversion: 2.1 time: 0.163767 Oct 20 06:06:58.114435 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 174/324] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:06:57 2022] GET /compute/v2.1/servers/5a669c5b-898f-4fef-8508-254ccd998571 => generated 1365 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:06:58.479637 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-02258f7e-d12b-432f-8e6e-35b32ba91a49 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:06:58.480240 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-02258f7e-d12b-432f-8e6e-35b32ba91a49 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] [instance: d38a019f-4bfc-4845-900b-a9e4e6397373] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:06:58.486123 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-02258f7e-d12b-432f-8e6e-35b32ba91a49 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:06:58.486607 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-02258f7e-d12b-432f-8e6e-35b32ba91a49 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:06:58.487046 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-02258f7e-d12b-432f-8e6e-35b32ba91a49 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:06:58.487736 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-02258f7e-d12b-432f-8e6e-35b32ba91a49 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:06:58.488192 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-02258f7e-d12b-432f-8e6e-35b32ba91a49 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:06:58.488622 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-02258f7e-d12b-432f-8e6e-35b32ba91a49 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:06:58.618876 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-02258f7e-d12b-432f-8e6e-35b32ba91a49 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d4cbd2a2154e5d925462df7c77815a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0d80988ca941acb8ad4318338dfbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:06:58.626482 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-02258f7e-d12b-432f-8e6e-35b32ba91a49 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] 10.222.0.20 "GET /compute/v2.1/servers/d38a019f-4bfc-4845-900b-a9e4e6397373" status: 200 len: 1510 microversion: 2.1 time: 0.151032 Oct 20 06:06:58.627032 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 151/325] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:06:58 2022] GET /compute/v2.1/servers/d38a019f-4bfc-4845-900b-a9e4e6397373 => generated 1510 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:06:59.127719 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-d3defdec-0dc2-4a65-a322-3f12daaaad61 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:06:59.128326 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-d3defdec-0dc2-4a65-a322-3f12daaaad61 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:06:59.135255 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d3defdec-0dc2-4a65-a322-3f12daaaad61 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:06:59.135733 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d3defdec-0dc2-4a65-a322-3f12daaaad61 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:06:59.135861 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-49801191-b0a3-457e-a127-5e44798dcf0f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:06:59.136303 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d3defdec-0dc2-4a65-a322-3f12daaaad61 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:06:59.136456 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-49801191-b0a3-457e-a127-5e44798dcf0f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: 5a669c5b-898f-4fef-8508-254ccd998571] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:06:59.136861 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d3defdec-0dc2-4a65-a322-3f12daaaad61 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:06:59.137308 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d3defdec-0dc2-4a65-a322-3f12daaaad61 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:06:59.137728 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d3defdec-0dc2-4a65-a322-3f12daaaad61 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:06:59.142703 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-49801191-b0a3-457e-a127-5e44798dcf0f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:06:59.143180 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-49801191-b0a3-457e-a127-5e44798dcf0f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:06:59.143611 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-49801191-b0a3-457e-a127-5e44798dcf0f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:06:59.144296 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-49801191-b0a3-457e-a127-5e44798dcf0f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:06:59.144773 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-49801191-b0a3-457e-a127-5e44798dcf0f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:06:59.145197 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-49801191-b0a3-457e-a127-5e44798dcf0f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:06:59.272212 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-d3defdec-0dc2-4a65-a322-3f12daaaad61 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:06:59.273250 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-49801191-b0a3-457e-a127-5e44798dcf0f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:06:59.281188 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-d3defdec-0dc2-4a65-a322-3f12daaaad61 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:06:59.281490 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-49801191-b0a3-457e-a127-5e44798dcf0f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/5a669c5b-898f-4fef-8508-254ccd998571" status: 200 len: 1365 microversion: 2.1 time: 0.149706 Oct 20 06:06:59.282638 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-d3defdec-0dc2-4a65-a322-3f12daaaad61 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:06:59.283801 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-d3defdec-0dc2-4a65-a322-3f12daaaad61 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1722 microversion: 2.20 time: 0.160041 Oct 20 06:06:59.284632 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 175/326] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:06:59 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:06:59.291578 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 152/327] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:06:59 2022] GET /compute/v2.1/servers/5a669c5b-898f-4fef-8508-254ccd998571 => generated 1365 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 06:06:59.650143 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-8ba86732-d7ae-471a-b099-eb2aefb7e1d1 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:06:59.650758 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-8ba86732-d7ae-471a-b099-eb2aefb7e1d1 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] [instance: d38a019f-4bfc-4845-900b-a9e4e6397373] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:06:59.656635 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-8ba86732-d7ae-471a-b099-eb2aefb7e1d1 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:06:59.657157 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-8ba86732-d7ae-471a-b099-eb2aefb7e1d1 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:06:59.657601 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-8ba86732-d7ae-471a-b099-eb2aefb7e1d1 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:06:59.658295 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-8ba86732-d7ae-471a-b099-eb2aefb7e1d1 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:06:59.658782 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-8ba86732-d7ae-471a-b099-eb2aefb7e1d1 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:06:59.659210 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-8ba86732-d7ae-471a-b099-eb2aefb7e1d1 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:06:59.783730 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-8ba86732-d7ae-471a-b099-eb2aefb7e1d1 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d4cbd2a2154e5d925462df7c77815a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0d80988ca941acb8ad4318338dfbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:06:59.791550 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-8ba86732-d7ae-471a-b099-eb2aefb7e1d1 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] 10.222.0.20 "GET /compute/v2.1/servers/d38a019f-4bfc-4845-900b-a9e4e6397373" status: 200 len: 1510 microversion: 2.1 time: 0.145850 Oct 20 06:06:59.792173 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 176/328] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:06:59 2022] GET /compute/v2.1/servers/d38a019f-4bfc-4845-900b-a9e4e6397373 => generated 1510 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:07:00.305402 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-b89d71f7-6284-42ca-abae-e6c27c13ab71 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:07:00.306847 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-b89d71f7-6284-42ca-abae-e6c27c13ab71 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: 5a669c5b-898f-4fef-8508-254ccd998571] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:07:00.309516 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-82d899ed-e780-4859-bf59-aa7e43887f22 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:07:00.310125 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-82d899ed-e780-4859-bf59-aa7e43887f22 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:07:00.313281 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b89d71f7-6284-42ca-abae-e6c27c13ab71 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:00.313765 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b89d71f7-6284-42ca-abae-e6c27c13ab71 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:00.314197 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b89d71f7-6284-42ca-abae-e6c27c13ab71 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:00.314998 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b89d71f7-6284-42ca-abae-e6c27c13ab71 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:00.316663 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-82d899ed-e780-4859-bf59-aa7e43887f22 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:00.317181 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-82d899ed-e780-4859-bf59-aa7e43887f22 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:00.317619 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-82d899ed-e780-4859-bf59-aa7e43887f22 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:00.318060 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b89d71f7-6284-42ca-abae-e6c27c13ab71 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:00.318313 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-82d899ed-e780-4859-bf59-aa7e43887f22 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:00.318496 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b89d71f7-6284-42ca-abae-e6c27c13ab71 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:00.318768 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-82d899ed-e780-4859-bf59-aa7e43887f22 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:00.319190 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-82d899ed-e780-4859-bf59-aa7e43887f22 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:00.450851 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-82d899ed-e780-4859-bf59-aa7e43887f22 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:00.451930 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-b89d71f7-6284-42ca-abae-e6c27c13ab71 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:00.459386 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-b89d71f7-6284-42ca-abae-e6c27c13ab71 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/5a669c5b-898f-4fef-8508-254ccd998571" status: 200 len: 1365 microversion: 2.1 time: 0.158613 Oct 20 06:07:00.459805 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-82d899ed-e780-4859-bf59-aa7e43887f22 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:00.463404 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 153/329] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:07:00 2022] GET /compute/v2.1/servers/5a669c5b-898f-4fef-8508-254ccd998571 => generated 1365 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:07:00.463556 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-82d899ed-e780-4859-bf59-aa7e43887f22 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:00.463556 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-82d899ed-e780-4859-bf59-aa7e43887f22 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1722 microversion: 2.20 time: 0.157706 Oct 20 06:07:00.463556 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 177/330] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:07:00 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 20 06:07:00.814845 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-d9d8b6f9-3ecf-46b9-999b-bd7b615978a6 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:07:00.815446 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-d9d8b6f9-3ecf-46b9-999b-bd7b615978a6 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] [instance: d38a019f-4bfc-4845-900b-a9e4e6397373] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:07:00.821947 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-d9d8b6f9-3ecf-46b9-999b-bd7b615978a6 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:00.822601 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-d9d8b6f9-3ecf-46b9-999b-bd7b615978a6 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:00.823035 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-d9d8b6f9-3ecf-46b9-999b-bd7b615978a6 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:00.823722 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-d9d8b6f9-3ecf-46b9-999b-bd7b615978a6 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:00.824173 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-d9d8b6f9-3ecf-46b9-999b-bd7b615978a6 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:00.824597 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-d9d8b6f9-3ecf-46b9-999b-bd7b615978a6 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:00.949291 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-d9d8b6f9-3ecf-46b9-999b-bd7b615978a6 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d4cbd2a2154e5d925462df7c77815a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0d80988ca941acb8ad4318338dfbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:00.952775 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG dbcounter [-] [118860] Writing DB stats nova_cell1:SELECT=100 {{(pid=118860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:07:00.957828 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-d9d8b6f9-3ecf-46b9-999b-bd7b615978a6 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] 10.222.0.20 "GET /compute/v2.1/servers/d38a019f-4bfc-4845-900b-a9e4e6397373" status: 200 len: 1510 microversion: 2.1 time: 0.146778 Oct 20 06:07:00.958392 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 154/331] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:07:00 2022] GET /compute/v2.1/servers/d38a019f-4bfc-4845-900b-a9e4e6397373 => generated 1510 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:07:01.483106 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-f505b550-0328-41c1-9e1d-f4f79a378092 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:07:01.483715 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-f505b550-0328-41c1-9e1d-f4f79a378092 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: 5a669c5b-898f-4fef-8508-254ccd998571] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:07:01.487180 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-a30e6781-d96d-4a1d-ae37-0bda62134440 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:07:01.487788 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-a30e6781-d96d-4a1d-ae37-0bda62134440 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:07:01.490184 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f505b550-0328-41c1-9e1d-f4f79a378092 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:01.490687 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f505b550-0328-41c1-9e1d-f4f79a378092 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:01.491117 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f505b550-0328-41c1-9e1d-f4f79a378092 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:01.491806 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f505b550-0328-41c1-9e1d-f4f79a378092 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:01.492255 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f505b550-0328-41c1-9e1d-f4f79a378092 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:01.492673 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f505b550-0328-41c1-9e1d-f4f79a378092 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:01.494283 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a30e6781-d96d-4a1d-ae37-0bda62134440 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:01.494758 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a30e6781-d96d-4a1d-ae37-0bda62134440 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:01.495190 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a30e6781-d96d-4a1d-ae37-0bda62134440 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:01.495875 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a30e6781-d96d-4a1d-ae37-0bda62134440 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:01.496322 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a30e6781-d96d-4a1d-ae37-0bda62134440 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:01.496774 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a30e6781-d96d-4a1d-ae37-0bda62134440 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:01.628037 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-f505b550-0328-41c1-9e1d-f4f79a378092 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:01.634378 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-a30e6781-d96d-4a1d-ae37-0bda62134440 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:01.636763 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-f505b550-0328-41c1-9e1d-f4f79a378092 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/5a669c5b-898f-4fef-8508-254ccd998571" status: 200 len: 1365 microversion: 2.1 time: 0.157541 Oct 20 06:07:01.637336 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 178/332] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:07:01 2022] GET /compute/v2.1/servers/5a669c5b-898f-4fef-8508-254ccd998571 => generated 1365 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:07:01.642638 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-a30e6781-d96d-4a1d-ae37-0bda62134440 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:01.644094 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-a30e6781-d96d-4a1d-ae37-0bda62134440 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:01.645375 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-a30e6781-d96d-4a1d-ae37-0bda62134440 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1722 microversion: 2.20 time: 0.162060 Oct 20 06:07:01.645931 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 155/333] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:07:01 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 20 06:07:01.981340 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-ade27de0-8412-49cc-abce-a9b6c8b0d1e6 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:07:01.981876 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-ade27de0-8412-49cc-abce-a9b6c8b0d1e6 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] [instance: d38a019f-4bfc-4845-900b-a9e4e6397373] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:07:01.987733 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ade27de0-8412-49cc-abce-a9b6c8b0d1e6 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:01.988209 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ade27de0-8412-49cc-abce-a9b6c8b0d1e6 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:01.988642 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ade27de0-8412-49cc-abce-a9b6c8b0d1e6 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:01.989351 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ade27de0-8412-49cc-abce-a9b6c8b0d1e6 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:01.989801 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ade27de0-8412-49cc-abce-a9b6c8b0d1e6 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:01.990229 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ade27de0-8412-49cc-abce-a9b6c8b0d1e6 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:02.115122 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-ade27de0-8412-49cc-abce-a9b6c8b0d1e6 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d4cbd2a2154e5d925462df7c77815a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0d80988ca941acb8ad4318338dfbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:02.123238 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-ade27de0-8412-49cc-abce-a9b6c8b0d1e6 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] 10.222.0.20 "GET /compute/v2.1/servers/d38a019f-4bfc-4845-900b-a9e4e6397373" status: 200 len: 1510 microversion: 2.1 time: 0.146127 Oct 20 06:07:02.123824 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 179/334] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:07:01 2022] GET /compute/v2.1/servers/d38a019f-4bfc-4845-900b-a9e4e6397373 => generated 1510 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:07:02.659942 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-ec61bee8-3bd1-4660-aec2-ed22c3e86098 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:07:02.660583 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-ec61bee8-3bd1-4660-aec2-ed22c3e86098 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: 5a669c5b-898f-4fef-8508-254ccd998571] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:07:02.667657 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-ec61bee8-3bd1-4660-aec2-ed22c3e86098 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:02.668137 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-ec61bee8-3bd1-4660-aec2-ed22c3e86098 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:02.668565 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-ec61bee8-3bd1-4660-aec2-ed22c3e86098 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:02.669277 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-ec61bee8-3bd1-4660-aec2-ed22c3e86098 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:02.669726 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-ec61bee8-3bd1-4660-aec2-ed22c3e86098 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:02.670146 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-ec61bee8-3bd1-4660-aec2-ed22c3e86098 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:02.671678 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-d757c219-9b94-4927-a22b-c0351c2b775a tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:07:02.672282 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-d757c219-9b94-4927-a22b-c0351c2b775a tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:07:02.678633 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d757c219-9b94-4927-a22b-c0351c2b775a tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:02.679119 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d757c219-9b94-4927-a22b-c0351c2b775a tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:02.679553 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d757c219-9b94-4927-a22b-c0351c2b775a tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:02.680268 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d757c219-9b94-4927-a22b-c0351c2b775a tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:02.680679 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d757c219-9b94-4927-a22b-c0351c2b775a tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:02.681691 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d757c219-9b94-4927-a22b-c0351c2b775a tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:02.799941 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-ec61bee8-3bd1-4660-aec2-ed22c3e86098 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:02.808401 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-ec61bee8-3bd1-4660-aec2-ed22c3e86098 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/5a669c5b-898f-4fef-8508-254ccd998571" status: 200 len: 1365 microversion: 2.1 time: 0.152261 Oct 20 06:07:02.809205 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 156/335] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:07:02 2022] GET /compute/v2.1/servers/5a669c5b-898f-4fef-8508-254ccd998571 => generated 1365 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:07:02.814876 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-d757c219-9b94-4927-a22b-c0351c2b775a tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:02.823095 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-d757c219-9b94-4927-a22b-c0351c2b775a tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:02.824537 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-d757c219-9b94-4927-a22b-c0351c2b775a tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:02.825721 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-d757c219-9b94-4927-a22b-c0351c2b775a tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1722 microversion: 2.20 time: 0.157916 Oct 20 06:07:02.826271 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 180/336] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:07:02 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:07:03.146436 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-49bc83ec-dac5-44a7-bd58-deb0eb79b71c tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:07:03.147046 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-49bc83ec-dac5-44a7-bd58-deb0eb79b71c tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] [instance: d38a019f-4bfc-4845-900b-a9e4e6397373] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:07:03.153503 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-49bc83ec-dac5-44a7-bd58-deb0eb79b71c tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:03.153980 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-49bc83ec-dac5-44a7-bd58-deb0eb79b71c tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:03.154409 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-49bc83ec-dac5-44a7-bd58-deb0eb79b71c tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:03.155086 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-49bc83ec-dac5-44a7-bd58-deb0eb79b71c tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:03.155534 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-49bc83ec-dac5-44a7-bd58-deb0eb79b71c tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:03.155961 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-49bc83ec-dac5-44a7-bd58-deb0eb79b71c tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:03.283157 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-49bc83ec-dac5-44a7-bd58-deb0eb79b71c tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d4cbd2a2154e5d925462df7c77815a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0d80988ca941acb8ad4318338dfbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:03.291329 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-49bc83ec-dac5-44a7-bd58-deb0eb79b71c tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] 10.222.0.20 "GET /compute/v2.1/servers/d38a019f-4bfc-4845-900b-a9e4e6397373" status: 200 len: 1510 microversion: 2.1 time: 0.148761 Oct 20 06:07:03.291893 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 157/337] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:07:03 2022] GET /compute/v2.1/servers/d38a019f-4bfc-4845-900b-a9e4e6397373 => generated 1510 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:07:03.831327 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-d127c4be-f67f-46ce-9846-401fb5e560c3 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:07:03.831937 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-d127c4be-f67f-46ce-9846-401fb5e560c3 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: 5a669c5b-898f-4fef-8508-254ccd998571] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:07:03.838500 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d127c4be-f67f-46ce-9846-401fb5e560c3 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:03.838981 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d127c4be-f67f-46ce-9846-401fb5e560c3 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:03.839415 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d127c4be-f67f-46ce-9846-401fb5e560c3 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:03.840112 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d127c4be-f67f-46ce-9846-401fb5e560c3 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:03.840562 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d127c4be-f67f-46ce-9846-401fb5e560c3 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:03.841025 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d127c4be-f67f-46ce-9846-401fb5e560c3 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:03.850914 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-dfc08d13-cb42-46e9-99bb-791350e0a1ac tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:07:03.851525 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-dfc08d13-cb42-46e9-99bb-791350e0a1ac tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:07:03.858154 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-dfc08d13-cb42-46e9-99bb-791350e0a1ac tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:03.858702 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-dfc08d13-cb42-46e9-99bb-791350e0a1ac tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:03.859142 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-dfc08d13-cb42-46e9-99bb-791350e0a1ac tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:03.859997 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-dfc08d13-cb42-46e9-99bb-791350e0a1ac tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:03.860455 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-dfc08d13-cb42-46e9-99bb-791350e0a1ac tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:03.860930 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-dfc08d13-cb42-46e9-99bb-791350e0a1ac tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:03.971586 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-d127c4be-f67f-46ce-9846-401fb5e560c3 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:03.979899 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-d127c4be-f67f-46ce-9846-401fb5e560c3 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/5a669c5b-898f-4fef-8508-254ccd998571" status: 200 len: 1365 microversion: 2.1 time: 0.152470 Oct 20 06:07:03.980463 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 181/338] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:07:03 2022] GET /compute/v2.1/servers/5a669c5b-898f-4fef-8508-254ccd998571 => generated 1365 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:07:03.995891 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-dfc08d13-cb42-46e9-99bb-791350e0a1ac tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:04.004070 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-dfc08d13-cb42-46e9-99bb-791350e0a1ac tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:04.005564 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-dfc08d13-cb42-46e9-99bb-791350e0a1ac tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:04.006719 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-dfc08d13-cb42-46e9-99bb-791350e0a1ac tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1722 microversion: 2.20 time: 0.159746 Oct 20 06:07:04.007268 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 158/339] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:07:03 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 20 06:07:04.313771 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-c91f2a06-9a6e-4e17-962f-5cbe130f9415 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:07:04.314380 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-c91f2a06-9a6e-4e17-962f-5cbe130f9415 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] [instance: d38a019f-4bfc-4845-900b-a9e4e6397373] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:07:04.320144 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c91f2a06-9a6e-4e17-962f-5cbe130f9415 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:04.320630 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c91f2a06-9a6e-4e17-962f-5cbe130f9415 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:04.321098 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c91f2a06-9a6e-4e17-962f-5cbe130f9415 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:04.322111 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c91f2a06-9a6e-4e17-962f-5cbe130f9415 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:04.322572 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c91f2a06-9a6e-4e17-962f-5cbe130f9415 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:04.323000 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c91f2a06-9a6e-4e17-962f-5cbe130f9415 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:04.449995 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-c91f2a06-9a6e-4e17-962f-5cbe130f9415 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d4cbd2a2154e5d925462df7c77815a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0d80988ca941acb8ad4318338dfbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:04.457600 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-c91f2a06-9a6e-4e17-962f-5cbe130f9415 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] 10.222.0.20 "GET /compute/v2.1/servers/d38a019f-4bfc-4845-900b-a9e4e6397373" status: 200 len: 1510 microversion: 2.1 time: 0.147639 Oct 20 06:07:04.458151 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 182/340] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:07:04 2022] GET /compute/v2.1/servers/d38a019f-4bfc-4845-900b-a9e4e6397373 => generated 1510 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:07:05.003568 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-73f5e9bf-f8bc-4403-85f0-a4e83920eabb tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:07:05.004172 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-73f5e9bf-f8bc-4403-85f0-a4e83920eabb tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: 5a669c5b-898f-4fef-8508-254ccd998571] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:07:05.011642 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-73f5e9bf-f8bc-4403-85f0-a4e83920eabb tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:05.012120 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-73f5e9bf-f8bc-4403-85f0-a4e83920eabb tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:05.012551 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-73f5e9bf-f8bc-4403-85f0-a4e83920eabb tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:05.013276 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-73f5e9bf-f8bc-4403-85f0-a4e83920eabb tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:05.013722 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-73f5e9bf-f8bc-4403-85f0-a4e83920eabb tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:05.014145 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-73f5e9bf-f8bc-4403-85f0-a4e83920eabb tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:05.032457 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-6f7abebc-df52-462a-8f7d-22dd190f1169 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:07:05.033084 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-6f7abebc-df52-462a-8f7d-22dd190f1169 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:07:05.039567 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-6f7abebc-df52-462a-8f7d-22dd190f1169 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:05.040167 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-6f7abebc-df52-462a-8f7d-22dd190f1169 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:05.040900 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-6f7abebc-df52-462a-8f7d-22dd190f1169 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:05.041535 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-6f7abebc-df52-462a-8f7d-22dd190f1169 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:05.041984 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-6f7abebc-df52-462a-8f7d-22dd190f1169 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:05.042410 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-6f7abebc-df52-462a-8f7d-22dd190f1169 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:05.144968 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-73f5e9bf-f8bc-4403-85f0-a4e83920eabb tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:05.153447 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-73f5e9bf-f8bc-4403-85f0-a4e83920eabb tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/5a669c5b-898f-4fef-8508-254ccd998571" status: 200 len: 1365 microversion: 2.1 time: 0.153721 Oct 20 06:07:05.154008 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 159/341] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:07:04 2022] GET /compute/v2.1/servers/5a669c5b-898f-4fef-8508-254ccd998571 => generated 1365 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:07:05.175061 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-6f7abebc-df52-462a-8f7d-22dd190f1169 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:05.183111 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-6f7abebc-df52-462a-8f7d-22dd190f1169 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:05.184558 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-6f7abebc-df52-462a-8f7d-22dd190f1169 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:05.185729 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-6f7abebc-df52-462a-8f7d-22dd190f1169 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1722 microversion: 2.20 time: 0.157210 Oct 20 06:07:05.186282 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 183/342] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:07:05 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 20 06:07:05.480599 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-ee544a0e-2ce9-48b1-9c09-c0fa6257952c tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:07:05.481226 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-ee544a0e-2ce9-48b1-9c09-c0fa6257952c tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] [instance: d38a019f-4bfc-4845-900b-a9e4e6397373] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:07:05.487921 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-ee544a0e-2ce9-48b1-9c09-c0fa6257952c tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:05.488408 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-ee544a0e-2ce9-48b1-9c09-c0fa6257952c tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:05.488877 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-ee544a0e-2ce9-48b1-9c09-c0fa6257952c tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:05.489701 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-ee544a0e-2ce9-48b1-9c09-c0fa6257952c tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:05.490041 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-ee544a0e-2ce9-48b1-9c09-c0fa6257952c tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:05.490469 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-ee544a0e-2ce9-48b1-9c09-c0fa6257952c tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:05.635460 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-ee544a0e-2ce9-48b1-9c09-c0fa6257952c tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d4cbd2a2154e5d925462df7c77815a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0d80988ca941acb8ad4318338dfbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:05.643777 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-ee544a0e-2ce9-48b1-9c09-c0fa6257952c tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] 10.222.0.20 "GET /compute/v2.1/servers/d38a019f-4bfc-4845-900b-a9e4e6397373" status: 200 len: 1510 microversion: 2.1 time: 0.167010 Oct 20 06:07:05.644371 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 160/343] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:07:05 2022] GET /compute/v2.1/servers/d38a019f-4bfc-4845-900b-a9e4e6397373 => generated 1510 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:07:06.176449 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-649bcf9b-fd0a-49c8-98d0-16cc2b90aab2 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:07:06.177080 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-649bcf9b-fd0a-49c8-98d0-16cc2b90aab2 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: 5a669c5b-898f-4fef-8508-254ccd998571] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:07:06.184065 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-649bcf9b-fd0a-49c8-98d0-16cc2b90aab2 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:06.184538 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-649bcf9b-fd0a-49c8-98d0-16cc2b90aab2 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:06.185000 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-649bcf9b-fd0a-49c8-98d0-16cc2b90aab2 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:06.185686 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-649bcf9b-fd0a-49c8-98d0-16cc2b90aab2 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:06.186134 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-649bcf9b-fd0a-49c8-98d0-16cc2b90aab2 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:06.186554 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-649bcf9b-fd0a-49c8-98d0-16cc2b90aab2 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:06.211595 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-31100e56-735c-4153-af28-be5aacfb4762 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:07:06.212463 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-31100e56-735c-4153-af28-be5aacfb4762 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:07:06.218833 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-31100e56-735c-4153-af28-be5aacfb4762 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:06.219309 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-31100e56-735c-4153-af28-be5aacfb4762 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:06.219738 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-31100e56-735c-4153-af28-be5aacfb4762 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:06.220425 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-31100e56-735c-4153-af28-be5aacfb4762 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:06.220900 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-31100e56-735c-4153-af28-be5aacfb4762 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:06.221318 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-31100e56-735c-4153-af28-be5aacfb4762 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:06.316066 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-649bcf9b-fd0a-49c8-98d0-16cc2b90aab2 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:06.324093 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-649bcf9b-fd0a-49c8-98d0-16cc2b90aab2 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/5a669c5b-898f-4fef-8508-254ccd998571" status: 200 len: 1365 microversion: 2.1 time: 0.151453 Oct 20 06:07:06.324656 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 184/344] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:07:06 2022] GET /compute/v2.1/servers/5a669c5b-898f-4fef-8508-254ccd998571 => generated 1365 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:07:06.351952 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-31100e56-735c-4153-af28-be5aacfb4762 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:06.360930 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-31100e56-735c-4153-af28-be5aacfb4762 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:06.362378 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-31100e56-735c-4153-af28-be5aacfb4762 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:06.363535 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-31100e56-735c-4153-af28-be5aacfb4762 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1722 microversion: 2.20 time: 0.155840 Oct 20 06:07:06.364085 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 161/345] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:07:06 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 20 06:07:06.668416 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-6e556758-52c5-477e-bb24-2cd6a9d07a17 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:07:06.669053 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-6e556758-52c5-477e-bb24-2cd6a9d07a17 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] [instance: d38a019f-4bfc-4845-900b-a9e4e6397373] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:07:06.674910 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-6e556758-52c5-477e-bb24-2cd6a9d07a17 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:06.675391 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-6e556758-52c5-477e-bb24-2cd6a9d07a17 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:06.675826 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-6e556758-52c5-477e-bb24-2cd6a9d07a17 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:06.676510 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-6e556758-52c5-477e-bb24-2cd6a9d07a17 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:06.676988 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-6e556758-52c5-477e-bb24-2cd6a9d07a17 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:06.677461 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-6e556758-52c5-477e-bb24-2cd6a9d07a17 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:06.697704 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG dbcounter [-] [118861] Writing DB stats nova_cell1:SELECT=100 {{(pid=118861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:07:06.812225 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-6e556758-52c5-477e-bb24-2cd6a9d07a17 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d4cbd2a2154e5d925462df7c77815a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0d80988ca941acb8ad4318338dfbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:06.822107 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-6e556758-52c5-477e-bb24-2cd6a9d07a17 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] 10.222.0.20 "GET /compute/v2.1/servers/d38a019f-4bfc-4845-900b-a9e4e6397373" status: 200 len: 1510 microversion: 2.1 time: 0.158541 Oct 20 06:07:06.822675 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 185/346] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:07:06 2022] GET /compute/v2.1/servers/d38a019f-4bfc-4845-900b-a9e4e6397373 => generated 1510 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:07:07.346724 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-29f6bade-d313-438c-a727-69ec80826a7c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:07:07.347333 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-29f6bade-d313-438c-a727-69ec80826a7c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: 5a669c5b-898f-4fef-8508-254ccd998571] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:07:07.353956 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-29f6bade-d313-438c-a727-69ec80826a7c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:07.354440 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-29f6bade-d313-438c-a727-69ec80826a7c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:07.354878 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-29f6bade-d313-438c-a727-69ec80826a7c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:07.355570 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-29f6bade-d313-438c-a727-69ec80826a7c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:07.356022 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-29f6bade-d313-438c-a727-69ec80826a7c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:07.356448 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-29f6bade-d313-438c-a727-69ec80826a7c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:07.390446 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-4ffc7c4c-f8ef-4aab-8a13-57c34bb22906 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:07:07.391252 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-4ffc7c4c-f8ef-4aab-8a13-57c34bb22906 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:07:07.397697 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4ffc7c4c-f8ef-4aab-8a13-57c34bb22906 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:07.398180 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4ffc7c4c-f8ef-4aab-8a13-57c34bb22906 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:07.398620 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4ffc7c4c-f8ef-4aab-8a13-57c34bb22906 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:07.399401 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4ffc7c4c-f8ef-4aab-8a13-57c34bb22906 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:07.399866 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4ffc7c4c-f8ef-4aab-8a13-57c34bb22906 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:07.400278 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4ffc7c4c-f8ef-4aab-8a13-57c34bb22906 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:07.493710 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-29f6bade-d313-438c-a727-69ec80826a7c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:07.501516 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-29f6bade-d313-438c-a727-69ec80826a7c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/5a669c5b-898f-4fef-8508-254ccd998571" status: 200 len: 1365 microversion: 2.1 time: 0.158658 Oct 20 06:07:07.502083 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 162/347] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:07:07 2022] GET /compute/v2.1/servers/5a669c5b-898f-4fef-8508-254ccd998571 => generated 1365 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:07:07.537576 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-4ffc7c4c-f8ef-4aab-8a13-57c34bb22906 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:07.552676 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-4ffc7c4c-f8ef-4aab-8a13-57c34bb22906 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:07.554212 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-4ffc7c4c-f8ef-4aab-8a13-57c34bb22906 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:07.555371 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-4ffc7c4c-f8ef-4aab-8a13-57c34bb22906 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1722 microversion: 2.20 time: 0.168870 Oct 20 06:07:07.556552 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 186/348] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:07:07 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1722 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 20 06:07:07.846284 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-1e28cd9b-8faf-4885-a433-97034c1ea5f3 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:07:07.846678 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-1e28cd9b-8faf-4885-a433-97034c1ea5f3 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] [instance: d38a019f-4bfc-4845-900b-a9e4e6397373] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:07:07.853415 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1e28cd9b-8faf-4885-a433-97034c1ea5f3 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:07.854003 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1e28cd9b-8faf-4885-a433-97034c1ea5f3 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:07.854441 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1e28cd9b-8faf-4885-a433-97034c1ea5f3 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:07.856492 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1e28cd9b-8faf-4885-a433-97034c1ea5f3 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:07.856492 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1e28cd9b-8faf-4885-a433-97034c1ea5f3 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:07.856492 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1e28cd9b-8faf-4885-a433-97034c1ea5f3 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:07.985313 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-1e28cd9b-8faf-4885-a433-97034c1ea5f3 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d4cbd2a2154e5d925462df7c77815a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0d80988ca941acb8ad4318338dfbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:07.992820 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-1e28cd9b-8faf-4885-a433-97034c1ea5f3 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] 10.222.0.20 "GET /compute/v2.1/servers/d38a019f-4bfc-4845-900b-a9e4e6397373" status: 200 len: 1510 microversion: 2.1 time: 0.150808 Oct 20 06:07:07.993937 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 163/349] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:07:07 2022] GET /compute/v2.1/servers/d38a019f-4bfc-4845-900b-a9e4e6397373 => generated 1510 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:07:08.523672 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-77ed29e5-6816-41b3-913c-62146569631e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:07:08.524962 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-77ed29e5-6816-41b3-913c-62146569631e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: 5a669c5b-898f-4fef-8508-254ccd998571] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:07:08.531305 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-77ed29e5-6816-41b3-913c-62146569631e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:08.531781 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-77ed29e5-6816-41b3-913c-62146569631e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:08.532218 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-77ed29e5-6816-41b3-913c-62146569631e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:08.532934 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-77ed29e5-6816-41b3-913c-62146569631e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:08.533383 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-77ed29e5-6816-41b3-913c-62146569631e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:08.533805 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-77ed29e5-6816-41b3-913c-62146569631e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:08.581671 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-a80877bd-9345-4617-b11a-783c34d314b6 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:07:08.582348 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-a80877bd-9345-4617-b11a-783c34d314b6 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:07:08.589445 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a80877bd-9345-4617-b11a-783c34d314b6 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:08.590011 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a80877bd-9345-4617-b11a-783c34d314b6 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:08.590522 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a80877bd-9345-4617-b11a-783c34d314b6 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:08.591334 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a80877bd-9345-4617-b11a-783c34d314b6 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:08.591886 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a80877bd-9345-4617-b11a-783c34d314b6 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:08.592386 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a80877bd-9345-4617-b11a-783c34d314b6 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:08.666543 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-77ed29e5-6816-41b3-913c-62146569631e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:08.674212 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-77ed29e5-6816-41b3-913c-62146569631e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/5a669c5b-898f-4fef-8508-254ccd998571" status: 200 len: 1365 microversion: 2.1 time: 0.154273 Oct 20 06:07:08.674769 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 187/350] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:07:08 2022] GET /compute/v2.1/servers/5a669c5b-898f-4fef-8508-254ccd998571 => generated 1365 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:07:08.722281 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-a80877bd-9345-4617-b11a-783c34d314b6 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:08.730418 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-a80877bd-9345-4617-b11a-783c34d314b6 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:08.731862 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-a80877bd-9345-4617-b11a-783c34d314b6 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:08.733054 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-a80877bd-9345-4617-b11a-783c34d314b6 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1722 microversion: 2.20 time: 0.155332 Oct 20 06:07:08.733646 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 164/351] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:07:08 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 20 06:07:09.015733 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-fdf5bd43-58fb-44f8-a847-80573b55fe8d tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:07:09.016369 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-fdf5bd43-58fb-44f8-a847-80573b55fe8d tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] [instance: d38a019f-4bfc-4845-900b-a9e4e6397373] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:07:09.022695 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-fdf5bd43-58fb-44f8-a847-80573b55fe8d tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:09.023055 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-fdf5bd43-58fb-44f8-a847-80573b55fe8d tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:09.023637 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-fdf5bd43-58fb-44f8-a847-80573b55fe8d tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:09.024614 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-fdf5bd43-58fb-44f8-a847-80573b55fe8d tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:09.025304 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-fdf5bd43-58fb-44f8-a847-80573b55fe8d tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:09.025721 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-fdf5bd43-58fb-44f8-a847-80573b55fe8d tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:09.151542 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-fdf5bd43-58fb-44f8-a847-80573b55fe8d tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d4cbd2a2154e5d925462df7c77815a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0d80988ca941acb8ad4318338dfbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:09.159156 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-fdf5bd43-58fb-44f8-a847-80573b55fe8d tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] 10.222.0.20 "GET /compute/v2.1/servers/d38a019f-4bfc-4845-900b-a9e4e6397373" status: 200 len: 1510 microversion: 2.1 time: 0.147334 Oct 20 06:07:09.159716 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 188/352] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:07:09 2022] GET /compute/v2.1/servers/d38a019f-4bfc-4845-900b-a9e4e6397373 => generated 1510 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:07:09.696833 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-142c4ec0-39b8-4c73-a4c4-e55d55aff875 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:07:09.697444 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-142c4ec0-39b8-4c73-a4c4-e55d55aff875 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: 5a669c5b-898f-4fef-8508-254ccd998571] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:07:09.704016 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-142c4ec0-39b8-4c73-a4c4-e55d55aff875 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:09.704497 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-142c4ec0-39b8-4c73-a4c4-e55d55aff875 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:09.704966 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-142c4ec0-39b8-4c73-a4c4-e55d55aff875 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:09.705686 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-142c4ec0-39b8-4c73-a4c4-e55d55aff875 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:09.706138 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-142c4ec0-39b8-4c73-a4c4-e55d55aff875 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:09.706558 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-142c4ec0-39b8-4c73-a4c4-e55d55aff875 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:09.758285 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-5a7a4b81-8439-4462-9224-366f71d9fc75 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:07:09.758908 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-5a7a4b81-8439-4462-9224-366f71d9fc75 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:07:09.765466 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5a7a4b81-8439-4462-9224-366f71d9fc75 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:09.765954 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5a7a4b81-8439-4462-9224-366f71d9fc75 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:09.766416 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5a7a4b81-8439-4462-9224-366f71d9fc75 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:09.767105 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5a7a4b81-8439-4462-9224-366f71d9fc75 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:09.767563 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5a7a4b81-8439-4462-9224-366f71d9fc75 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:09.768046 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5a7a4b81-8439-4462-9224-366f71d9fc75 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:09.838770 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-142c4ec0-39b8-4c73-a4c4-e55d55aff875 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:09.846583 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-142c4ec0-39b8-4c73-a4c4-e55d55aff875 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/5a669c5b-898f-4fef-8508-254ccd998571" status: 200 len: 1365 microversion: 2.1 time: 0.153612 Oct 20 06:07:09.847243 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 165/353] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:07:09 2022] GET /compute/v2.1/servers/5a669c5b-898f-4fef-8508-254ccd998571 => generated 1365 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:07:09.898759 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-5a7a4b81-8439-4462-9224-366f71d9fc75 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:09.906862 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-5a7a4b81-8439-4462-9224-366f71d9fc75 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:09.908312 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-5a7a4b81-8439-4462-9224-366f71d9fc75 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:09.909513 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-5a7a4b81-8439-4462-9224-366f71d9fc75 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1722 microversion: 2.20 time: 0.155516 Oct 20 06:07:09.910065 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 189/354] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:07:09 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 20 06:07:10.182777 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-5e0d9bf1-dddf-4abc-b577-613f1174cb99 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:07:10.183410 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-5e0d9bf1-dddf-4abc-b577-613f1174cb99 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] [instance: d38a019f-4bfc-4845-900b-a9e4e6397373] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:07:10.189239 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5e0d9bf1-dddf-4abc-b577-613f1174cb99 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:10.189714 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5e0d9bf1-dddf-4abc-b577-613f1174cb99 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:10.190147 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5e0d9bf1-dddf-4abc-b577-613f1174cb99 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:10.190832 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5e0d9bf1-dddf-4abc-b577-613f1174cb99 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:10.191280 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5e0d9bf1-dddf-4abc-b577-613f1174cb99 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:10.191701 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5e0d9bf1-dddf-4abc-b577-613f1174cb99 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:10.321545 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-5e0d9bf1-dddf-4abc-b577-613f1174cb99 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d4cbd2a2154e5d925462df7c77815a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0d80988ca941acb8ad4318338dfbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:10.329199 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-5e0d9bf1-dddf-4abc-b577-613f1174cb99 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] 10.222.0.20 "GET /compute/v2.1/servers/d38a019f-4bfc-4845-900b-a9e4e6397373" status: 200 len: 1510 microversion: 2.1 time: 0.150362 Oct 20 06:07:10.329763 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 166/355] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:07:10 2022] GET /compute/v2.1/servers/d38a019f-4bfc-4845-900b-a9e4e6397373 => generated 1510 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:07:10.869679 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-da96e9a1-b93b-4155-bc98-753e12048b69 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:07:10.870223 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-da96e9a1-b93b-4155-bc98-753e12048b69 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: 5a669c5b-898f-4fef-8508-254ccd998571] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:07:10.876591 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-da96e9a1-b93b-4155-bc98-753e12048b69 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:10.877107 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-da96e9a1-b93b-4155-bc98-753e12048b69 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:10.877544 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-da96e9a1-b93b-4155-bc98-753e12048b69 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:10.878232 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-da96e9a1-b93b-4155-bc98-753e12048b69 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:10.878687 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-da96e9a1-b93b-4155-bc98-753e12048b69 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:10.879113 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-da96e9a1-b93b-4155-bc98-753e12048b69 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:10.935742 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-f5a77234-4ac5-4f19-ae33-bdfbb097e10e tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:07:10.936433 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-f5a77234-4ac5-4f19-ae33-bdfbb097e10e tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:07:10.942768 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f5a77234-4ac5-4f19-ae33-bdfbb097e10e tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:10.943427 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f5a77234-4ac5-4f19-ae33-bdfbb097e10e tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:10.943939 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f5a77234-4ac5-4f19-ae33-bdfbb097e10e tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:10.944711 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f5a77234-4ac5-4f19-ae33-bdfbb097e10e tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:10.945234 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f5a77234-4ac5-4f19-ae33-bdfbb097e10e tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:10.945828 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f5a77234-4ac5-4f19-ae33-bdfbb097e10e tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:11.015009 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-da96e9a1-b93b-4155-bc98-753e12048b69 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:11.023128 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-da96e9a1-b93b-4155-bc98-753e12048b69 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/5a669c5b-898f-4fef-8508-254ccd998571" status: 200 len: 1365 microversion: 2.1 time: 0.158111 Oct 20 06:07:11.023961 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 190/356] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:07:10 2022] GET /compute/v2.1/servers/5a669c5b-898f-4fef-8508-254ccd998571 => generated 1365 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:07:11.082690 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-f5a77234-4ac5-4f19-ae33-bdfbb097e10e tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:11.091127 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-f5a77234-4ac5-4f19-ae33-bdfbb097e10e tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:11.092555 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-f5a77234-4ac5-4f19-ae33-bdfbb097e10e tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:11.093734 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-f5a77234-4ac5-4f19-ae33-bdfbb097e10e tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1722 microversion: 2.20 time: 0.161960 Oct 20 06:07:11.094283 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 167/357] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:07:10 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:07:11.351830 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-b75bd493-ddf9-4f5c-91b6-b6a45bebd405 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:07:11.353304 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-b75bd493-ddf9-4f5c-91b6-b6a45bebd405 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] [instance: d38a019f-4bfc-4845-900b-a9e4e6397373] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:07:11.359232 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b75bd493-ddf9-4f5c-91b6-b6a45bebd405 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:11.359718 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b75bd493-ddf9-4f5c-91b6-b6a45bebd405 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:11.360159 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b75bd493-ddf9-4f5c-91b6-b6a45bebd405 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:11.360880 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b75bd493-ddf9-4f5c-91b6-b6a45bebd405 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:11.361332 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b75bd493-ddf9-4f5c-91b6-b6a45bebd405 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:11.361758 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b75bd493-ddf9-4f5c-91b6-b6a45bebd405 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:11.490125 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-b75bd493-ddf9-4f5c-91b6-b6a45bebd405 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d4cbd2a2154e5d925462df7c77815a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0d80988ca941acb8ad4318338dfbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:11.498073 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-b75bd493-ddf9-4f5c-91b6-b6a45bebd405 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] 10.222.0.20 "GET /compute/v2.1/servers/d38a019f-4bfc-4845-900b-a9e4e6397373" status: 200 len: 1510 microversion: 2.1 time: 0.150141 Oct 20 06:07:11.498632 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 191/358] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:07:11 2022] GET /compute/v2.1/servers/d38a019f-4bfc-4845-900b-a9e4e6397373 => generated 1510 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:07:12.047264 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-223e2ce2-a91d-4bbd-8573-9157c4353060 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:07:12.047897 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-223e2ce2-a91d-4bbd-8573-9157c4353060 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: 5a669c5b-898f-4fef-8508-254ccd998571] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:07:12.054581 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-223e2ce2-a91d-4bbd-8573-9157c4353060 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:12.055063 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-223e2ce2-a91d-4bbd-8573-9157c4353060 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:12.056012 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-223e2ce2-a91d-4bbd-8573-9157c4353060 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:12.056722 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-223e2ce2-a91d-4bbd-8573-9157c4353060 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:12.057166 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-223e2ce2-a91d-4bbd-8573-9157c4353060 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:12.057591 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-223e2ce2-a91d-4bbd-8573-9157c4353060 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:12.120036 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-b1ea76fc-1dd0-4050-a8ae-7a2345b8ab70 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:07:12.120649 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-b1ea76fc-1dd0-4050-a8ae-7a2345b8ab70 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:07:12.127025 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b1ea76fc-1dd0-4050-a8ae-7a2345b8ab70 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:12.127507 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b1ea76fc-1dd0-4050-a8ae-7a2345b8ab70 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:12.127951 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b1ea76fc-1dd0-4050-a8ae-7a2345b8ab70 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:12.128654 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b1ea76fc-1dd0-4050-a8ae-7a2345b8ab70 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:12.129142 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b1ea76fc-1dd0-4050-a8ae-7a2345b8ab70 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:12.129569 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b1ea76fc-1dd0-4050-a8ae-7a2345b8ab70 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:12.187684 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-223e2ce2-a91d-4bbd-8573-9157c4353060 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:12.195476 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-223e2ce2-a91d-4bbd-8573-9157c4353060 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/5a669c5b-898f-4fef-8508-254ccd998571" status: 200 len: 1365 microversion: 2.1 time: 0.151983 Oct 20 06:07:12.196049 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 168/359] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:07:12 2022] GET /compute/v2.1/servers/5a669c5b-898f-4fef-8508-254ccd998571 => generated 1365 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:07:12.260236 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-b1ea76fc-1dd0-4050-a8ae-7a2345b8ab70 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:12.268300 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-b1ea76fc-1dd0-4050-a8ae-7a2345b8ab70 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:12.269788 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-b1ea76fc-1dd0-4050-a8ae-7a2345b8ab70 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:12.270947 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-b1ea76fc-1dd0-4050-a8ae-7a2345b8ab70 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1722 microversion: 2.20 time: 0.155583 Oct 20 06:07:12.271505 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 192/360] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:07:12 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 20 06:07:12.521669 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-25b065ce-0311-4310-8403-e621c63a88d6 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:07:12.522211 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-25b065ce-0311-4310-8403-e621c63a88d6 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] [instance: d38a019f-4bfc-4845-900b-a9e4e6397373] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:07:12.528775 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-25b065ce-0311-4310-8403-e621c63a88d6 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:12.529262 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-25b065ce-0311-4310-8403-e621c63a88d6 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:12.529704 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-25b065ce-0311-4310-8403-e621c63a88d6 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:12.530406 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-25b065ce-0311-4310-8403-e621c63a88d6 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:12.530864 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-25b065ce-0311-4310-8403-e621c63a88d6 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:12.531297 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-25b065ce-0311-4310-8403-e621c63a88d6 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:12.658051 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-25b065ce-0311-4310-8403-e621c63a88d6 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d4cbd2a2154e5d925462df7c77815a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0d80988ca941acb8ad4318338dfbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:12.666332 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-25b065ce-0311-4310-8403-e621c63a88d6 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] 10.222.0.20 "GET /compute/v2.1/servers/d38a019f-4bfc-4845-900b-a9e4e6397373" status: 200 len: 1510 microversion: 2.1 time: 0.148614 Oct 20 06:07:12.666887 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 169/361] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:07:12 2022] GET /compute/v2.1/servers/d38a019f-4bfc-4845-900b-a9e4e6397373 => generated 1510 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:07:13.218458 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-31b4ed7a-45bc-4070-b499-e2013c1720e5 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:07:13.219066 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-31b4ed7a-45bc-4070-b499-e2013c1720e5 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: 5a669c5b-898f-4fef-8508-254ccd998571] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:07:13.225410 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-31b4ed7a-45bc-4070-b499-e2013c1720e5 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:13.225884 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-31b4ed7a-45bc-4070-b499-e2013c1720e5 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:13.226312 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-31b4ed7a-45bc-4070-b499-e2013c1720e5 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:13.227052 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-31b4ed7a-45bc-4070-b499-e2013c1720e5 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:13.227612 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-31b4ed7a-45bc-4070-b499-e2013c1720e5 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:13.228056 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-31b4ed7a-45bc-4070-b499-e2013c1720e5 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:13.296150 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-04f2771f-7c4e-406d-9afa-5510e18cf3a4 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:07:13.297359 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-04f2771f-7c4e-406d-9afa-5510e18cf3a4 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:07:13.304042 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-04f2771f-7c4e-406d-9afa-5510e18cf3a4 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:13.304797 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-04f2771f-7c4e-406d-9afa-5510e18cf3a4 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:13.306053 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-04f2771f-7c4e-406d-9afa-5510e18cf3a4 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:13.306887 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-04f2771f-7c4e-406d-9afa-5510e18cf3a4 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:13.307871 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-04f2771f-7c4e-406d-9afa-5510e18cf3a4 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:13.308070 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-04f2771f-7c4e-406d-9afa-5510e18cf3a4 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:13.356354 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-31b4ed7a-45bc-4070-b499-e2013c1720e5 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:13.364060 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-31b4ed7a-45bc-4070-b499-e2013c1720e5 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/5a669c5b-898f-4fef-8508-254ccd998571" status: 200 len: 1365 microversion: 2.1 time: 0.149276 Oct 20 06:07:13.364558 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 193/362] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:07:13 2022] GET /compute/v2.1/servers/5a669c5b-898f-4fef-8508-254ccd998571 => generated 1365 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:07:13.437918 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-04f2771f-7c4e-406d-9afa-5510e18cf3a4 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:13.446532 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-04f2771f-7c4e-406d-9afa-5510e18cf3a4 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:13.447966 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-04f2771f-7c4e-406d-9afa-5510e18cf3a4 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:13.449157 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-04f2771f-7c4e-406d-9afa-5510e18cf3a4 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1722 microversion: 2.20 time: 0.157563 Oct 20 06:07:13.449708 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 170/363] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:07:13 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 20 06:07:13.688008 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-b87eb3b4-8c76-4675-8f94-d768521ae019 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:07:13.688619 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-b87eb3b4-8c76-4675-8f94-d768521ae019 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] [instance: d38a019f-4bfc-4845-900b-a9e4e6397373] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:07:13.694535 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b87eb3b4-8c76-4675-8f94-d768521ae019 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:13.695020 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b87eb3b4-8c76-4675-8f94-d768521ae019 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:13.695463 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b87eb3b4-8c76-4675-8f94-d768521ae019 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:13.696276 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b87eb3b4-8c76-4675-8f94-d768521ae019 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:13.696754 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b87eb3b4-8c76-4675-8f94-d768521ae019 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:13.697187 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b87eb3b4-8c76-4675-8f94-d768521ae019 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:13.823800 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-b87eb3b4-8c76-4675-8f94-d768521ae019 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d4cbd2a2154e5d925462df7c77815a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0d80988ca941acb8ad4318338dfbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:13.831645 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-b87eb3b4-8c76-4675-8f94-d768521ae019 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] 10.222.0.20 "GET /compute/v2.1/servers/d38a019f-4bfc-4845-900b-a9e4e6397373" status: 200 len: 1510 microversion: 2.1 time: 0.147413 Oct 20 06:07:13.832219 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 194/364] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:07:13 2022] GET /compute/v2.1/servers/d38a019f-4bfc-4845-900b-a9e4e6397373 => generated 1510 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:07:14.387801 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-eda6926e-ce1b-43b8-b3e8-127da1d66271 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:07:14.388406 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-eda6926e-ce1b-43b8-b3e8-127da1d66271 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: 5a669c5b-898f-4fef-8508-254ccd998571] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:07:14.394798 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-eda6926e-ce1b-43b8-b3e8-127da1d66271 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:14.395278 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-eda6926e-ce1b-43b8-b3e8-127da1d66271 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:14.395715 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-eda6926e-ce1b-43b8-b3e8-127da1d66271 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:14.396403 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-eda6926e-ce1b-43b8-b3e8-127da1d66271 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:14.396954 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-eda6926e-ce1b-43b8-b3e8-127da1d66271 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:14.397381 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-eda6926e-ce1b-43b8-b3e8-127da1d66271 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:14.416502 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG dbcounter [-] [118860] Writing DB stats nova_cell1:SELECT=100 {{(pid=118860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:07:14.473114 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-ee20151b-ac75-4337-97fd-80e1a5f4922c tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:07:14.473711 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-ee20151b-ac75-4337-97fd-80e1a5f4922c tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:07:14.480924 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ee20151b-ac75-4337-97fd-80e1a5f4922c tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:14.481403 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ee20151b-ac75-4337-97fd-80e1a5f4922c tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:14.481831 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ee20151b-ac75-4337-97fd-80e1a5f4922c tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:14.482521 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ee20151b-ac75-4337-97fd-80e1a5f4922c tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:14.482977 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ee20151b-ac75-4337-97fd-80e1a5f4922c tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:14.483390 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ee20151b-ac75-4337-97fd-80e1a5f4922c tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:14.527485 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-eda6926e-ce1b-43b8-b3e8-127da1d66271 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:14.536508 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-eda6926e-ce1b-43b8-b3e8-127da1d66271 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/5a669c5b-898f-4fef-8508-254ccd998571" status: 200 len: 1365 microversion: 2.1 time: 0.152826 Oct 20 06:07:14.537104 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 171/365] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:07:14 2022] GET /compute/v2.1/servers/5a669c5b-898f-4fef-8508-254ccd998571 => generated 1365 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:07:14.613407 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-ee20151b-ac75-4337-97fd-80e1a5f4922c tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:14.621669 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-ee20151b-ac75-4337-97fd-80e1a5f4922c tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:14.623118 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-ee20151b-ac75-4337-97fd-80e1a5f4922c tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:14.624278 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-ee20151b-ac75-4337-97fd-80e1a5f4922c tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1722 microversion: 2.20 time: 0.155071 Oct 20 06:07:14.624882 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 195/366] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:07:14 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 20 06:07:14.854809 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-8883ad46-97df-4a26-af6c-7fadea6b7ab8 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:07:14.855339 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-8883ad46-97df-4a26-af6c-7fadea6b7ab8 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] [instance: d38a019f-4bfc-4845-900b-a9e4e6397373] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:07:14.861247 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-8883ad46-97df-4a26-af6c-7fadea6b7ab8 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:14.861730 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-8883ad46-97df-4a26-af6c-7fadea6b7ab8 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:14.862169 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-8883ad46-97df-4a26-af6c-7fadea6b7ab8 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:14.862858 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-8883ad46-97df-4a26-af6c-7fadea6b7ab8 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:14.863312 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-8883ad46-97df-4a26-af6c-7fadea6b7ab8 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:14.863737 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-8883ad46-97df-4a26-af6c-7fadea6b7ab8 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:14.994198 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-8883ad46-97df-4a26-af6c-7fadea6b7ab8 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d4cbd2a2154e5d925462df7c77815a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0d80988ca941acb8ad4318338dfbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:15.001809 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-8883ad46-97df-4a26-af6c-7fadea6b7ab8 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] 10.222.0.20 "GET /compute/v2.1/servers/d38a019f-4bfc-4845-900b-a9e4e6397373" status: 200 len: 1510 microversion: 2.1 time: 0.151201 Oct 20 06:07:15.002375 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 172/367] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:07:14 2022] GET /compute/v2.1/servers/d38a019f-4bfc-4845-900b-a9e4e6397373 => generated 1510 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:07:15.560389 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-1d6260d3-27db-4aa5-b6cb-5c5b24c3b704 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:07:15.561027 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-1d6260d3-27db-4aa5-b6cb-5c5b24c3b704 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: 5a669c5b-898f-4fef-8508-254ccd998571] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:07:15.567447 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1d6260d3-27db-4aa5-b6cb-5c5b24c3b704 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:15.567964 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1d6260d3-27db-4aa5-b6cb-5c5b24c3b704 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:15.568407 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1d6260d3-27db-4aa5-b6cb-5c5b24c3b704 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:15.569139 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1d6260d3-27db-4aa5-b6cb-5c5b24c3b704 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:15.569594 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1d6260d3-27db-4aa5-b6cb-5c5b24c3b704 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:15.570019 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1d6260d3-27db-4aa5-b6cb-5c5b24c3b704 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:15.650043 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-50d2ed2f-1513-44ce-9c61-31ad4413cace tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:07:15.650440 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-50d2ed2f-1513-44ce-9c61-31ad4413cace tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:07:15.656901 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-50d2ed2f-1513-44ce-9c61-31ad4413cace tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:15.657400 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-50d2ed2f-1513-44ce-9c61-31ad4413cace tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:15.657844 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-50d2ed2f-1513-44ce-9c61-31ad4413cace tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:15.658551 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-50d2ed2f-1513-44ce-9c61-31ad4413cace tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:15.659008 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-50d2ed2f-1513-44ce-9c61-31ad4413cace tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:15.659436 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-50d2ed2f-1513-44ce-9c61-31ad4413cace tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:15.703896 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-1d6260d3-27db-4aa5-b6cb-5c5b24c3b704 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:15.711721 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-1d6260d3-27db-4aa5-b6cb-5c5b24c3b704 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/5a669c5b-898f-4fef-8508-254ccd998571" status: 200 len: 1365 microversion: 2.1 time: 0.155472 Oct 20 06:07:15.716258 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 196/368] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:07:15 2022] GET /compute/v2.1/servers/5a669c5b-898f-4fef-8508-254ccd998571 => generated 1365 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:07:15.795667 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-50d2ed2f-1513-44ce-9c61-31ad4413cace tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:15.803622 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-50d2ed2f-1513-44ce-9c61-31ad4413cace tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:15.805711 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-50d2ed2f-1513-44ce-9c61-31ad4413cace tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:15.806853 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-50d2ed2f-1513-44ce-9c61-31ad4413cace tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1722 microversion: 2.20 time: 0.161129 Oct 20 06:07:15.807405 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 173/369] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:07:15 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 20 06:07:16.026741 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-61a6a755-d6a6-42c9-84fb-6900c4b00b35 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:07:16.027394 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-61a6a755-d6a6-42c9-84fb-6900c4b00b35 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] [instance: d38a019f-4bfc-4845-900b-a9e4e6397373] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:07:16.033335 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-61a6a755-d6a6-42c9-84fb-6900c4b00b35 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:16.033819 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-61a6a755-d6a6-42c9-84fb-6900c4b00b35 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:16.034250 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-61a6a755-d6a6-42c9-84fb-6900c4b00b35 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:16.034930 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-61a6a755-d6a6-42c9-84fb-6900c4b00b35 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:16.035376 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-61a6a755-d6a6-42c9-84fb-6900c4b00b35 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:16.035794 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-61a6a755-d6a6-42c9-84fb-6900c4b00b35 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:16.165799 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-61a6a755-d6a6-42c9-84fb-6900c4b00b35 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d4cbd2a2154e5d925462df7c77815a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0d80988ca941acb8ad4318338dfbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:16.173270 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-61a6a755-d6a6-42c9-84fb-6900c4b00b35 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] 10.222.0.20 "GET /compute/v2.1/servers/d38a019f-4bfc-4845-900b-a9e4e6397373" status: 200 len: 1510 microversion: 2.1 time: 0.151649 Oct 20 06:07:16.173835 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 197/370] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:07:16 2022] GET /compute/v2.1/servers/d38a019f-4bfc-4845-900b-a9e4e6397373 => generated 1510 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:07:16.733927 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-90cdc01c-abb4-4b70-b350-96550d3792a7 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:07:16.734538 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-90cdc01c-abb4-4b70-b350-96550d3792a7 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: 5a669c5b-898f-4fef-8508-254ccd998571] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:07:16.740959 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-90cdc01c-abb4-4b70-b350-96550d3792a7 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:16.741552 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-90cdc01c-abb4-4b70-b350-96550d3792a7 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:16.741873 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-90cdc01c-abb4-4b70-b350-96550d3792a7 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:16.742679 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-90cdc01c-abb4-4b70-b350-96550d3792a7 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:16.743190 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-90cdc01c-abb4-4b70-b350-96550d3792a7 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:16.743617 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-90cdc01c-abb4-4b70-b350-96550d3792a7 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:16.831246 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-9bba6844-a4fd-4c6d-a47a-b0dc681b72f8 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:07:16.831971 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-9bba6844-a4fd-4c6d-a47a-b0dc681b72f8 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:07:16.839519 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-9bba6844-a4fd-4c6d-a47a-b0dc681b72f8 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:16.840037 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-9bba6844-a4fd-4c6d-a47a-b0dc681b72f8 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:16.840479 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-9bba6844-a4fd-4c6d-a47a-b0dc681b72f8 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:16.841212 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-9bba6844-a4fd-4c6d-a47a-b0dc681b72f8 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:16.841664 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-9bba6844-a4fd-4c6d-a47a-b0dc681b72f8 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:16.842116 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-9bba6844-a4fd-4c6d-a47a-b0dc681b72f8 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:16.872173 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-90cdc01c-abb4-4b70-b350-96550d3792a7 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:16.880316 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-90cdc01c-abb4-4b70-b350-96550d3792a7 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/5a669c5b-898f-4fef-8508-254ccd998571" status: 200 len: 1365 microversion: 2.1 time: 0.150120 Oct 20 06:07:16.880917 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 174/371] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:07:16 2022] GET /compute/v2.1/servers/5a669c5b-898f-4fef-8508-254ccd998571 => generated 1365 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:07:16.971957 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-9bba6844-a4fd-4c6d-a47a-b0dc681b72f8 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:16.980642 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-9bba6844-a4fd-4c6d-a47a-b0dc681b72f8 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:16.982060 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-9bba6844-a4fd-4c6d-a47a-b0dc681b72f8 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:16.983209 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-9bba6844-a4fd-4c6d-a47a-b0dc681b72f8 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1722 microversion: 2.20 time: 0.155847 Oct 20 06:07:16.983773 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 198/372] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:07:16 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 20 06:07:17.197119 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-70cb99b6-011a-4a36-b783-64612cd48e9b tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:07:17.197726 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-70cb99b6-011a-4a36-b783-64612cd48e9b tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] [instance: d38a019f-4bfc-4845-900b-a9e4e6397373] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:07:17.203596 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-70cb99b6-011a-4a36-b783-64612cd48e9b tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:17.204080 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-70cb99b6-011a-4a36-b783-64612cd48e9b tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:17.204515 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-70cb99b6-011a-4a36-b783-64612cd48e9b tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:17.205233 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-70cb99b6-011a-4a36-b783-64612cd48e9b tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:17.205686 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-70cb99b6-011a-4a36-b783-64612cd48e9b tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:17.206115 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-70cb99b6-011a-4a36-b783-64612cd48e9b tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:17.338887 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-70cb99b6-011a-4a36-b783-64612cd48e9b tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d4cbd2a2154e5d925462df7c77815a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0d80988ca941acb8ad4318338dfbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:17.347651 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-70cb99b6-011a-4a36-b783-64612cd48e9b tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] 10.222.0.20 "GET /compute/v2.1/servers/d38a019f-4bfc-4845-900b-a9e4e6397373" status: 200 len: 1510 microversion: 2.1 time: 0.154843 Oct 20 06:07:17.348244 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 175/373] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:07:17 2022] GET /compute/v2.1/servers/d38a019f-4bfc-4845-900b-a9e4e6397373 => generated 1510 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:07:17.902764 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-0387c520-a894-48d2-a5b2-25a8167ff8bf tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:07:17.903406 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-0387c520-a894-48d2-a5b2-25a8167ff8bf tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: 5a669c5b-898f-4fef-8508-254ccd998571] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:07:17.909920 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-0387c520-a894-48d2-a5b2-25a8167ff8bf tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:17.910399 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-0387c520-a894-48d2-a5b2-25a8167ff8bf tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:17.910834 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-0387c520-a894-48d2-a5b2-25a8167ff8bf tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:17.911519 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-0387c520-a894-48d2-a5b2-25a8167ff8bf tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:17.911967 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-0387c520-a894-48d2-a5b2-25a8167ff8bf tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:17.912385 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-0387c520-a894-48d2-a5b2-25a8167ff8bf tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:18.008685 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-34ef0927-4fee-45f6-9693-c7a4b91a2b72 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:07:18.009856 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-34ef0927-4fee-45f6-9693-c7a4b91a2b72 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:07:18.016266 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-34ef0927-4fee-45f6-9693-c7a4b91a2b72 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:18.016784 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-34ef0927-4fee-45f6-9693-c7a4b91a2b72 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:18.017228 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-34ef0927-4fee-45f6-9693-c7a4b91a2b72 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:18.017929 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-34ef0927-4fee-45f6-9693-c7a4b91a2b72 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:18.018390 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-34ef0927-4fee-45f6-9693-c7a4b91a2b72 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:18.018821 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-34ef0927-4fee-45f6-9693-c7a4b91a2b72 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:18.043795 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-0387c520-a894-48d2-a5b2-25a8167ff8bf tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:18.056461 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-0387c520-a894-48d2-a5b2-25a8167ff8bf tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/5a669c5b-898f-4fef-8508-254ccd998571" status: 200 len: 1365 microversion: 2.1 time: 0.157434 Oct 20 06:07:18.057105 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 199/374] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:07:17 2022] GET /compute/v2.1/servers/5a669c5b-898f-4fef-8508-254ccd998571 => generated 1365 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:07:18.154330 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-34ef0927-4fee-45f6-9693-c7a4b91a2b72 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:18.162361 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-34ef0927-4fee-45f6-9693-c7a4b91a2b72 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:18.163860 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-34ef0927-4fee-45f6-9693-c7a4b91a2b72 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:18.165306 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-34ef0927-4fee-45f6-9693-c7a4b91a2b72 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1722 microversion: 2.20 time: 0.160829 Oct 20 06:07:18.165888 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 176/375] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:07:18 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 20 06:07:18.371107 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-9abf0b66-149c-443d-8199-9130f4b1ef9a tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:07:18.371715 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-9abf0b66-149c-443d-8199-9130f4b1ef9a tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] [instance: d38a019f-4bfc-4845-900b-a9e4e6397373] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:07:18.377590 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-9abf0b66-149c-443d-8199-9130f4b1ef9a tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:18.378099 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-9abf0b66-149c-443d-8199-9130f4b1ef9a tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:18.378504 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-9abf0b66-149c-443d-8199-9130f4b1ef9a tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:18.379195 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-9abf0b66-149c-443d-8199-9130f4b1ef9a tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:18.379647 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-9abf0b66-149c-443d-8199-9130f4b1ef9a tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:18.380228 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-9abf0b66-149c-443d-8199-9130f4b1ef9a tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:18.506990 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-9abf0b66-149c-443d-8199-9130f4b1ef9a tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d4cbd2a2154e5d925462df7c77815a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0d80988ca941acb8ad4318338dfbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:18.515476 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-9abf0b66-149c-443d-8199-9130f4b1ef9a tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] 10.222.0.20 "GET /compute/v2.1/servers/d38a019f-4bfc-4845-900b-a9e4e6397373" status: 200 len: 1510 microversion: 2.1 time: 0.149361 Oct 20 06:07:18.516041 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 200/376] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:07:18 2022] GET /compute/v2.1/servers/d38a019f-4bfc-4845-900b-a9e4e6397373 => generated 1510 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:07:19.079317 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-d9ff985c-768f-49d1-a909-fa5051bc3911 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:07:19.079921 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-d9ff985c-768f-49d1-a909-fa5051bc3911 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: 5a669c5b-898f-4fef-8508-254ccd998571] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:07:19.086712 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-d9ff985c-768f-49d1-a909-fa5051bc3911 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:19.087276 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-d9ff985c-768f-49d1-a909-fa5051bc3911 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:19.087709 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-d9ff985c-768f-49d1-a909-fa5051bc3911 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:19.088389 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-d9ff985c-768f-49d1-a909-fa5051bc3911 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:19.088872 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-d9ff985c-768f-49d1-a909-fa5051bc3911 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:19.089289 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-d9ff985c-768f-49d1-a909-fa5051bc3911 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:19.190768 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-d0fdb01d-67ec-416e-934d-495eaf615b47 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:07:19.191375 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-d0fdb01d-67ec-416e-934d-495eaf615b47 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:07:19.197985 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d0fdb01d-67ec-416e-934d-495eaf615b47 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:19.198465 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d0fdb01d-67ec-416e-934d-495eaf615b47 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:19.198965 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d0fdb01d-67ec-416e-934d-495eaf615b47 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:19.199656 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d0fdb01d-67ec-416e-934d-495eaf615b47 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:19.200103 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d0fdb01d-67ec-416e-934d-495eaf615b47 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:19.200521 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d0fdb01d-67ec-416e-934d-495eaf615b47 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:19.223774 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-d9ff985c-768f-49d1-a909-fa5051bc3911 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:19.232102 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-d9ff985c-768f-49d1-a909-fa5051bc3911 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/5a669c5b-898f-4fef-8508-254ccd998571" status: 200 len: 1365 microversion: 2.1 time: 0.156646 Oct 20 06:07:19.232675 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 177/377] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:07:19 2022] GET /compute/v2.1/servers/5a669c5b-898f-4fef-8508-254ccd998571 => generated 1365 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:07:19.328260 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-d0fdb01d-67ec-416e-934d-495eaf615b47 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:19.337103 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-d0fdb01d-67ec-416e-934d-495eaf615b47 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:19.338726 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-d0fdb01d-67ec-416e-934d-495eaf615b47 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:19.339874 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-d0fdb01d-67ec-416e-934d-495eaf615b47 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1722 microversion: 2.20 time: 0.153038 Oct 20 06:07:19.340425 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 201/378] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:07:19 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 20 06:07:19.538330 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-1509793b-cb34-4663-a3df-34284bd29086 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:07:19.538972 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-1509793b-cb34-4663-a3df-34284bd29086 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] [instance: d38a019f-4bfc-4845-900b-a9e4e6397373] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:07:19.544954 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1509793b-cb34-4663-a3df-34284bd29086 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:19.545440 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1509793b-cb34-4663-a3df-34284bd29086 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:19.545876 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1509793b-cb34-4663-a3df-34284bd29086 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:19.546571 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1509793b-cb34-4663-a3df-34284bd29086 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:19.547069 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1509793b-cb34-4663-a3df-34284bd29086 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:19.547927 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1509793b-cb34-4663-a3df-34284bd29086 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:19.678399 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-1509793b-cb34-4663-a3df-34284bd29086 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d4cbd2a2154e5d925462df7c77815a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0d80988ca941acb8ad4318338dfbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:19.686546 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-1509793b-cb34-4663-a3df-34284bd29086 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] 10.222.0.20 "GET /compute/v2.1/servers/d38a019f-4bfc-4845-900b-a9e4e6397373" status: 200 len: 1510 microversion: 2.1 time: 0.152090 Oct 20 06:07:19.687112 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 178/379] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:07:19 2022] GET /compute/v2.1/servers/d38a019f-4bfc-4845-900b-a9e4e6397373 => generated 1510 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:07:20.255137 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-7b4c9a31-6909-46b3-9dde-7df685aa8ca7 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:07:20.255747 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-7b4c9a31-6909-46b3-9dde-7df685aa8ca7 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: 5a669c5b-898f-4fef-8508-254ccd998571] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:07:20.262641 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7b4c9a31-6909-46b3-9dde-7df685aa8ca7 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:20.263129 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7b4c9a31-6909-46b3-9dde-7df685aa8ca7 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:20.263556 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7b4c9a31-6909-46b3-9dde-7df685aa8ca7 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:20.264241 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7b4c9a31-6909-46b3-9dde-7df685aa8ca7 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:20.264710 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7b4c9a31-6909-46b3-9dde-7df685aa8ca7 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:20.265134 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7b4c9a31-6909-46b3-9dde-7df685aa8ca7 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:20.269061 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG dbcounter [-] [118861] Writing DB stats nova_cell1:SELECT=100 {{(pid=118861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:07:20.365365 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-53b8184e-d35a-4584-9a72-6faa826f41ab tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:07:20.365976 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-53b8184e-d35a-4584-9a72-6faa826f41ab tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:07:20.373009 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-53b8184e-d35a-4584-9a72-6faa826f41ab tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:20.373496 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-53b8184e-d35a-4584-9a72-6faa826f41ab tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:20.373964 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-53b8184e-d35a-4584-9a72-6faa826f41ab tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:20.374663 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-53b8184e-d35a-4584-9a72-6faa826f41ab tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:20.375149 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-53b8184e-d35a-4584-9a72-6faa826f41ab tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:20.375757 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-53b8184e-d35a-4584-9a72-6faa826f41ab tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:20.396639 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-7b4c9a31-6909-46b3-9dde-7df685aa8ca7 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:20.405023 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-7b4c9a31-6909-46b3-9dde-7df685aa8ca7 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/5a669c5b-898f-4fef-8508-254ccd998571" status: 200 len: 1365 microversion: 2.1 time: 0.153759 Oct 20 06:07:20.405594 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 202/380] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:07:20 2022] GET /compute/v2.1/servers/5a669c5b-898f-4fef-8508-254ccd998571 => generated 1365 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:07:20.515655 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-53b8184e-d35a-4584-9a72-6faa826f41ab tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:20.524202 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-53b8184e-d35a-4584-9a72-6faa826f41ab tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:20.526028 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-53b8184e-d35a-4584-9a72-6faa826f41ab tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:20.527184 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-53b8184e-d35a-4584-9a72-6faa826f41ab tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1722 microversion: 2.20 time: 0.165787 Oct 20 06:07:20.527726 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 179/381] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:07:20 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1722 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:07:20.710624 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-2436e6b8-1925-4af1-a4c2-da82d21faeb4 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:07:20.711186 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-2436e6b8-1925-4af1-a4c2-da82d21faeb4 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] [instance: d38a019f-4bfc-4845-900b-a9e4e6397373] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:07:20.717352 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-2436e6b8-1925-4af1-a4c2-da82d21faeb4 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:20.717839 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-2436e6b8-1925-4af1-a4c2-da82d21faeb4 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:20.718277 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-2436e6b8-1925-4af1-a4c2-da82d21faeb4 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:20.718971 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-2436e6b8-1925-4af1-a4c2-da82d21faeb4 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:20.719422 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-2436e6b8-1925-4af1-a4c2-da82d21faeb4 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:20.719844 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-2436e6b8-1925-4af1-a4c2-da82d21faeb4 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:20.846580 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-2436e6b8-1925-4af1-a4c2-da82d21faeb4 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d4cbd2a2154e5d925462df7c77815a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0d80988ca941acb8ad4318338dfbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:20.854695 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-2436e6b8-1925-4af1-a4c2-da82d21faeb4 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] 10.222.0.20 "GET /compute/v2.1/servers/d38a019f-4bfc-4845-900b-a9e4e6397373" status: 200 len: 1510 microversion: 2.1 time: 0.148036 Oct 20 06:07:20.855265 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 203/382] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:07:20 2022] GET /compute/v2.1/servers/d38a019f-4bfc-4845-900b-a9e4e6397373 => generated 1510 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:07:21.428511 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-3ca11c80-41f8-41e2-86a7-fb6d7907882a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:07:21.429149 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-3ca11c80-41f8-41e2-86a7-fb6d7907882a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: 5a669c5b-898f-4fef-8508-254ccd998571] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:07:21.435280 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3ca11c80-41f8-41e2-86a7-fb6d7907882a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:21.435764 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3ca11c80-41f8-41e2-86a7-fb6d7907882a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:21.436205 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3ca11c80-41f8-41e2-86a7-fb6d7907882a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:21.436932 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3ca11c80-41f8-41e2-86a7-fb6d7907882a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:21.437387 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3ca11c80-41f8-41e2-86a7-fb6d7907882a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:21.437814 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3ca11c80-41f8-41e2-86a7-fb6d7907882a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:21.551266 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-72fb661a-85c0-4caf-bd95-eda37d7301f2 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:07:21.551879 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-72fb661a-85c0-4caf-bd95-eda37d7301f2 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:07:21.559056 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-72fb661a-85c0-4caf-bd95-eda37d7301f2 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:21.559538 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-72fb661a-85c0-4caf-bd95-eda37d7301f2 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:21.559973 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-72fb661a-85c0-4caf-bd95-eda37d7301f2 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:21.560682 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-72fb661a-85c0-4caf-bd95-eda37d7301f2 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:21.561160 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-72fb661a-85c0-4caf-bd95-eda37d7301f2 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:21.561765 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-72fb661a-85c0-4caf-bd95-eda37d7301f2 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:21.567476 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-3ca11c80-41f8-41e2-86a7-fb6d7907882a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:21.577240 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-3ca11c80-41f8-41e2-86a7-fb6d7907882a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/5a669c5b-898f-4fef-8508-254ccd998571" status: 200 len: 1365 microversion: 2.1 time: 0.152650 Oct 20 06:07:21.578379 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 180/383] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:07:21 2022] GET /compute/v2.1/servers/5a669c5b-898f-4fef-8508-254ccd998571 => generated 1365 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:07:21.697251 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-72fb661a-85c0-4caf-bd95-eda37d7301f2 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:21.705222 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-72fb661a-85c0-4caf-bd95-eda37d7301f2 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:21.706646 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-72fb661a-85c0-4caf-bd95-eda37d7301f2 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:21.707782 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-72fb661a-85c0-4caf-bd95-eda37d7301f2 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1722 microversion: 2.20 time: 0.160435 Oct 20 06:07:21.708337 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 204/384] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:07:21 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 20 06:07:21.878287 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-2b1b5200-ec0f-4600-8ec6-41cff16ca4c2 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:07:21.878896 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-2b1b5200-ec0f-4600-8ec6-41cff16ca4c2 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] [instance: d38a019f-4bfc-4845-900b-a9e4e6397373] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:07:21.886041 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2b1b5200-ec0f-4600-8ec6-41cff16ca4c2 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:21.886529 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2b1b5200-ec0f-4600-8ec6-41cff16ca4c2 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:21.886969 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2b1b5200-ec0f-4600-8ec6-41cff16ca4c2 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:21.887668 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2b1b5200-ec0f-4600-8ec6-41cff16ca4c2 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:21.888122 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2b1b5200-ec0f-4600-8ec6-41cff16ca4c2 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:21.888549 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2b1b5200-ec0f-4600-8ec6-41cff16ca4c2 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:22.015227 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-2b1b5200-ec0f-4600-8ec6-41cff16ca4c2 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d4cbd2a2154e5d925462df7c77815a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0d80988ca941acb8ad4318338dfbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:22.022783 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-2b1b5200-ec0f-4600-8ec6-41cff16ca4c2 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] 10.222.0.20 "GET /compute/v2.1/servers/d38a019f-4bfc-4845-900b-a9e4e6397373" status: 200 len: 1510 microversion: 2.1 time: 0.148348 Oct 20 06:07:22.023278 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 181/385] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:07:21 2022] GET /compute/v2.1/servers/d38a019f-4bfc-4845-900b-a9e4e6397373 => generated 1510 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:07:22.604209 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-12dd21b9-f974-4c4d-ae64-31729a951de2 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:07:22.604862 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-12dd21b9-f974-4c4d-ae64-31729a951de2 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: 5a669c5b-898f-4fef-8508-254ccd998571] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:07:22.611326 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-12dd21b9-f974-4c4d-ae64-31729a951de2 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:22.611829 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-12dd21b9-f974-4c4d-ae64-31729a951de2 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:22.612247 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-12dd21b9-f974-4c4d-ae64-31729a951de2 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:22.612968 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-12dd21b9-f974-4c4d-ae64-31729a951de2 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:22.613419 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-12dd21b9-f974-4c4d-ae64-31729a951de2 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:22.613845 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-12dd21b9-f974-4c4d-ae64-31729a951de2 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:22.733880 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-478ff400-10fc-49c4-82d7-984e83f2b700 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:07:22.734478 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-478ff400-10fc-49c4-82d7-984e83f2b700 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:07:22.740538 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-12dd21b9-f974-4c4d-ae64-31729a951de2 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:22.740798 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-478ff400-10fc-49c4-82d7-984e83f2b700 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:22.741283 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-478ff400-10fc-49c4-82d7-984e83f2b700 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:22.741717 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-478ff400-10fc-49c4-82d7-984e83f2b700 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:22.742413 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-478ff400-10fc-49c4-82d7-984e83f2b700 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:22.742857 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-478ff400-10fc-49c4-82d7-984e83f2b700 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:22.743275 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-478ff400-10fc-49c4-82d7-984e83f2b700 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:22.749113 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-12dd21b9-f974-4c4d-ae64-31729a951de2 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/5a669c5b-898f-4fef-8508-254ccd998571" status: 200 len: 1365 microversion: 2.1 time: 0.149029 Oct 20 06:07:22.749787 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 205/386] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:07:22 2022] GET /compute/v2.1/servers/5a669c5b-898f-4fef-8508-254ccd998571 => generated 1365 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:07:22.871927 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-478ff400-10fc-49c4-82d7-984e83f2b700 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:22.879876 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-478ff400-10fc-49c4-82d7-984e83f2b700 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:22.881345 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-478ff400-10fc-49c4-82d7-984e83f2b700 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:22.882483 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-478ff400-10fc-49c4-82d7-984e83f2b700 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1722 microversion: 2.20 time: 0.152541 Oct 20 06:07:22.883289 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 182/387] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:07:22 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 20 06:07:23.046547 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-c39f80ea-2097-480b-8b31-d694e311df7b tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:07:23.047157 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-c39f80ea-2097-480b-8b31-d694e311df7b tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] [instance: d38a019f-4bfc-4845-900b-a9e4e6397373] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:07:23.053522 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c39f80ea-2097-480b-8b31-d694e311df7b tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:23.054013 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c39f80ea-2097-480b-8b31-d694e311df7b tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:23.054446 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c39f80ea-2097-480b-8b31-d694e311df7b tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:23.055137 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c39f80ea-2097-480b-8b31-d694e311df7b tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:23.055635 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c39f80ea-2097-480b-8b31-d694e311df7b tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:23.056055 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c39f80ea-2097-480b-8b31-d694e311df7b tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:23.181290 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-c39f80ea-2097-480b-8b31-d694e311df7b tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d4cbd2a2154e5d925462df7c77815a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0d80988ca941acb8ad4318338dfbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:23.189532 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-c39f80ea-2097-480b-8b31-d694e311df7b tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] 10.222.0.20 "GET /compute/v2.1/servers/d38a019f-4bfc-4845-900b-a9e4e6397373" status: 200 len: 1510 microversion: 2.1 time: 0.146882 Oct 20 06:07:23.190094 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 206/388] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:07:23 2022] GET /compute/v2.1/servers/d38a019f-4bfc-4845-900b-a9e4e6397373 => generated 1510 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:07:23.772350 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-413174e5-8ae5-4cd2-8ea9-43311c077282 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:07:23.772983 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-413174e5-8ae5-4cd2-8ea9-43311c077282 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: 5a669c5b-898f-4fef-8508-254ccd998571] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:07:23.779915 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-413174e5-8ae5-4cd2-8ea9-43311c077282 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:23.780391 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-413174e5-8ae5-4cd2-8ea9-43311c077282 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:23.780872 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-413174e5-8ae5-4cd2-8ea9-43311c077282 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:23.781553 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-413174e5-8ae5-4cd2-8ea9-43311c077282 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:23.782000 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-413174e5-8ae5-4cd2-8ea9-43311c077282 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:23.782419 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-413174e5-8ae5-4cd2-8ea9-43311c077282 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:23.907621 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-d6ea1123-b58b-4d52-8435-d17477191159 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:07:23.908138 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-413174e5-8ae5-4cd2-8ea9-43311c077282 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:23.908248 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-d6ea1123-b58b-4d52-8435-d17477191159 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:07:23.914769 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d6ea1123-b58b-4d52-8435-d17477191159 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:23.915254 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d6ea1123-b58b-4d52-8435-d17477191159 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:23.915563 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-413174e5-8ae5-4cd2-8ea9-43311c077282 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/5a669c5b-898f-4fef-8508-254ccd998571" status: 200 len: 1365 microversion: 2.1 time: 0.146914 Oct 20 06:07:23.916001 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d6ea1123-b58b-4d52-8435-d17477191159 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:23.916114 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 183/389] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:07:23 2022] GET /compute/v2.1/servers/5a669c5b-898f-4fef-8508-254ccd998571 => generated 1365 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:07:23.916796 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d6ea1123-b58b-4d52-8435-d17477191159 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:23.917253 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d6ea1123-b58b-4d52-8435-d17477191159 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:23.917678 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d6ea1123-b58b-4d52-8435-d17477191159 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:24.053629 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-d6ea1123-b58b-4d52-8435-d17477191159 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:24.061821 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-d6ea1123-b58b-4d52-8435-d17477191159 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:24.063271 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-d6ea1123-b58b-4d52-8435-d17477191159 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:24.064427 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-d6ea1123-b58b-4d52-8435-d17477191159 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1722 microversion: 2.20 time: 0.160743 Oct 20 06:07:24.065029 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 207/390] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:07:23 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 20 06:07:24.211922 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-d7c9386e-f231-438d-812f-c240b02cbbf8 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:07:24.212453 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-d7c9386e-f231-438d-812f-c240b02cbbf8 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] [instance: d38a019f-4bfc-4845-900b-a9e4e6397373] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:07:24.219096 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-d7c9386e-f231-438d-812f-c240b02cbbf8 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:24.219578 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-d7c9386e-f231-438d-812f-c240b02cbbf8 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:24.220011 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-d7c9386e-f231-438d-812f-c240b02cbbf8 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:24.220716 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-d7c9386e-f231-438d-812f-c240b02cbbf8 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:24.221171 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-d7c9386e-f231-438d-812f-c240b02cbbf8 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:24.221591 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-d7c9386e-f231-438d-812f-c240b02cbbf8 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:24.354129 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-d7c9386e-f231-438d-812f-c240b02cbbf8 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d4cbd2a2154e5d925462df7c77815a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0d80988ca941acb8ad4318338dfbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:24.361645 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-d7c9386e-f231-438d-812f-c240b02cbbf8 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] 10.222.0.20 "GET /compute/v2.1/servers/d38a019f-4bfc-4845-900b-a9e4e6397373" status: 200 len: 1510 microversion: 2.1 time: 0.153574 Oct 20 06:07:24.362203 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 184/391] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:07:24 2022] GET /compute/v2.1/servers/d38a019f-4bfc-4845-900b-a9e4e6397373 => generated 1510 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:07:24.938102 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-ce2ae9e1-470c-4cbe-8d9a-a5b7c328188d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:07:24.938716 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-ce2ae9e1-470c-4cbe-8d9a-a5b7c328188d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: 5a669c5b-898f-4fef-8508-254ccd998571] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:07:24.941039 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG dbcounter [-] [118861] Writing DB stats nova_api:SELECT=78 {{(pid=118861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:07:24.946522 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ce2ae9e1-470c-4cbe-8d9a-a5b7c328188d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:24.947041 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ce2ae9e1-470c-4cbe-8d9a-a5b7c328188d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:24.947471 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ce2ae9e1-470c-4cbe-8d9a-a5b7c328188d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:24.948163 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ce2ae9e1-470c-4cbe-8d9a-a5b7c328188d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:24.948613 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ce2ae9e1-470c-4cbe-8d9a-a5b7c328188d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:24.949062 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ce2ae9e1-470c-4cbe-8d9a-a5b7c328188d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:25.077944 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-ce2ae9e1-470c-4cbe-8d9a-a5b7c328188d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:25.085667 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-ce2ae9e1-470c-4cbe-8d9a-a5b7c328188d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/5a669c5b-898f-4fef-8508-254ccd998571" status: 200 len: 1365 microversion: 2.1 time: 0.151451 Oct 20 06:07:25.086234 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 208/392] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:07:24 2022] GET /compute/v2.1/servers/5a669c5b-898f-4fef-8508-254ccd998571 => generated 1365 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:07:25.090313 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-83cc2a22-9dcb-480c-80a2-6794c59d4ee9 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:07:25.090926 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-83cc2a22-9dcb-480c-80a2-6794c59d4ee9 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:07:25.097301 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-83cc2a22-9dcb-480c-80a2-6794c59d4ee9 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:25.097775 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-83cc2a22-9dcb-480c-80a2-6794c59d4ee9 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:25.098210 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-83cc2a22-9dcb-480c-80a2-6794c59d4ee9 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:25.098930 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-83cc2a22-9dcb-480c-80a2-6794c59d4ee9 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:25.099385 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-83cc2a22-9dcb-480c-80a2-6794c59d4ee9 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:25.099812 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-83cc2a22-9dcb-480c-80a2-6794c59d4ee9 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:25.227658 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-83cc2a22-9dcb-480c-80a2-6794c59d4ee9 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:25.236069 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-83cc2a22-9dcb-480c-80a2-6794c59d4ee9 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:25.237566 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-83cc2a22-9dcb-480c-80a2-6794c59d4ee9 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:25.238708 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-83cc2a22-9dcb-480c-80a2-6794c59d4ee9 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1722 microversion: 2.20 time: 0.153322 Oct 20 06:07:25.239257 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 185/393] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:07:25 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 20 06:07:25.384033 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-c96f3456-e6cc-4667-860a-8e4514ed8d7f tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:07:25.384781 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-c96f3456-e6cc-4667-860a-8e4514ed8d7f tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] [instance: d38a019f-4bfc-4845-900b-a9e4e6397373] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:07:25.390776 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c96f3456-e6cc-4667-860a-8e4514ed8d7f tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:25.391263 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c96f3456-e6cc-4667-860a-8e4514ed8d7f tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:25.391707 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c96f3456-e6cc-4667-860a-8e4514ed8d7f tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:25.392404 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c96f3456-e6cc-4667-860a-8e4514ed8d7f tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:25.392891 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c96f3456-e6cc-4667-860a-8e4514ed8d7f tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:25.393324 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c96f3456-e6cc-4667-860a-8e4514ed8d7f tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:25.526353 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-c96f3456-e6cc-4667-860a-8e4514ed8d7f tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d4cbd2a2154e5d925462df7c77815a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0d80988ca941acb8ad4318338dfbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:25.534004 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-c96f3456-e6cc-4667-860a-8e4514ed8d7f tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] 10.222.0.20 "GET /compute/v2.1/servers/d38a019f-4bfc-4845-900b-a9e4e6397373" status: 200 len: 1510 microversion: 2.1 time: 0.154055 Oct 20 06:07:25.534565 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 209/394] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:07:25 2022] GET /compute/v2.1/servers/d38a019f-4bfc-4845-900b-a9e4e6397373 => generated 1510 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:07:26.109134 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-49e99ea9-9302-48f7-91f2-a010c2255d3b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:07:26.109710 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-49e99ea9-9302-48f7-91f2-a010c2255d3b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: 5a669c5b-898f-4fef-8508-254ccd998571] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:07:26.112023 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG dbcounter [-] [118860] Writing DB stats nova_api:SELECT=78 {{(pid=118860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:07:26.117220 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-49e99ea9-9302-48f7-91f2-a010c2255d3b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:26.117697 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-49e99ea9-9302-48f7-91f2-a010c2255d3b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:26.118132 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-49e99ea9-9302-48f7-91f2-a010c2255d3b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:26.119956 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-49e99ea9-9302-48f7-91f2-a010c2255d3b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:26.120415 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-49e99ea9-9302-48f7-91f2-a010c2255d3b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:26.120871 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-49e99ea9-9302-48f7-91f2-a010c2255d3b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:26.248665 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-49e99ea9-9302-48f7-91f2-a010c2255d3b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:26.256239 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-49e99ea9-9302-48f7-91f2-a010c2255d3b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/5a669c5b-898f-4fef-8508-254ccd998571" status: 200 len: 1365 microversion: 2.1 time: 0.151002 Oct 20 06:07:26.256831 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 186/395] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:07:26 2022] GET /compute/v2.1/servers/5a669c5b-898f-4fef-8508-254ccd998571 => generated 1365 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:07:26.263654 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-6734c6f0-359d-497c-83e6-83239dd1282f tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:07:26.264266 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-6734c6f0-359d-497c-83e6-83239dd1282f tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:07:26.270727 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-6734c6f0-359d-497c-83e6-83239dd1282f tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:26.271210 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-6734c6f0-359d-497c-83e6-83239dd1282f tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:26.271655 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-6734c6f0-359d-497c-83e6-83239dd1282f tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:26.272347 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-6734c6f0-359d-497c-83e6-83239dd1282f tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:26.272828 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-6734c6f0-359d-497c-83e6-83239dd1282f tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:26.273255 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-6734c6f0-359d-497c-83e6-83239dd1282f tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:26.399049 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-6734c6f0-359d-497c-83e6-83239dd1282f tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:26.407764 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-6734c6f0-359d-497c-83e6-83239dd1282f tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:26.409238 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-6734c6f0-359d-497c-83e6-83239dd1282f tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:26.410389 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-6734c6f0-359d-497c-83e6-83239dd1282f tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1722 microversion: 2.20 time: 0.150768 Oct 20 06:07:26.410950 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 210/396] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:07:26 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:07:26.557522 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-6be8870e-1393-48ec-bf47-120ea8851f5a tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:07:26.558124 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-6be8870e-1393-48ec-bf47-120ea8851f5a tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] [instance: d38a019f-4bfc-4845-900b-a9e4e6397373] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:07:26.563985 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-6be8870e-1393-48ec-bf47-120ea8851f5a tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:26.564459 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-6be8870e-1393-48ec-bf47-120ea8851f5a tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:26.564935 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-6be8870e-1393-48ec-bf47-120ea8851f5a tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:26.565632 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-6be8870e-1393-48ec-bf47-120ea8851f5a tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:26.566069 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-6be8870e-1393-48ec-bf47-120ea8851f5a tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:26.566492 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-6be8870e-1393-48ec-bf47-120ea8851f5a tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:26.697414 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-6be8870e-1393-48ec-bf47-120ea8851f5a tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d4cbd2a2154e5d925462df7c77815a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0d80988ca941acb8ad4318338dfbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:26.704901 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-6be8870e-1393-48ec-bf47-120ea8851f5a tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] 10.222.0.20 "GET /compute/v2.1/servers/d38a019f-4bfc-4845-900b-a9e4e6397373" status: 200 len: 1510 microversion: 2.1 time: 0.151351 Oct 20 06:07:26.705454 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 187/397] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:07:26 2022] GET /compute/v2.1/servers/d38a019f-4bfc-4845-900b-a9e4e6397373 => generated 1510 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:07:27.279981 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-cc06e286-10d9-4d06-b357-85782f863310 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:07:27.280526 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-cc06e286-10d9-4d06-b357-85782f863310 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: 5a669c5b-898f-4fef-8508-254ccd998571] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:07:27.286695 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-cc06e286-10d9-4d06-b357-85782f863310 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:27.287171 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-cc06e286-10d9-4d06-b357-85782f863310 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:27.287603 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-cc06e286-10d9-4d06-b357-85782f863310 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:27.288288 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-cc06e286-10d9-4d06-b357-85782f863310 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:27.288765 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-cc06e286-10d9-4d06-b357-85782f863310 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:27.289192 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-cc06e286-10d9-4d06-b357-85782f863310 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:27.422822 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-cc06e286-10d9-4d06-b357-85782f863310 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:27.430681 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-cc06e286-10d9-4d06-b357-85782f863310 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/5a669c5b-898f-4fef-8508-254ccd998571" status: 200 len: 1365 microversion: 2.1 time: 0.155163 Oct 20 06:07:27.431766 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 211/398] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:07:27 2022] GET /compute/v2.1/servers/5a669c5b-898f-4fef-8508-254ccd998571 => generated 1365 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:07:27.436018 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-85c863a5-5816-4ced-987c-068820d2ae69 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:07:27.436626 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-85c863a5-5816-4ced-987c-068820d2ae69 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:07:27.443193 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-85c863a5-5816-4ced-987c-068820d2ae69 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:27.443691 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-85c863a5-5816-4ced-987c-068820d2ae69 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:27.444124 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-85c863a5-5816-4ced-987c-068820d2ae69 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:27.444834 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-85c863a5-5816-4ced-987c-068820d2ae69 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:27.445281 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-85c863a5-5816-4ced-987c-068820d2ae69 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:27.445702 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-85c863a5-5816-4ced-987c-068820d2ae69 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:27.450593 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG dbcounter [-] [118860] Writing DB stats nova_cell1:SELECT=100 {{(pid=118860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:07:27.573550 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-85c863a5-5816-4ced-987c-068820d2ae69 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:27.581900 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-85c863a5-5816-4ced-987c-068820d2ae69 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:27.583377 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-85c863a5-5816-4ced-987c-068820d2ae69 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:27.584555 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-85c863a5-5816-4ced-987c-068820d2ae69 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1722 microversion: 2.20 time: 0.153062 Oct 20 06:07:27.585142 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 188/399] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:07:27 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 20 06:07:27.727763 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-f6036669-15c9-4f8f-9123-50536cbcea1b tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:07:27.728897 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-f6036669-15c9-4f8f-9123-50536cbcea1b tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] [instance: d38a019f-4bfc-4845-900b-a9e4e6397373] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:07:27.734934 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f6036669-15c9-4f8f-9123-50536cbcea1b tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:27.735432 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f6036669-15c9-4f8f-9123-50536cbcea1b tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:27.735863 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f6036669-15c9-4f8f-9123-50536cbcea1b tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:27.736550 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f6036669-15c9-4f8f-9123-50536cbcea1b tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:27.737043 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f6036669-15c9-4f8f-9123-50536cbcea1b tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:27.737458 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f6036669-15c9-4f8f-9123-50536cbcea1b tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:27.865316 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-f6036669-15c9-4f8f-9123-50536cbcea1b tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d4cbd2a2154e5d925462df7c77815a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0d80988ca941acb8ad4318338dfbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:27.874146 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-f6036669-15c9-4f8f-9123-50536cbcea1b tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] 10.222.0.20 "GET /compute/v2.1/servers/d38a019f-4bfc-4845-900b-a9e4e6397373" status: 200 len: 1510 microversion: 2.1 time: 0.150116 Oct 20 06:07:27.874718 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 212/400] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:07:27 2022] GET /compute/v2.1/servers/d38a019f-4bfc-4845-900b-a9e4e6397373 => generated 1510 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:07:28.453502 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-a47a400c-eb12-4306-a75f-e2cfa6e4c479 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:07:28.454111 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-a47a400c-eb12-4306-a75f-e2cfa6e4c479 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: 5a669c5b-898f-4fef-8508-254ccd998571] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:07:28.460514 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a47a400c-eb12-4306-a75f-e2cfa6e4c479 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:28.461026 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a47a400c-eb12-4306-a75f-e2cfa6e4c479 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:28.461461 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a47a400c-eb12-4306-a75f-e2cfa6e4c479 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:28.462148 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a47a400c-eb12-4306-a75f-e2cfa6e4c479 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:28.462657 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a47a400c-eb12-4306-a75f-e2cfa6e4c479 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:28.463268 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a47a400c-eb12-4306-a75f-e2cfa6e4c479 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:28.591116 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-a47a400c-eb12-4306-a75f-e2cfa6e4c479 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:28.598785 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-a47a400c-eb12-4306-a75f-e2cfa6e4c479 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/5a669c5b-898f-4fef-8508-254ccd998571" status: 200 len: 1365 microversion: 2.1 time: 0.149105 Oct 20 06:07:28.599377 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 189/401] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:07:28 2022] GET /compute/v2.1/servers/5a669c5b-898f-4fef-8508-254ccd998571 => generated 1365 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:07:28.610121 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-b248f0d4-373c-4f5d-b285-b88ef3e5d462 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:07:28.610732 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-b248f0d4-373c-4f5d-b285-b88ef3e5d462 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:07:28.617127 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b248f0d4-373c-4f5d-b285-b88ef3e5d462 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:28.617614 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b248f0d4-373c-4f5d-b285-b88ef3e5d462 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:28.618046 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b248f0d4-373c-4f5d-b285-b88ef3e5d462 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:28.619420 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b248f0d4-373c-4f5d-b285-b88ef3e5d462 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:28.619933 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b248f0d4-373c-4f5d-b285-b88ef3e5d462 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:28.620379 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b248f0d4-373c-4f5d-b285-b88ef3e5d462 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:28.747780 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-b248f0d4-373c-4f5d-b285-b88ef3e5d462 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:28.755746 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-b248f0d4-373c-4f5d-b285-b88ef3e5d462 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:28.757215 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-b248f0d4-373c-4f5d-b285-b88ef3e5d462 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:28.758620 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-b248f0d4-373c-4f5d-b285-b88ef3e5d462 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1722 microversion: 2.20 time: 0.152382 Oct 20 06:07:28.759182 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 213/402] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:07:28 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:07:28.896780 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-84c40c4a-211b-4be7-943f-4cc9bed2b6de tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:07:28.897382 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-84c40c4a-211b-4be7-943f-4cc9bed2b6de tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] [instance: d38a019f-4bfc-4845-900b-a9e4e6397373] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:07:28.903846 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-84c40c4a-211b-4be7-943f-4cc9bed2b6de tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:28.904320 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-84c40c4a-211b-4be7-943f-4cc9bed2b6de tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:28.904772 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-84c40c4a-211b-4be7-943f-4cc9bed2b6de tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:28.905457 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-84c40c4a-211b-4be7-943f-4cc9bed2b6de tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:28.905904 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-84c40c4a-211b-4be7-943f-4cc9bed2b6de tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:28.906322 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-84c40c4a-211b-4be7-943f-4cc9bed2b6de tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:29.034308 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-84c40c4a-211b-4be7-943f-4cc9bed2b6de tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d4cbd2a2154e5d925462df7c77815a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0d80988ca941acb8ad4318338dfbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:29.041852 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-84c40c4a-211b-4be7-943f-4cc9bed2b6de tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] 10.222.0.20 "GET /compute/v2.1/servers/d38a019f-4bfc-4845-900b-a9e4e6397373" status: 200 len: 1510 microversion: 2.1 time: 0.149218 Oct 20 06:07:29.042437 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 190/403] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:07:28 2022] GET /compute/v2.1/servers/d38a019f-4bfc-4845-900b-a9e4e6397373 => generated 1510 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:07:29.623755 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-2ac9df0f-c979-47db-95f1-f982d36bcb68 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:07:29.624316 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-2ac9df0f-c979-47db-95f1-f982d36bcb68 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: 5a669c5b-898f-4fef-8508-254ccd998571] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:07:29.630940 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-2ac9df0f-c979-47db-95f1-f982d36bcb68 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:29.631444 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-2ac9df0f-c979-47db-95f1-f982d36bcb68 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:29.631903 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-2ac9df0f-c979-47db-95f1-f982d36bcb68 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:29.632587 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-2ac9df0f-c979-47db-95f1-f982d36bcb68 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:29.633312 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-2ac9df0f-c979-47db-95f1-f982d36bcb68 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:29.633729 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-2ac9df0f-c979-47db-95f1-f982d36bcb68 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:29.765705 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-2ac9df0f-c979-47db-95f1-f982d36bcb68 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:29.773211 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-2ac9df0f-c979-47db-95f1-f982d36bcb68 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/5a669c5b-898f-4fef-8508-254ccd998571" status: 200 len: 1365 microversion: 2.1 time: 0.153439 Oct 20 06:07:29.773781 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 214/404] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:07:29 2022] GET /compute/v2.1/servers/5a669c5b-898f-4fef-8508-254ccd998571 => generated 1365 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:07:29.784273 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-f96cc03d-83d4-4749-bfb5-d1849ff5c639 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:07:29.784993 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-f96cc03d-83d4-4749-bfb5-d1849ff5c639 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:07:29.792133 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f96cc03d-83d4-4749-bfb5-d1849ff5c639 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:29.792614 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f96cc03d-83d4-4749-bfb5-d1849ff5c639 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:29.793086 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f96cc03d-83d4-4749-bfb5-d1849ff5c639 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:29.793785 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f96cc03d-83d4-4749-bfb5-d1849ff5c639 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:29.794238 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f96cc03d-83d4-4749-bfb5-d1849ff5c639 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:29.794695 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f96cc03d-83d4-4749-bfb5-d1849ff5c639 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:29.923581 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-f96cc03d-83d4-4749-bfb5-d1849ff5c639 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:29.932422 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-f96cc03d-83d4-4749-bfb5-d1849ff5c639 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:29.933936 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-f96cc03d-83d4-4749-bfb5-d1849ff5c639 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:29.935123 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-f96cc03d-83d4-4749-bfb5-d1849ff5c639 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1722 microversion: 2.20 time: 0.154707 Oct 20 06:07:29.935699 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 191/405] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:07:29 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:07:30.064192 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-b4950ef6-d6ec-4c68-97b2-b407110a6f9c tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:07:30.064846 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-b4950ef6-d6ec-4c68-97b2-b407110a6f9c tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] [instance: d38a019f-4bfc-4845-900b-a9e4e6397373] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:07:30.070727 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b4950ef6-d6ec-4c68-97b2-b407110a6f9c tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:30.071212 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b4950ef6-d6ec-4c68-97b2-b407110a6f9c tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:30.071650 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b4950ef6-d6ec-4c68-97b2-b407110a6f9c tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:30.072337 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b4950ef6-d6ec-4c68-97b2-b407110a6f9c tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:30.072818 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b4950ef6-d6ec-4c68-97b2-b407110a6f9c tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:30.073245 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b4950ef6-d6ec-4c68-97b2-b407110a6f9c tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:30.200015 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-b4950ef6-d6ec-4c68-97b2-b407110a6f9c tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d4cbd2a2154e5d925462df7c77815a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0d80988ca941acb8ad4318338dfbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:30.207624 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-b4950ef6-d6ec-4c68-97b2-b407110a6f9c tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] 10.222.0.20 "GET /compute/v2.1/servers/d38a019f-4bfc-4845-900b-a9e4e6397373" status: 200 len: 1510 microversion: 2.1 time: 0.147272 Oct 20 06:07:30.208182 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 215/406] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:07:30 2022] GET /compute/v2.1/servers/d38a019f-4bfc-4845-900b-a9e4e6397373 => generated 1510 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:07:30.795566 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-6de10e2c-d6e8-4ab0-ae3e-c636cd17297c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:07:30.796178 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-6de10e2c-d6e8-4ab0-ae3e-c636cd17297c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: 5a669c5b-898f-4fef-8508-254ccd998571] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:07:30.802426 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-6de10e2c-d6e8-4ab0-ae3e-c636cd17297c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:30.802901 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-6de10e2c-d6e8-4ab0-ae3e-c636cd17297c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:30.803332 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-6de10e2c-d6e8-4ab0-ae3e-c636cd17297c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:30.804020 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-6de10e2c-d6e8-4ab0-ae3e-c636cd17297c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:30.804468 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-6de10e2c-d6e8-4ab0-ae3e-c636cd17297c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:30.804913 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-6de10e2c-d6e8-4ab0-ae3e-c636cd17297c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:30.930079 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-6de10e2c-d6e8-4ab0-ae3e-c636cd17297c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:30.937736 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-6de10e2c-d6e8-4ab0-ae3e-c636cd17297c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/5a669c5b-898f-4fef-8508-254ccd998571" status: 200 len: 1365 microversion: 2.1 time: 0.145894 Oct 20 06:07:30.938300 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 192/407] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:07:30 2022] GET /compute/v2.1/servers/5a669c5b-898f-4fef-8508-254ccd998571 => generated 1365 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:07:30.960239 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-f30792aa-e41b-431c-befe-a10ae1afb09a tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:07:30.960879 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-f30792aa-e41b-431c-befe-a10ae1afb09a tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:07:30.967975 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f30792aa-e41b-431c-befe-a10ae1afb09a tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:30.968459 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f30792aa-e41b-431c-befe-a10ae1afb09a tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:30.968927 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f30792aa-e41b-431c-befe-a10ae1afb09a tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:30.969612 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f30792aa-e41b-431c-befe-a10ae1afb09a tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:30.970062 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f30792aa-e41b-431c-befe-a10ae1afb09a tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:30.970482 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f30792aa-e41b-431c-befe-a10ae1afb09a tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:31.102072 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-f30792aa-e41b-431c-befe-a10ae1afb09a tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:31.110782 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-f30792aa-e41b-431c-befe-a10ae1afb09a tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:31.112204 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-f30792aa-e41b-431c-befe-a10ae1afb09a tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:31.113378 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-f30792aa-e41b-431c-befe-a10ae1afb09a tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1722 microversion: 2.20 time: 0.156989 Oct 20 06:07:31.113931 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 216/408] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:07:30 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:07:31.231875 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-d195851b-c442-4588-9a2b-c76746bb49c1 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:07:31.232481 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-d195851b-c442-4588-9a2b-c76746bb49c1 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] [instance: d38a019f-4bfc-4845-900b-a9e4e6397373] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:07:31.238514 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-d195851b-c442-4588-9a2b-c76746bb49c1 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:31.239005 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-d195851b-c442-4588-9a2b-c76746bb49c1 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:31.239444 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-d195851b-c442-4588-9a2b-c76746bb49c1 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:31.240141 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-d195851b-c442-4588-9a2b-c76746bb49c1 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:31.240597 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-d195851b-c442-4588-9a2b-c76746bb49c1 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:31.241103 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-d195851b-c442-4588-9a2b-c76746bb49c1 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:31.371112 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-d195851b-c442-4588-9a2b-c76746bb49c1 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d4cbd2a2154e5d925462df7c77815a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0d80988ca941acb8ad4318338dfbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:31.378674 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-d195851b-c442-4588-9a2b-c76746bb49c1 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] 10.222.0.20 "GET /compute/v2.1/servers/d38a019f-4bfc-4845-900b-a9e4e6397373" status: 200 len: 1510 microversion: 2.1 time: 0.151705 Oct 20 06:07:31.379238 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 193/409] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:07:31 2022] GET /compute/v2.1/servers/d38a019f-4bfc-4845-900b-a9e4e6397373 => generated 1510 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:07:31.960487 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-27ea77db-919c-43aa-9560-cf4c7d335750 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:07:31.961124 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-27ea77db-919c-43aa-9560-cf4c7d335750 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: 5a669c5b-898f-4fef-8508-254ccd998571] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:07:31.967765 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-27ea77db-919c-43aa-9560-cf4c7d335750 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:31.968225 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-27ea77db-919c-43aa-9560-cf4c7d335750 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:31.968652 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-27ea77db-919c-43aa-9560-cf4c7d335750 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:31.969365 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-27ea77db-919c-43aa-9560-cf4c7d335750 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:31.969808 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-27ea77db-919c-43aa-9560-cf4c7d335750 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:31.970227 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-27ea77db-919c-43aa-9560-cf4c7d335750 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:32.098793 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-27ea77db-919c-43aa-9560-cf4c7d335750 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:32.107135 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-27ea77db-919c-43aa-9560-cf4c7d335750 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/5a669c5b-898f-4fef-8508-254ccd998571" status: 200 len: 1365 microversion: 2.1 time: 0.150515 Oct 20 06:07:32.107707 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 217/410] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:07:31 2022] GET /compute/v2.1/servers/5a669c5b-898f-4fef-8508-254ccd998571 => generated 1365 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:07:32.138652 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-647a5d20-d81e-4eba-adc5-41926882cffb tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:07:32.139250 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-647a5d20-d81e-4eba-adc5-41926882cffb tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:07:32.145704 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-647a5d20-d81e-4eba-adc5-41926882cffb tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:32.146178 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-647a5d20-d81e-4eba-adc5-41926882cffb tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:32.146609 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-647a5d20-d81e-4eba-adc5-41926882cffb tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:32.147288 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-647a5d20-d81e-4eba-adc5-41926882cffb tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:32.147733 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-647a5d20-d81e-4eba-adc5-41926882cffb tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:32.148155 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-647a5d20-d81e-4eba-adc5-41926882cffb tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:32.280668 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-647a5d20-d81e-4eba-adc5-41926882cffb tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:32.288720 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-647a5d20-d81e-4eba-adc5-41926882cffb tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:32.290167 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-647a5d20-d81e-4eba-adc5-41926882cffb tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:32.291328 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-647a5d20-d81e-4eba-adc5-41926882cffb tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1722 microversion: 2.20 time: 0.156936 Oct 20 06:07:32.291888 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 194/411] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:07:32 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:07:32.402187 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-56c3c5de-43d9-462e-9ef7-b33bf777babd tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:07:32.402815 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-56c3c5de-43d9-462e-9ef7-b33bf777babd tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] [instance: d38a019f-4bfc-4845-900b-a9e4e6397373] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:07:32.408944 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-56c3c5de-43d9-462e-9ef7-b33bf777babd tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:32.409463 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-56c3c5de-43d9-462e-9ef7-b33bf777babd tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:32.409901 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-56c3c5de-43d9-462e-9ef7-b33bf777babd tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:32.410601 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-56c3c5de-43d9-462e-9ef7-b33bf777babd tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:32.411056 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-56c3c5de-43d9-462e-9ef7-b33bf777babd tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:32.411479 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-56c3c5de-43d9-462e-9ef7-b33bf777babd tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:32.545187 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-56c3c5de-43d9-462e-9ef7-b33bf777babd tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d4cbd2a2154e5d925462df7c77815a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0d80988ca941acb8ad4318338dfbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:32.548591 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG dbcounter [-] [118861] Writing DB stats nova_cell1:SELECT=100 {{(pid=118861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:07:32.553705 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-56c3c5de-43d9-462e-9ef7-b33bf777babd tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] 10.222.0.20 "GET /compute/v2.1/servers/d38a019f-4bfc-4845-900b-a9e4e6397373" status: 200 len: 1510 microversion: 2.1 time: 0.155510 Oct 20 06:07:32.554259 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 218/412] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:07:32 2022] GET /compute/v2.1/servers/d38a019f-4bfc-4845-900b-a9e4e6397373 => generated 1510 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:07:33.129731 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-2c8d5c40-fd29-4a6f-81e9-dc1d53cf5de0 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:07:33.130256 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-2c8d5c40-fd29-4a6f-81e9-dc1d53cf5de0 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: 5a669c5b-898f-4fef-8508-254ccd998571] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:07:33.136593 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2c8d5c40-fd29-4a6f-81e9-dc1d53cf5de0 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:33.137103 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2c8d5c40-fd29-4a6f-81e9-dc1d53cf5de0 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:33.137534 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2c8d5c40-fd29-4a6f-81e9-dc1d53cf5de0 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:33.138219 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2c8d5c40-fd29-4a6f-81e9-dc1d53cf5de0 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:33.138664 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2c8d5c40-fd29-4a6f-81e9-dc1d53cf5de0 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:33.139084 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2c8d5c40-fd29-4a6f-81e9-dc1d53cf5de0 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:33.265282 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-2c8d5c40-fd29-4a6f-81e9-dc1d53cf5de0 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:33.272826 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-2c8d5c40-fd29-4a6f-81e9-dc1d53cf5de0 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/5a669c5b-898f-4fef-8508-254ccd998571" status: 200 len: 1365 microversion: 2.1 time: 0.146978 Oct 20 06:07:33.273389 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 195/413] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:07:33 2022] GET /compute/v2.1/servers/5a669c5b-898f-4fef-8508-254ccd998571 => generated 1365 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:07:33.315281 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-d1cdac71-8b51-4bd8-8e42-df892f8044d9 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:07:33.315885 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-d1cdac71-8b51-4bd8-8e42-df892f8044d9 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:07:33.322467 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d1cdac71-8b51-4bd8-8e42-df892f8044d9 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:33.322944 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d1cdac71-8b51-4bd8-8e42-df892f8044d9 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:33.323376 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d1cdac71-8b51-4bd8-8e42-df892f8044d9 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:33.324065 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d1cdac71-8b51-4bd8-8e42-df892f8044d9 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:33.324514 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d1cdac71-8b51-4bd8-8e42-df892f8044d9 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:33.324977 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d1cdac71-8b51-4bd8-8e42-df892f8044d9 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:33.451153 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-d1cdac71-8b51-4bd8-8e42-df892f8044d9 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:33.459186 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-d1cdac71-8b51-4bd8-8e42-df892f8044d9 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:33.460627 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-d1cdac71-8b51-4bd8-8e42-df892f8044d9 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:33.461810 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-d1cdac71-8b51-4bd8-8e42-df892f8044d9 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1722 microversion: 2.20 time: 0.150449 Oct 20 06:07:33.462872 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 219/414] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:07:33 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:07:33.576873 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-d3a81d0c-9824-4fdd-80ef-5aa19cdfe7d2 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:07:33.577476 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-d3a81d0c-9824-4fdd-80ef-5aa19cdfe7d2 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] [instance: d38a019f-4bfc-4845-900b-a9e4e6397373] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:07:33.583302 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-d3a81d0c-9824-4fdd-80ef-5aa19cdfe7d2 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:33.583781 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-d3a81d0c-9824-4fdd-80ef-5aa19cdfe7d2 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:33.584213 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-d3a81d0c-9824-4fdd-80ef-5aa19cdfe7d2 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:33.584923 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-d3a81d0c-9824-4fdd-80ef-5aa19cdfe7d2 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:33.585373 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-d3a81d0c-9824-4fdd-80ef-5aa19cdfe7d2 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:33.585795 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-d3a81d0c-9824-4fdd-80ef-5aa19cdfe7d2 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:33.718444 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-d3a81d0c-9824-4fdd-80ef-5aa19cdfe7d2 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d4cbd2a2154e5d925462df7c77815a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0d80988ca941acb8ad4318338dfbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:33.726043 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-d3a81d0c-9824-4fdd-80ef-5aa19cdfe7d2 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] 10.222.0.20 "GET /compute/v2.1/servers/d38a019f-4bfc-4845-900b-a9e4e6397373" status: 200 len: 1510 microversion: 2.1 time: 0.153027 Oct 20 06:07:33.726603 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 196/415] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:07:33 2022] GET /compute/v2.1/servers/d38a019f-4bfc-4845-900b-a9e4e6397373 => generated 1510 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:07:34.295739 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-c700c85b-59d1-40c0-a5d0-e53947affcd4 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:07:34.296384 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-c700c85b-59d1-40c0-a5d0-e53947affcd4 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: 5a669c5b-898f-4fef-8508-254ccd998571] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:07:34.302536 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c700c85b-59d1-40c0-a5d0-e53947affcd4 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:34.303084 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c700c85b-59d1-40c0-a5d0-e53947affcd4 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:34.303527 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c700c85b-59d1-40c0-a5d0-e53947affcd4 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:34.304237 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c700c85b-59d1-40c0-a5d0-e53947affcd4 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:34.304712 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c700c85b-59d1-40c0-a5d0-e53947affcd4 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:34.305149 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c700c85b-59d1-40c0-a5d0-e53947affcd4 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:34.432916 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-c700c85b-59d1-40c0-a5d0-e53947affcd4 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:34.440453 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-c700c85b-59d1-40c0-a5d0-e53947affcd4 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/5a669c5b-898f-4fef-8508-254ccd998571" status: 200 len: 1365 microversion: 2.1 time: 0.148504 Oct 20 06:07:34.440979 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 220/416] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:07:34 2022] GET /compute/v2.1/servers/5a669c5b-898f-4fef-8508-254ccd998571 => generated 1365 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:07:34.487209 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-8ca59a50-027f-4989-b03c-8a3e4fab4d71 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:07:34.487810 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-8ca59a50-027f-4989-b03c-8a3e4fab4d71 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:07:34.495096 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-8ca59a50-027f-4989-b03c-8a3e4fab4d71 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:34.495567 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-8ca59a50-027f-4989-b03c-8a3e4fab4d71 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:34.496004 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-8ca59a50-027f-4989-b03c-8a3e4fab4d71 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:34.496684 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-8ca59a50-027f-4989-b03c-8a3e4fab4d71 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:34.497155 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-8ca59a50-027f-4989-b03c-8a3e4fab4d71 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:34.497575 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-8ca59a50-027f-4989-b03c-8a3e4fab4d71 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:34.626422 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-8ca59a50-027f-4989-b03c-8a3e4fab4d71 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:34.635150 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-8ca59a50-027f-4989-b03c-8a3e4fab4d71 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:34.636593 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-8ca59a50-027f-4989-b03c-8a3e4fab4d71 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:34.637768 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-8ca59a50-027f-4989-b03c-8a3e4fab4d71 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1722 microversion: 2.20 time: 0.154446 Oct 20 06:07:34.638324 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 197/417] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:07:34 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:07:34.748939 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-21189bff-992e-4cc2-99f0-b89f13472e39 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:07:34.749470 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-21189bff-992e-4cc2-99f0-b89f13472e39 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] [instance: d38a019f-4bfc-4845-900b-a9e4e6397373] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:07:34.755404 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-21189bff-992e-4cc2-99f0-b89f13472e39 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:34.755880 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-21189bff-992e-4cc2-99f0-b89f13472e39 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:34.756310 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-21189bff-992e-4cc2-99f0-b89f13472e39 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:34.757015 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-21189bff-992e-4cc2-99f0-b89f13472e39 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:34.757463 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-21189bff-992e-4cc2-99f0-b89f13472e39 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:34.758193 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-21189bff-992e-4cc2-99f0-b89f13472e39 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:34.889718 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-21189bff-992e-4cc2-99f0-b89f13472e39 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d4cbd2a2154e5d925462df7c77815a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0d80988ca941acb8ad4318338dfbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:34.897325 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-21189bff-992e-4cc2-99f0-b89f13472e39 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] 10.222.0.20 "GET /compute/v2.1/servers/d38a019f-4bfc-4845-900b-a9e4e6397373" status: 200 len: 1510 microversion: 2.1 time: 0.152294 Oct 20 06:07:34.897890 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 221/418] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:07:34 2022] GET /compute/v2.1/servers/d38a019f-4bfc-4845-900b-a9e4e6397373 => generated 1510 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:07:35.463377 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-c2addff4-c67c-4f08-a3d0-5940fb51519f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:07:35.463988 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-c2addff4-c67c-4f08-a3d0-5940fb51519f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: 5a669c5b-898f-4fef-8508-254ccd998571] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:07:35.469869 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c2addff4-c67c-4f08-a3d0-5940fb51519f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:35.470354 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c2addff4-c67c-4f08-a3d0-5940fb51519f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:35.470781 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c2addff4-c67c-4f08-a3d0-5940fb51519f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:35.471468 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c2addff4-c67c-4f08-a3d0-5940fb51519f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:35.471921 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c2addff4-c67c-4f08-a3d0-5940fb51519f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:35.472373 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c2addff4-c67c-4f08-a3d0-5940fb51519f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:35.600104 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-c2addff4-c67c-4f08-a3d0-5940fb51519f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:35.607758 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-c2addff4-c67c-4f08-a3d0-5940fb51519f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/5a669c5b-898f-4fef-8508-254ccd998571" status: 200 len: 1365 microversion: 2.1 time: 0.148271 Oct 20 06:07:35.608312 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 198/419] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:07:35 2022] GET /compute/v2.1/servers/5a669c5b-898f-4fef-8508-254ccd998571 => generated 1365 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:07:35.663562 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-15d14016-a7db-4ee3-8767-9de83c905719 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:07:35.664252 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-15d14016-a7db-4ee3-8767-9de83c905719 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:07:35.670973 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-15d14016-a7db-4ee3-8767-9de83c905719 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:35.671458 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-15d14016-a7db-4ee3-8767-9de83c905719 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:35.671898 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-15d14016-a7db-4ee3-8767-9de83c905719 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:35.672617 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-15d14016-a7db-4ee3-8767-9de83c905719 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:35.673093 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-15d14016-a7db-4ee3-8767-9de83c905719 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:35.673525 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-15d14016-a7db-4ee3-8767-9de83c905719 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:35.799046 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-15d14016-a7db-4ee3-8767-9de83c905719 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:35.807931 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-15d14016-a7db-4ee3-8767-9de83c905719 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:35.809389 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-15d14016-a7db-4ee3-8767-9de83c905719 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:35.810534 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-15d14016-a7db-4ee3-8767-9de83c905719 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1722 microversion: 2.20 time: 0.150922 Oct 20 06:07:35.811079 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 222/420] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:07:35 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:07:35.921150 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-55b13704-c5f8-47aa-8ab8-3af54800192a tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:07:35.921781 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-55b13704-c5f8-47aa-8ab8-3af54800192a tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] [instance: d38a019f-4bfc-4845-900b-a9e4e6397373] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:07:35.927647 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-55b13704-c5f8-47aa-8ab8-3af54800192a tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:35.928126 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-55b13704-c5f8-47aa-8ab8-3af54800192a tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:35.928564 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-55b13704-c5f8-47aa-8ab8-3af54800192a tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:35.929277 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-55b13704-c5f8-47aa-8ab8-3af54800192a tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:35.929732 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-55b13704-c5f8-47aa-8ab8-3af54800192a tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:35.930160 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-55b13704-c5f8-47aa-8ab8-3af54800192a tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:36.062876 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-55b13704-c5f8-47aa-8ab8-3af54800192a tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d4cbd2a2154e5d925462df7c77815a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0d80988ca941acb8ad4318338dfbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:36.070359 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-55b13704-c5f8-47aa-8ab8-3af54800192a tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] 10.222.0.20 "GET /compute/v2.1/servers/d38a019f-4bfc-4845-900b-a9e4e6397373" status: 200 len: 1510 microversion: 2.1 time: 0.153029 Oct 20 06:07:36.070925 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 199/421] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:07:35 2022] GET /compute/v2.1/servers/d38a019f-4bfc-4845-900b-a9e4e6397373 => generated 1510 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:07:36.631589 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-5146324c-8900-4431-8d3d-75ba84928e19 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:07:36.632232 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-5146324c-8900-4431-8d3d-75ba84928e19 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: 5a669c5b-898f-4fef-8508-254ccd998571] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:07:36.639249 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5146324c-8900-4431-8d3d-75ba84928e19 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:36.639733 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5146324c-8900-4431-8d3d-75ba84928e19 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:36.640194 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5146324c-8900-4431-8d3d-75ba84928e19 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:36.640896 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5146324c-8900-4431-8d3d-75ba84928e19 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:36.641350 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5146324c-8900-4431-8d3d-75ba84928e19 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:36.641977 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5146324c-8900-4431-8d3d-75ba84928e19 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:36.772235 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-5146324c-8900-4431-8d3d-75ba84928e19 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:36.780487 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-5146324c-8900-4431-8d3d-75ba84928e19 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/5a669c5b-898f-4fef-8508-254ccd998571" status: 200 len: 1365 microversion: 2.1 time: 0.153445 Oct 20 06:07:36.781102 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 223/422] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:07:36 2022] GET /compute/v2.1/servers/5a669c5b-898f-4fef-8508-254ccd998571 => generated 1365 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:07:36.835001 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-866d4320-5940-48f3-b2d2-2ff3222ad6bd tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:07:36.835608 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-866d4320-5940-48f3-b2d2-2ff3222ad6bd tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:07:36.842630 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-866d4320-5940-48f3-b2d2-2ff3222ad6bd tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:36.843044 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-866d4320-5940-48f3-b2d2-2ff3222ad6bd tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:36.843481 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-866d4320-5940-48f3-b2d2-2ff3222ad6bd tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:36.844171 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-866d4320-5940-48f3-b2d2-2ff3222ad6bd tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:36.844627 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-866d4320-5940-48f3-b2d2-2ff3222ad6bd tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:36.845079 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-866d4320-5940-48f3-b2d2-2ff3222ad6bd tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:36.972480 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-866d4320-5940-48f3-b2d2-2ff3222ad6bd tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:36.980617 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-866d4320-5940-48f3-b2d2-2ff3222ad6bd tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:36.982098 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-866d4320-5940-48f3-b2d2-2ff3222ad6bd tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:36.983250 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-866d4320-5940-48f3-b2d2-2ff3222ad6bd tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1722 microversion: 2.20 time: 0.152097 Oct 20 06:07:36.983803 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 200/423] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:07:36 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:07:37.093638 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-143d199a-f498-4f62-8ba3-c250a7d04b2f tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:07:37.094175 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-143d199a-f498-4f62-8ba3-c250a7d04b2f tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] [instance: d38a019f-4bfc-4845-900b-a9e4e6397373] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:07:37.100173 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-143d199a-f498-4f62-8ba3-c250a7d04b2f tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:37.100664 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-143d199a-f498-4f62-8ba3-c250a7d04b2f tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:37.101135 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-143d199a-f498-4f62-8ba3-c250a7d04b2f tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:37.101832 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-143d199a-f498-4f62-8ba3-c250a7d04b2f tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:37.102287 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-143d199a-f498-4f62-8ba3-c250a7d04b2f tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:37.102771 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-143d199a-f498-4f62-8ba3-c250a7d04b2f tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:37.230706 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-143d199a-f498-4f62-8ba3-c250a7d04b2f tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d4cbd2a2154e5d925462df7c77815a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0d80988ca941acb8ad4318338dfbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:37.238317 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-143d199a-f498-4f62-8ba3-c250a7d04b2f tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] 10.222.0.20 "GET /compute/v2.1/servers/d38a019f-4bfc-4845-900b-a9e4e6397373" status: 200 len: 1510 microversion: 2.1 time: 0.148564 Oct 20 06:07:37.238880 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 224/424] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:07:37 2022] GET /compute/v2.1/servers/d38a019f-4bfc-4845-900b-a9e4e6397373 => generated 1510 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:07:37.802920 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-a5956f8a-d9e2-4b85-a8fd-a86a28345e7e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:07:37.803529 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-a5956f8a-d9e2-4b85-a8fd-a86a28345e7e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: 5a669c5b-898f-4fef-8508-254ccd998571] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:07:37.810325 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a5956f8a-d9e2-4b85-a8fd-a86a28345e7e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:37.810810 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a5956f8a-d9e2-4b85-a8fd-a86a28345e7e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:37.811247 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a5956f8a-d9e2-4b85-a8fd-a86a28345e7e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:37.811942 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a5956f8a-d9e2-4b85-a8fd-a86a28345e7e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:37.812396 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a5956f8a-d9e2-4b85-a8fd-a86a28345e7e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:37.812869 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a5956f8a-d9e2-4b85-a8fd-a86a28345e7e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:37.941655 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-a5956f8a-d9e2-4b85-a8fd-a86a28345e7e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:37.949571 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-a5956f8a-d9e2-4b85-a8fd-a86a28345e7e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/5a669c5b-898f-4fef-8508-254ccd998571" status: 200 len: 1365 microversion: 2.1 time: 0.150462 Oct 20 06:07:37.950168 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 201/425] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:07:37 2022] GET /compute/v2.1/servers/5a669c5b-898f-4fef-8508-254ccd998571 => generated 1365 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 06:07:38.010436 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-bc0af8b5-efe8-4e53-a6db-d44ba455d0d5 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:07:38.011037 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-bc0af8b5-efe8-4e53-a6db-d44ba455d0d5 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:07:38.017421 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-bc0af8b5-efe8-4e53-a6db-d44ba455d0d5 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:38.017897 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-bc0af8b5-efe8-4e53-a6db-d44ba455d0d5 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:38.018331 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-bc0af8b5-efe8-4e53-a6db-d44ba455d0d5 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:38.019012 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-bc0af8b5-efe8-4e53-a6db-d44ba455d0d5 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:38.019464 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-bc0af8b5-efe8-4e53-a6db-d44ba455d0d5 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:38.019880 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-bc0af8b5-efe8-4e53-a6db-d44ba455d0d5 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:38.149770 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-bc0af8b5-efe8-4e53-a6db-d44ba455d0d5 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:38.157816 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-bc0af8b5-efe8-4e53-a6db-d44ba455d0d5 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:38.159123 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-bc0af8b5-efe8-4e53-a6db-d44ba455d0d5 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:38.160272 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-bc0af8b5-efe8-4e53-a6db-d44ba455d0d5 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1722 microversion: 2.20 time: 0.154689 Oct 20 06:07:38.160842 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 225/426] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:07:38 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 20 06:07:38.261963 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-3d68a4d0-4038-4f92-a966-7a156756c2ba tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:07:38.262571 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-3d68a4d0-4038-4f92-a966-7a156756c2ba tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] [instance: d38a019f-4bfc-4845-900b-a9e4e6397373] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:07:38.268381 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3d68a4d0-4038-4f92-a966-7a156756c2ba tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:38.268975 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3d68a4d0-4038-4f92-a966-7a156756c2ba tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:38.269417 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3d68a4d0-4038-4f92-a966-7a156756c2ba tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:38.270110 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3d68a4d0-4038-4f92-a966-7a156756c2ba tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:38.270592 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3d68a4d0-4038-4f92-a966-7a156756c2ba tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:38.271298 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3d68a4d0-4038-4f92-a966-7a156756c2ba tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:38.398718 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-3d68a4d0-4038-4f92-a966-7a156756c2ba tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d4cbd2a2154e5d925462df7c77815a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0d80988ca941acb8ad4318338dfbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:38.407385 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-3d68a4d0-4038-4f92-a966-7a156756c2ba tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] 10.222.0.20 "GET /compute/v2.1/servers/d38a019f-4bfc-4845-900b-a9e4e6397373" status: 200 len: 1510 microversion: 2.1 time: 0.149927 Oct 20 06:07:38.407952 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 202/427] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:07:38 2022] GET /compute/v2.1/servers/d38a019f-4bfc-4845-900b-a9e4e6397373 => generated 1510 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:07:38.972548 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-4e523c1f-5c29-4073-8433-cf22e54dd5c3 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:07:38.973114 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-4e523c1f-5c29-4073-8433-cf22e54dd5c3 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: 5a669c5b-898f-4fef-8508-254ccd998571] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:07:38.979535 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4e523c1f-5c29-4073-8433-cf22e54dd5c3 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:38.980022 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4e523c1f-5c29-4073-8433-cf22e54dd5c3 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:38.980462 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4e523c1f-5c29-4073-8433-cf22e54dd5c3 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:38.981184 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4e523c1f-5c29-4073-8433-cf22e54dd5c3 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:38.981649 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4e523c1f-5c29-4073-8433-cf22e54dd5c3 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:38.982062 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4e523c1f-5c29-4073-8433-cf22e54dd5c3 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:39.111217 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-4e523c1f-5c29-4073-8433-cf22e54dd5c3 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:39.119452 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-4e523c1f-5c29-4073-8433-cf22e54dd5c3 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/5a669c5b-898f-4fef-8508-254ccd998571" status: 200 len: 1365 microversion: 2.1 time: 0.150728 Oct 20 06:07:39.120008 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 226/428] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:07:38 2022] GET /compute/v2.1/servers/5a669c5b-898f-4fef-8508-254ccd998571 => generated 1365 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:07:39.185151 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-dfc3908b-0569-4c5f-ad26-2ad66cb5f8a6 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:07:39.185752 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-dfc3908b-0569-4c5f-ad26-2ad66cb5f8a6 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:07:39.192038 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-dfc3908b-0569-4c5f-ad26-2ad66cb5f8a6 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:39.192518 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-dfc3908b-0569-4c5f-ad26-2ad66cb5f8a6 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:39.192985 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-dfc3908b-0569-4c5f-ad26-2ad66cb5f8a6 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:39.193665 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-dfc3908b-0569-4c5f-ad26-2ad66cb5f8a6 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:39.194109 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-dfc3908b-0569-4c5f-ad26-2ad66cb5f8a6 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:39.194527 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-dfc3908b-0569-4c5f-ad26-2ad66cb5f8a6 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:39.323815 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-dfc3908b-0569-4c5f-ad26-2ad66cb5f8a6 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:39.333016 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-dfc3908b-0569-4c5f-ad26-2ad66cb5f8a6 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:39.334499 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-dfc3908b-0569-4c5f-ad26-2ad66cb5f8a6 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:39.335653 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-dfc3908b-0569-4c5f-ad26-2ad66cb5f8a6 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1722 microversion: 2.20 time: 0.154411 Oct 20 06:07:39.336204 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 203/429] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:07:39 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:07:39.431070 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-7376adae-cb92-42e8-92f1-9aa96cde8777 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:07:39.431663 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-7376adae-cb92-42e8-92f1-9aa96cde8777 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] [instance: d38a019f-4bfc-4845-900b-a9e4e6397373] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:07:39.437608 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7376adae-cb92-42e8-92f1-9aa96cde8777 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:39.438095 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7376adae-cb92-42e8-92f1-9aa96cde8777 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:39.438535 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7376adae-cb92-42e8-92f1-9aa96cde8777 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:39.439229 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7376adae-cb92-42e8-92f1-9aa96cde8777 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:39.439689 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7376adae-cb92-42e8-92f1-9aa96cde8777 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:39.440120 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7376adae-cb92-42e8-92f1-9aa96cde8777 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:39.569016 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-7376adae-cb92-42e8-92f1-9aa96cde8777 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d4cbd2a2154e5d925462df7c77815a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0d80988ca941acb8ad4318338dfbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:39.577134 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-7376adae-cb92-42e8-92f1-9aa96cde8777 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] 10.222.0.20 "GET /compute/v2.1/servers/d38a019f-4bfc-4845-900b-a9e4e6397373" status: 200 len: 1510 microversion: 2.1 time: 0.149928 Oct 20 06:07:39.577696 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 227/430] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:07:39 2022] GET /compute/v2.1/servers/d38a019f-4bfc-4845-900b-a9e4e6397373 => generated 1510 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:07:40.142139 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-0e64c5c4-5963-4cc0-9f46-cc75320c7bc9 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:07:40.142750 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-0e64c5c4-5963-4cc0-9f46-cc75320c7bc9 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: 5a669c5b-898f-4fef-8508-254ccd998571] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:07:40.148653 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0e64c5c4-5963-4cc0-9f46-cc75320c7bc9 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:40.149182 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0e64c5c4-5963-4cc0-9f46-cc75320c7bc9 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:40.150618 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0e64c5c4-5963-4cc0-9f46-cc75320c7bc9 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:40.151325 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0e64c5c4-5963-4cc0-9f46-cc75320c7bc9 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:40.151788 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0e64c5c4-5963-4cc0-9f46-cc75320c7bc9 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:40.152220 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0e64c5c4-5963-4cc0-9f46-cc75320c7bc9 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:40.347628 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-0e64c5c4-5963-4cc0-9f46-cc75320c7bc9 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:40.351657 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG dbcounter [-] [118860] Writing DB stats nova_cell1:SELECT=100 {{(pid=118860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:07:40.358443 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-0e64c5c4-5963-4cc0-9f46-cc75320c7bc9 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/5a669c5b-898f-4fef-8508-254ccd998571" status: 200 len: 1365 microversion: 2.1 time: 0.219010 Oct 20 06:07:40.364786 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-3a2b0045-3c09-4ee3-b3ef-742c7972162c tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:07:40.365481 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-3a2b0045-3c09-4ee3-b3ef-742c7972162c tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:07:40.371192 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 204/431] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:07:40 2022] GET /compute/v2.1/servers/5a669c5b-898f-4fef-8508-254ccd998571 => generated 1365 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:07:40.373531 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-3a2b0045-3c09-4ee3-b3ef-742c7972162c tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:40.373531 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-3a2b0045-3c09-4ee3-b3ef-742c7972162c tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:40.373858 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-3a2b0045-3c09-4ee3-b3ef-742c7972162c tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:40.374600 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-3a2b0045-3c09-4ee3-b3ef-742c7972162c tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:40.375097 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-3a2b0045-3c09-4ee3-b3ef-742c7972162c tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:40.375463 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-3a2b0045-3c09-4ee3-b3ef-742c7972162c tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:40.402830 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [req-1dba16da-684c-4b2d-a4b4-0fac153ed79b req-4872af85-6357-4b74-97f6-187193e18c72 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a669c5b-898f-4fef-8508-254ccd998571", "tag": "1f531466-92dc-4842-b2bd-609d42b1626c"}]} {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 06:07:40.418435 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [req-1dba16da-684c-4b2d-a4b4-0fac153ed79b req-4872af85-6357-4b74-97f6-187193e18c72 service nova] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:40.418435 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [req-1dba16da-684c-4b2d-a4b4-0fac153ed79b req-4872af85-6357-4b74-97f6-187193e18c72 service nova] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:40.418435 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [req-1dba16da-684c-4b2d-a4b4-0fac153ed79b req-4872af85-6357-4b74-97f6-187193e18c72 service nova] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:40.429941 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.compute.server_external_events [req-1dba16da-684c-4b2d-a4b4-0fac153ed79b req-4872af85-6357-4b74-97f6-187193e18c72 service nova] Creating event network-changed:1f531466-92dc-4842-b2bd-609d42b1626c for instance 5a669c5b-898f-4fef-8508-254ccd998571 on hv-cinder-86156 Oct 20 06:07:40.435385 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [req-1dba16da-684c-4b2d-a4b4-0fac153ed79b req-4872af85-6357-4b74-97f6-187193e18c72 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037226 Oct 20 06:07:40.435981 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 205/432] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 20 06:07:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 20 06:07:40.531240 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-3a2b0045-3c09-4ee3-b3ef-742c7972162c tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:40.539523 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-3a2b0045-3c09-4ee3-b3ef-742c7972162c tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:40.541659 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-3a2b0045-3c09-4ee3-b3ef-742c7972162c tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:40.542861 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-3a2b0045-3c09-4ee3-b3ef-742c7972162c tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1722 microversion: 2.20 time: 0.183142 Oct 20 06:07:40.543421 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 228/433] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:07:40 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1722 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:07:40.600548 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-826896f3-3599-488c-8bc3-d31fa8dfde23 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:07:40.601275 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-826896f3-3599-488c-8bc3-d31fa8dfde23 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] [instance: d38a019f-4bfc-4845-900b-a9e4e6397373] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:07:40.607873 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-826896f3-3599-488c-8bc3-d31fa8dfde23 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:40.608358 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-826896f3-3599-488c-8bc3-d31fa8dfde23 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:40.608816 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-826896f3-3599-488c-8bc3-d31fa8dfde23 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:40.609511 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-826896f3-3599-488c-8bc3-d31fa8dfde23 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:40.609966 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-826896f3-3599-488c-8bc3-d31fa8dfde23 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:40.610395 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-826896f3-3599-488c-8bc3-d31fa8dfde23 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:40.735022 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-826896f3-3599-488c-8bc3-d31fa8dfde23 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d4cbd2a2154e5d925462df7c77815a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0d80988ca941acb8ad4318338dfbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:40.742852 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-826896f3-3599-488c-8bc3-d31fa8dfde23 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] 10.222.0.20 "GET /compute/v2.1/servers/d38a019f-4bfc-4845-900b-a9e4e6397373" status: 200 len: 1516 microversion: 2.1 time: 0.146470 Oct 20 06:07:40.744099 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 206/434] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:07:40 2022] GET /compute/v2.1/servers/d38a019f-4bfc-4845-900b-a9e4e6397373 => generated 1516 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:07:41.381690 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-35d03047-443e-4c88-b62f-4ce073780911 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:07:41.383353 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-35d03047-443e-4c88-b62f-4ce073780911 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: 5a669c5b-898f-4fef-8508-254ccd998571] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:07:41.392029 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-35d03047-443e-4c88-b62f-4ce073780911 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:41.392500 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-35d03047-443e-4c88-b62f-4ce073780911 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:41.398886 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-35d03047-443e-4c88-b62f-4ce073780911 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:41.400839 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-35d03047-443e-4c88-b62f-4ce073780911 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:41.401296 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-35d03047-443e-4c88-b62f-4ce073780911 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:41.406049 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-35d03047-443e-4c88-b62f-4ce073780911 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:41.582828 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-83632988-2de5-4dae-80ef-0d84a9d6da6f tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:07:41.584352 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-83632988-2de5-4dae-80ef-0d84a9d6da6f tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:07:41.600242 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-35d03047-443e-4c88-b62f-4ce073780911 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:41.604139 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-83632988-2de5-4dae-80ef-0d84a9d6da6f tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:41.604941 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-83632988-2de5-4dae-80ef-0d84a9d6da6f tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:41.605406 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-83632988-2de5-4dae-80ef-0d84a9d6da6f tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:41.606118 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-83632988-2de5-4dae-80ef-0d84a9d6da6f tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:41.606570 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-83632988-2de5-4dae-80ef-0d84a9d6da6f tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:41.607035 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-83632988-2de5-4dae-80ef-0d84a9d6da6f tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:41.625398 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-35d03047-443e-4c88-b62f-4ce073780911 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/5a669c5b-898f-4fef-8508-254ccd998571" status: 200 len: 1365 microversion: 2.1 time: 0.247227 Oct 20 06:07:41.626347 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 229/435] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:07:41 2022] GET /compute/v2.1/servers/5a669c5b-898f-4fef-8508-254ccd998571 => generated 1365 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:07:42.194952 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-83632988-2de5-4dae-80ef-0d84a9d6da6f tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:42.203269 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-83632988-2de5-4dae-80ef-0d84a9d6da6f tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:42.204642 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-83632988-2de5-4dae-80ef-0d84a9d6da6f tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:42.205871 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-83632988-2de5-4dae-80ef-0d84a9d6da6f tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1743 microversion: 2.20 time: 0.638966 Oct 20 06:07:42.206430 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 207/436] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:07:41 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1743 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 20 06:07:42.560513 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-fa153676-920c-4a42-8c3e-12174681adad tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 06:07:42.567046 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-fa153676-920c-4a42-8c3e-12174681adad tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:42.567537 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-fa153676-920c-4a42-8c3e-12174681adad tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:42.567980 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-fa153676-920c-4a42-8c3e-12174681adad tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:42.628055 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-fa153676-920c-4a42-8c3e-12174681adad tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Going to try to stop instance {{(pid=118861) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 20 06:07:42.649020 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-5b2027e2-b838-4ca3-ac3e-7e739f165d8d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:07:42.649870 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-5b2027e2-b838-4ca3-ac3e-7e739f165d8d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: 5a669c5b-898f-4fef-8508-254ccd998571] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:07:42.656497 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5b2027e2-b838-4ca3-ac3e-7e739f165d8d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:42.657022 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5b2027e2-b838-4ca3-ac3e-7e739f165d8d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:42.657453 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5b2027e2-b838-4ca3-ac3e-7e739f165d8d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:42.658146 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5b2027e2-b838-4ca3-ac3e-7e739f165d8d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:42.658592 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5b2027e2-b838-4ca3-ac3e-7e739f165d8d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:42.659009 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5b2027e2-b838-4ca3-ac3e-7e739f165d8d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:42.671048 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-fa153676-920c-4a42-8c3e-12174681adad tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "POST /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/action" status: 202 len: 0 microversion: 2.1 time: 0.114216 Oct 20 06:07:42.671838 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 230/437] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Oct 20 06:07:42 2022] POST /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/action => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 20 06:07:42.679882 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-4d0c434a-9f4c-41ed-b95a-a19e4c3ad482 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:07:42.681219 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-4d0c434a-9f4c-41ed-b95a-a19e4c3ad482 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:07:42.687312 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4d0c434a-9f4c-41ed-b95a-a19e4c3ad482 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:42.687803 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4d0c434a-9f4c-41ed-b95a-a19e4c3ad482 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:42.688240 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4d0c434a-9f4c-41ed-b95a-a19e4c3ad482 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:42.688983 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4d0c434a-9f4c-41ed-b95a-a19e4c3ad482 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:42.689439 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4d0c434a-9f4c-41ed-b95a-a19e4c3ad482 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:42.689869 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4d0c434a-9f4c-41ed-b95a-a19e4c3ad482 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:42.813487 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-5b2027e2-b838-4ca3-ac3e-7e739f165d8d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:42.828506 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-5b2027e2-b838-4ca3-ac3e-7e739f165d8d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/5a669c5b-898f-4fef-8508-254ccd998571" status: 200 len: 1365 microversion: 2.1 time: 0.182959 Oct 20 06:07:42.829902 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 208/438] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:07:42 2022] GET /compute/v2.1/servers/5a669c5b-898f-4fef-8508-254ccd998571 => generated 1365 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 06:07:42.834851 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-4d0c434a-9f4c-41ed-b95a-a19e4c3ad482 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:42.850767 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-4d0c434a-9f4c-41ed-b95a-a19e4c3ad482 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1722 microversion: 2.1 time: 0.174745 Oct 20 06:07:42.851340 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 231/439] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:07:42 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1722 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 06:07:43.233368 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-dd6305fd-abd6-45c4-902e-52cb26156f1c tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:07:43.233972 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-dd6305fd-abd6-45c4-902e-52cb26156f1c tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:07:43.239849 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-dd6305fd-abd6-45c4-902e-52cb26156f1c tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:43.240331 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-dd6305fd-abd6-45c4-902e-52cb26156f1c tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:43.240786 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-dd6305fd-abd6-45c4-902e-52cb26156f1c tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:43.241479 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-dd6305fd-abd6-45c4-902e-52cb26156f1c tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:43.241931 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-dd6305fd-abd6-45c4-902e-52cb26156f1c tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:43.242356 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-dd6305fd-abd6-45c4-902e-52cb26156f1c tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:43.375653 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-dd6305fd-abd6-45c4-902e-52cb26156f1c tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:43.384971 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-dd6305fd-abd6-45c4-902e-52cb26156f1c tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:43.386485 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-dd6305fd-abd6-45c4-902e-52cb26156f1c tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:43.387699 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-dd6305fd-abd6-45c4-902e-52cb26156f1c tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1743 microversion: 2.20 time: 0.158166 Oct 20 06:07:43.388254 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 209/440] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:07:43 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1743 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:07:43.512215 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [req-6e5b4ead-a9b2-46cf-85b3-aa1b391ee1c2 req-3b907935-d209-444d-b799-a0a1e599dd45 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71be459d-e948-4a17-b379-182f4196411d", "name": "network-vif-plugged", "status": "completed", "tag": "eb253026-482c-4675-acce-8325c21757fd"}]} {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 06:07:43.527423 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [req-6e5b4ead-a9b2-46cf-85b3-aa1b391ee1c2 req-3b907935-d209-444d-b799-a0a1e599dd45 service nova] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:43.527423 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [req-6e5b4ead-a9b2-46cf-85b3-aa1b391ee1c2 req-3b907935-d209-444d-b799-a0a1e599dd45 service nova] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:43.527423 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [req-6e5b4ead-a9b2-46cf-85b3-aa1b391ee1c2 req-3b907935-d209-444d-b799-a0a1e599dd45 service nova] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:43.535788 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.compute.server_external_events [req-6e5b4ead-a9b2-46cf-85b3-aa1b391ee1c2 req-3b907935-d209-444d-b799-a0a1e599dd45 service nova] Creating event network-vif-plugged:eb253026-482c-4675-acce-8325c21757fd for instance 71be459d-e948-4a17-b379-182f4196411d on hv-cinder-86156 Oct 20 06:07:43.540934 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [req-6e5b4ead-a9b2-46cf-85b3-aa1b391ee1c2 req-3b907935-d209-444d-b799-a0a1e599dd45 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033123 Oct 20 06:07:43.541522 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 232/441] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 20 06:07:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:07:43.853211 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-f8bc2fcb-204f-4aec-9084-bcc790efade9 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:07:43.853820 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-f8bc2fcb-204f-4aec-9084-bcc790efade9 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: 5a669c5b-898f-4fef-8508-254ccd998571] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:07:43.860216 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f8bc2fcb-204f-4aec-9084-bcc790efade9 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:43.860720 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f8bc2fcb-204f-4aec-9084-bcc790efade9 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:43.861183 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f8bc2fcb-204f-4aec-9084-bcc790efade9 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:43.861931 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f8bc2fcb-204f-4aec-9084-bcc790efade9 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:43.862389 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f8bc2fcb-204f-4aec-9084-bcc790efade9 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:43.862818 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f8bc2fcb-204f-4aec-9084-bcc790efade9 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:43.875376 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-58d920d6-9436-403f-b338-68cd06e884a9 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:07:43.876078 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-58d920d6-9436-403f-b338-68cd06e884a9 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:07:43.882918 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-58d920d6-9436-403f-b338-68cd06e884a9 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:43.883464 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-58d920d6-9436-403f-b338-68cd06e884a9 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:43.884611 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-58d920d6-9436-403f-b338-68cd06e884a9 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:43.885348 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-58d920d6-9436-403f-b338-68cd06e884a9 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:43.885805 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-58d920d6-9436-403f-b338-68cd06e884a9 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:43.886233 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-58d920d6-9436-403f-b338-68cd06e884a9 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:44.001895 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-f8bc2fcb-204f-4aec-9084-bcc790efade9 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:44.010958 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-f8bc2fcb-204f-4aec-9084-bcc790efade9 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/5a669c5b-898f-4fef-8508-254ccd998571" status: 200 len: 1365 microversion: 2.1 time: 0.162289 Oct 20 06:07:44.011650 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 210/442] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:07:43 2022] GET /compute/v2.1/servers/5a669c5b-898f-4fef-8508-254ccd998571 => generated 1365 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:07:44.023596 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-58d920d6-9436-403f-b338-68cd06e884a9 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:44.034260 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-58d920d6-9436-403f-b338-68cd06e884a9 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1722 microversion: 2.1 time: 0.163190 Oct 20 06:07:44.034867 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 233/443] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:07:43 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 06:07:44.412939 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-86504b74-f4fe-4d6f-8ddd-503b1da299df tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:07:44.413554 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-86504b74-f4fe-4d6f-8ddd-503b1da299df tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:07:44.420048 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-86504b74-f4fe-4d6f-8ddd-503b1da299df tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:44.420534 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-86504b74-f4fe-4d6f-8ddd-503b1da299df tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:44.421011 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-86504b74-f4fe-4d6f-8ddd-503b1da299df tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:44.421712 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-86504b74-f4fe-4d6f-8ddd-503b1da299df tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:44.422159 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-86504b74-f4fe-4d6f-8ddd-503b1da299df tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:44.422590 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-86504b74-f4fe-4d6f-8ddd-503b1da299df tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:44.559938 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-86504b74-f4fe-4d6f-8ddd-503b1da299df tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:44.568353 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-86504b74-f4fe-4d6f-8ddd-503b1da299df tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:44.570220 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-86504b74-f4fe-4d6f-8ddd-503b1da299df tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:44.571635 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-86504b74-f4fe-4d6f-8ddd-503b1da299df tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1743 microversion: 2.20 time: 0.162555 Oct 20 06:07:44.572193 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 211/444] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:07:44 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1743 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:07:45.034357 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-b43a7fac-28ce-45a3-b9b9-29459901d05c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:07:45.034972 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-b43a7fac-28ce-45a3-b9b9-29459901d05c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: 5a669c5b-898f-4fef-8508-254ccd998571] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:07:45.041995 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b43a7fac-28ce-45a3-b9b9-29459901d05c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:45.042475 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b43a7fac-28ce-45a3-b9b9-29459901d05c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:45.042918 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b43a7fac-28ce-45a3-b9b9-29459901d05c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:45.043612 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b43a7fac-28ce-45a3-b9b9-29459901d05c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:45.044066 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b43a7fac-28ce-45a3-b9b9-29459901d05c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:45.044492 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b43a7fac-28ce-45a3-b9b9-29459901d05c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:45.059663 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-6dfb7091-1adc-4583-a440-19b34781a3a7 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:07:45.061420 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-6dfb7091-1adc-4583-a440-19b34781a3a7 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:07:45.067547 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-6dfb7091-1adc-4583-a440-19b34781a3a7 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:45.068337 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-6dfb7091-1adc-4583-a440-19b34781a3a7 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:45.068941 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-6dfb7091-1adc-4583-a440-19b34781a3a7 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:45.069877 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-6dfb7091-1adc-4583-a440-19b34781a3a7 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:45.070481 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-6dfb7091-1adc-4583-a440-19b34781a3a7 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:45.071234 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-6dfb7091-1adc-4583-a440-19b34781a3a7 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:45.200367 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-b43a7fac-28ce-45a3-b9b9-29459901d05c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:45.208420 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-b43a7fac-28ce-45a3-b9b9-29459901d05c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/5a669c5b-898f-4fef-8508-254ccd998571" status: 200 len: 1365 microversion: 2.1 time: 0.177770 Oct 20 06:07:45.209245 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 234/445] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:07:45 2022] GET /compute/v2.1/servers/5a669c5b-898f-4fef-8508-254ccd998571 => generated 1365 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:07:45.243597 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-6dfb7091-1adc-4583-a440-19b34781a3a7 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:45.252605 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-6dfb7091-1adc-4583-a440-19b34781a3a7 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1722 microversion: 2.1 time: 0.197756 Oct 20 06:07:45.253313 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 212/446] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:07:45 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1722 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 06:07:45.599394 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-71717f3e-0e0d-471f-b9f9-699277e82ae2 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:07:45.600196 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-71717f3e-0e0d-471f-b9f9-699277e82ae2 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:07:45.621504 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-71717f3e-0e0d-471f-b9f9-699277e82ae2 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:45.623532 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-71717f3e-0e0d-471f-b9f9-699277e82ae2 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:45.624224 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-71717f3e-0e0d-471f-b9f9-699277e82ae2 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:45.625191 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-71717f3e-0e0d-471f-b9f9-699277e82ae2 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:45.626596 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-71717f3e-0e0d-471f-b9f9-699277e82ae2 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:45.627240 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-71717f3e-0e0d-471f-b9f9-699277e82ae2 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:45.637199 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG dbcounter [-] [118861] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:07:45.813159 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-71717f3e-0e0d-471f-b9f9-699277e82ae2 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:45.824307 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-71717f3e-0e0d-471f-b9f9-699277e82ae2 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:45.825889 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-71717f3e-0e0d-471f-b9f9-699277e82ae2 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:45.827151 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-71717f3e-0e0d-471f-b9f9-699277e82ae2 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1738 microversion: 2.20 time: 0.232527 Oct 20 06:07:45.828269 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 235/447] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:07:45 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1738 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:07:46.230524 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-ffc48857-9d67-45ee-931f-52f51804d1e1 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:07:46.231301 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-ffc48857-9d67-45ee-931f-52f51804d1e1 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: 5a669c5b-898f-4fef-8508-254ccd998571] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:07:46.245796 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-ffc48857-9d67-45ee-931f-52f51804d1e1 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:46.246612 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-ffc48857-9d67-45ee-931f-52f51804d1e1 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:46.247272 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-ffc48857-9d67-45ee-931f-52f51804d1e1 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:46.248046 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-ffc48857-9d67-45ee-931f-52f51804d1e1 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:46.248570 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-ffc48857-9d67-45ee-931f-52f51804d1e1 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:46.249087 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-ffc48857-9d67-45ee-931f-52f51804d1e1 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:46.279106 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-79a57e4a-3538-4754-9d5f-e18d70da3d38 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:07:46.279834 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-79a57e4a-3538-4754-9d5f-e18d70da3d38 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:07:46.298587 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-79a57e4a-3538-4754-9d5f-e18d70da3d38 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:46.299398 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-79a57e4a-3538-4754-9d5f-e18d70da3d38 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:46.300039 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-79a57e4a-3538-4754-9d5f-e18d70da3d38 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:46.300992 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-79a57e4a-3538-4754-9d5f-e18d70da3d38 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:46.301671 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-79a57e4a-3538-4754-9d5f-e18d70da3d38 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:46.302346 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-79a57e4a-3538-4754-9d5f-e18d70da3d38 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:46.427174 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-ffc48857-9d67-45ee-931f-52f51804d1e1 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:46.435146 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-ffc48857-9d67-45ee-931f-52f51804d1e1 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/5a669c5b-898f-4fef-8508-254ccd998571" status: 200 len: 1365 microversion: 2.1 time: 0.208921 Oct 20 06:07:46.435913 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 213/448] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:07:46 2022] GET /compute/v2.1/servers/5a669c5b-898f-4fef-8508-254ccd998571 => generated 1365 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:07:46.478479 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-79a57e4a-3538-4754-9d5f-e18d70da3d38 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:46.489403 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-79a57e4a-3538-4754-9d5f-e18d70da3d38 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1722 microversion: 2.1 time: 0.217465 Oct 20 06:07:46.490173 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 236/449] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:07:46 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1722 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:07:46.853603 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-bde04c34-031e-4429-b2ee-d0787dc93a93 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:07:46.854120 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-bde04c34-031e-4429-b2ee-d0787dc93a93 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:07:46.860080 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-bde04c34-031e-4429-b2ee-d0787dc93a93 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:46.860794 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-bde04c34-031e-4429-b2ee-d0787dc93a93 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:46.861431 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-bde04c34-031e-4429-b2ee-d0787dc93a93 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:46.862128 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-bde04c34-031e-4429-b2ee-d0787dc93a93 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:46.862591 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-bde04c34-031e-4429-b2ee-d0787dc93a93 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:46.863014 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-bde04c34-031e-4429-b2ee-d0787dc93a93 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:47.023404 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-bde04c34-031e-4429-b2ee-d0787dc93a93 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:47.033157 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-bde04c34-031e-4429-b2ee-d0787dc93a93 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:47.034913 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-bde04c34-031e-4429-b2ee-d0787dc93a93 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:47.036227 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-bde04c34-031e-4429-b2ee-d0787dc93a93 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1738 microversion: 2.20 time: 0.186780 Oct 20 06:07:47.037226 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 214/450] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:07:46 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1738 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:07:47.459907 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-ee6a58f8-c166-4d01-bbae-8acbeb9adcb7 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:07:47.462593 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-ee6a58f8-c166-4d01-bbae-8acbeb9adcb7 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: 5a669c5b-898f-4fef-8508-254ccd998571] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:07:47.469557 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ee6a58f8-c166-4d01-bbae-8acbeb9adcb7 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:47.470453 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ee6a58f8-c166-4d01-bbae-8acbeb9adcb7 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:47.471017 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ee6a58f8-c166-4d01-bbae-8acbeb9adcb7 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:47.472296 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ee6a58f8-c166-4d01-bbae-8acbeb9adcb7 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:47.473126 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ee6a58f8-c166-4d01-bbae-8acbeb9adcb7 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:47.473780 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ee6a58f8-c166-4d01-bbae-8acbeb9adcb7 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:47.514973 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-59ec2d81-e54a-46f8-849c-6f8ecc257475 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:07:47.516180 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-59ec2d81-e54a-46f8-849c-6f8ecc257475 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:07:47.526181 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-59ec2d81-e54a-46f8-849c-6f8ecc257475 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:47.526949 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-59ec2d81-e54a-46f8-849c-6f8ecc257475 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:47.534035 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-59ec2d81-e54a-46f8-849c-6f8ecc257475 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:47.534961 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-59ec2d81-e54a-46f8-849c-6f8ecc257475 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:47.535573 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-59ec2d81-e54a-46f8-849c-6f8ecc257475 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:47.536147 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-59ec2d81-e54a-46f8-849c-6f8ecc257475 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:47.698667 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-ee6a58f8-c166-4d01-bbae-8acbeb9adcb7 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:47.715360 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-ee6a58f8-c166-4d01-bbae-8acbeb9adcb7 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/5a669c5b-898f-4fef-8508-254ccd998571" status: 200 len: 1365 microversion: 2.1 time: 0.253973 Oct 20 06:07:47.715980 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 237/451] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:07:47 2022] GET /compute/v2.1/servers/5a669c5b-898f-4fef-8508-254ccd998571 => generated 1365 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:07:47.724482 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [req-1f185c58-2af8-4a2b-979b-dbbe17f57989 req-41f1e532-5537-4f05-aaf4-8f61d8bafd04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a669c5b-898f-4fef-8508-254ccd998571", "name": "network-vif-plugged", "status": "completed", "tag": "1f531466-92dc-4842-b2bd-609d42b1626c"}]} {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 06:07:47.734742 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [req-1f185c58-2af8-4a2b-979b-dbbe17f57989 req-41f1e532-5537-4f05-aaf4-8f61d8bafd04 service nova] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:47.735223 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [req-1f185c58-2af8-4a2b-979b-dbbe17f57989 req-41f1e532-5537-4f05-aaf4-8f61d8bafd04 service nova] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:47.735841 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [req-1f185c58-2af8-4a2b-979b-dbbe17f57989 req-41f1e532-5537-4f05-aaf4-8f61d8bafd04 service nova] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:47.748046 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.compute.server_external_events [req-1f185c58-2af8-4a2b-979b-dbbe17f57989 req-41f1e532-5537-4f05-aaf4-8f61d8bafd04 service nova] Creating event network-vif-plugged:1f531466-92dc-4842-b2bd-609d42b1626c for instance 5a669c5b-898f-4fef-8508-254ccd998571 on hv-cinder-86156 Oct 20 06:07:47.753939 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [req-1f185c58-2af8-4a2b-979b-dbbe17f57989 req-41f1e532-5537-4f05-aaf4-8f61d8bafd04 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036811 Oct 20 06:07:47.755232 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 238/452] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 20 06:07:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:07:47.786005 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-59ec2d81-e54a-46f8-849c-6f8ecc257475 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:47.795305 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-59ec2d81-e54a-46f8-849c-6f8ecc257475 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1722 microversion: 2.1 time: 0.284134 Oct 20 06:07:47.795877 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 215/453] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:07:47 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1722 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:07:48.066767 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-0409b4fb-e1d3-4ecc-a134-ff73b90f8a92 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:07:48.068656 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-0409b4fb-e1d3-4ecc-a134-ff73b90f8a92 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:07:48.076086 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-0409b4fb-e1d3-4ecc-a134-ff73b90f8a92 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:48.076567 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-0409b4fb-e1d3-4ecc-a134-ff73b90f8a92 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:48.077073 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-0409b4fb-e1d3-4ecc-a134-ff73b90f8a92 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:48.077788 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-0409b4fb-e1d3-4ecc-a134-ff73b90f8a92 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:48.078216 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-0409b4fb-e1d3-4ecc-a134-ff73b90f8a92 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:48.078632 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-0409b4fb-e1d3-4ecc-a134-ff73b90f8a92 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:48.232152 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-0409b4fb-e1d3-4ecc-a134-ff73b90f8a92 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:48.240312 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-0409b4fb-e1d3-4ecc-a134-ff73b90f8a92 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:48.244615 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-0409b4fb-e1d3-4ecc-a134-ff73b90f8a92 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:48.246021 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-0409b4fb-e1d3-4ecc-a134-ff73b90f8a92 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1738 microversion: 2.20 time: 0.184301 Oct 20 06:07:48.246906 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 239/454] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:07:48 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1738 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:07:48.738566 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-32a34daa-9cb6-4a14-9529-86e3dc7deec4 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:07:48.739801 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-32a34daa-9cb6-4a14-9529-86e3dc7deec4 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: 5a669c5b-898f-4fef-8508-254ccd998571] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:07:48.746853 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-32a34daa-9cb6-4a14-9529-86e3dc7deec4 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:48.747530 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-32a34daa-9cb6-4a14-9529-86e3dc7deec4 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:48.748143 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-32a34daa-9cb6-4a14-9529-86e3dc7deec4 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:48.749026 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-32a34daa-9cb6-4a14-9529-86e3dc7deec4 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:48.749632 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-32a34daa-9cb6-4a14-9529-86e3dc7deec4 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:48.750208 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-32a34daa-9cb6-4a14-9529-86e3dc7deec4 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:48.824520 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-be2733ad-7161-41f9-8d78-f94a6d59fae6 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:07:48.826164 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-be2733ad-7161-41f9-8d78-f94a6d59fae6 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:07:48.833102 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-be2733ad-7161-41f9-8d78-f94a6d59fae6 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:48.833835 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-be2733ad-7161-41f9-8d78-f94a6d59fae6 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:48.834452 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-be2733ad-7161-41f9-8d78-f94a6d59fae6 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:48.835362 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-be2733ad-7161-41f9-8d78-f94a6d59fae6 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:48.835979 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-be2733ad-7161-41f9-8d78-f94a6d59fae6 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:48.837326 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-be2733ad-7161-41f9-8d78-f94a6d59fae6 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:48.913809 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-32a34daa-9cb6-4a14-9529-86e3dc7deec4 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:48.925526 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-32a34daa-9cb6-4a14-9529-86e3dc7deec4 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/5a669c5b-898f-4fef-8508-254ccd998571" status: 200 len: 1365 microversion: 2.1 time: 0.190556 Oct 20 06:07:48.926628 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 216/455] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:07:48 2022] GET /compute/v2.1/servers/5a669c5b-898f-4fef-8508-254ccd998571 => generated 1365 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 06:07:48.993863 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-be2733ad-7161-41f9-8d78-f94a6d59fae6 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:49.003005 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-be2733ad-7161-41f9-8d78-f94a6d59fae6 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1722 microversion: 2.1 time: 0.183547 Oct 20 06:07:49.017584 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 240/456] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:07:48 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1722 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 06:07:49.273720 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-3a78ed2f-dabd-464d-985f-4336e33bdaca tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:07:49.275557 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-3a78ed2f-dabd-464d-985f-4336e33bdaca tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:07:49.310516 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3a78ed2f-dabd-464d-985f-4336e33bdaca tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:49.313647 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3a78ed2f-dabd-464d-985f-4336e33bdaca tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:49.314361 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3a78ed2f-dabd-464d-985f-4336e33bdaca tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:49.315311 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3a78ed2f-dabd-464d-985f-4336e33bdaca tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:49.315904 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3a78ed2f-dabd-464d-985f-4336e33bdaca tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:49.317256 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3a78ed2f-dabd-464d-985f-4336e33bdaca tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:49.470433 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-3a78ed2f-dabd-464d-985f-4336e33bdaca tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:49.479033 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-3a78ed2f-dabd-464d-985f-4336e33bdaca tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:49.480949 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-3a78ed2f-dabd-464d-985f-4336e33bdaca tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:49.482291 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-3a78ed2f-dabd-464d-985f-4336e33bdaca tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1738 microversion: 2.20 time: 0.212837 Oct 20 06:07:49.483002 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 217/457] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:07:49 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1738 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:07:49.949643 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-b969cfc5-3348-4aeb-99a7-e838373d958e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:07:49.952958 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-b969cfc5-3348-4aeb-99a7-e838373d958e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: 5a669c5b-898f-4fef-8508-254ccd998571] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:07:49.960315 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b969cfc5-3348-4aeb-99a7-e838373d958e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:49.960934 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b969cfc5-3348-4aeb-99a7-e838373d958e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:49.962407 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b969cfc5-3348-4aeb-99a7-e838373d958e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:49.963146 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b969cfc5-3348-4aeb-99a7-e838373d958e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:49.963598 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b969cfc5-3348-4aeb-99a7-e838373d958e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:49.964019 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b969cfc5-3348-4aeb-99a7-e838373d958e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:50.030837 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-34fc9edf-48b1-4351-9a19-47d642902ae9 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:07:50.031473 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-34fc9edf-48b1-4351-9a19-47d642902ae9 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:07:50.043838 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-34fc9edf-48b1-4351-9a19-47d642902ae9 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:50.047969 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-34fc9edf-48b1-4351-9a19-47d642902ae9 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:50.059867 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-34fc9edf-48b1-4351-9a19-47d642902ae9 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:50.063915 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-34fc9edf-48b1-4351-9a19-47d642902ae9 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:50.064650 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-34fc9edf-48b1-4351-9a19-47d642902ae9 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:50.067116 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-34fc9edf-48b1-4351-9a19-47d642902ae9 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:50.140629 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-b969cfc5-3348-4aeb-99a7-e838373d958e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:50.149963 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-b969cfc5-3348-4aeb-99a7-e838373d958e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/5a669c5b-898f-4fef-8508-254ccd998571" status: 200 len: 1555 microversion: 2.1 time: 0.204447 Oct 20 06:07:50.151166 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 241/458] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:07:49 2022] GET /compute/v2.1/servers/5a669c5b-898f-4fef-8508-254ccd998571 => generated 1555 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:07:50.175034 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-f9e39086-1ad3-4a6a-9c5a-e6f2c61ae681 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:07:50.175557 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-f9e39086-1ad3-4a6a-9c5a-e6f2c61ae681 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: 5a669c5b-898f-4fef-8508-254ccd998571] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:07:50.182462 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f9e39086-1ad3-4a6a-9c5a-e6f2c61ae681 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:50.183210 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f9e39086-1ad3-4a6a-9c5a-e6f2c61ae681 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:50.183800 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f9e39086-1ad3-4a6a-9c5a-e6f2c61ae681 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:50.184661 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f9e39086-1ad3-4a6a-9c5a-e6f2c61ae681 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:50.185136 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f9e39086-1ad3-4a6a-9c5a-e6f2c61ae681 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:50.185735 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f9e39086-1ad3-4a6a-9c5a-e6f2c61ae681 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:50.259040 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-34fc9edf-48b1-4351-9a19-47d642902ae9 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:50.267854 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-34fc9edf-48b1-4351-9a19-47d642902ae9 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1722 microversion: 2.1 time: 0.244318 Oct 20 06:07:50.269006 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 218/459] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:07:50 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1722 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 06:07:50.285229 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-f9e39086-1ad3-4a6a-9c5a-e6f2c61ae681 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/5a669c5b-898f-4fef-8508-254ccd998571/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.114022 Oct 20 06:07:50.286083 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 242/460] 10.222.0.20 () {58 vars in 1275 bytes} [Thu Oct 20 06:07:50 2022] GET /compute/v2.1/servers/5a669c5b-898f-4fef-8508-254ccd998571/os-interface => generated 284 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 20 06:07:50.511979 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-3d529761-b0cc-4d6a-b163-285323c59c77 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:07:50.513380 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-3d529761-b0cc-4d6a-b163-285323c59c77 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:07:50.519626 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3d529761-b0cc-4d6a-b163-285323c59c77 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:50.520561 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3d529761-b0cc-4d6a-b163-285323c59c77 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:50.521018 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3d529761-b0cc-4d6a-b163-285323c59c77 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:50.521800 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3d529761-b0cc-4d6a-b163-285323c59c77 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:50.522640 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3d529761-b0cc-4d6a-b163-285323c59c77 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:50.523531 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3d529761-b0cc-4d6a-b163-285323c59c77 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:50.821241 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-3d529761-b0cc-4d6a-b163-285323c59c77 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:50.833296 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-3d529761-b0cc-4d6a-b163-285323c59c77 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:50.834736 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-3d529761-b0cc-4d6a-b163-285323c59c77 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:50.836219 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-3d529761-b0cc-4d6a-b163-285323c59c77 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1738 microversion: 2.20 time: 0.330003 Oct 20 06:07:50.851011 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 219/461] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:07:50 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1738 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 20 06:07:51.293217 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-956d0541-638d-44dc-b826-1b006e1ee0d0 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:07:51.294456 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-956d0541-638d-44dc-b826-1b006e1ee0d0 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:07:51.313947 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-956d0541-638d-44dc-b826-1b006e1ee0d0 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:51.315334 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-956d0541-638d-44dc-b826-1b006e1ee0d0 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:51.315784 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-956d0541-638d-44dc-b826-1b006e1ee0d0 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:51.316522 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-956d0541-638d-44dc-b826-1b006e1ee0d0 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:51.317008 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-956d0541-638d-44dc-b826-1b006e1ee0d0 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:51.317437 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-956d0541-638d-44dc-b826-1b006e1ee0d0 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:51.486324 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-956d0541-638d-44dc-b826-1b006e1ee0d0 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:51.500258 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-956d0541-638d-44dc-b826-1b006e1ee0d0 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1722 microversion: 2.1 time: 0.211867 Oct 20 06:07:51.500941 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 243/462] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:07:51 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1722 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:07:51.516276 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [req-e75dafc2-228a-412b-9a58-ae149d5217a3 req-c17d4553-37e5-4cae-91c6-cadb37cf3355 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a669c5b-898f-4fef-8508-254ccd998571", "tag": "1f531466-92dc-4842-b2bd-609d42b1626c"}]} {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 06:07:51.533637 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [req-e75dafc2-228a-412b-9a58-ae149d5217a3 req-c17d4553-37e5-4cae-91c6-cadb37cf3355 service nova] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:51.534125 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [req-e75dafc2-228a-412b-9a58-ae149d5217a3 req-c17d4553-37e5-4cae-91c6-cadb37cf3355 service nova] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:51.534560 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [req-e75dafc2-228a-412b-9a58-ae149d5217a3 req-c17d4553-37e5-4cae-91c6-cadb37cf3355 service nova] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:51.546692 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.compute.server_external_events [req-e75dafc2-228a-412b-9a58-ae149d5217a3 req-c17d4553-37e5-4cae-91c6-cadb37cf3355 service nova] Creating event network-changed:1f531466-92dc-4842-b2bd-609d42b1626c for instance 5a669c5b-898f-4fef-8508-254ccd998571 on hv-cinder-86156 Oct 20 06:07:51.552027 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [req-e75dafc2-228a-412b-9a58-ae149d5217a3 req-c17d4553-37e5-4cae-91c6-cadb37cf3355 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044619 Oct 20 06:07:51.553009 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 220/463] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 20 06:07:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:07:51.866547 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-53581194-905d-4329-a698-bb5e26296ad6 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:07:51.868432 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-53581194-905d-4329-a698-bb5e26296ad6 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:07:51.893633 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-53581194-905d-4329-a698-bb5e26296ad6 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:51.895137 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-53581194-905d-4329-a698-bb5e26296ad6 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:51.897406 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-53581194-905d-4329-a698-bb5e26296ad6 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:51.901277 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-53581194-905d-4329-a698-bb5e26296ad6 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:51.901960 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-53581194-905d-4329-a698-bb5e26296ad6 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:51.904958 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-53581194-905d-4329-a698-bb5e26296ad6 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:52.099030 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-53581194-905d-4329-a698-bb5e26296ad6 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:52.112061 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-53581194-905d-4329-a698-bb5e26296ad6 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:52.115087 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-53581194-905d-4329-a698-bb5e26296ad6 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:52.116326 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-53581194-905d-4329-a698-bb5e26296ad6 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1738 microversion: 2.20 time: 0.256777 Oct 20 06:07:52.117311 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 244/464] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:07:51 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1738 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:07:52.538719 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-76c2ed9d-e890-4a43-929c-a631c26939ff tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:07:52.540596 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-76c2ed9d-e890-4a43-929c-a631c26939ff tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:07:52.548806 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-76c2ed9d-e890-4a43-929c-a631c26939ff tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:52.549954 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-76c2ed9d-e890-4a43-929c-a631c26939ff tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:52.550579 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-76c2ed9d-e890-4a43-929c-a631c26939ff tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:52.551463 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-76c2ed9d-e890-4a43-929c-a631c26939ff tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:52.552089 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-76c2ed9d-e890-4a43-929c-a631c26939ff tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:52.553866 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-76c2ed9d-e890-4a43-929c-a631c26939ff tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:52.734226 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-76c2ed9d-e890-4a43-929c-a631c26939ff tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:52.746630 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-76c2ed9d-e890-4a43-929c-a631c26939ff tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1722 microversion: 2.1 time: 0.214328 Oct 20 06:07:52.772723 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 221/465] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:07:52 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1722 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:07:53.146500 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-41da413d-73eb-48c0-b509-5b7aa5a849a8 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:07:53.147529 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-41da413d-73eb-48c0-b509-5b7aa5a849a8 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:07:53.156223 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-41da413d-73eb-48c0-b509-5b7aa5a849a8 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:53.157620 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-41da413d-73eb-48c0-b509-5b7aa5a849a8 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:53.158346 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-41da413d-73eb-48c0-b509-5b7aa5a849a8 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:53.159461 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-41da413d-73eb-48c0-b509-5b7aa5a849a8 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:53.169586 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-41da413d-73eb-48c0-b509-5b7aa5a849a8 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:53.170646 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-41da413d-73eb-48c0-b509-5b7aa5a849a8 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:53.335694 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-41da413d-73eb-48c0-b509-5b7aa5a849a8 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:53.344522 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-41da413d-73eb-48c0-b509-5b7aa5a849a8 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:53.346265 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-41da413d-73eb-48c0-b509-5b7aa5a849a8 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:53.347445 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-41da413d-73eb-48c0-b509-5b7aa5a849a8 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1738 microversion: 2.20 time: 0.204890 Oct 20 06:07:53.348329 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 245/466] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:07:53 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1738 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:07:53.783807 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-fe59622f-d5b6-4813-b86e-21c51a0643c0 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:07:53.784421 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-fe59622f-d5b6-4813-b86e-21c51a0643c0 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:07:53.799300 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-fe59622f-d5b6-4813-b86e-21c51a0643c0 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:53.799822 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-fe59622f-d5b6-4813-b86e-21c51a0643c0 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:53.800263 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-fe59622f-d5b6-4813-b86e-21c51a0643c0 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:53.801016 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-fe59622f-d5b6-4813-b86e-21c51a0643c0 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:53.801469 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-fe59622f-d5b6-4813-b86e-21c51a0643c0 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:53.801924 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-fe59622f-d5b6-4813-b86e-21c51a0643c0 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:53.972971 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-fe59622f-d5b6-4813-b86e-21c51a0643c0 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:53.976922 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG dbcounter [-] [118860] Writing DB stats nova_cell1:SELECT=100 {{(pid=118860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:07:53.984570 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-fe59622f-d5b6-4813-b86e-21c51a0643c0 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1722 microversion: 2.1 time: 0.203543 Oct 20 06:07:53.985223 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 222/467] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:07:53 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1722 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:07:54.373864 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-cbb31117-9dfd-40c8-9d61-3c9fb454f87f tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:07:54.374486 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-cbb31117-9dfd-40c8-9d61-3c9fb454f87f tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:07:54.384479 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-cbb31117-9dfd-40c8-9d61-3c9fb454f87f tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:54.385004 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-cbb31117-9dfd-40c8-9d61-3c9fb454f87f tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:54.385447 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-cbb31117-9dfd-40c8-9d61-3c9fb454f87f tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:54.386158 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-cbb31117-9dfd-40c8-9d61-3c9fb454f87f tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:54.386831 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-cbb31117-9dfd-40c8-9d61-3c9fb454f87f tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:54.387450 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-cbb31117-9dfd-40c8-9d61-3c9fb454f87f tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:54.551942 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-cbb31117-9dfd-40c8-9d61-3c9fb454f87f tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:54.561895 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-cbb31117-9dfd-40c8-9d61-3c9fb454f87f tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:54.563276 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-cbb31117-9dfd-40c8-9d61-3c9fb454f87f tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:54.564487 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-cbb31117-9dfd-40c8-9d61-3c9fb454f87f tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1738 microversion: 2.20 time: 0.194550 Oct 20 06:07:54.565092 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 246/468] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:07:54 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1738 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:07:55.007765 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-32591079-3ef0-4534-a4eb-e5a1346e4afb tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:07:55.008793 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-32591079-3ef0-4534-a4eb-e5a1346e4afb tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:07:55.016017 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-32591079-3ef0-4534-a4eb-e5a1346e4afb tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:55.016592 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-32591079-3ef0-4534-a4eb-e5a1346e4afb tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:55.017114 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-32591079-3ef0-4534-a4eb-e5a1346e4afb tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:55.018059 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-32591079-3ef0-4534-a4eb-e5a1346e4afb tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:55.018585 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-32591079-3ef0-4534-a4eb-e5a1346e4afb tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:55.019263 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-32591079-3ef0-4534-a4eb-e5a1346e4afb tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:55.170727 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-32591079-3ef0-4534-a4eb-e5a1346e4afb tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:55.183700 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-32591079-3ef0-4534-a4eb-e5a1346e4afb tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1722 microversion: 2.1 time: 0.179777 Oct 20 06:07:55.184502 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 223/469] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:07:55 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1722 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:07:55.590950 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-3bebd71f-f1c8-45cb-856c-b2c6a973f2d6 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:07:55.591563 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-3bebd71f-f1c8-45cb-856c-b2c6a973f2d6 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:07:55.594011 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG dbcounter [-] [118861] Writing DB stats nova_api:SELECT=78 {{(pid=118861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:07:55.599381 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-3bebd71f-f1c8-45cb-856c-b2c6a973f2d6 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:55.599867 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-3bebd71f-f1c8-45cb-856c-b2c6a973f2d6 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:55.600303 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-3bebd71f-f1c8-45cb-856c-b2c6a973f2d6 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:55.601037 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-3bebd71f-f1c8-45cb-856c-b2c6a973f2d6 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:55.601490 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-3bebd71f-f1c8-45cb-856c-b2c6a973f2d6 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:55.602048 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-3bebd71f-f1c8-45cb-856c-b2c6a973f2d6 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:55.729174 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-3bebd71f-f1c8-45cb-856c-b2c6a973f2d6 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:55.737192 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-3bebd71f-f1c8-45cb-856c-b2c6a973f2d6 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:55.738642 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-3bebd71f-f1c8-45cb-856c-b2c6a973f2d6 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:55.739796 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-3bebd71f-f1c8-45cb-856c-b2c6a973f2d6 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1738 microversion: 2.20 time: 0.153501 Oct 20 06:07:55.740355 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 247/470] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:07:55 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1738 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:07:56.207188 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-675a2cf3-fadd-42d1-881c-612f2602e792 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:07:56.207789 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-675a2cf3-fadd-42d1-881c-612f2602e792 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:07:56.210059 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG dbcounter [-] [118860] Writing DB stats nova_api:SELECT=76 {{(pid=118860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:07:56.215792 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-675a2cf3-fadd-42d1-881c-612f2602e792 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:56.216315 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-675a2cf3-fadd-42d1-881c-612f2602e792 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:56.216990 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-675a2cf3-fadd-42d1-881c-612f2602e792 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:56.217694 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-675a2cf3-fadd-42d1-881c-612f2602e792 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:56.218145 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-675a2cf3-fadd-42d1-881c-612f2602e792 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:56.218599 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-675a2cf3-fadd-42d1-881c-612f2602e792 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:56.413806 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-675a2cf3-fadd-42d1-881c-612f2602e792 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:56.422899 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-675a2cf3-fadd-42d1-881c-612f2602e792 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1722 microversion: 2.1 time: 0.219476 Oct 20 06:07:56.423477 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 224/471] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:07:56 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1722 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:07:56.766041 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-91245ae0-b9f5-45fa-b902-a276f5ba7ad1 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:07:56.766569 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-91245ae0-b9f5-45fa-b902-a276f5ba7ad1 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:07:56.772958 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-91245ae0-b9f5-45fa-b902-a276f5ba7ad1 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:56.774057 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-91245ae0-b9f5-45fa-b902-a276f5ba7ad1 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:56.774505 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-91245ae0-b9f5-45fa-b902-a276f5ba7ad1 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:56.775202 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-91245ae0-b9f5-45fa-b902-a276f5ba7ad1 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:56.775659 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-91245ae0-b9f5-45fa-b902-a276f5ba7ad1 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:56.776087 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-91245ae0-b9f5-45fa-b902-a276f5ba7ad1 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:56.904048 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-91245ae0-b9f5-45fa-b902-a276f5ba7ad1 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:56.911985 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-91245ae0-b9f5-45fa-b902-a276f5ba7ad1 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:56.913586 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-91245ae0-b9f5-45fa-b902-a276f5ba7ad1 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:56.914730 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-91245ae0-b9f5-45fa-b902-a276f5ba7ad1 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1720 microversion: 2.20 time: 0.152688 Oct 20 06:07:56.915270 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 248/472] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:07:56 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1720 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:07:57.446543 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-d76228b0-d9d8-4d37-a8bf-2d1e939d1992 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:07:57.447157 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-d76228b0-d9d8-4d37-a8bf-2d1e939d1992 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:07:57.453743 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-d76228b0-d9d8-4d37-a8bf-2d1e939d1992 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:57.454238 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-d76228b0-d9d8-4d37-a8bf-2d1e939d1992 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:57.454680 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-d76228b0-d9d8-4d37-a8bf-2d1e939d1992 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:57.455381 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-d76228b0-d9d8-4d37-a8bf-2d1e939d1992 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:57.455839 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-d76228b0-d9d8-4d37-a8bf-2d1e939d1992 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:57.456270 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-d76228b0-d9d8-4d37-a8bf-2d1e939d1992 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:57.594250 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-d76228b0-d9d8-4d37-a8bf-2d1e939d1992 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:57.602583 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-d76228b0-d9d8-4d37-a8bf-2d1e939d1992 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1722 microversion: 2.1 time: 0.160954 Oct 20 06:07:57.603155 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 225/473] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:07:57 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:07:57.940112 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-5fda08c8-1de0-4963-99e8-a199ed10e53d tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:07:57.940730 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-5fda08c8-1de0-4963-99e8-a199ed10e53d tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:07:57.947413 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5fda08c8-1de0-4963-99e8-a199ed10e53d tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:57.947894 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5fda08c8-1de0-4963-99e8-a199ed10e53d tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:57.948322 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5fda08c8-1de0-4963-99e8-a199ed10e53d tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:57.949134 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5fda08c8-1de0-4963-99e8-a199ed10e53d tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:57.949583 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5fda08c8-1de0-4963-99e8-a199ed10e53d tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:57.950002 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5fda08c8-1de0-4963-99e8-a199ed10e53d tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:58.082301 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-5fda08c8-1de0-4963-99e8-a199ed10e53d tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:58.090761 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-5fda08c8-1de0-4963-99e8-a199ed10e53d tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:58.092200 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-5fda08c8-1de0-4963-99e8-a199ed10e53d tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:58.093391 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-5fda08c8-1de0-4963-99e8-a199ed10e53d tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1720 microversion: 2.20 time: 0.157297 Oct 20 06:07:58.093943 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 249/474] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:07:57 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1720 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:07:58.626378 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-a6126778-6a6c-406c-b3d5-934aabb57235 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:07:58.627009 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-a6126778-6a6c-406c-b3d5-934aabb57235 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:07:58.633756 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a6126778-6a6c-406c-b3d5-934aabb57235 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:58.634236 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a6126778-6a6c-406c-b3d5-934aabb57235 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:58.634670 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a6126778-6a6c-406c-b3d5-934aabb57235 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:58.635356 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a6126778-6a6c-406c-b3d5-934aabb57235 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:58.635805 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a6126778-6a6c-406c-b3d5-934aabb57235 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:58.636221 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a6126778-6a6c-406c-b3d5-934aabb57235 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:58.765917 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-a6126778-6a6c-406c-b3d5-934aabb57235 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:58.774546 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-a6126778-6a6c-406c-b3d5-934aabb57235 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1722 microversion: 2.1 time: 0.152052 Oct 20 06:07:58.775102 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 226/475] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:07:58 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 06:07:59.119131 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-a5bceeb9-1f4a-41a4-a2bc-5d69f46f5613 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:07:59.119769 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-a5bceeb9-1f4a-41a4-a2bc-5d69f46f5613 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:07:59.126146 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a5bceeb9-1f4a-41a4-a2bc-5d69f46f5613 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:59.126657 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a5bceeb9-1f4a-41a4-a2bc-5d69f46f5613 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:59.127096 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a5bceeb9-1f4a-41a4-a2bc-5d69f46f5613 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:59.127784 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a5bceeb9-1f4a-41a4-a2bc-5d69f46f5613 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:59.128235 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a5bceeb9-1f4a-41a4-a2bc-5d69f46f5613 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:59.128659 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a5bceeb9-1f4a-41a4-a2bc-5d69f46f5613 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:59.254887 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-a5bceeb9-1f4a-41a4-a2bc-5d69f46f5613 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:59.264479 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-a5bceeb9-1f4a-41a4-a2bc-5d69f46f5613 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:59.265954 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-a5bceeb9-1f4a-41a4-a2bc-5d69f46f5613 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:59.267104 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-a5bceeb9-1f4a-41a4-a2bc-5d69f46f5613 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1663 microversion: 2.20 time: 0.152411 Oct 20 06:07:59.267659 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 250/476] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:07:59 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1663 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:07:59.294796 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-c156a1ac-fcdf-4f2f-925e-938f8915d479 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ffda1749-fb55-4929-9287-47fe4ed7301f"}} {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 06:07:59.297311 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-c156a1ac-fcdf-4f2f-925e-938f8915d479 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:07:59.303496 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c156a1ac-fcdf-4f2f-925e-938f8915d479 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:59.304001 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c156a1ac-fcdf-4f2f-925e-938f8915d479 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:59.304445 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c156a1ac-fcdf-4f2f-925e-938f8915d479 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:59.305199 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c156a1ac-fcdf-4f2f-925e-938f8915d479 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:59.305743 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c156a1ac-fcdf-4f2f-925e-938f8915d479 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:59.306173 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c156a1ac-fcdf-4f2f-925e-938f8915d479 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:59.584084 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [req-6c4eda3a-80c3-4e54-bb42-4cf4d4fc713a req-81b2388e-b921-4f88-8bb1-0f8c2d8787f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71be459d-e948-4a17-b379-182f4196411d", "name": "network-vif-unplugged", "status": "completed", "tag": "eb253026-482c-4675-acce-8325c21757fd"}]} {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 06:07:59.594873 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-c156a1ac-fcdf-4f2f-925e-938f8915d479 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "POST /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.304873 Oct 20 06:07:59.600856 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 227/477] 10.222.0.20 () {62 vars in 1364 bytes} [Thu Oct 20 06:07:59 2022] POST /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d/os-volume_attachments => generated 188 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 20 06:07:59.601007 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [req-6c4eda3a-80c3-4e54-bb42-4cf4d4fc713a req-81b2388e-b921-4f88-8bb1-0f8c2d8787f1 service nova] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:59.601007 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [req-6c4eda3a-80c3-4e54-bb42-4cf4d4fc713a req-81b2388e-b921-4f88-8bb1-0f8c2d8787f1 service nova] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:59.601007 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [req-6c4eda3a-80c3-4e54-bb42-4cf4d4fc713a req-81b2388e-b921-4f88-8bb1-0f8c2d8787f1 service nova] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:59.613076 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.compute.server_external_events [req-6c4eda3a-80c3-4e54-bb42-4cf4d4fc713a req-81b2388e-b921-4f88-8bb1-0f8c2d8787f1 service nova] Unable to find a host for instance 71be459d-e948-4a17-b379-182f4196411d. Dropping event network-vif-unplugged {{(pid=118861) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 20 06:07:59.613773 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [req-6c4eda3a-80c3-4e54-bb42-4cf4d4fc713a req-81b2388e-b921-4f88-8bb1-0f8c2d8787f1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.033363 Oct 20 06:07:59.614507 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 251/478] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 20 06:07:59 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 34 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Oct 20 06:07:59.726107 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-d770137c-6318-4735-ab81-2a0a56b2e80e tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 06:07:59.727307 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-d770137c-6318-4735-ab81-2a0a56b2e80e tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:07:59.733961 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-d770137c-6318-4735-ab81-2a0a56b2e80e tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:59.734446 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-d770137c-6318-4735-ab81-2a0a56b2e80e tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:59.734885 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-d770137c-6318-4735-ab81-2a0a56b2e80e tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:59.735790 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-d770137c-6318-4735-ab81-2a0a56b2e80e tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:59.736243 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-d770137c-6318-4735-ab81-2a0a56b2e80e tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:59.738132 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-d770137c-6318-4735-ab81-2a0a56b2e80e tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:59.785767 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-d770137c-6318-4735-ab81-2a0a56b2e80e tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=118860) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 20 06:07:59.797913 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-ae053823-c4b4-4cc2-a3f4-7eeb4b8fadcc tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:07:59.798695 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-ae053823-c4b4-4cc2-a3f4-7eeb4b8fadcc tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:07:59.806351 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ae053823-c4b4-4cc2-a3f4-7eeb4b8fadcc tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:59.806937 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ae053823-c4b4-4cc2-a3f4-7eeb4b8fadcc tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:59.807373 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ae053823-c4b4-4cc2-a3f4-7eeb4b8fadcc tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:59.808062 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ae053823-c4b4-4cc2-a3f4-7eeb4b8fadcc tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:59.808537 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ae053823-c4b4-4cc2-a3f4-7eeb4b8fadcc tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:59.808989 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ae053823-c4b4-4cc2-a3f4-7eeb4b8fadcc tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:59.856807 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-d770137c-6318-4735-ab81-2a0a56b2e80e tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "POST /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d/action" status: 202 len: 0 microversion: 2.20 time: 0.134474 Oct 20 06:07:59.857397 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 228/479] 10.222.0.20 () {62 vars in 1319 bytes} [Thu Oct 20 06:07:59 2022] POST /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d/action => generated 0 bytes in 136 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 20 06:07:59.865216 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-e1db7bfc-8f04-4c9d-85b7-b160ba81ed76 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:07:59.865826 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-e1db7bfc-8f04-4c9d-85b7-b160ba81ed76 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:07:59.872160 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e1db7bfc-8f04-4c9d-85b7-b160ba81ed76 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:59.872650 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e1db7bfc-8f04-4c9d-85b7-b160ba81ed76 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:59.873132 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e1db7bfc-8f04-4c9d-85b7-b160ba81ed76 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:59.873835 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e1db7bfc-8f04-4c9d-85b7-b160ba81ed76 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:59.874286 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e1db7bfc-8f04-4c9d-85b7-b160ba81ed76 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:59.874719 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e1db7bfc-8f04-4c9d-85b7-b160ba81ed76 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:07:59.955907 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-ae053823-c4b4-4cc2-a3f4-7eeb4b8fadcc tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:07:59.964686 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-ae053823-c4b4-4cc2-a3f4-7eeb4b8fadcc tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1699 microversion: 2.1 time: 0.170773 Oct 20 06:07:59.965485 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 252/480] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:07:59 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1699 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 06:07:59.988878 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-68d43592-55f8-45e3-9677-40f412bcddb4 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 06:07:59.996510 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-68d43592-55f8-45e3-9677-40f412bcddb4 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:07:59.997405 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-68d43592-55f8-45e3-9677-40f412bcddb4 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:07:59.997854 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-68d43592-55f8-45e3-9677-40f412bcddb4 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:08:00.011261 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-e1db7bfc-8f04-4c9d-85b7-b160ba81ed76 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:08:00.016072 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG dbcounter [-] [118861] Writing DB stats nova_cell1:SELECT=100 {{(pid=118861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:08:00.022801 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-e1db7bfc-8f04-4c9d-85b7-b160ba81ed76 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:08:00.022936 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-68d43592-55f8-45e3-9677-40f412bcddb4 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Going to try to start instance {{(pid=118861) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 20 06:08:00.024496 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-e1db7bfc-8f04-4c9d-85b7-b160ba81ed76 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:08:00.025944 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-e1db7bfc-8f04-4c9d-85b7-b160ba81ed76 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1749 microversion: 2.20 time: 0.164370 Oct 20 06:08:00.026738 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 229/481] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:07:59 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1749 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 20 06:08:00.071747 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-68d43592-55f8-45e3-9677-40f412bcddb4 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "POST /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/action" status: 202 len: 0 microversion: 2.1 time: 0.087564 Oct 20 06:08:00.072353 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 253/482] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Oct 20 06:07:59 2022] POST /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/action => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 20 06:08:00.080385 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-abbf96c1-0d2e-4ee2-9c2d-f0a795b7be77 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:08:00.081041 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-abbf96c1-0d2e-4ee2-9c2d-f0a795b7be77 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:08:00.087860 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-abbf96c1-0d2e-4ee2-9c2d-f0a795b7be77 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:08:00.088356 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-abbf96c1-0d2e-4ee2-9c2d-f0a795b7be77 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:08:00.089176 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-abbf96c1-0d2e-4ee2-9c2d-f0a795b7be77 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:08:00.089531 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-abbf96c1-0d2e-4ee2-9c2d-f0a795b7be77 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:08:00.089990 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-abbf96c1-0d2e-4ee2-9c2d-f0a795b7be77 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:08:00.090415 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-abbf96c1-0d2e-4ee2-9c2d-f0a795b7be77 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:08:00.244134 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-abbf96c1-0d2e-4ee2-9c2d-f0a795b7be77 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:08:00.256799 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-abbf96c1-0d2e-4ee2-9c2d-f0a795b7be77 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1708 microversion: 2.1 time: 0.176812 Oct 20 06:08:00.258059 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 230/483] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:08:00 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1708 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 06:08:01.052357 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-5cbd8505-b74b-43e9-93ef-aed643d0a693 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:08:01.053156 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-5cbd8505-b74b-43e9-93ef-aed643d0a693 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:08:01.059923 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5cbd8505-b74b-43e9-93ef-aed643d0a693 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:08:01.060406 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5cbd8505-b74b-43e9-93ef-aed643d0a693 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:08:01.060878 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5cbd8505-b74b-43e9-93ef-aed643d0a693 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:08:01.061575 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5cbd8505-b74b-43e9-93ef-aed643d0a693 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:08:01.062028 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5cbd8505-b74b-43e9-93ef-aed643d0a693 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:08:01.062453 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5cbd8505-b74b-43e9-93ef-aed643d0a693 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:08:01.280854 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-b010ddf7-a40f-4ca5-ac79-0a6997fe673a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:08:01.281464 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-b010ddf7-a40f-4ca5-ac79-0a6997fe673a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:08:01.288159 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b010ddf7-a40f-4ca5-ac79-0a6997fe673a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:08:01.288651 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b010ddf7-a40f-4ca5-ac79-0a6997fe673a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:08:01.289997 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b010ddf7-a40f-4ca5-ac79-0a6997fe673a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:08:01.290723 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b010ddf7-a40f-4ca5-ac79-0a6997fe673a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:08:01.291183 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b010ddf7-a40f-4ca5-ac79-0a6997fe673a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:08:01.291611 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b010ddf7-a40f-4ca5-ac79-0a6997fe673a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:08:01.396171 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-5cbd8505-b74b-43e9-93ef-aed643d0a693 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:08:01.405099 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-5cbd8505-b74b-43e9-93ef-aed643d0a693 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:08:01.406552 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-5cbd8505-b74b-43e9-93ef-aed643d0a693 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:08:01.407721 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-5cbd8505-b74b-43e9-93ef-aed643d0a693 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1749 microversion: 2.20 time: 0.360093 Oct 20 06:08:01.408283 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 254/484] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:08:01 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1749 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:08:01.426463 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-b010ddf7-a40f-4ca5-ac79-0a6997fe673a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:08:01.435453 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-b010ddf7-a40f-4ca5-ac79-0a6997fe673a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1708 microversion: 2.1 time: 0.158662 Oct 20 06:08:01.436020 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 231/485] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:08:01 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1708 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 06:08:02.434555 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-93f03ee6-70b5-412f-8973-63778ac36867 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:08:02.435102 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-93f03ee6-70b5-412f-8973-63778ac36867 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:08:02.441023 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-93f03ee6-70b5-412f-8973-63778ac36867 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:08:02.441508 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-93f03ee6-70b5-412f-8973-63778ac36867 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:08:02.441947 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-93f03ee6-70b5-412f-8973-63778ac36867 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:08:02.442639 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-93f03ee6-70b5-412f-8973-63778ac36867 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:08:02.443092 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-93f03ee6-70b5-412f-8973-63778ac36867 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:08:02.443519 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-93f03ee6-70b5-412f-8973-63778ac36867 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:08:02.459297 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-3b5cdf02-def3-4232-ad38-dd92bec32685 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:08:02.459894 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-3b5cdf02-def3-4232-ad38-dd92bec32685 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:08:02.466275 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3b5cdf02-def3-4232-ad38-dd92bec32685 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:08:02.466750 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3b5cdf02-def3-4232-ad38-dd92bec32685 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:08:02.467179 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3b5cdf02-def3-4232-ad38-dd92bec32685 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:08:02.467893 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3b5cdf02-def3-4232-ad38-dd92bec32685 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:08:02.468352 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3b5cdf02-def3-4232-ad38-dd92bec32685 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:08:02.468816 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3b5cdf02-def3-4232-ad38-dd92bec32685 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:08:02.575451 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-93f03ee6-70b5-412f-8973-63778ac36867 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:08:02.584780 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-93f03ee6-70b5-412f-8973-63778ac36867 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:08:02.587115 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-93f03ee6-70b5-412f-8973-63778ac36867 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:08:02.588295 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-93f03ee6-70b5-412f-8973-63778ac36867 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1749 microversion: 2.20 time: 0.158753 Oct 20 06:08:02.588882 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 255/486] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:08:02 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1749 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:08:02.602995 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-3b5cdf02-def3-4232-ad38-dd92bec32685 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:08:02.611011 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-3b5cdf02-def3-4232-ad38-dd92bec32685 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1712 microversion: 2.1 time: 0.155509 Oct 20 06:08:02.611561 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 232/487] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:08:02 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1712 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 06:08:03.613697 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-5ade9123-8f5c-4890-b28f-a0a535cf9c78 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:08:03.614295 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-5ade9123-8f5c-4890-b28f-a0a535cf9c78 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:08:03.620764 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5ade9123-8f5c-4890-b28f-a0a535cf9c78 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:08:03.621244 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5ade9123-8f5c-4890-b28f-a0a535cf9c78 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:08:03.621681 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5ade9123-8f5c-4890-b28f-a0a535cf9c78 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:08:03.622363 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5ade9123-8f5c-4890-b28f-a0a535cf9c78 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:08:03.622810 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5ade9123-8f5c-4890-b28f-a0a535cf9c78 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:08:03.623230 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5ade9123-8f5c-4890-b28f-a0a535cf9c78 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:08:03.712133 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 20 06:08:03.712273 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: Thu Oct 20 06:08:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d (ip 10.222.0.20) !!! Oct 20 06:08:03.713348 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 20 06:08:03.713499 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: Thu Oct 20 06:08:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d (ip 10.222.0.20) !!! Oct 20 06:08:03.761613 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-5ade9123-8f5c-4890-b28f-a0a535cf9c78 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:08:03.770021 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-5ade9123-8f5c-4890-b28f-a0a535cf9c78 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:08:03.771456 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-5ade9123-8f5c-4890-b28f-a0a535cf9c78 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:08:03.772606 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-5ade9123-8f5c-4890-b28f-a0a535cf9c78 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1749 microversion: 2.20 time: 0.162768 Oct 20 06:08:03.773216 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 256/488] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:08:03 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1749 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:08:04.798589 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-b234ab0f-a2a3-44be-8179-2c68b17368c4 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:08:04.799121 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-b234ab0f-a2a3-44be-8179-2c68b17368c4 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:08:04.806133 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b234ab0f-a2a3-44be-8179-2c68b17368c4 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:08:04.806616 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b234ab0f-a2a3-44be-8179-2c68b17368c4 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:08:04.807046 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b234ab0f-a2a3-44be-8179-2c68b17368c4 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:08:04.807725 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b234ab0f-a2a3-44be-8179-2c68b17368c4 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:08:04.808172 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b234ab0f-a2a3-44be-8179-2c68b17368c4 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:08:04.808591 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b234ab0f-a2a3-44be-8179-2c68b17368c4 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:08:04.937423 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-b234ab0f-a2a3-44be-8179-2c68b17368c4 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:08:04.946682 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-b234ab0f-a2a3-44be-8179-2c68b17368c4 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:08:04.948102 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-b234ab0f-a2a3-44be-8179-2c68b17368c4 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:08:04.949266 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-b234ab0f-a2a3-44be-8179-2c68b17368c4 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1749 microversion: 2.20 time: 0.154739 Oct 20 06:08:04.949817 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 233/489] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:08:04 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1749 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:08:05.974449 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-59a3e4b9-b585-42b3-aa7c-706c24d84482 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:08:05.975051 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-59a3e4b9-b585-42b3-aa7c-706c24d84482 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:08:05.982104 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-59a3e4b9-b585-42b3-aa7c-706c24d84482 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:08:05.982583 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-59a3e4b9-b585-42b3-aa7c-706c24d84482 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:08:05.983018 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-59a3e4b9-b585-42b3-aa7c-706c24d84482 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:08:05.983705 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-59a3e4b9-b585-42b3-aa7c-706c24d84482 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:08:05.984152 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-59a3e4b9-b585-42b3-aa7c-706c24d84482 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:08:05.984570 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-59a3e4b9-b585-42b3-aa7c-706c24d84482 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:08:06.109595 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-59a3e4b9-b585-42b3-aa7c-706c24d84482 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:08:06.119264 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-59a3e4b9-b585-42b3-aa7c-706c24d84482 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:08:06.120780 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-59a3e4b9-b585-42b3-aa7c-706c24d84482 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:08:06.121995 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-59a3e4b9-b585-42b3-aa7c-706c24d84482 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1751 microversion: 2.20 time: 0.151479 Oct 20 06:08:06.122547 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 257/490] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:08:05 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1751 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:08:07.147368 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-6fa280b4-03c7-4265-bcb0-76e875ae7027 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:08:07.148504 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-6fa280b4-03c7-4265-bcb0-76e875ae7027 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:08:07.155363 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-6fa280b4-03c7-4265-bcb0-76e875ae7027 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:08:07.155845 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-6fa280b4-03c7-4265-bcb0-76e875ae7027 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:08:07.156280 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-6fa280b4-03c7-4265-bcb0-76e875ae7027 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:08:07.156998 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-6fa280b4-03c7-4265-bcb0-76e875ae7027 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:08:07.157449 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-6fa280b4-03c7-4265-bcb0-76e875ae7027 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:08:07.157872 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-6fa280b4-03c7-4265-bcb0-76e875ae7027 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:08:07.283773 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-6fa280b4-03c7-4265-bcb0-76e875ae7027 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:08:07.293055 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-6fa280b4-03c7-4265-bcb0-76e875ae7027 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:08:07.294501 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-6fa280b4-03c7-4265-bcb0-76e875ae7027 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:08:07.295689 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-6fa280b4-03c7-4265-bcb0-76e875ae7027 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1751 microversion: 2.20 time: 0.152112 Oct 20 06:08:07.297050 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 234/491] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:08:07 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1751 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:08:08.321737 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-27e440fd-dad0-488d-92a9-9778e48ca859 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:08:08.322344 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-27e440fd-dad0-488d-92a9-9778e48ca859 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:08:08.329324 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-27e440fd-dad0-488d-92a9-9778e48ca859 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:08:08.329812 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-27e440fd-dad0-488d-92a9-9778e48ca859 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:08:08.330245 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-27e440fd-dad0-488d-92a9-9778e48ca859 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:08:08.331027 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-27e440fd-dad0-488d-92a9-9778e48ca859 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:08:08.331477 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-27e440fd-dad0-488d-92a9-9778e48ca859 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:08:08.331902 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-27e440fd-dad0-488d-92a9-9778e48ca859 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:08:08.459235 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-27e440fd-dad0-488d-92a9-9778e48ca859 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:08:08.468219 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-27e440fd-dad0-488d-92a9-9778e48ca859 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:08:08.469683 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-27e440fd-dad0-488d-92a9-9778e48ca859 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:08:08.470833 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-27e440fd-dad0-488d-92a9-9778e48ca859 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1751 microversion: 2.20 time: 0.153148 Oct 20 06:08:08.471455 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 258/492] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:08:08 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1751 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:08:09.495459 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-0828f7ca-d334-4f44-9feb-dd6d63e85441 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:08:09.495963 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-0828f7ca-d334-4f44-9feb-dd6d63e85441 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:08:09.502378 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0828f7ca-d334-4f44-9feb-dd6d63e85441 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:08:09.502854 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0828f7ca-d334-4f44-9feb-dd6d63e85441 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:08:09.503285 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0828f7ca-d334-4f44-9feb-dd6d63e85441 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:08:09.503968 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0828f7ca-d334-4f44-9feb-dd6d63e85441 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:08:09.504415 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0828f7ca-d334-4f44-9feb-dd6d63e85441 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:08:09.504873 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0828f7ca-d334-4f44-9feb-dd6d63e85441 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:08:09.635484 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-0828f7ca-d334-4f44-9feb-dd6d63e85441 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:08:09.639270 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG dbcounter [-] [118860] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=118860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:08:09.645529 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-0828f7ca-d334-4f44-9feb-dd6d63e85441 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:08:09.646965 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-0828f7ca-d334-4f44-9feb-dd6d63e85441 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:08:09.648729 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-0828f7ca-d334-4f44-9feb-dd6d63e85441 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1751 microversion: 2.20 time: 0.156733 Oct 20 06:08:09.649277 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 235/493] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:08:09 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1751 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:08:10.674509 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-c6655fdb-e0c0-4cff-82c4-549826204a0a tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:08:10.675333 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-c6655fdb-e0c0-4cff-82c4-549826204a0a tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:08:10.681890 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c6655fdb-e0c0-4cff-82c4-549826204a0a tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:08:10.682369 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c6655fdb-e0c0-4cff-82c4-549826204a0a tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:08:10.682805 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c6655fdb-e0c0-4cff-82c4-549826204a0a tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:08:10.683493 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c6655fdb-e0c0-4cff-82c4-549826204a0a tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:08:10.683941 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c6655fdb-e0c0-4cff-82c4-549826204a0a tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:08:10.684364 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c6655fdb-e0c0-4cff-82c4-549826204a0a tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:08:10.812551 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-c6655fdb-e0c0-4cff-82c4-549826204a0a tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:08:10.821442 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-c6655fdb-e0c0-4cff-82c4-549826204a0a tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:08:10.822873 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-c6655fdb-e0c0-4cff-82c4-549826204a0a tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:08:10.824024 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-c6655fdb-e0c0-4cff-82c4-549826204a0a tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1751 microversion: 2.20 time: 0.153502 Oct 20 06:08:10.824580 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 259/494] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:08:10 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1751 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:08:11.850456 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-7371ea00-52ad-4906-8806-ad22a1287be2 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:08:11.851716 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-7371ea00-52ad-4906-8806-ad22a1287be2 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:08:11.859042 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7371ea00-52ad-4906-8806-ad22a1287be2 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:08:11.859510 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7371ea00-52ad-4906-8806-ad22a1287be2 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:08:11.859945 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7371ea00-52ad-4906-8806-ad22a1287be2 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:08:11.860673 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7371ea00-52ad-4906-8806-ad22a1287be2 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:08:11.861092 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7371ea00-52ad-4906-8806-ad22a1287be2 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:08:11.861512 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7371ea00-52ad-4906-8806-ad22a1287be2 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:08:11.988257 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-7371ea00-52ad-4906-8806-ad22a1287be2 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:08:11.997514 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-7371ea00-52ad-4906-8806-ad22a1287be2 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:08:11.998930 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-7371ea00-52ad-4906-8806-ad22a1287be2 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:08:12.000066 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-7371ea00-52ad-4906-8806-ad22a1287be2 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1751 microversion: 2.20 time: 0.154042 Oct 20 06:08:12.000615 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 236/495] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:08:11 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1751 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:08:13.025970 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-dd6278c7-472a-4fb9-b749-c49c6133eaa2 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:08:13.026503 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-dd6278c7-472a-4fb9-b749-c49c6133eaa2 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:08:13.033633 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-dd6278c7-472a-4fb9-b749-c49c6133eaa2 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:08:13.034113 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-dd6278c7-472a-4fb9-b749-c49c6133eaa2 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:08:13.034550 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-dd6278c7-472a-4fb9-b749-c49c6133eaa2 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:08:13.035251 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-dd6278c7-472a-4fb9-b749-c49c6133eaa2 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:08:13.035702 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-dd6278c7-472a-4fb9-b749-c49c6133eaa2 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:08:13.036131 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-dd6278c7-472a-4fb9-b749-c49c6133eaa2 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:08:13.163136 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-dd6278c7-472a-4fb9-b749-c49c6133eaa2 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:08:13.172300 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-dd6278c7-472a-4fb9-b749-c49c6133eaa2 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:08:13.173754 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-dd6278c7-472a-4fb9-b749-c49c6133eaa2 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:08:13.174897 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-dd6278c7-472a-4fb9-b749-c49c6133eaa2 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1751 microversion: 2.20 time: 0.153431 Oct 20 06:08:13.175451 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 260/496] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:08:13 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1751 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:08:14.200017 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-2a87e869-27a3-4a05-a02c-3307b707a81e tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:08:14.200591 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-2a87e869-27a3-4a05-a02c-3307b707a81e tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:08:14.207047 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2a87e869-27a3-4a05-a02c-3307b707a81e tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:08:14.207519 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2a87e869-27a3-4a05-a02c-3307b707a81e tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:08:14.207951 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2a87e869-27a3-4a05-a02c-3307b707a81e tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:08:14.208763 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2a87e869-27a3-4a05-a02c-3307b707a81e tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:08:14.209215 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2a87e869-27a3-4a05-a02c-3307b707a81e tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:08:14.209634 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2a87e869-27a3-4a05-a02c-3307b707a81e tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:08:14.337577 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-2a87e869-27a3-4a05-a02c-3307b707a81e tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:08:14.346047 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-2a87e869-27a3-4a05-a02c-3307b707a81e tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:08:14.347487 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-2a87e869-27a3-4a05-a02c-3307b707a81e tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:08:14.348636 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-2a87e869-27a3-4a05-a02c-3307b707a81e tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1751 microversion: 2.20 time: 0.152619 Oct 20 06:08:14.349215 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 237/497] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:08:14 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1751 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:08:15.374834 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-df8ff622-e9b0-4567-8fe2-e923008d0b7e tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:08:15.375442 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-df8ff622-e9b0-4567-8fe2-e923008d0b7e tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:08:15.382052 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-df8ff622-e9b0-4567-8fe2-e923008d0b7e tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:08:15.382807 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-df8ff622-e9b0-4567-8fe2-e923008d0b7e tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:08:15.383352 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-df8ff622-e9b0-4567-8fe2-e923008d0b7e tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:08:15.384050 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-df8ff622-e9b0-4567-8fe2-e923008d0b7e tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:08:15.384496 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-df8ff622-e9b0-4567-8fe2-e923008d0b7e tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:08:15.384950 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-df8ff622-e9b0-4567-8fe2-e923008d0b7e tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:08:15.514310 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-df8ff622-e9b0-4567-8fe2-e923008d0b7e tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:08:15.525237 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-df8ff622-e9b0-4567-8fe2-e923008d0b7e tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:08:15.526693 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-df8ff622-e9b0-4567-8fe2-e923008d0b7e tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:08:15.527868 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-df8ff622-e9b0-4567-8fe2-e923008d0b7e tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1751 microversion: 2.20 time: 0.156935 Oct 20 06:08:15.528812 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 261/498] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:08:15 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1751 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:08:16.553775 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-c06253b5-bb2a-42b4-9991-7f42a9139f8d tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:08:16.554425 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-c06253b5-bb2a-42b4-9991-7f42a9139f8d tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:08:16.560878 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c06253b5-bb2a-42b4-9991-7f42a9139f8d tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:08:16.561298 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c06253b5-bb2a-42b4-9991-7f42a9139f8d tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:08:16.561738 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c06253b5-bb2a-42b4-9991-7f42a9139f8d tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:08:16.562423 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c06253b5-bb2a-42b4-9991-7f42a9139f8d tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:08:16.562873 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c06253b5-bb2a-42b4-9991-7f42a9139f8d tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:08:16.563294 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c06253b5-bb2a-42b4-9991-7f42a9139f8d tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:08:16.691913 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-c06253b5-bb2a-42b4-9991-7f42a9139f8d tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:08:16.701087 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-c06253b5-bb2a-42b4-9991-7f42a9139f8d tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:08:16.706825 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-c06253b5-bb2a-42b4-9991-7f42a9139f8d tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:08:16.709151 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-c06253b5-bb2a-42b4-9991-7f42a9139f8d tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1751 microversion: 2.20 time: 0.159323 Oct 20 06:08:16.709707 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 238/499] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:08:16 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1751 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:08:17.734874 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-89104fa6-c013-4f65-a846-9407619036a8 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:08:17.735752 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-89104fa6-c013-4f65-a846-9407619036a8 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:08:17.743469 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-89104fa6-c013-4f65-a846-9407619036a8 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:08:17.743992 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-89104fa6-c013-4f65-a846-9407619036a8 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:08:17.744433 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-89104fa6-c013-4f65-a846-9407619036a8 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:08:17.745196 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-89104fa6-c013-4f65-a846-9407619036a8 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:08:17.745679 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-89104fa6-c013-4f65-a846-9407619036a8 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:08:17.746103 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-89104fa6-c013-4f65-a846-9407619036a8 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:08:17.875016 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-89104fa6-c013-4f65-a846-9407619036a8 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:08:17.884619 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-89104fa6-c013-4f65-a846-9407619036a8 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:08:17.886108 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-89104fa6-c013-4f65-a846-9407619036a8 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:08:17.887266 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-89104fa6-c013-4f65-a846-9407619036a8 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1751 microversion: 2.20 time: 0.156208 Oct 20 06:08:17.887816 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 262/500] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:08:17 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1751 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:08:18.912490 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-b01f0d64-2389-4f13-93b5-ef05f4e1b63f tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:08:18.913756 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-b01f0d64-2389-4f13-93b5-ef05f4e1b63f tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:08:18.920334 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b01f0d64-2389-4f13-93b5-ef05f4e1b63f tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:08:18.920850 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b01f0d64-2389-4f13-93b5-ef05f4e1b63f tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:08:18.921288 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b01f0d64-2389-4f13-93b5-ef05f4e1b63f tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:08:18.921977 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b01f0d64-2389-4f13-93b5-ef05f4e1b63f tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:08:18.922426 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b01f0d64-2389-4f13-93b5-ef05f4e1b63f tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:08:18.922849 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b01f0d64-2389-4f13-93b5-ef05f4e1b63f tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:08:19.051739 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-b01f0d64-2389-4f13-93b5-ef05f4e1b63f tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:08:19.061258 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-b01f0d64-2389-4f13-93b5-ef05f4e1b63f tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:08:19.062689 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-b01f0d64-2389-4f13-93b5-ef05f4e1b63f tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:08:19.063861 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-b01f0d64-2389-4f13-93b5-ef05f4e1b63f tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1751 microversion: 2.20 time: 0.155288 Oct 20 06:08:19.064409 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 239/501] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:08:18 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1751 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:08:20.089793 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-d9b507e7-36fc-44ec-bdde-262bc4b7381a tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:08:20.090330 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-d9b507e7-36fc-44ec-bdde-262bc4b7381a tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:08:20.096816 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d9b507e7-36fc-44ec-bdde-262bc4b7381a tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:08:20.097304 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d9b507e7-36fc-44ec-bdde-262bc4b7381a tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:08:20.097746 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d9b507e7-36fc-44ec-bdde-262bc4b7381a tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:08:20.098444 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d9b507e7-36fc-44ec-bdde-262bc4b7381a tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:08:20.098901 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d9b507e7-36fc-44ec-bdde-262bc4b7381a tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:08:20.099326 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d9b507e7-36fc-44ec-bdde-262bc4b7381a tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:08:20.230065 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-d9b507e7-36fc-44ec-bdde-262bc4b7381a tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:08:20.238622 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-d9b507e7-36fc-44ec-bdde-262bc4b7381a tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:08:20.240049 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-d9b507e7-36fc-44ec-bdde-262bc4b7381a tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:08:20.241232 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-d9b507e7-36fc-44ec-bdde-262bc4b7381a tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1751 microversion: 2.20 time: 0.156165 Oct 20 06:08:20.241779 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 263/502] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:08:20 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1751 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:08:21.265963 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-214e35b0-e0d5-4cbe-9f6a-1a7e95f56d97 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:08:21.266566 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-214e35b0-e0d5-4cbe-9f6a-1a7e95f56d97 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:08:21.273194 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-214e35b0-e0d5-4cbe-9f6a-1a7e95f56d97 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:08:21.273687 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-214e35b0-e0d5-4cbe-9f6a-1a7e95f56d97 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:08:21.274107 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-214e35b0-e0d5-4cbe-9f6a-1a7e95f56d97 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:08:21.274798 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-214e35b0-e0d5-4cbe-9f6a-1a7e95f56d97 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:08:21.275245 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-214e35b0-e0d5-4cbe-9f6a-1a7e95f56d97 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:08:21.275665 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-214e35b0-e0d5-4cbe-9f6a-1a7e95f56d97 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:08:21.406181 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-214e35b0-e0d5-4cbe-9f6a-1a7e95f56d97 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:08:21.415366 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-214e35b0-e0d5-4cbe-9f6a-1a7e95f56d97 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:08:21.416877 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-214e35b0-e0d5-4cbe-9f6a-1a7e95f56d97 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:08:21.418028 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-214e35b0-e0d5-4cbe-9f6a-1a7e95f56d97 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1751 microversion: 2.20 time: 0.156060 Oct 20 06:08:21.418577 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 240/503] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:08:21 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1751 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:08:22.443173 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-388f0f78-094e-477c-b361-f24a2ccee84b tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:08:22.443781 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-388f0f78-094e-477c-b361-f24a2ccee84b tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:08:22.450867 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-388f0f78-094e-477c-b361-f24a2ccee84b tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:08:22.451347 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-388f0f78-094e-477c-b361-f24a2ccee84b tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:08:22.451782 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-388f0f78-094e-477c-b361-f24a2ccee84b tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:08:22.452473 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-388f0f78-094e-477c-b361-f24a2ccee84b tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:08:22.452958 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-388f0f78-094e-477c-b361-f24a2ccee84b tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:08:22.453382 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-388f0f78-094e-477c-b361-f24a2ccee84b tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:08:22.579062 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-388f0f78-094e-477c-b361-f24a2ccee84b tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:08:22.587839 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-388f0f78-094e-477c-b361-f24a2ccee84b tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:08:22.589303 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-388f0f78-094e-477c-b361-f24a2ccee84b tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:08:22.590451 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-388f0f78-094e-477c-b361-f24a2ccee84b tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1751 microversion: 2.20 time: 0.151214 Oct 20 06:08:22.591014 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 264/504] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:08:22 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1751 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:08:23.615460 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-bc94eb0a-88e3-46cc-89c4-817457074309 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:08:23.616650 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-bc94eb0a-88e3-46cc-89c4-817457074309 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:08:23.623353 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-bc94eb0a-88e3-46cc-89c4-817457074309 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:08:23.623834 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-bc94eb0a-88e3-46cc-89c4-817457074309 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:08:23.624269 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-bc94eb0a-88e3-46cc-89c4-817457074309 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:08:23.625020 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-bc94eb0a-88e3-46cc-89c4-817457074309 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:08:23.625474 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-bc94eb0a-88e3-46cc-89c4-817457074309 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:08:23.625905 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-bc94eb0a-88e3-46cc-89c4-817457074309 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:08:23.753294 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-bc94eb0a-88e3-46cc-89c4-817457074309 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:08:23.762200 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-bc94eb0a-88e3-46cc-89c4-817457074309 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:08:23.763661 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-bc94eb0a-88e3-46cc-89c4-817457074309 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:08:23.764842 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-bc94eb0a-88e3-46cc-89c4-817457074309 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1751 microversion: 2.20 time: 0.153407 Oct 20 06:08:23.765405 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 241/505] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:08:23 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1751 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:08:24.790911 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-22d0eb73-ff47-477a-aa91-2e38f0d647b9 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:08:24.791517 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-22d0eb73-ff47-477a-aa91-2e38f0d647b9 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:08:24.797944 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-22d0eb73-ff47-477a-aa91-2e38f0d647b9 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:08:24.798444 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-22d0eb73-ff47-477a-aa91-2e38f0d647b9 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:08:24.798878 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-22d0eb73-ff47-477a-aa91-2e38f0d647b9 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:08:24.799571 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-22d0eb73-ff47-477a-aa91-2e38f0d647b9 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:08:24.800020 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-22d0eb73-ff47-477a-aa91-2e38f0d647b9 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:08:24.800442 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-22d0eb73-ff47-477a-aa91-2e38f0d647b9 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:08:24.928816 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-22d0eb73-ff47-477a-aa91-2e38f0d647b9 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:08:24.937530 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-22d0eb73-ff47-477a-aa91-2e38f0d647b9 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:08:24.938975 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-22d0eb73-ff47-477a-aa91-2e38f0d647b9 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:08:24.940124 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-22d0eb73-ff47-477a-aa91-2e38f0d647b9 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1751 microversion: 2.20 time: 0.153947 Oct 20 06:08:24.940671 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 265/506] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:08:24 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1751 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:08:25.966349 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-2c927528-6c58-465a-a883-ce6f546a698b tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:08:25.966952 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-2c927528-6c58-465a-a883-ce6f546a698b tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:08:25.973419 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2c927528-6c58-465a-a883-ce6f546a698b tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:08:25.973902 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2c927528-6c58-465a-a883-ce6f546a698b tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:08:25.974337 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2c927528-6c58-465a-a883-ce6f546a698b tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:08:25.975028 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2c927528-6c58-465a-a883-ce6f546a698b tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:08:25.976368 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2c927528-6c58-465a-a883-ce6f546a698b tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:08:25.976850 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2c927528-6c58-465a-a883-ce6f546a698b tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:08:26.107345 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-2c927528-6c58-465a-a883-ce6f546a698b tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:08:26.116378 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-2c927528-6c58-465a-a883-ce6f546a698b tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:08:26.117884 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-2c927528-6c58-465a-a883-ce6f546a698b tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:08:26.119150 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-2c927528-6c58-465a-a883-ce6f546a698b tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1751 microversion: 2.20 time: 0.156801 Oct 20 06:08:26.128746 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 242/507] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:08:25 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1751 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:08:27.144651 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-4c5db973-38da-4930-a08b-d3c20d0d5e8a tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:08:27.145272 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-4c5db973-38da-4930-a08b-d3c20d0d5e8a tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:08:27.148018 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG dbcounter [-] [118861] Writing DB stats nova_api:SELECT=38 {{(pid=118861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:08:27.153250 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4c5db973-38da-4930-a08b-d3c20d0d5e8a tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:08:27.153731 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4c5db973-38da-4930-a08b-d3c20d0d5e8a tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:08:27.154161 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4c5db973-38da-4930-a08b-d3c20d0d5e8a tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:08:27.154857 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4c5db973-38da-4930-a08b-d3c20d0d5e8a tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:08:27.155301 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4c5db973-38da-4930-a08b-d3c20d0d5e8a tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:08:27.155717 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4c5db973-38da-4930-a08b-d3c20d0d5e8a tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:08:27.285487 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-4c5db973-38da-4930-a08b-d3c20d0d5e8a tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:08:27.294639 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-4c5db973-38da-4930-a08b-d3c20d0d5e8a tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:08:27.296067 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-4c5db973-38da-4930-a08b-d3c20d0d5e8a tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:08:27.297248 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-4c5db973-38da-4930-a08b-d3c20d0d5e8a tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1751 microversion: 2.20 time: 0.156561 Oct 20 06:08:27.297799 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 266/508] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:08:27 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1751 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:08:28.140501 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-8299bb0d-6feb-4a17-856a-9310a4934833 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:08:28.141087 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-8299bb0d-6feb-4a17-856a-9310a4934833 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: 5a669c5b-898f-4fef-8508-254ccd998571] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:08:28.143334 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG dbcounter [-] [118860] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1 {{(pid=118860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:08:28.149233 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-8299bb0d-6feb-4a17-856a-9310a4934833 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:08:28.149706 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-8299bb0d-6feb-4a17-856a-9310a4934833 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:08:28.150133 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-8299bb0d-6feb-4a17-856a-9310a4934833 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:08:28.150816 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-8299bb0d-6feb-4a17-856a-9310a4934833 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:08:28.151259 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-8299bb0d-6feb-4a17-856a-9310a4934833 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:08:28.151678 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-8299bb0d-6feb-4a17-856a-9310a4934833 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:08:28.175982 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-8299bb0d-6feb-4a17-856a-9310a4934833 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/5a669c5b-898f-4fef-8508-254ccd998571/ips" status: 200 len: 150 microversion: 2.1 time: 0.039341 Oct 20 06:08:28.176537 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 243/509] 10.222.0.20 () {58 vars in 1248 bytes} [Thu Oct 20 06:08:28 2022] GET /compute/v2.1/servers/5a669c5b-898f-4fef-8508-254ccd998571/ips => generated 150 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:08:28.189019 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-ac4bb443-7088-4d5d-92cf-d530c9121233 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2d55ac41-e07d-4ad7-8598-c94ac2d4ee84"}} {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 06:08:28.191418 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-ac4bb443-7088-4d5d-92cf-d530c9121233 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: 5a669c5b-898f-4fef-8508-254ccd998571] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:08:28.198031 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ac4bb443-7088-4d5d-92cf-d530c9121233 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:08:28.198505 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ac4bb443-7088-4d5d-92cf-d530c9121233 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:08:28.199092 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ac4bb443-7088-4d5d-92cf-d530c9121233 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:08:28.199919 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ac4bb443-7088-4d5d-92cf-d530c9121233 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:08:28.200321 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ac4bb443-7088-4d5d-92cf-d530c9121233 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:08:28.200609 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ac4bb443-7088-4d5d-92cf-d530c9121233 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:08:28.308309 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.wsgi [None req-ac4bb443-7088-4d5d-92cf-d530c9121233 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] HTTP exception thrown: Invalid volume: volume 2d55ac41-e07d-4ad7-8598-c94ac2d4ee84 is already attached to instances: d4ba366c-2f51-44e0-b5da-c838e4672533 Oct 20 06:08:28.310318 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-ac4bb443-7088-4d5d-92cf-d530c9121233 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Request method failure captured: Oct 20 06:08:28.310318 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: request: POST /compute/v2.1/servers/5a669c5b-898f-4fef-8508-254ccd998571/os-volume_attachments HTTP/1.1 Oct 20 06:08:28.310318 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: Accept: application/json Oct 20 06:08:28.310318 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: Accept-Encoding: identity Oct 20 06:08:28.310318 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: Connection: close Oct 20 06:08:28.310318 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: Content-Length: 74 Oct 20 06:08:28.310318 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: Content-Type: application/json Oct 20 06:08:28.310318 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: Host: 10.222.0.20 Oct 20 06:08:28.310318 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: Openstack-System-Scope: None Oct 20 06:08:28.310318 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: User-Agent: python-urllib3/1.26.12 Oct 20 06:08:28.310318 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Auth-Token: gAAAAABjUOTwMaxd25vy00-4oHbEqr1c9uD0B3sBZ9MAdUaT4nUKyQqgu2h768xAiNalZc89J9ijH_fe0UIBbKxoYtfSVrasjyy2mvwwjVbv-SkvU3sz2HoGnLJESeVi8iC7ILXfpH5FGWeNjpUJsWoV8PgeWEWJ-eQs7SGcBSSwmqYY25H6IKc Oct 20 06:08:28.310318 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Domain-Id: None Oct 20 06:08:28.310318 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Domain-Name: None Oct 20 06:08:28.310318 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Identity-Status: Confirmed Oct 20 06:08:28.310318 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Is-Admin-Project: True Oct 20 06:08:28.310318 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Project-Domain-Id: default Oct 20 06:08:28.310318 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Project-Domain-Name: Default Oct 20 06:08:28.310318 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Project-Id: b90087118fe040389f291d846461c0a7 Oct 20 06:08:28.310318 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Project-Name: tempest-AttachVolumeNegativeTest-617663425 Oct 20 06:08:28.310318 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Role: reader,member Oct 20 06:08:28.310318 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Roles: reader,member Oct 20 06:08:28.311833 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b90087118fe040389f291d846461c0a7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b90087118fe040389f291d846461c0a7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b90087118fe040389f291d846461c0a7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b90087118fe040389f291d846461c0a7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 20 06:08:28.311833 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Tenant: tempest-AttachVolumeNegativeTest-617663425 Oct 20 06:08:28.311833 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Tenant-Id: b90087118fe040389f291d846461c0a7 Oct 20 06:08:28.311833 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-617663425 Oct 20 06:08:28.311833 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-User: tempest-AttachVolumeNegativeTest-617663425-project Oct 20 06:08:28.311833 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-User-Domain-Id: default Oct 20 06:08:28.311833 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-User-Domain-Name: Default Oct 20 06:08:28.311833 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-User-Id: 2c6be23065c643939055a3de375187d5 Oct 20 06:08:28.311833 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-User-Name: tempest-AttachVolumeNegativeTest-617663425-project Oct 20 06:08:28.311833 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: Oct 20 06:08:28.311833 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: {"volumeAttachment": {"volumeId": "2d55ac41-e07d-4ad7-8598-c94ac2d4ee84"}} Oct 20 06:08:28.311833 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: method: > Oct 20 06:08:28.312849 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: exception: Invalid volume: volume 2d55ac41-e07d-4ad7-8598-c94ac2d4ee84 is already attached to instances: d4ba366c-2f51-44e0-b5da-c838e4672533 Oct 20 06:08:28.312849 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: action_args: {'server_id': '5a669c5b-898f-4fef-8508-254ccd998571', 'body': {'volumeAttachment': {'volumeId': '2d55ac41-e07d-4ad7-8598-c94ac2d4ee84'}}} Oct 20 06:08:28.312849 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 20 06:08:28.312849 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 06:08:28.312849 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 20 06:08:28.312849 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 20 06:08:28.312849 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 20 06:08:28.312849 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 20 06:08:28.312849 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 20 06:08:28.312849 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 20 06:08:28.312849 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 20 06:08:28.312849 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 20 06:08:28.312849 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 20 06:08:28.312849 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 20 06:08:28.312849 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 2d55ac41-e07d-4ad7-8598-c94ac2d4ee84 is already attached to instances: d4ba366c-2f51-44e0-b5da-c838e4672533 Oct 20 06:08:28.312849 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi Oct 20 06:08:28.312849 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 06:08:28.312849 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi Oct 20 06:08:28.312849 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 06:08:28.314305 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 06:08:28.314305 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 06:08:28.314305 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 20 06:08:28.314305 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 20 06:08:28.314305 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 20 06:08:28.314305 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 20 06:08:28.314305 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 20 06:08:28.314305 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 20 06:08:28.314305 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 20 06:08:28.314305 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 20 06:08:28.314305 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 20 06:08:28.314305 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 20 06:08:28.314305 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 20 06:08:28.314305 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 20 06:08:28.314305 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 2d55ac41-e07d-4ad7-8598-c94ac2d4ee84 is already attached to instances: d4ba366c-2f51-44e0-b5da-c838e4672533 Oct 20 06:08:28.314305 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi Oct 20 06:08:28.314305 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 06:08:28.314305 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi Oct 20 06:08:28.314305 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 06:08:28.314305 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 06:08:28.315917 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 06:08:28.315917 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 20 06:08:28.315917 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 20 06:08:28.315917 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 2d55ac41-e07d-4ad7-8598-c94ac2d4ee84 is already attached to instances: d4ba366c-2f51-44e0-b5da-c838e4672533 Oct 20 06:08:28.315917 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi Oct 20 06:08:28.315917 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-ac4bb443-7088-4d5d-92cf-d530c9121233 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Returning 400 to user: Invalid volume: volume 2d55ac41-e07d-4ad7-8598-c94ac2d4ee84 is already attached to instances: d4ba366c-2f51-44e0-b5da-c838e4672533 {{(pid=118861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 20 06:08:28.315917 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-ac4bb443-7088-4d5d-92cf-d530c9121233 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "POST /compute/v2.1/servers/5a669c5b-898f-4fef-8508-254ccd998571/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.126905 Oct 20 06:08:28.315917 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 267/510] 10.222.0.20 () {60 vars in 1323 bytes} [Thu Oct 20 06:08:28 2022] POST /compute/v2.1/servers/5a669c5b-898f-4fef-8508-254ccd998571/os-volume_attachments => generated 174 bytes in 128 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 20 06:08:28.321336 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-caace127-8c03-4bf4-bc8f-05e98c2ddb53 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:08:28.321827 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-caace127-8c03-4bf4-bc8f-05e98c2ddb53 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: 5a669c5b-898f-4fef-8508-254ccd998571] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:08:28.322554 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-08a86847-b809-4054-a04e-9a8084fc594a tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:08:28.323162 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-08a86847-b809-4054-a04e-9a8084fc594a tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:08:28.327703 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-caace127-8c03-4bf4-bc8f-05e98c2ddb53 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:08:28.328180 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-caace127-8c03-4bf4-bc8f-05e98c2ddb53 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:08:28.328612 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-caace127-8c03-4bf4-bc8f-05e98c2ddb53 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:08:28.329320 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-caace127-8c03-4bf4-bc8f-05e98c2ddb53 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:08:28.329768 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-caace127-8c03-4bf4-bc8f-05e98c2ddb53 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:08:28.329876 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-08a86847-b809-4054-a04e-9a8084fc594a tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:08:28.330187 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-caace127-8c03-4bf4-bc8f-05e98c2ddb53 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:08:28.330283 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-08a86847-b809-4054-a04e-9a8084fc594a tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:08:28.330718 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-08a86847-b809-4054-a04e-9a8084fc594a tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:08:28.331416 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-08a86847-b809-4054-a04e-9a8084fc594a tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:08:28.331871 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-08a86847-b809-4054-a04e-9a8084fc594a tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:08:28.332353 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-08a86847-b809-4054-a04e-9a8084fc594a tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:08:28.354826 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-caace127-8c03-4bf4-bc8f-05e98c2ddb53 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: 5a669c5b-898f-4fef-8508-254ccd998571] Going to try to terminate instance {{(pid=118860) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 20 06:08:28.435917 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-caace127-8c03-4bf4-bc8f-05e98c2ddb53 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "DELETE /compute/v2.1/servers/5a669c5b-898f-4fef-8508-254ccd998571" status: 204 len: 0 microversion: 2.1 time: 0.118661 Oct 20 06:08:28.436642 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 244/511] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 20 06:08:28 2022] DELETE /compute/v2.1/servers/5a669c5b-898f-4fef-8508-254ccd998571 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 20 06:08:28.445781 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-d8d4f4ab-cf63-4a77-aab6-cc68ca58c391 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:08:28.446474 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-d8d4f4ab-cf63-4a77-aab6-cc68ca58c391 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: 5a669c5b-898f-4fef-8508-254ccd998571] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:08:28.452497 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-d8d4f4ab-cf63-4a77-aab6-cc68ca58c391 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:08:28.453038 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-d8d4f4ab-cf63-4a77-aab6-cc68ca58c391 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:08:28.453476 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-d8d4f4ab-cf63-4a77-aab6-cc68ca58c391 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:08:28.454200 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-d8d4f4ab-cf63-4a77-aab6-cc68ca58c391 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:08:28.454650 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-d8d4f4ab-cf63-4a77-aab6-cc68ca58c391 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:08:28.455073 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-d8d4f4ab-cf63-4a77-aab6-cc68ca58c391 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:08:28.473014 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-08a86847-b809-4054-a04e-9a8084fc594a tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:08:28.481758 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-08a86847-b809-4054-a04e-9a8084fc594a tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:08:28.483339 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-08a86847-b809-4054-a04e-9a8084fc594a tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:08:28.484563 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-08a86847-b809-4054-a04e-9a8084fc594a tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1751 microversion: 2.20 time: 0.166136 Oct 20 06:08:28.485210 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 268/512] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:08:28 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1751 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 20 06:08:28.586248 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-d8d4f4ab-cf63-4a77-aab6-cc68ca58c391 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:08:28.594057 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-d8d4f4ab-cf63-4a77-aab6-cc68ca58c391 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/5a669c5b-898f-4fef-8508-254ccd998571" status: 200 len: 1680 microversion: 2.1 time: 0.153089 Oct 20 06:08:28.594624 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 245/513] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:08:28 2022] GET /compute/v2.1/servers/5a669c5b-898f-4fef-8508-254ccd998571 => generated 1680 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 06:08:29.510812 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-db49b0c4-1d95-4fda-8fc3-3e00eabc319c tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:08:29.511332 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-db49b0c4-1d95-4fda-8fc3-3e00eabc319c tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:08:29.517706 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-db49b0c4-1d95-4fda-8fc3-3e00eabc319c tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:08:29.518188 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-db49b0c4-1d95-4fda-8fc3-3e00eabc319c tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:08:29.518625 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-db49b0c4-1d95-4fda-8fc3-3e00eabc319c tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:08:29.519321 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-db49b0c4-1d95-4fda-8fc3-3e00eabc319c tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:08:29.519778 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-db49b0c4-1d95-4fda-8fc3-3e00eabc319c tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:08:29.520214 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-db49b0c4-1d95-4fda-8fc3-3e00eabc319c tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:08:29.524835 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG dbcounter [-] [118861] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:08:29.617542 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-69300753-46e3-4746-9b25-8fd1309fb002 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:08:29.618242 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-69300753-46e3-4746-9b25-8fd1309fb002 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: 5a669c5b-898f-4fef-8508-254ccd998571] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:08:29.625565 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-69300753-46e3-4746-9b25-8fd1309fb002 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:08:29.626473 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-69300753-46e3-4746-9b25-8fd1309fb002 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:08:29.628305 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-69300753-46e3-4746-9b25-8fd1309fb002 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:08:29.629180 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-69300753-46e3-4746-9b25-8fd1309fb002 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:08:29.629887 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-69300753-46e3-4746-9b25-8fd1309fb002 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:08:29.630327 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-69300753-46e3-4746-9b25-8fd1309fb002 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:08:29.655307 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-db49b0c4-1d95-4fda-8fc3-3e00eabc319c tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:08:29.676583 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-db49b0c4-1d95-4fda-8fc3-3e00eabc319c tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:08:29.678213 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-db49b0c4-1d95-4fda-8fc3-3e00eabc319c tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:08:29.679839 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-db49b0c4-1d95-4fda-8fc3-3e00eabc319c tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1751 microversion: 2.20 time: 0.173344 Oct 20 06:08:29.680652 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 269/514] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:08:29 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1751 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:08:29.769775 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-69300753-46e3-4746-9b25-8fd1309fb002 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:08:29.778036 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-69300753-46e3-4746-9b25-8fd1309fb002 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/5a669c5b-898f-4fef-8508-254ccd998571" status: 200 len: 1680 microversion: 2.1 time: 0.164568 Oct 20 06:08:29.778598 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 246/515] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:08:29 2022] GET /compute/v2.1/servers/5a669c5b-898f-4fef-8508-254ccd998571 => generated 1680 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 06:08:30.705545 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-7acde878-bfc7-4628-bac5-caad16f8944f tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:08:30.706326 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-7acde878-bfc7-4628-bac5-caad16f8944f tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:08:30.713184 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7acde878-bfc7-4628-bac5-caad16f8944f tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:08:30.713970 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7acde878-bfc7-4628-bac5-caad16f8944f tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:08:30.714909 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7acde878-bfc7-4628-bac5-caad16f8944f tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:08:30.716030 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7acde878-bfc7-4628-bac5-caad16f8944f tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:08:30.716865 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7acde878-bfc7-4628-bac5-caad16f8944f tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:08:30.717529 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7acde878-bfc7-4628-bac5-caad16f8944f tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:08:30.803870 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-1bc75b6d-165a-49b2-b03b-bd840f9da590 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:08:30.804887 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-1bc75b6d-165a-49b2-b03b-bd840f9da590 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: 5a669c5b-898f-4fef-8508-254ccd998571] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:08:30.816180 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1bc75b6d-165a-49b2-b03b-bd840f9da590 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:08:30.816719 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1bc75b6d-165a-49b2-b03b-bd840f9da590 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:08:30.817308 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1bc75b6d-165a-49b2-b03b-bd840f9da590 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:08:30.818019 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1bc75b6d-165a-49b2-b03b-bd840f9da590 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:08:30.819809 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1bc75b6d-165a-49b2-b03b-bd840f9da590 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:08:30.820418 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1bc75b6d-165a-49b2-b03b-bd840f9da590 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:08:30.931350 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-1bc75b6d-165a-49b2-b03b-bd840f9da590 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:08:30.940897 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-1bc75b6d-165a-49b2-b03b-bd840f9da590 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/5a669c5b-898f-4fef-8508-254ccd998571" status: 200 len: 1613 microversion: 2.1 time: 0.142091 Oct 20 06:08:30.941983 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 247/516] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:08:30 2022] GET /compute/v2.1/servers/5a669c5b-898f-4fef-8508-254ccd998571 => generated 1613 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 06:08:30.947358 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-7acde878-bfc7-4628-bac5-caad16f8944f tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:08:30.958875 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [req-8135d0ea-9524-46ec-a62f-afabfb299c3b req-765c54e5-e5d6-4ee0-ab02-b73cf3d8e29d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a669c5b-898f-4fef-8508-254ccd998571", "name": "network-vif-deleted", "tag": "1f531466-92dc-4842-b2bd-609d42b1626c"}]} {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 06:08:30.965605 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-7acde878-bfc7-4628-bac5-caad16f8944f tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:08:30.973405 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-7acde878-bfc7-4628-bac5-caad16f8944f tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:08:30.974702 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-7acde878-bfc7-4628-bac5-caad16f8944f tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1751 microversion: 2.20 time: 0.273010 Oct 20 06:08:30.975406 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 270/517] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:08:30 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1751 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:08:30.979275 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [req-8135d0ea-9524-46ec-a62f-afabfb299c3b req-765c54e5-e5d6-4ee0-ab02-b73cf3d8e29d service nova] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:08:30.979760 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [req-8135d0ea-9524-46ec-a62f-afabfb299c3b req-765c54e5-e5d6-4ee0-ab02-b73cf3d8e29d service nova] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:08:30.980215 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [req-8135d0ea-9524-46ec-a62f-afabfb299c3b req-765c54e5-e5d6-4ee0-ab02-b73cf3d8e29d service nova] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:08:30.992624 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.compute.server_external_events [req-8135d0ea-9524-46ec-a62f-afabfb299c3b req-765c54e5-e5d6-4ee0-ab02-b73cf3d8e29d service nova] Creating event network-vif-deleted:1f531466-92dc-4842-b2bd-609d42b1626c for instance 5a669c5b-898f-4fef-8508-254ccd998571 on hv-cinder-86156 Oct 20 06:08:30.998937 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [req-8135d0ea-9524-46ec-a62f-afabfb299c3b req-765c54e5-e5d6-4ee0-ab02-b73cf3d8e29d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055375 Oct 20 06:08:30.999528 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 248/518] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 20 06:08:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:08:31.965288 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-6b6de329-112a-4d64-803a-61a27ea240d5 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:08:31.965895 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-6b6de329-112a-4d64-803a-61a27ea240d5 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: 5a669c5b-898f-4fef-8508-254ccd998571] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:08:31.972379 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-6b6de329-112a-4d64-803a-61a27ea240d5 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:08:31.972907 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-6b6de329-112a-4d64-803a-61a27ea240d5 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:08:31.973335 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-6b6de329-112a-4d64-803a-61a27ea240d5 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:08:31.974019 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-6b6de329-112a-4d64-803a-61a27ea240d5 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:08:31.974465 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-6b6de329-112a-4d64-803a-61a27ea240d5 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:08:31.975583 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-6b6de329-112a-4d64-803a-61a27ea240d5 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:08:31.989423 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.wsgi [None req-6b6de329-112a-4d64-803a-61a27ea240d5 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] HTTP exception thrown: Instance 5a669c5b-898f-4fef-8508-254ccd998571 could not be found. Oct 20 06:08:31.991159 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-6b6de329-112a-4d64-803a-61a27ea240d5 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Request method failure captured: Oct 20 06:08:31.991159 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: request: GET /compute/v2.1/servers/5a669c5b-898f-4fef-8508-254ccd998571 HTTP/1.1 Oct 20 06:08:31.991159 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: Accept: application/json Oct 20 06:08:31.991159 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: Accept-Encoding: identity Oct 20 06:08:31.991159 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: Connection: close Oct 20 06:08:31.991159 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: Content-Length: 0 Oct 20 06:08:31.991159 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: Content-Type: application/json Oct 20 06:08:31.991159 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: Host: 10.222.0.20 Oct 20 06:08:31.991159 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: Openstack-System-Scope: None Oct 20 06:08:31.991159 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: User-Agent: python-urllib3/1.26.12 Oct 20 06:08:31.991159 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Auth-Token: gAAAAABjUOTwMaxd25vy00-4oHbEqr1c9uD0B3sBZ9MAdUaT4nUKyQqgu2h768xAiNalZc89J9ijH_fe0UIBbKxoYtfSVrasjyy2mvwwjVbv-SkvU3sz2HoGnLJESeVi8iC7ILXfpH5FGWeNjpUJsWoV8PgeWEWJ-eQs7SGcBSSwmqYY25H6IKc Oct 20 06:08:31.991159 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Domain-Id: None Oct 20 06:08:31.991159 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Domain-Name: None Oct 20 06:08:31.991159 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Identity-Status: Confirmed Oct 20 06:08:31.991159 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Is-Admin-Project: True Oct 20 06:08:31.991159 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Project-Domain-Id: default Oct 20 06:08:31.991159 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Project-Domain-Name: Default Oct 20 06:08:31.991159 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Project-Id: b90087118fe040389f291d846461c0a7 Oct 20 06:08:31.991159 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Project-Name: tempest-AttachVolumeNegativeTest-617663425 Oct 20 06:08:31.991159 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Role: reader,member Oct 20 06:08:31.991159 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Roles: reader,member Oct 20 06:08:31.992679 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b90087118fe040389f291d846461c0a7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b90087118fe040389f291d846461c0a7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b90087118fe040389f291d846461c0a7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b90087118fe040389f291d846461c0a7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 20 06:08:31.992679 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Tenant: tempest-AttachVolumeNegativeTest-617663425 Oct 20 06:08:31.992679 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Tenant-Id: b90087118fe040389f291d846461c0a7 Oct 20 06:08:31.992679 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-617663425 Oct 20 06:08:31.992679 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-User: tempest-AttachVolumeNegativeTest-617663425-project Oct 20 06:08:31.992679 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-User-Domain-Id: default Oct 20 06:08:31.992679 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-User-Domain-Name: Default Oct 20 06:08:31.992679 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-User-Id: 2c6be23065c643939055a3de375187d5 Oct 20 06:08:31.992679 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-User-Name: tempest-AttachVolumeNegativeTest-617663425-project Oct 20 06:08:31.992679 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: method: > Oct 20 06:08:31.992679 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: exception: Instance 5a669c5b-898f-4fef-8508-254ccd998571 could not be found. Oct 20 06:08:31.992679 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: action_args: {'id': '5a669c5b-898f-4fef-8508-254ccd998571'} Oct 20 06:08:31.993570 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 20 06:08:31.993570 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 06:08:31.993570 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 20 06:08:31.993570 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 20 06:08:31.993570 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 20 06:08:31.993570 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 20 06:08:31.993570 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 20 06:08:31.993570 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 20 06:08:31.993570 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 20 06:08:31.993570 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 20 06:08:31.993570 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a669c5b-898f-4fef-8508-254ccd998571 could not be found. Oct 20 06:08:31.993570 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi Oct 20 06:08:31.993570 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 06:08:31.993570 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi Oct 20 06:08:31.993570 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 06:08:31.993570 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 06:08:31.993570 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 06:08:31.993570 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 20 06:08:31.993570 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 20 06:08:31.993570 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 20 06:08:31.994916 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 20 06:08:31.994916 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 20 06:08:31.994916 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 20 06:08:31.994916 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 20 06:08:31.994916 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 20 06:08:31.994916 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 20 06:08:31.994916 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 20 06:08:31.994916 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a669c5b-898f-4fef-8508-254ccd998571 could not be found. Oct 20 06:08:31.994916 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi Oct 20 06:08:31.994916 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 06:08:31.994916 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi Oct 20 06:08:31.994916 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 06:08:31.994916 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 06:08:31.994916 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 06:08:31.994916 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 20 06:08:31.994916 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 20 06:08:31.994916 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a669c5b-898f-4fef-8508-254ccd998571 could not be found. Oct 20 06:08:31.994916 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi Oct 20 06:08:31.996151 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-6b6de329-112a-4d64-803a-61a27ea240d5 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Returning 404 to user: Instance 5a669c5b-898f-4fef-8508-254ccd998571 could not be found. {{(pid=118861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 20 06:08:31.996151 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-6b6de329-112a-4d64-803a-61a27ea240d5 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/5a669c5b-898f-4fef-8508-254ccd998571" status: 404 len: 111 microversion: 2.1 time: 0.031148 Oct 20 06:08:31.996539 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 271/519] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:08:31 2022] GET /compute/v2.1/servers/5a669c5b-898f-4fef-8508-254ccd998571 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 20 06:08:32.001078 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-a80fca66-f229-420a-b685-989ce7aa515a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '.version_select at 0x7fbe4ab9d0d0>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:08:32.002609 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-bfe75e87-570e-4af3-b7dd-c56cdd04a175 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:08:32.003315 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-bfe75e87-570e-4af3-b7dd-c56cdd04a175 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:08:32.012893 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-bfe75e87-570e-4af3-b7dd-c56cdd04a175 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:08:32.013383 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-bfe75e87-570e-4af3-b7dd-c56cdd04a175 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:08:32.013851 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-bfe75e87-570e-4af3-b7dd-c56cdd04a175 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:08:32.014762 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-bfe75e87-570e-4af3-b7dd-c56cdd04a175 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:08:32.015224 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-bfe75e87-570e-4af3-b7dd-c56cdd04a175 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:08:32.015657 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-bfe75e87-570e-4af3-b7dd-c56cdd04a175 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:08:32.025963 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-a80fca66-f229-420a-b685-989ce7aa515a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-512168868" status: 202 len: 0 microversion: 2.1 time: 0.028421 Oct 20 06:08:32.026537 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 272/520] 10.222.0.20 () {58 vars in 1218 bytes} [Thu Oct 20 06:08:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-512168868 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 20 06:08:32.213855 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-bfe75e87-570e-4af3-b7dd-c56cdd04a175 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:08:32.223264 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-bfe75e87-570e-4af3-b7dd-c56cdd04a175 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:08:32.225496 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-bfe75e87-570e-4af3-b7dd-c56cdd04a175 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:08:32.226829 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-bfe75e87-570e-4af3-b7dd-c56cdd04a175 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1751 microversion: 2.20 time: 0.229775 Oct 20 06:08:32.227597 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 249/521] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:08:31 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1751 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:08:32.806053 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-a11d64ce-e8b4-4cda-b5a4-f9604f5e32d6 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:08:32.806553 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-a11d64ce-e8b4-4cda-b5a4-f9604f5e32d6 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:08:32.817001 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a11d64ce-e8b4-4cda-b5a4-f9604f5e32d6 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:08:32.817501 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a11d64ce-e8b4-4cda-b5a4-f9604f5e32d6 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:08:32.817952 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a11d64ce-e8b4-4cda-b5a4-f9604f5e32d6 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:08:32.818711 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a11d64ce-e8b4-4cda-b5a4-f9604f5e32d6 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:08:32.819424 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a11d64ce-e8b4-4cda-b5a4-f9604f5e32d6 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:08:32.819861 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a11d64ce-e8b4-4cda-b5a4-f9604f5e32d6 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:08:32.946851 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.objects.instance [None req-a11d64ce-e8b4-4cda-b5a4-f9604f5e32d6 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lazy-loading 'services' on Instance uuid d4ba366c-2f51-44e0-b5da-c838e4672533 {{(pid=118861) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 20 06:08:33.062914 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-a11d64ce-e8b4-4cda-b5a4-f9604f5e32d6 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "DELETE /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments/2d55ac41-e07d-4ad7-8598-c94ac2d4ee84" status: 202 len: 0 microversion: 2.1 time: 0.261558 Oct 20 06:08:33.063557 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 273/522] 10.222.0.20 () {58 vars in 1416 bytes} [Thu Oct 20 06:08:32 2022] DELETE /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments/2d55ac41-e07d-4ad7-8598-c94ac2d4ee84 => generated 0 bytes in 263 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 20 06:08:33.072822 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-a81ed64b-f5a9-4fef-803f-a1da40703cb9 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:08:33.074966 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-a81ed64b-f5a9-4fef-803f-a1da40703cb9 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:08:33.081274 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a81ed64b-f5a9-4fef-803f-a1da40703cb9 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:08:33.081753 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a81ed64b-f5a9-4fef-803f-a1da40703cb9 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:08:33.082189 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a81ed64b-f5a9-4fef-803f-a1da40703cb9 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:08:33.082887 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a81ed64b-f5a9-4fef-803f-a1da40703cb9 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:08:33.083342 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a81ed64b-f5a9-4fef-803f-a1da40703cb9 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:08:33.083762 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a81ed64b-f5a9-4fef-803f-a1da40703cb9 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:08:33.116236 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-a81ed64b-f5a9-4fef-803f-a1da40703cb9 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047809 Oct 20 06:08:33.116874 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 250/523] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:08:33 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:08:33.254840 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-5132ef57-d775-4f89-bcde-25bc45232d9e tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:08:33.255466 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-5132ef57-d775-4f89-bcde-25bc45232d9e tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:08:33.262509 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5132ef57-d775-4f89-bcde-25bc45232d9e tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:08:33.262996 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5132ef57-d775-4f89-bcde-25bc45232d9e tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:08:33.263432 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5132ef57-d775-4f89-bcde-25bc45232d9e tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:08:33.264119 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5132ef57-d775-4f89-bcde-25bc45232d9e tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:08:33.264568 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5132ef57-d775-4f89-bcde-25bc45232d9e tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:08:33.265022 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5132ef57-d775-4f89-bcde-25bc45232d9e tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:08:33.395118 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-5132ef57-d775-4f89-bcde-25bc45232d9e tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:08:33.404209 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-5132ef57-d775-4f89-bcde-25bc45232d9e tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:08:33.405714 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-5132ef57-d775-4f89-bcde-25bc45232d9e tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:08:33.406858 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-5132ef57-d775-4f89-bcde-25bc45232d9e tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1751 microversion: 2.20 time: 0.156399 Oct 20 06:08:33.407406 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 274/524] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:08:33 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1751 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:08:34.127987 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-fc56f471-cd4b-45a2-8896-5e1354f00f77 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:08:34.130115 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-fc56f471-cd4b-45a2-8896-5e1354f00f77 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:08:34.137476 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-fc56f471-cd4b-45a2-8896-5e1354f00f77 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:08:34.137956 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-fc56f471-cd4b-45a2-8896-5e1354f00f77 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:08:34.138391 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-fc56f471-cd4b-45a2-8896-5e1354f00f77 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:08:34.139079 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-fc56f471-cd4b-45a2-8896-5e1354f00f77 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:08:34.139528 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-fc56f471-cd4b-45a2-8896-5e1354f00f77 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:08:34.139950 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-fc56f471-cd4b-45a2-8896-5e1354f00f77 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:08:34.165981 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG dbcounter [-] [118860] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:08:34.171029 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-fc56f471-cd4b-45a2-8896-5e1354f00f77 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047063 Oct 20 06:08:34.171579 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 251/525] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:08:34 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:08:34.432768 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-c3ec1bb1-36e9-419d-9d07-207140d9e8bd tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:08:34.433369 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-c3ec1bb1-36e9-419d-9d07-207140d9e8bd tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:08:34.439596 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c3ec1bb1-36e9-419d-9d07-207140d9e8bd tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:08:34.440072 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c3ec1bb1-36e9-419d-9d07-207140d9e8bd tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:08:34.440500 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c3ec1bb1-36e9-419d-9d07-207140d9e8bd tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:08:34.441366 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c3ec1bb1-36e9-419d-9d07-207140d9e8bd tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:08:34.441809 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c3ec1bb1-36e9-419d-9d07-207140d9e8bd tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:08:34.442228 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c3ec1bb1-36e9-419d-9d07-207140d9e8bd tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:08:34.572911 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-c3ec1bb1-36e9-419d-9d07-207140d9e8bd tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:08:34.582713 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-c3ec1bb1-36e9-419d-9d07-207140d9e8bd tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:08:34.584765 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-c3ec1bb1-36e9-419d-9d07-207140d9e8bd tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:08:34.586145 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-c3ec1bb1-36e9-419d-9d07-207140d9e8bd tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1751 microversion: 2.20 time: 0.157304 Oct 20 06:08:34.586954 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 275/526] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:08:34 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1751 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:08:35.183509 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-00ab8ea5-75b0-4377-9ea9-82e1780093b9 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:08:35.185598 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-00ab8ea5-75b0-4377-9ea9-82e1780093b9 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:08:35.193886 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-00ab8ea5-75b0-4377-9ea9-82e1780093b9 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:08:35.194454 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-00ab8ea5-75b0-4377-9ea9-82e1780093b9 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:08:35.194811 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-00ab8ea5-75b0-4377-9ea9-82e1780093b9 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:08:35.195502 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-00ab8ea5-75b0-4377-9ea9-82e1780093b9 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:08:35.195956 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-00ab8ea5-75b0-4377-9ea9-82e1780093b9 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:08:35.196383 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-00ab8ea5-75b0-4377-9ea9-82e1780093b9 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:08:35.226212 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-00ab8ea5-75b0-4377-9ea9-82e1780093b9 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046733 Oct 20 06:08:35.226762 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 252/527] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:08:35 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 20 06:08:35.610990 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-f3d45428-ac34-49f1-8a1f-ef5232444395 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:08:35.611599 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-f3d45428-ac34-49f1-8a1f-ef5232444395 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:08:35.618930 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f3d45428-ac34-49f1-8a1f-ef5232444395 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:08:35.619426 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f3d45428-ac34-49f1-8a1f-ef5232444395 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:08:35.619865 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f3d45428-ac34-49f1-8a1f-ef5232444395 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:08:35.620564 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f3d45428-ac34-49f1-8a1f-ef5232444395 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:08:35.621063 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f3d45428-ac34-49f1-8a1f-ef5232444395 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:08:35.621492 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f3d45428-ac34-49f1-8a1f-ef5232444395 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:08:35.752174 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-f3d45428-ac34-49f1-8a1f-ef5232444395 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:08:35.760920 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-f3d45428-ac34-49f1-8a1f-ef5232444395 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:08:35.762356 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-f3d45428-ac34-49f1-8a1f-ef5232444395 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:08:35.763502 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-f3d45428-ac34-49f1-8a1f-ef5232444395 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1751 microversion: 2.20 time: 0.156370 Oct 20 06:08:35.764053 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 276/528] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:08:35 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1751 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:08:36.238680 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-d6e47d19-503d-4988-865e-fe4ef87d01dc tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:08:36.240881 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-d6e47d19-503d-4988-865e-fe4ef87d01dc tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:08:36.247772 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-d6e47d19-503d-4988-865e-fe4ef87d01dc tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:08:36.248262 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-d6e47d19-503d-4988-865e-fe4ef87d01dc tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:08:36.248729 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-d6e47d19-503d-4988-865e-fe4ef87d01dc tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:08:36.249437 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-d6e47d19-503d-4988-865e-fe4ef87d01dc tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:08:36.249895 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-d6e47d19-503d-4988-865e-fe4ef87d01dc tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:08:36.250321 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-d6e47d19-503d-4988-865e-fe4ef87d01dc tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:08:36.282558 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-d6e47d19-503d-4988-865e-fe4ef87d01dc tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047870 Oct 20 06:08:36.283152 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 253/529] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:08:36 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:08:36.788408 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-26b40c8d-3d0b-4a48-b056-f305edf6544b tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:08:36.789055 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-26b40c8d-3d0b-4a48-b056-f305edf6544b tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:08:36.795541 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-26b40c8d-3d0b-4a48-b056-f305edf6544b tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:08:36.796016 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-26b40c8d-3d0b-4a48-b056-f305edf6544b tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:08:36.796448 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-26b40c8d-3d0b-4a48-b056-f305edf6544b tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:08:36.797224 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-26b40c8d-3d0b-4a48-b056-f305edf6544b tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:08:36.797675 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-26b40c8d-3d0b-4a48-b056-f305edf6544b tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:08:36.798093 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-26b40c8d-3d0b-4a48-b056-f305edf6544b tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:08:36.925181 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-26b40c8d-3d0b-4a48-b056-f305edf6544b tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:08:36.934379 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-26b40c8d-3d0b-4a48-b056-f305edf6544b tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:08:36.935804 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-26b40c8d-3d0b-4a48-b056-f305edf6544b tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:08:36.936967 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-26b40c8d-3d0b-4a48-b056-f305edf6544b tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1751 microversion: 2.20 time: 0.152438 Oct 20 06:08:36.937516 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 277/530] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:08:36 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1751 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:08:37.296109 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-6239a471-d4e0-45cb-b6da-5b06063cbb67 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:08:37.298264 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-6239a471-d4e0-45cb-b6da-5b06063cbb67 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:08:37.304652 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-6239a471-d4e0-45cb-b6da-5b06063cbb67 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:08:37.305786 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-6239a471-d4e0-45cb-b6da-5b06063cbb67 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:08:37.306220 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-6239a471-d4e0-45cb-b6da-5b06063cbb67 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:08:37.306913 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-6239a471-d4e0-45cb-b6da-5b06063cbb67 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:08:37.307596 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-6239a471-d4e0-45cb-b6da-5b06063cbb67 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:08:37.307766 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-6239a471-d4e0-45cb-b6da-5b06063cbb67 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:08:37.336407 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-6239a471-d4e0-45cb-b6da-5b06063cbb67 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044216 Oct 20 06:08:37.337106 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 254/531] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:08:37 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:08:37.962491 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-3126447e-af00-4fc5-b17c-3f546035ad32 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:08:37.963038 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-3126447e-af00-4fc5-b17c-3f546035ad32 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:08:37.969400 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-3126447e-af00-4fc5-b17c-3f546035ad32 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:08:37.969877 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-3126447e-af00-4fc5-b17c-3f546035ad32 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:08:37.970310 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-3126447e-af00-4fc5-b17c-3f546035ad32 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:08:37.970991 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-3126447e-af00-4fc5-b17c-3f546035ad32 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:08:37.971434 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-3126447e-af00-4fc5-b17c-3f546035ad32 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:08:37.971853 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-3126447e-af00-4fc5-b17c-3f546035ad32 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:08:38.101594 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-3126447e-af00-4fc5-b17c-3f546035ad32 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:08:38.110782 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-3126447e-af00-4fc5-b17c-3f546035ad32 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:08:38.112400 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-3126447e-af00-4fc5-b17c-3f546035ad32 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:08:38.113574 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-3126447e-af00-4fc5-b17c-3f546035ad32 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1751 microversion: 2.20 time: 0.155766 Oct 20 06:08:38.117309 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 278/532] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:08:37 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1751 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 20 06:08:38.349132 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-77f123b8-5948-44e7-8da8-ec937eca7b8b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:08:38.351255 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-77f123b8-5948-44e7-8da8-ec937eca7b8b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:08:38.358496 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-77f123b8-5948-44e7-8da8-ec937eca7b8b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:08:38.358975 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-77f123b8-5948-44e7-8da8-ec937eca7b8b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:08:38.359411 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-77f123b8-5948-44e7-8da8-ec937eca7b8b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:08:38.360093 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-77f123b8-5948-44e7-8da8-ec937eca7b8b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:08:38.360546 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-77f123b8-5948-44e7-8da8-ec937eca7b8b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:08:38.361004 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-77f123b8-5948-44e7-8da8-ec937eca7b8b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:08:38.390331 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-77f123b8-5948-44e7-8da8-ec937eca7b8b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045299 Oct 20 06:08:38.390870 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 255/533] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:08:38 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:08:39.139716 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-33f4578a-3de8-4974-b1b8-302c84af6447 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:08:39.140583 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-33f4578a-3de8-4974-b1b8-302c84af6447 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:08:39.147369 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-33f4578a-3de8-4974-b1b8-302c84af6447 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:08:39.147859 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-33f4578a-3de8-4974-b1b8-302c84af6447 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:08:39.148297 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-33f4578a-3de8-4974-b1b8-302c84af6447 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:08:39.149548 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-33f4578a-3de8-4974-b1b8-302c84af6447 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:08:39.150010 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-33f4578a-3de8-4974-b1b8-302c84af6447 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:08:39.150564 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-33f4578a-3de8-4974-b1b8-302c84af6447 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:08:39.303670 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-33f4578a-3de8-4974-b1b8-302c84af6447 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:08:39.313534 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-33f4578a-3de8-4974-b1b8-302c84af6447 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:08:39.314978 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-33f4578a-3de8-4974-b1b8-302c84af6447 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:08:39.316141 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-33f4578a-3de8-4974-b1b8-302c84af6447 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1751 microversion: 2.20 time: 0.180615 Oct 20 06:08:39.316721 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 279/534] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:08:39 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1751 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:08:39.402723 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-76971ba1-bca7-49d4-84e5-ccd0174255d8 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:08:39.404883 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-76971ba1-bca7-49d4-84e5-ccd0174255d8 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:08:39.411195 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-76971ba1-bca7-49d4-84e5-ccd0174255d8 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:08:39.411671 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-76971ba1-bca7-49d4-84e5-ccd0174255d8 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:08:39.412102 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-76971ba1-bca7-49d4-84e5-ccd0174255d8 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:08:39.412819 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-76971ba1-bca7-49d4-84e5-ccd0174255d8 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:08:39.413270 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-76971ba1-bca7-49d4-84e5-ccd0174255d8 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:08:39.413692 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-76971ba1-bca7-49d4-84e5-ccd0174255d8 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:08:39.443798 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-76971ba1-bca7-49d4-84e5-ccd0174255d8 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045151 Oct 20 06:08:39.444339 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 256/535] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:08:39 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:08:40.342006 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-78cf04a4-3e5c-4c45-b3b6-0599a57a3e4f tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:08:40.342637 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-78cf04a4-3e5c-4c45-b3b6-0599a57a3e4f tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:08:40.349127 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-78cf04a4-3e5c-4c45-b3b6-0599a57a3e4f tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:08:40.349603 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-78cf04a4-3e5c-4c45-b3b6-0599a57a3e4f tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:08:40.350033 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-78cf04a4-3e5c-4c45-b3b6-0599a57a3e4f tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:08:40.350708 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-78cf04a4-3e5c-4c45-b3b6-0599a57a3e4f tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:08:40.351150 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-78cf04a4-3e5c-4c45-b3b6-0599a57a3e4f tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:08:40.351566 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-78cf04a4-3e5c-4c45-b3b6-0599a57a3e4f tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:08:40.457013 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-0139d5e8-585f-4202-a466-15627180ed61 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:08:40.459031 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-0139d5e8-585f-4202-a466-15627180ed61 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:08:40.465586 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0139d5e8-585f-4202-a466-15627180ed61 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:08:40.466157 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0139d5e8-585f-4202-a466-15627180ed61 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:08:40.466591 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0139d5e8-585f-4202-a466-15627180ed61 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:08:40.467275 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0139d5e8-585f-4202-a466-15627180ed61 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:08:40.467721 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0139d5e8-585f-4202-a466-15627180ed61 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:08:40.468135 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0139d5e8-585f-4202-a466-15627180ed61 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:08:40.479890 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-78cf04a4-3e5c-4c45-b3b6-0599a57a3e4f tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:08:40.488526 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-78cf04a4-3e5c-4c45-b3b6-0599a57a3e4f tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:08:40.489975 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-78cf04a4-3e5c-4c45-b3b6-0599a57a3e4f tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:08:40.491119 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-78cf04a4-3e5c-4c45-b3b6-0599a57a3e4f tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1751 microversion: 2.20 time: 0.152997 Oct 20 06:08:40.491672 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 280/536] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:08:40 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1751 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:08:40.499447 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-0139d5e8-585f-4202-a466-15627180ed61 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046449 Oct 20 06:08:40.499992 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 257/537] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:08:40 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 20 06:08:40.678151 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-ab311075-65ec-4bd0-9793-6459df5f87bd tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:08:40.678640 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-ab311075-65ec-4bd0-9793-6459df5f87bd tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:08:40.684538 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ab311075-65ec-4bd0-9793-6459df5f87bd tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:08:40.685060 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ab311075-65ec-4bd0-9793-6459df5f87bd tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:08:40.685492 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ab311075-65ec-4bd0-9793-6459df5f87bd tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:08:40.686181 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ab311075-65ec-4bd0-9793-6459df5f87bd tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:08:40.686630 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ab311075-65ec-4bd0-9793-6459df5f87bd tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:08:40.687051 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ab311075-65ec-4bd0-9793-6459df5f87bd tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:08:40.768083 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.objects.instance [None req-ab311075-65ec-4bd0-9793-6459df5f87bd tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lazy-loading 'services' on Instance uuid 42fc4539-f891-4ab5-b30a-4bfe5033db86 {{(pid=118861) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 20 06:08:40.837766 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-ab311075-65ec-4bd0-9793-6459df5f87bd tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "DELETE /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments/11ccc208-d7ea-44f8-a1f9-baf6327b112f" status: 202 len: 0 microversion: 2.1 time: 0.163358 Oct 20 06:08:40.838343 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 281/538] 10.222.0.20 () {58 vars in 1416 bytes} [Thu Oct 20 06:08:40 2022] DELETE /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments/11ccc208-d7ea-44f8-a1f9-baf6327b112f => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 20 06:08:41.511736 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-cd657fb2-fa8a-41cd-96be-4afca6613cc7 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:08:41.513826 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-cd657fb2-fa8a-41cd-96be-4afca6613cc7 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:08:41.519146 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-23a42676-e650-4a4c-b0be-34255b658012 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:08:41.519843 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-23a42676-e650-4a4c-b0be-34255b658012 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:08:41.520191 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-cd657fb2-fa8a-41cd-96be-4afca6613cc7 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:08:41.520672 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-cd657fb2-fa8a-41cd-96be-4afca6613cc7 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:08:41.521132 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-cd657fb2-fa8a-41cd-96be-4afca6613cc7 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:08:41.521822 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-cd657fb2-fa8a-41cd-96be-4afca6613cc7 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:08:41.522268 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-cd657fb2-fa8a-41cd-96be-4afca6613cc7 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:08:41.522682 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-cd657fb2-fa8a-41cd-96be-4afca6613cc7 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:08:41.526723 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-23a42676-e650-4a4c-b0be-34255b658012 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:08:41.527214 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-23a42676-e650-4a4c-b0be-34255b658012 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:08:41.527653 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-23a42676-e650-4a4c-b0be-34255b658012 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:08:41.528341 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-23a42676-e650-4a4c-b0be-34255b658012 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:08:41.528835 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-23a42676-e650-4a4c-b0be-34255b658012 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:08:41.529262 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-23a42676-e650-4a4c-b0be-34255b658012 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:08:41.553706 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-cd657fb2-fa8a-41cd-96be-4afca6613cc7 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045890 Oct 20 06:08:41.554258 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 258/539] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:08:41 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:08:41.660378 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-23a42676-e650-4a4c-b0be-34255b658012 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:08:41.669506 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-23a42676-e650-4a4c-b0be-34255b658012 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:08:41.670929 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-23a42676-e650-4a4c-b0be-34255b658012 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:08:41.672065 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-23a42676-e650-4a4c-b0be-34255b658012 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1751 microversion: 2.20 time: 0.157660 Oct 20 06:08:41.672609 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 282/540] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:08:41 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1751 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 20 06:08:42.565682 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-b00e4cef-c12a-4777-812e-e2beaddb7aca tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:08:42.567742 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-b00e4cef-c12a-4777-812e-e2beaddb7aca tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:08:42.575855 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b00e4cef-c12a-4777-812e-e2beaddb7aca tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:08:42.576336 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b00e4cef-c12a-4777-812e-e2beaddb7aca tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:08:42.576809 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b00e4cef-c12a-4777-812e-e2beaddb7aca tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:08:42.577499 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b00e4cef-c12a-4777-812e-e2beaddb7aca tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:08:42.577982 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b00e4cef-c12a-4777-812e-e2beaddb7aca tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:08:42.578407 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b00e4cef-c12a-4777-812e-e2beaddb7aca tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:08:42.608816 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-b00e4cef-c12a-4777-812e-e2beaddb7aca tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047093 Oct 20 06:08:42.609379 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 259/541] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:08:42 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:08:42.697088 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-d2dd56bf-2ccb-418c-9bb2-f92cb9292530 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:08:42.697691 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-d2dd56bf-2ccb-418c-9bb2-f92cb9292530 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:08:42.704065 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d2dd56bf-2ccb-418c-9bb2-f92cb9292530 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:08:42.704536 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d2dd56bf-2ccb-418c-9bb2-f92cb9292530 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:08:42.705003 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d2dd56bf-2ccb-418c-9bb2-f92cb9292530 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:08:42.705686 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d2dd56bf-2ccb-418c-9bb2-f92cb9292530 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:08:42.706126 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d2dd56bf-2ccb-418c-9bb2-f92cb9292530 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:08:42.706542 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d2dd56bf-2ccb-418c-9bb2-f92cb9292530 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:08:42.830451 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-d2dd56bf-2ccb-418c-9bb2-f92cb9292530 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:08:42.839598 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-d2dd56bf-2ccb-418c-9bb2-f92cb9292530 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:08:42.841062 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-d2dd56bf-2ccb-418c-9bb2-f92cb9292530 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:08:42.842215 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-d2dd56bf-2ccb-418c-9bb2-f92cb9292530 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1751 microversion: 2.20 time: 0.149170 Oct 20 06:08:42.842768 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 283/542] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:08:42 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1751 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:08:43.621887 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-4ff237bb-bf47-4aaf-a41d-90a015433b35 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:08:43.623956 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-4ff237bb-bf47-4aaf-a41d-90a015433b35 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:08:43.630383 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-4ff237bb-bf47-4aaf-a41d-90a015433b35 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:08:43.630861 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-4ff237bb-bf47-4aaf-a41d-90a015433b35 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:08:43.631290 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-4ff237bb-bf47-4aaf-a41d-90a015433b35 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:08:43.632256 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-4ff237bb-bf47-4aaf-a41d-90a015433b35 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:08:43.632719 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-4ff237bb-bf47-4aaf-a41d-90a015433b35 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:08:43.633715 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-4ff237bb-bf47-4aaf-a41d-90a015433b35 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:08:43.663667 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-4ff237bb-bf47-4aaf-a41d-90a015433b35 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046368 Oct 20 06:08:43.664501 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 260/543] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:08:43 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:08:43.868449 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-60bfd8ab-f523-4a09-9599-cb0a507e606a tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:08:43.869081 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-60bfd8ab-f523-4a09-9599-cb0a507e606a tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:08:43.875537 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-60bfd8ab-f523-4a09-9599-cb0a507e606a tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:08:43.875959 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-60bfd8ab-f523-4a09-9599-cb0a507e606a tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:08:43.876393 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-60bfd8ab-f523-4a09-9599-cb0a507e606a tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:08:43.877115 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-60bfd8ab-f523-4a09-9599-cb0a507e606a tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:08:43.877566 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-60bfd8ab-f523-4a09-9599-cb0a507e606a tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:08:43.877991 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-60bfd8ab-f523-4a09-9599-cb0a507e606a tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:08:44.007059 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-60bfd8ab-f523-4a09-9599-cb0a507e606a tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:08:44.015542 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-60bfd8ab-f523-4a09-9599-cb0a507e606a tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:08:44.017027 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-60bfd8ab-f523-4a09-9599-cb0a507e606a tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:08:44.018267 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-60bfd8ab-f523-4a09-9599-cb0a507e606a tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1751 microversion: 2.20 time: 0.154217 Oct 20 06:08:44.018814 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 284/544] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:08:43 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1751 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:08:44.676369 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-1414a19f-4769-4414-b63c-767295061b1b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:08:44.678536 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-1414a19f-4769-4414-b63c-767295061b1b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:08:44.685046 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1414a19f-4769-4414-b63c-767295061b1b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:08:44.685533 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1414a19f-4769-4414-b63c-767295061b1b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:08:44.685976 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1414a19f-4769-4414-b63c-767295061b1b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:08:44.686666 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1414a19f-4769-4414-b63c-767295061b1b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:08:44.687121 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1414a19f-4769-4414-b63c-767295061b1b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:08:44.687547 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1414a19f-4769-4414-b63c-767295061b1b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:08:44.717491 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-1414a19f-4769-4414-b63c-767295061b1b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045135 Oct 20 06:08:44.718041 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 261/545] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:08:44 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:08:45.044375 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-3f6a28dc-4b9c-4ada-915e-0ef8e3acbdc2 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:08:45.044949 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-3f6a28dc-4b9c-4ada-915e-0ef8e3acbdc2 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:08:45.051225 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-3f6a28dc-4b9c-4ada-915e-0ef8e3acbdc2 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:08:45.051707 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-3f6a28dc-4b9c-4ada-915e-0ef8e3acbdc2 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:08:45.052134 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-3f6a28dc-4b9c-4ada-915e-0ef8e3acbdc2 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:08:45.052843 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-3f6a28dc-4b9c-4ada-915e-0ef8e3acbdc2 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:08:45.053291 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-3f6a28dc-4b9c-4ada-915e-0ef8e3acbdc2 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:08:45.053710 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-3f6a28dc-4b9c-4ada-915e-0ef8e3acbdc2 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:08:45.184881 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-3f6a28dc-4b9c-4ada-915e-0ef8e3acbdc2 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:08:45.193322 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-3f6a28dc-4b9c-4ada-915e-0ef8e3acbdc2 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:08:45.194776 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-3f6a28dc-4b9c-4ada-915e-0ef8e3acbdc2 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:08:45.196010 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-3f6a28dc-4b9c-4ada-915e-0ef8e3acbdc2 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1751 microversion: 2.20 time: 0.155667 Oct 20 06:08:45.196552 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 285/546] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:08:45 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1751 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:08:45.729832 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-1d0c9567-2ea9-4451-9fba-0e9a0908a824 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:08:45.731975 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-1d0c9567-2ea9-4451-9fba-0e9a0908a824 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:08:45.738267 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1d0c9567-2ea9-4451-9fba-0e9a0908a824 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:08:45.738824 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1d0c9567-2ea9-4451-9fba-0e9a0908a824 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:08:45.739260 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1d0c9567-2ea9-4451-9fba-0e9a0908a824 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:08:45.739938 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1d0c9567-2ea9-4451-9fba-0e9a0908a824 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:08:45.740383 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1d0c9567-2ea9-4451-9fba-0e9a0908a824 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:08:45.740828 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1d0c9567-2ea9-4451-9fba-0e9a0908a824 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:08:45.769574 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-1d0c9567-2ea9-4451-9fba-0e9a0908a824 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043779 Oct 20 06:08:45.770112 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 262/547] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:08:45 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:08:46.223293 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-16376b9f-5738-4760-9297-e1077380f317 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:08:46.224547 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-16376b9f-5738-4760-9297-e1077380f317 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:08:46.231137 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-16376b9f-5738-4760-9297-e1077380f317 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:08:46.231621 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-16376b9f-5738-4760-9297-e1077380f317 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:08:46.232052 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-16376b9f-5738-4760-9297-e1077380f317 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:08:46.232779 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-16376b9f-5738-4760-9297-e1077380f317 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:08:46.233231 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-16376b9f-5738-4760-9297-e1077380f317 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:08:46.233650 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-16376b9f-5738-4760-9297-e1077380f317 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:08:46.238078 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG dbcounter [-] [118861] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=2 {{(pid=118861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:08:46.364089 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-16376b9f-5738-4760-9297-e1077380f317 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:08:46.372599 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-16376b9f-5738-4760-9297-e1077380f317 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:08:46.374041 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-16376b9f-5738-4760-9297-e1077380f317 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:08:46.375186 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-16376b9f-5738-4760-9297-e1077380f317 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1751 microversion: 2.20 time: 0.157202 Oct 20 06:08:46.375739 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 286/548] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:08:46 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1751 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:08:46.782843 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-aea142cb-b21d-4a19-b0f1-d7c6b7ba9c24 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:08:46.784948 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-aea142cb-b21d-4a19-b0f1-d7c6b7ba9c24 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:08:46.791529 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-aea142cb-b21d-4a19-b0f1-d7c6b7ba9c24 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:08:46.792004 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-aea142cb-b21d-4a19-b0f1-d7c6b7ba9c24 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:08:46.792432 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-aea142cb-b21d-4a19-b0f1-d7c6b7ba9c24 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:08:46.793143 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-aea142cb-b21d-4a19-b0f1-d7c6b7ba9c24 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:08:46.793587 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-aea142cb-b21d-4a19-b0f1-d7c6b7ba9c24 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:08:46.794004 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-aea142cb-b21d-4a19-b0f1-d7c6b7ba9c24 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:08:46.830098 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-aea142cb-b21d-4a19-b0f1-d7c6b7ba9c24 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051228 Oct 20 06:08:46.830648 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 263/549] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:08:46 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:08:47.401661 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-832a075a-7dd9-4b9f-9b60-8332c3d63136 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:08:47.402305 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-832a075a-7dd9-4b9f-9b60-8332c3d63136 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:08:47.408682 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-832a075a-7dd9-4b9f-9b60-8332c3d63136 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:08:47.409193 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-832a075a-7dd9-4b9f-9b60-8332c3d63136 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:08:47.409626 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-832a075a-7dd9-4b9f-9b60-8332c3d63136 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:08:47.410321 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-832a075a-7dd9-4b9f-9b60-8332c3d63136 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:08:47.410774 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-832a075a-7dd9-4b9f-9b60-8332c3d63136 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:08:47.411208 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-832a075a-7dd9-4b9f-9b60-8332c3d63136 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:08:47.546787 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-832a075a-7dd9-4b9f-9b60-8332c3d63136 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:08:47.555723 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-832a075a-7dd9-4b9f-9b60-8332c3d63136 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:08:47.557282 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-832a075a-7dd9-4b9f-9b60-8332c3d63136 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:08:47.558433 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-832a075a-7dd9-4b9f-9b60-8332c3d63136 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1751 microversion: 2.20 time: 0.161149 Oct 20 06:08:47.558983 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 287/550] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:08:47 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1751 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:08:47.843018 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-3a6b91a2-33dc-44cd-820d-dd03c91ca699 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:08:47.845225 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-3a6b91a2-33dc-44cd-820d-dd03c91ca699 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:08:47.852023 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3a6b91a2-33dc-44cd-820d-dd03c91ca699 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:08:47.852515 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3a6b91a2-33dc-44cd-820d-dd03c91ca699 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:08:47.852982 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3a6b91a2-33dc-44cd-820d-dd03c91ca699 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:08:47.853673 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3a6b91a2-33dc-44cd-820d-dd03c91ca699 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:08:47.854141 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3a6b91a2-33dc-44cd-820d-dd03c91ca699 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:08:47.854549 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3a6b91a2-33dc-44cd-820d-dd03c91ca699 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:08:47.887422 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-3a6b91a2-33dc-44cd-820d-dd03c91ca699 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048300 Oct 20 06:08:47.887978 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 264/551] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:08:47 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:08:48.583516 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-eaa6ae77-04db-4323-933c-770a5e58e458 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:08:48.584047 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-eaa6ae77-04db-4323-933c-770a5e58e458 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:08:48.590537 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-eaa6ae77-04db-4323-933c-770a5e58e458 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:08:48.591011 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-eaa6ae77-04db-4323-933c-770a5e58e458 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:08:48.591439 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-eaa6ae77-04db-4323-933c-770a5e58e458 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:08:48.592120 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-eaa6ae77-04db-4323-933c-770a5e58e458 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:08:48.592560 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-eaa6ae77-04db-4323-933c-770a5e58e458 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:08:48.593007 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-eaa6ae77-04db-4323-933c-770a5e58e458 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:08:48.721134 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-eaa6ae77-04db-4323-933c-770a5e58e458 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:08:48.730197 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-eaa6ae77-04db-4323-933c-770a5e58e458 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:08:48.731624 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-eaa6ae77-04db-4323-933c-770a5e58e458 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:08:48.732856 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-eaa6ae77-04db-4323-933c-770a5e58e458 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1751 microversion: 2.20 time: 0.153229 Oct 20 06:08:48.733403 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 288/552] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:08:48 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1751 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:08:48.900562 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-d045cad3-d0da-48ab-95cd-5ae8f1097986 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:08:48.902741 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-d045cad3-d0da-48ab-95cd-5ae8f1097986 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:08:48.909095 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-d045cad3-d0da-48ab-95cd-5ae8f1097986 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:08:48.909578 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-d045cad3-d0da-48ab-95cd-5ae8f1097986 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:08:48.910015 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-d045cad3-d0da-48ab-95cd-5ae8f1097986 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:08:48.910709 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-d045cad3-d0da-48ab-95cd-5ae8f1097986 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:08:48.911158 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-d045cad3-d0da-48ab-95cd-5ae8f1097986 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:08:48.911583 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-d045cad3-d0da-48ab-95cd-5ae8f1097986 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:08:48.941470 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-d045cad3-d0da-48ab-95cd-5ae8f1097986 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045764 Oct 20 06:08:48.942014 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 265/553] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:08:48 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:08:49.759920 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-a2a9379c-3bd1-4b5b-9c91-1640b4e051b0 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:08:49.760521 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-a2a9379c-3bd1-4b5b-9c91-1640b4e051b0 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:08:49.766838 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a2a9379c-3bd1-4b5b-9c91-1640b4e051b0 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:08:49.767312 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a2a9379c-3bd1-4b5b-9c91-1640b4e051b0 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:08:49.767739 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a2a9379c-3bd1-4b5b-9c91-1640b4e051b0 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:08:49.768421 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a2a9379c-3bd1-4b5b-9c91-1640b4e051b0 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:08:49.768915 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a2a9379c-3bd1-4b5b-9c91-1640b4e051b0 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:08:49.769333 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a2a9379c-3bd1-4b5b-9c91-1640b4e051b0 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:08:49.905352 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-a2a9379c-3bd1-4b5b-9c91-1640b4e051b0 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:08:49.913755 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-a2a9379c-3bd1-4b5b-9c91-1640b4e051b0 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:08:49.915842 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-a2a9379c-3bd1-4b5b-9c91-1640b4e051b0 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:08:49.916982 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-a2a9379c-3bd1-4b5b-9c91-1640b4e051b0 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1751 microversion: 2.20 time: 0.161899 Oct 20 06:08:49.917535 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 289/554] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:08:49 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1751 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:08:49.953578 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-378f3c8d-b533-40e8-8ac6-731c353fbea2 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:08:49.955720 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-378f3c8d-b533-40e8-8ac6-731c353fbea2 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:08:49.962063 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-378f3c8d-b533-40e8-8ac6-731c353fbea2 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:08:49.962727 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-378f3c8d-b533-40e8-8ac6-731c353fbea2 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:08:49.963164 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-378f3c8d-b533-40e8-8ac6-731c353fbea2 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:08:49.963853 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-378f3c8d-b533-40e8-8ac6-731c353fbea2 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:08:49.964302 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-378f3c8d-b533-40e8-8ac6-731c353fbea2 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:08:49.964749 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-378f3c8d-b533-40e8-8ac6-731c353fbea2 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:08:49.994691 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-378f3c8d-b533-40e8-8ac6-731c353fbea2 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045214 Oct 20 06:08:49.995230 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 266/555] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:08:49 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 20 06:08:50.941576 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-0667906f-7b7d-486e-aea6-0bf5385d6502 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:08:50.942177 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-0667906f-7b7d-486e-aea6-0bf5385d6502 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:08:50.949343 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-0667906f-7b7d-486e-aea6-0bf5385d6502 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:08:50.949852 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-0667906f-7b7d-486e-aea6-0bf5385d6502 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:08:50.950282 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-0667906f-7b7d-486e-aea6-0bf5385d6502 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:08:50.950992 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-0667906f-7b7d-486e-aea6-0bf5385d6502 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:08:50.951459 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-0667906f-7b7d-486e-aea6-0bf5385d6502 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:08:50.951879 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-0667906f-7b7d-486e-aea6-0bf5385d6502 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:08:51.007760 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-febf06f9-deae-49f4-90c6-ccba301ac877 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:08:51.010552 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-febf06f9-deae-49f4-90c6-ccba301ac877 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:08:51.016430 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-febf06f9-deae-49f4-90c6-ccba301ac877 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:08:51.016945 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-febf06f9-deae-49f4-90c6-ccba301ac877 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:08:51.017388 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-febf06f9-deae-49f4-90c6-ccba301ac877 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:08:51.018074 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-febf06f9-deae-49f4-90c6-ccba301ac877 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:08:51.018551 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-febf06f9-deae-49f4-90c6-ccba301ac877 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:08:51.018972 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-febf06f9-deae-49f4-90c6-ccba301ac877 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:08:51.048737 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-febf06f9-deae-49f4-90c6-ccba301ac877 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045400 Oct 20 06:08:51.049301 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 267/556] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:08:51 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 20 06:08:51.079445 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-0667906f-7b7d-486e-aea6-0bf5385d6502 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:08:51.087899 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-0667906f-7b7d-486e-aea6-0bf5385d6502 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:08:51.089491 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-0667906f-7b7d-486e-aea6-0bf5385d6502 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:08:51.090645 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-0667906f-7b7d-486e-aea6-0bf5385d6502 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1751 microversion: 2.20 time: 0.152919 Oct 20 06:08:51.091207 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 290/557] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:08:50 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1751 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:08:52.060594 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-0616b75b-6786-4aaa-b351-bc2673a74c3a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:08:52.062692 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-0616b75b-6786-4aaa-b351-bc2673a74c3a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:08:52.068999 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0616b75b-6786-4aaa-b351-bc2673a74c3a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:08:52.069476 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0616b75b-6786-4aaa-b351-bc2673a74c3a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:08:52.070053 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0616b75b-6786-4aaa-b351-bc2673a74c3a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:08:52.070737 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0616b75b-6786-4aaa-b351-bc2673a74c3a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:08:52.071211 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0616b75b-6786-4aaa-b351-bc2673a74c3a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:08:52.071630 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0616b75b-6786-4aaa-b351-bc2673a74c3a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:08:52.087590 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG dbcounter [-] [118860] Writing DB stats nova_cell1:SELECT=100 {{(pid=118860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:08:52.101957 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-0616b75b-6786-4aaa-b351-bc2673a74c3a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045607 Oct 20 06:08:52.102495 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 268/558] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:08:52 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:08:52.115261 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-89fc04fb-b9bb-451b-9783-9e44bec614a5 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:08:52.115869 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-89fc04fb-b9bb-451b-9783-9e44bec614a5 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:08:52.122892 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-89fc04fb-b9bb-451b-9783-9e44bec614a5 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:08:52.123374 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-89fc04fb-b9bb-451b-9783-9e44bec614a5 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:08:52.123811 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-89fc04fb-b9bb-451b-9783-9e44bec614a5 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:08:52.124495 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-89fc04fb-b9bb-451b-9783-9e44bec614a5 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:08:52.124980 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-89fc04fb-b9bb-451b-9783-9e44bec614a5 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:08:52.125404 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-89fc04fb-b9bb-451b-9783-9e44bec614a5 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:08:52.250273 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-89fc04fb-b9bb-451b-9783-9e44bec614a5 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:08:52.258978 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-89fc04fb-b9bb-451b-9783-9e44bec614a5 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:08:52.260938 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-89fc04fb-b9bb-451b-9783-9e44bec614a5 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:08:52.262118 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-89fc04fb-b9bb-451b-9783-9e44bec614a5 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1751 microversion: 2.20 time: 0.150778 Oct 20 06:08:52.262667 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 291/559] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:08:52 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1751 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:08:53.116134 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-533c90a6-75c5-4d04-a4b6-f26c4df4a2ea tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:08:53.118234 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-533c90a6-75c5-4d04-a4b6-f26c4df4a2ea tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:08:53.125260 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-533c90a6-75c5-4d04-a4b6-f26c4df4a2ea tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:08:53.125750 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-533c90a6-75c5-4d04-a4b6-f26c4df4a2ea tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:08:53.126187 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-533c90a6-75c5-4d04-a4b6-f26c4df4a2ea tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:08:53.126882 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-533c90a6-75c5-4d04-a4b6-f26c4df4a2ea tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:08:53.127337 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-533c90a6-75c5-4d04-a4b6-f26c4df4a2ea tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:08:53.127764 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-533c90a6-75c5-4d04-a4b6-f26c4df4a2ea tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:08:53.157596 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-533c90a6-75c5-4d04-a4b6-f26c4df4a2ea tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046149 Oct 20 06:08:53.158246 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 269/560] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:08:53 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:08:53.288165 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-d6ee3746-7c62-40ba-b934-7300f8f05e4a tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:08:53.288822 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-d6ee3746-7c62-40ba-b934-7300f8f05e4a tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:08:53.300613 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d6ee3746-7c62-40ba-b934-7300f8f05e4a tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:08:53.300613 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d6ee3746-7c62-40ba-b934-7300f8f05e4a tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:08:53.300613 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d6ee3746-7c62-40ba-b934-7300f8f05e4a tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:08:53.300613 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d6ee3746-7c62-40ba-b934-7300f8f05e4a tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:08:53.301072 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d6ee3746-7c62-40ba-b934-7300f8f05e4a tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:08:53.301072 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d6ee3746-7c62-40ba-b934-7300f8f05e4a tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:08:53.451509 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-d6ee3746-7c62-40ba-b934-7300f8f05e4a tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:08:53.461105 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-d6ee3746-7c62-40ba-b934-7300f8f05e4a tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:08:53.462866 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-d6ee3746-7c62-40ba-b934-7300f8f05e4a tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:08:53.465403 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-d6ee3746-7c62-40ba-b934-7300f8f05e4a tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1751 microversion: 2.20 time: 0.180960 Oct 20 06:08:53.466030 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 292/561] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:08:53 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1751 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:08:54.171038 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-5c2564f8-35b6-4916-92b9-18989b084537 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:08:54.173118 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-5c2564f8-35b6-4916-92b9-18989b084537 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:08:54.179455 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5c2564f8-35b6-4916-92b9-18989b084537 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:08:54.179932 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5c2564f8-35b6-4916-92b9-18989b084537 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:08:54.180368 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5c2564f8-35b6-4916-92b9-18989b084537 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:08:54.181085 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5c2564f8-35b6-4916-92b9-18989b084537 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:08:54.181543 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5c2564f8-35b6-4916-92b9-18989b084537 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:08:54.181972 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5c2564f8-35b6-4916-92b9-18989b084537 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:08:54.210407 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-5c2564f8-35b6-4916-92b9-18989b084537 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043979 Oct 20 06:08:54.210945 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 270/562] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:08:54 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:08:54.497275 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-157f8e53-8978-454b-bf89-a5793701aa30 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:08:54.497793 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-157f8e53-8978-454b-bf89-a5793701aa30 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:08:54.504175 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-157f8e53-8978-454b-bf89-a5793701aa30 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:08:54.504650 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-157f8e53-8978-454b-bf89-a5793701aa30 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:08:54.505116 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-157f8e53-8978-454b-bf89-a5793701aa30 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:08:54.505805 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-157f8e53-8978-454b-bf89-a5793701aa30 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:08:54.506258 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-157f8e53-8978-454b-bf89-a5793701aa30 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:08:54.506941 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-157f8e53-8978-454b-bf89-a5793701aa30 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:08:54.634508 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-157f8e53-8978-454b-bf89-a5793701aa30 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:08:54.643687 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-157f8e53-8978-454b-bf89-a5793701aa30 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:08:54.645147 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-157f8e53-8978-454b-bf89-a5793701aa30 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:08:54.646294 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-157f8e53-8978-454b-bf89-a5793701aa30 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1751 microversion: 2.20 time: 0.153055 Oct 20 06:08:54.646849 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 293/563] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:08:54 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1751 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:08:55.223387 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-b938a5d0-f677-4334-ae9a-5c1d13755723 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:08:55.225492 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-b938a5d0-f677-4334-ae9a-5c1d13755723 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:08:55.232743 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b938a5d0-f677-4334-ae9a-5c1d13755723 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:08:55.233229 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b938a5d0-f677-4334-ae9a-5c1d13755723 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:08:55.233658 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b938a5d0-f677-4334-ae9a-5c1d13755723 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:08:55.234339 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b938a5d0-f677-4334-ae9a-5c1d13755723 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:08:55.234783 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b938a5d0-f677-4334-ae9a-5c1d13755723 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:08:55.235202 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b938a5d0-f677-4334-ae9a-5c1d13755723 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:08:55.264269 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-b938a5d0-f677-4334-ae9a-5c1d13755723 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044894 Oct 20 06:08:55.264857 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 271/564] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:08:55 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:08:55.672801 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-277e2d0a-238d-41e8-b1d1-283ed92fcc98 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:08:55.673412 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-277e2d0a-238d-41e8-b1d1-283ed92fcc98 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:08:55.679825 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-277e2d0a-238d-41e8-b1d1-283ed92fcc98 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:08:55.680306 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-277e2d0a-238d-41e8-b1d1-283ed92fcc98 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:08:55.680769 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-277e2d0a-238d-41e8-b1d1-283ed92fcc98 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:08:55.681464 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-277e2d0a-238d-41e8-b1d1-283ed92fcc98 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:08:55.681968 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-277e2d0a-238d-41e8-b1d1-283ed92fcc98 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:08:55.682800 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-277e2d0a-238d-41e8-b1d1-283ed92fcc98 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:08:55.818759 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-277e2d0a-238d-41e8-b1d1-283ed92fcc98 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:08:55.828036 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-277e2d0a-238d-41e8-b1d1-283ed92fcc98 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:08:55.829514 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-277e2d0a-238d-41e8-b1d1-283ed92fcc98 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:08:55.830662 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-277e2d0a-238d-41e8-b1d1-283ed92fcc98 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1751 microversion: 2.20 time: 0.161781 Oct 20 06:08:55.831215 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 294/565] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:08:55 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1751 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:08:56.276844 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-65f8d764-b63e-4bce-82ae-325fd4183fe5 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:08:56.278915 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-65f8d764-b63e-4bce-82ae-325fd4183fe5 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:08:56.285289 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-65f8d764-b63e-4bce-82ae-325fd4183fe5 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:08:56.285764 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-65f8d764-b63e-4bce-82ae-325fd4183fe5 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:08:56.286196 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-65f8d764-b63e-4bce-82ae-325fd4183fe5 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:08:56.286883 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-65f8d764-b63e-4bce-82ae-325fd4183fe5 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:08:56.287336 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-65f8d764-b63e-4bce-82ae-325fd4183fe5 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:08:56.287759 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-65f8d764-b63e-4bce-82ae-325fd4183fe5 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:08:56.317603 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-65f8d764-b63e-4bce-82ae-325fd4183fe5 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045276 Oct 20 06:08:56.318153 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 272/566] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:08:56 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:08:56.855532 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-1e76186c-ab72-4d70-bd03-09c695d75dad tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:08:56.856139 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-1e76186c-ab72-4d70-bd03-09c695d75dad tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:08:56.862540 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1e76186c-ab72-4d70-bd03-09c695d75dad tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:08:56.863020 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1e76186c-ab72-4d70-bd03-09c695d75dad tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:08:56.863455 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1e76186c-ab72-4d70-bd03-09c695d75dad tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:08:56.864142 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1e76186c-ab72-4d70-bd03-09c695d75dad tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:08:56.864589 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1e76186c-ab72-4d70-bd03-09c695d75dad tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:08:56.865042 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1e76186c-ab72-4d70-bd03-09c695d75dad tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:08:56.989511 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-1e76186c-ab72-4d70-bd03-09c695d75dad tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:08:56.998905 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-1e76186c-ab72-4d70-bd03-09c695d75dad tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:08:57.000280 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-1e76186c-ab72-4d70-bd03-09c695d75dad tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:08:57.001454 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-1e76186c-ab72-4d70-bd03-09c695d75dad tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1751 microversion: 2.20 time: 0.149736 Oct 20 06:08:57.002005 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 295/567] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:08:56 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1751 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:08:57.330101 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-7c1ca7b6-962e-471e-a9b3-1c579ae828c4 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:08:57.332230 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-7c1ca7b6-962e-471e-a9b3-1c579ae828c4 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:08:57.339003 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7c1ca7b6-962e-471e-a9b3-1c579ae828c4 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:08:57.339484 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7c1ca7b6-962e-471e-a9b3-1c579ae828c4 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:08:57.339922 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7c1ca7b6-962e-471e-a9b3-1c579ae828c4 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:08:57.340610 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7c1ca7b6-962e-471e-a9b3-1c579ae828c4 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:08:57.341091 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7c1ca7b6-962e-471e-a9b3-1c579ae828c4 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:08:57.341517 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7c1ca7b6-962e-471e-a9b3-1c579ae828c4 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:08:57.372241 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-7c1ca7b6-962e-471e-a9b3-1c579ae828c4 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046086 Oct 20 06:08:57.372820 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 273/568] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:08:57 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:08:58.027978 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-9356c3b5-cb9f-42d8-9e9b-dcf26ec19f81 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:08:58.028576 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-9356c3b5-cb9f-42d8-9e9b-dcf26ec19f81 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:08:58.031143 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG dbcounter [-] [118861] Writing DB stats nova_api:SELECT=61,nova_api:DELETE=1 {{(pid=118861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:08:58.036949 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-9356c3b5-cb9f-42d8-9e9b-dcf26ec19f81 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:08:58.037429 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-9356c3b5-cb9f-42d8-9e9b-dcf26ec19f81 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:08:58.037861 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-9356c3b5-cb9f-42d8-9e9b-dcf26ec19f81 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:08:58.038547 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-9356c3b5-cb9f-42d8-9e9b-dcf26ec19f81 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:08:58.038993 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-9356c3b5-cb9f-42d8-9e9b-dcf26ec19f81 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:08:58.039411 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-9356c3b5-cb9f-42d8-9e9b-dcf26ec19f81 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:08:58.171659 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-9356c3b5-cb9f-42d8-9e9b-dcf26ec19f81 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:08:58.180031 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-9356c3b5-cb9f-42d8-9e9b-dcf26ec19f81 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:08:58.181517 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-9356c3b5-cb9f-42d8-9e9b-dcf26ec19f81 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:08:58.182811 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-9356c3b5-cb9f-42d8-9e9b-dcf26ec19f81 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1751 microversion: 2.20 time: 0.159291 Oct 20 06:08:58.183364 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 296/569] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:08:58 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1751 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:08:58.384743 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-54c182ac-e0e7-4967-a430-198623d3426d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:08:58.387899 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-54c182ac-e0e7-4967-a430-198623d3426d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:08:58.390193 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG dbcounter [-] [118860] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=1 {{(pid=118860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:08:58.395292 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-54c182ac-e0e7-4967-a430-198623d3426d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:08:58.395781 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-54c182ac-e0e7-4967-a430-198623d3426d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:08:58.396254 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-54c182ac-e0e7-4967-a430-198623d3426d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:08:58.398769 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-54c182ac-e0e7-4967-a430-198623d3426d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:08:58.399243 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-54c182ac-e0e7-4967-a430-198623d3426d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:08:58.399680 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-54c182ac-e0e7-4967-a430-198623d3426d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:08:58.432966 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-54c182ac-e0e7-4967-a430-198623d3426d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051933 Oct 20 06:08:58.433526 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 274/570] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:08:58 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:08:59.209245 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-c1835108-33e6-4661-a94b-567e3012b1e9 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:08:59.209851 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-c1835108-33e6-4661-a94b-567e3012b1e9 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:08:59.216747 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c1835108-33e6-4661-a94b-567e3012b1e9 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:08:59.217226 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c1835108-33e6-4661-a94b-567e3012b1e9 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:08:59.217652 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c1835108-33e6-4661-a94b-567e3012b1e9 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:08:59.218341 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c1835108-33e6-4661-a94b-567e3012b1e9 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:08:59.218786 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c1835108-33e6-4661-a94b-567e3012b1e9 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:08:59.219209 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c1835108-33e6-4661-a94b-567e3012b1e9 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:08:59.344200 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-c1835108-33e6-4661-a94b-567e3012b1e9 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:08:59.352636 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-c1835108-33e6-4661-a94b-567e3012b1e9 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:08:59.354724 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-c1835108-33e6-4661-a94b-567e3012b1e9 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:08:59.355990 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-c1835108-33e6-4661-a94b-567e3012b1e9 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1751 microversion: 2.20 time: 0.150589 Oct 20 06:08:59.356550 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 297/571] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:08:59 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1751 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:08:59.445375 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-134be685-8599-4e14-aaf6-37c1943d19bb tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:08:59.447455 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-134be685-8599-4e14-aaf6-37c1943d19bb tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:08:59.454085 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-134be685-8599-4e14-aaf6-37c1943d19bb tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:08:59.454567 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-134be685-8599-4e14-aaf6-37c1943d19bb tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:08:59.455003 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-134be685-8599-4e14-aaf6-37c1943d19bb tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:08:59.455689 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-134be685-8599-4e14-aaf6-37c1943d19bb tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:08:59.456147 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-134be685-8599-4e14-aaf6-37c1943d19bb tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:08:59.456568 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-134be685-8599-4e14-aaf6-37c1943d19bb tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:08:59.486264 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-134be685-8599-4e14-aaf6-37c1943d19bb tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044847 Oct 20 06:08:59.486802 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 275/572] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:08:59 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:09:00.382765 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-7e8394d0-ffe6-40d0-be01-72f16f70cbb1 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:09:00.383373 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-7e8394d0-ffe6-40d0-be01-72f16f70cbb1 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:09:00.390188 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7e8394d0-ffe6-40d0-be01-72f16f70cbb1 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:09:00.390668 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7e8394d0-ffe6-40d0-be01-72f16f70cbb1 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:09:00.391109 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7e8394d0-ffe6-40d0-be01-72f16f70cbb1 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:09:00.391793 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7e8394d0-ffe6-40d0-be01-72f16f70cbb1 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:09:00.392245 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7e8394d0-ffe6-40d0-be01-72f16f70cbb1 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:09:00.392664 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7e8394d0-ffe6-40d0-be01-72f16f70cbb1 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:09:00.499821 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-a01745b2-c837-47a0-9b4e-bfc56c000adb tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:09:00.502050 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-a01745b2-c837-47a0-9b4e-bfc56c000adb tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:09:00.508817 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a01745b2-c837-47a0-9b4e-bfc56c000adb tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:09:00.509297 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a01745b2-c837-47a0-9b4e-bfc56c000adb tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:09:00.509726 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a01745b2-c837-47a0-9b4e-bfc56c000adb tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:09:00.510578 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a01745b2-c837-47a0-9b4e-bfc56c000adb tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:09:00.511132 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a01745b2-c837-47a0-9b4e-bfc56c000adb tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:09:00.511556 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a01745b2-c837-47a0-9b4e-bfc56c000adb tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:09:00.522865 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-7e8394d0-ffe6-40d0-be01-72f16f70cbb1 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:09:00.531469 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-7e8394d0-ffe6-40d0-be01-72f16f70cbb1 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:09:00.532947 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-7e8394d0-ffe6-40d0-be01-72f16f70cbb1 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:09:00.534100 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-7e8394d0-ffe6-40d0-be01-72f16f70cbb1 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1751 microversion: 2.20 time: 0.155643 Oct 20 06:09:00.534664 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 298/573] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:09:00 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1751 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:09:00.540651 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-a01745b2-c837-47a0-9b4e-bfc56c000adb tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044888 Oct 20 06:09:00.541221 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 276/574] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:09:00 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 20 06:09:01.553800 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-e4553904-0e85-4771-8117-513cd4b787bc tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:09:01.556136 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-e4553904-0e85-4771-8117-513cd4b787bc tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:09:01.559843 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-066b63ed-2b13-47c5-a207-8bd2cdfba7c0 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:09:01.560447 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-066b63ed-2b13-47c5-a207-8bd2cdfba7c0 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:09:01.563400 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e4553904-0e85-4771-8117-513cd4b787bc tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:09:01.563894 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e4553904-0e85-4771-8117-513cd4b787bc tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:09:01.564325 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e4553904-0e85-4771-8117-513cd4b787bc tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:09:01.565064 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e4553904-0e85-4771-8117-513cd4b787bc tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:09:01.565516 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e4553904-0e85-4771-8117-513cd4b787bc tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:09:01.566058 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e4553904-0e85-4771-8117-513cd4b787bc tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:09:01.566746 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-066b63ed-2b13-47c5-a207-8bd2cdfba7c0 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:09:01.567216 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-066b63ed-2b13-47c5-a207-8bd2cdfba7c0 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:09:01.567644 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-066b63ed-2b13-47c5-a207-8bd2cdfba7c0 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:09:01.568321 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-066b63ed-2b13-47c5-a207-8bd2cdfba7c0 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:09:01.568804 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-066b63ed-2b13-47c5-a207-8bd2cdfba7c0 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:09:01.569226 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-066b63ed-2b13-47c5-a207-8bd2cdfba7c0 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:09:01.598238 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-e4553904-0e85-4771-8117-513cd4b787bc tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048396 Oct 20 06:09:01.598793 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 299/575] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:09:01 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:09:01.695087 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-066b63ed-2b13-47c5-a207-8bd2cdfba7c0 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:09:01.704544 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-066b63ed-2b13-47c5-a207-8bd2cdfba7c0 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:09:01.706012 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-066b63ed-2b13-47c5-a207-8bd2cdfba7c0 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:09:01.707167 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-066b63ed-2b13-47c5-a207-8bd2cdfba7c0 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1751 microversion: 2.20 time: 0.151971 Oct 20 06:09:01.707720 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 277/576] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:09:01 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1751 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 20 06:09:02.611138 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-f4901d25-6939-4c11-9f5e-de80db30ca1a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:09:02.613306 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-f4901d25-6939-4c11-9f5e-de80db30ca1a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:09:02.620267 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f4901d25-6939-4c11-9f5e-de80db30ca1a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:09:02.620822 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f4901d25-6939-4c11-9f5e-de80db30ca1a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:09:02.621267 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f4901d25-6939-4c11-9f5e-de80db30ca1a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:09:02.621959 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f4901d25-6939-4c11-9f5e-de80db30ca1a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:09:02.622410 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f4901d25-6939-4c11-9f5e-de80db30ca1a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:09:02.622833 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f4901d25-6939-4c11-9f5e-de80db30ca1a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:09:02.651498 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-f4901d25-6939-4c11-9f5e-de80db30ca1a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044409 Oct 20 06:09:02.652046 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 300/577] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:09:02 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 20 06:09:02.733009 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-18377853-a036-4fc3-a0d6-63f8f786d5ea tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:09:02.733618 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-18377853-a036-4fc3-a0d6-63f8f786d5ea tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:09:02.740194 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-18377853-a036-4fc3-a0d6-63f8f786d5ea tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:09:02.740684 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-18377853-a036-4fc3-a0d6-63f8f786d5ea tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:09:02.741151 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-18377853-a036-4fc3-a0d6-63f8f786d5ea tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:09:02.741848 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-18377853-a036-4fc3-a0d6-63f8f786d5ea tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:09:02.742307 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-18377853-a036-4fc3-a0d6-63f8f786d5ea tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:09:02.742737 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-18377853-a036-4fc3-a0d6-63f8f786d5ea tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:09:02.871973 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-18377853-a036-4fc3-a0d6-63f8f786d5ea tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:09:02.880393 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-18377853-a036-4fc3-a0d6-63f8f786d5ea tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:09:02.882138 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-18377853-a036-4fc3-a0d6-63f8f786d5ea tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:09:02.883290 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-18377853-a036-4fc3-a0d6-63f8f786d5ea tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1751 microversion: 2.20 time: 0.154752 Oct 20 06:09:02.883847 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 278/578] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:09:02 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1751 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:09:03.663908 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-a3b2f33d-177c-46d1-86a0-339f0342b252 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:09:03.666051 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-a3b2f33d-177c-46d1-86a0-339f0342b252 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:09:03.672877 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a3b2f33d-177c-46d1-86a0-339f0342b252 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:09:03.673358 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a3b2f33d-177c-46d1-86a0-339f0342b252 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:09:03.673793 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a3b2f33d-177c-46d1-86a0-339f0342b252 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:09:03.674489 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a3b2f33d-177c-46d1-86a0-339f0342b252 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:09:03.674942 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a3b2f33d-177c-46d1-86a0-339f0342b252 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:09:03.675367 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a3b2f33d-177c-46d1-86a0-339f0342b252 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:09:03.704545 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-a3b2f33d-177c-46d1-86a0-339f0342b252 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044719 Oct 20 06:09:03.705125 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 301/579] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:09:03 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:09:03.908310 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-2acb1fd8-23dd-4b26-a82c-454fa5ce6899 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:09:03.908945 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-2acb1fd8-23dd-4b26-a82c-454fa5ce6899 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:09:03.915365 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2acb1fd8-23dd-4b26-a82c-454fa5ce6899 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:09:03.915785 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2acb1fd8-23dd-4b26-a82c-454fa5ce6899 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:09:03.916872 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2acb1fd8-23dd-4b26-a82c-454fa5ce6899 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:09:03.917572 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2acb1fd8-23dd-4b26-a82c-454fa5ce6899 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:09:03.918024 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2acb1fd8-23dd-4b26-a82c-454fa5ce6899 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:09:03.918444 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2acb1fd8-23dd-4b26-a82c-454fa5ce6899 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:09:04.045468 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-2acb1fd8-23dd-4b26-a82c-454fa5ce6899 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:09:04.053851 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-2acb1fd8-23dd-4b26-a82c-454fa5ce6899 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:09:04.055282 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-2acb1fd8-23dd-4b26-a82c-454fa5ce6899 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:09:04.056421 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-2acb1fd8-23dd-4b26-a82c-454fa5ce6899 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1751 microversion: 2.20 time: 0.151973 Oct 20 06:09:04.057657 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 279/580] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:09:03 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1751 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:09:04.717532 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-e8b17985-f5fe-4007-b9d4-76cb279b8181 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:09:04.719603 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-e8b17985-f5fe-4007-b9d4-76cb279b8181 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:09:04.726002 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e8b17985-f5fe-4007-b9d4-76cb279b8181 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:09:04.726490 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e8b17985-f5fe-4007-b9d4-76cb279b8181 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:09:04.726929 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e8b17985-f5fe-4007-b9d4-76cb279b8181 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:09:04.727629 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e8b17985-f5fe-4007-b9d4-76cb279b8181 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:09:04.728084 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e8b17985-f5fe-4007-b9d4-76cb279b8181 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:09:04.728515 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e8b17985-f5fe-4007-b9d4-76cb279b8181 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:09:04.753248 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG dbcounter [-] [118861] Writing DB stats nova_cell1:SELECT=100 {{(pid=118861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:09:04.758580 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-e8b17985-f5fe-4007-b9d4-76cb279b8181 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045665 Oct 20 06:09:04.759139 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 302/581] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:09:04 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:09:05.083047 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-6d4837da-fa80-4f9f-8413-1ed9594f9f75 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:09:05.083595 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-6d4837da-fa80-4f9f-8413-1ed9594f9f75 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:09:05.090011 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-6d4837da-fa80-4f9f-8413-1ed9594f9f75 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:09:05.090484 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-6d4837da-fa80-4f9f-8413-1ed9594f9f75 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:09:05.090916 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-6d4837da-fa80-4f9f-8413-1ed9594f9f75 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:09:05.091595 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-6d4837da-fa80-4f9f-8413-1ed9594f9f75 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:09:05.092044 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-6d4837da-fa80-4f9f-8413-1ed9594f9f75 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:09:05.092460 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-6d4837da-fa80-4f9f-8413-1ed9594f9f75 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:09:05.219363 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-6d4837da-fa80-4f9f-8413-1ed9594f9f75 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:09:05.227692 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-6d4837da-fa80-4f9f-8413-1ed9594f9f75 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:09:05.229145 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-6d4837da-fa80-4f9f-8413-1ed9594f9f75 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:09:05.230284 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-6d4837da-fa80-4f9f-8413-1ed9594f9f75 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1751 microversion: 2.20 time: 0.151241 Oct 20 06:09:05.230826 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 280/582] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:09:05 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1751 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:09:05.771399 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-7e59d349-2ec2-4c27-8ae9-e9a032ec8ab8 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:09:05.773502 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-7e59d349-2ec2-4c27-8ae9-e9a032ec8ab8 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:09:05.780181 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7e59d349-2ec2-4c27-8ae9-e9a032ec8ab8 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:09:05.780662 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7e59d349-2ec2-4c27-8ae9-e9a032ec8ab8 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:09:05.781158 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7e59d349-2ec2-4c27-8ae9-e9a032ec8ab8 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:09:05.781849 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7e59d349-2ec2-4c27-8ae9-e9a032ec8ab8 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:09:05.782302 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7e59d349-2ec2-4c27-8ae9-e9a032ec8ab8 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:09:05.782729 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7e59d349-2ec2-4c27-8ae9-e9a032ec8ab8 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:09:05.813079 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-7e59d349-2ec2-4c27-8ae9-e9a032ec8ab8 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045960 Oct 20 06:09:05.813625 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 303/583] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:09:05 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 20 06:09:06.256006 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-266e272a-fc91-46b6-83c5-63028628cbf4 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:09:06.256907 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-266e272a-fc91-46b6-83c5-63028628cbf4 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:09:06.263316 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-266e272a-fc91-46b6-83c5-63028628cbf4 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:09:06.263792 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-266e272a-fc91-46b6-83c5-63028628cbf4 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:09:06.264228 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-266e272a-fc91-46b6-83c5-63028628cbf4 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:09:06.264946 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-266e272a-fc91-46b6-83c5-63028628cbf4 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:09:06.265393 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-266e272a-fc91-46b6-83c5-63028628cbf4 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:09:06.265812 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-266e272a-fc91-46b6-83c5-63028628cbf4 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:09:06.400271 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-266e272a-fc91-46b6-83c5-63028628cbf4 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:09:06.409547 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-266e272a-fc91-46b6-83c5-63028628cbf4 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:09:06.410989 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-266e272a-fc91-46b6-83c5-63028628cbf4 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:09:06.412138 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-266e272a-fc91-46b6-83c5-63028628cbf4 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1751 microversion: 2.20 time: 0.160123 Oct 20 06:09:06.412689 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 281/584] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:09:06 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1751 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:09:06.825901 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-02c675d7-d706-428a-b618-26f905bd12c2 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:09:06.827998 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-02c675d7-d706-428a-b618-26f905bd12c2 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:09:06.834409 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-02c675d7-d706-428a-b618-26f905bd12c2 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:09:06.834890 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-02c675d7-d706-428a-b618-26f905bd12c2 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:09:06.835326 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-02c675d7-d706-428a-b618-26f905bd12c2 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:09:06.836011 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-02c675d7-d706-428a-b618-26f905bd12c2 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:09:06.836459 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-02c675d7-d706-428a-b618-26f905bd12c2 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:09:06.836915 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-02c675d7-d706-428a-b618-26f905bd12c2 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:09:06.867079 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-02c675d7-d706-428a-b618-26f905bd12c2 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045578 Oct 20 06:09:06.867631 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 304/585] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:09:06 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:09:07.437575 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-8a143bb2-c5b4-4e20-a510-10ce556b8858 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:09:07.438176 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-8a143bb2-c5b4-4e20-a510-10ce556b8858 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:09:07.444526 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-8a143bb2-c5b4-4e20-a510-10ce556b8858 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:09:07.445047 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-8a143bb2-c5b4-4e20-a510-10ce556b8858 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:09:07.445480 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-8a143bb2-c5b4-4e20-a510-10ce556b8858 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:09:07.446164 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-8a143bb2-c5b4-4e20-a510-10ce556b8858 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:09:07.446612 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-8a143bb2-c5b4-4e20-a510-10ce556b8858 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:09:07.447031 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-8a143bb2-c5b4-4e20-a510-10ce556b8858 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:09:07.574190 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-8a143bb2-c5b4-4e20-a510-10ce556b8858 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:09:07.583046 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-8a143bb2-c5b4-4e20-a510-10ce556b8858 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:09:07.584484 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-8a143bb2-c5b4-4e20-a510-10ce556b8858 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:09:07.585677 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-8a143bb2-c5b4-4e20-a510-10ce556b8858 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1751 microversion: 2.20 time: 0.151880 Oct 20 06:09:07.586681 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 282/586] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:09:07 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1751 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 20 06:09:07.878773 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-22300977-8f4a-4011-a5ee-3cc4d1d7e6d0 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:09:07.880940 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-22300977-8f4a-4011-a5ee-3cc4d1d7e6d0 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:09:07.888465 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-22300977-8f4a-4011-a5ee-3cc4d1d7e6d0 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:09:07.888974 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-22300977-8f4a-4011-a5ee-3cc4d1d7e6d0 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:09:07.889414 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-22300977-8f4a-4011-a5ee-3cc4d1d7e6d0 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:09:07.890110 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-22300977-8f4a-4011-a5ee-3cc4d1d7e6d0 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:09:07.890563 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-22300977-8f4a-4011-a5ee-3cc4d1d7e6d0 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:09:07.890989 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-22300977-8f4a-4011-a5ee-3cc4d1d7e6d0 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:09:07.924809 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-22300977-8f4a-4011-a5ee-3cc4d1d7e6d0 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049865 Oct 20 06:09:07.925374 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 305/587] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:09:07 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:09:08.612386 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-63a990dc-6dda-47ec-a7a6-286d13221b8c tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:09:08.613054 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-63a990dc-6dda-47ec-a7a6-286d13221b8c tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:09:08.619331 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-63a990dc-6dda-47ec-a7a6-286d13221b8c tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:09:08.620370 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-63a990dc-6dda-47ec-a7a6-286d13221b8c tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:09:08.620824 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-63a990dc-6dda-47ec-a7a6-286d13221b8c tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:09:08.621612 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-63a990dc-6dda-47ec-a7a6-286d13221b8c tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:09:08.622064 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-63a990dc-6dda-47ec-a7a6-286d13221b8c tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:09:08.622482 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-63a990dc-6dda-47ec-a7a6-286d13221b8c tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:09:08.754999 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-63a990dc-6dda-47ec-a7a6-286d13221b8c tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:09:08.763763 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-63a990dc-6dda-47ec-a7a6-286d13221b8c tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:09:08.765286 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-63a990dc-6dda-47ec-a7a6-286d13221b8c tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:09:08.766453 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-63a990dc-6dda-47ec-a7a6-286d13221b8c tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1751 microversion: 2.20 time: 0.157915 Oct 20 06:09:08.766996 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 283/588] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:09:08 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1751 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:09:08.937816 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-cddc1900-7942-4f50-9f98-34218bba5a79 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:09:08.939919 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-cddc1900-7942-4f50-9f98-34218bba5a79 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:09:08.946225 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-cddc1900-7942-4f50-9f98-34218bba5a79 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:09:08.946695 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-cddc1900-7942-4f50-9f98-34218bba5a79 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:09:08.947124 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-cddc1900-7942-4f50-9f98-34218bba5a79 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:09:08.947808 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-cddc1900-7942-4f50-9f98-34218bba5a79 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:09:08.948329 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-cddc1900-7942-4f50-9f98-34218bba5a79 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:09:08.948773 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-cddc1900-7942-4f50-9f98-34218bba5a79 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:09:08.977665 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-cddc1900-7942-4f50-9f98-34218bba5a79 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043693 Oct 20 06:09:08.978137 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 306/589] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:09:08 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:09:09.792049 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-bd839573-f3d1-457e-ad26-28e978778b16 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:09:09.792665 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-bd839573-f3d1-457e-ad26-28e978778b16 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:09:09.799385 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-bd839573-f3d1-457e-ad26-28e978778b16 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:09:09.799876 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-bd839573-f3d1-457e-ad26-28e978778b16 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:09:09.800319 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-bd839573-f3d1-457e-ad26-28e978778b16 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:09:09.801050 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-bd839573-f3d1-457e-ad26-28e978778b16 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:09:09.801542 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-bd839573-f3d1-457e-ad26-28e978778b16 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:09:09.801972 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-bd839573-f3d1-457e-ad26-28e978778b16 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:09:09.927473 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-bd839573-f3d1-457e-ad26-28e978778b16 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:09:09.936840 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-bd839573-f3d1-457e-ad26-28e978778b16 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:09:09.938803 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-bd839573-f3d1-457e-ad26-28e978778b16 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:09:09.939513 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-bd839573-f3d1-457e-ad26-28e978778b16 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1751 microversion: 2.20 time: 0.151525 Oct 20 06:09:09.940062 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 284/590] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:09:09 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1751 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 20 06:09:09.990615 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-ee2e997c-54ff-4aa9-b22d-98522d622b53 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:09:09.992776 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-ee2e997c-54ff-4aa9-b22d-98522d622b53 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:09:09.999878 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ee2e997c-54ff-4aa9-b22d-98522d622b53 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:09:10.000361 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ee2e997c-54ff-4aa9-b22d-98522d622b53 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:09:10.000842 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ee2e997c-54ff-4aa9-b22d-98522d622b53 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:09:10.001535 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ee2e997c-54ff-4aa9-b22d-98522d622b53 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:09:10.001990 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ee2e997c-54ff-4aa9-b22d-98522d622b53 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:09:10.002417 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ee2e997c-54ff-4aa9-b22d-98522d622b53 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:09:10.032021 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-ee2e997c-54ff-4aa9-b22d-98522d622b53 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045272 Oct 20 06:09:10.032613 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 307/591] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:09:09 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:09:10.965418 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-2d628905-12a2-482a-af8d-b85888dcc754 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:09:10.966034 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-2d628905-12a2-482a-af8d-b85888dcc754 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:09:10.972464 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2d628905-12a2-482a-af8d-b85888dcc754 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:09:10.972988 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2d628905-12a2-482a-af8d-b85888dcc754 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:09:10.973430 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2d628905-12a2-482a-af8d-b85888dcc754 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:09:10.974122 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2d628905-12a2-482a-af8d-b85888dcc754 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:09:10.974577 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2d628905-12a2-482a-af8d-b85888dcc754 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:09:10.975003 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2d628905-12a2-482a-af8d-b85888dcc754 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:09:10.979357 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG dbcounter [-] [118860] Writing DB stats nova_cell1:SELECT=100 {{(pid=118860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:09:11.045326 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-60b055f8-4d58-43a0-80f4-be43b803af3a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:09:11.047458 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-60b055f8-4d58-43a0-80f4-be43b803af3a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:09:11.053638 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-60b055f8-4d58-43a0-80f4-be43b803af3a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:09:11.054125 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-60b055f8-4d58-43a0-80f4-be43b803af3a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:09:11.054564 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-60b055f8-4d58-43a0-80f4-be43b803af3a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:09:11.055262 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-60b055f8-4d58-43a0-80f4-be43b803af3a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:09:11.055805 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-60b055f8-4d58-43a0-80f4-be43b803af3a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:09:11.056124 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-60b055f8-4d58-43a0-80f4-be43b803af3a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:09:11.086162 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-60b055f8-4d58-43a0-80f4-be43b803af3a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045290 Oct 20 06:09:11.086730 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 308/592] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:09:11 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 20 06:09:11.107084 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-2d628905-12a2-482a-af8d-b85888dcc754 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:09:11.115728 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-2d628905-12a2-482a-af8d-b85888dcc754 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:09:11.117210 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-2d628905-12a2-482a-af8d-b85888dcc754 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:09:11.118368 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-2d628905-12a2-482a-af8d-b85888dcc754 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1751 microversion: 2.20 time: 0.156921 Oct 20 06:09:11.118915 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 285/593] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:09:10 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1751 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:09:12.098646 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-8f8a974d-4fcf-453b-b986-ee6bf7dbc3a5 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:09:12.100803 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-8f8a974d-4fcf-453b-b986-ee6bf7dbc3a5 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:09:12.107372 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-8f8a974d-4fcf-453b-b986-ee6bf7dbc3a5 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:09:12.107850 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-8f8a974d-4fcf-453b-b986-ee6bf7dbc3a5 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:09:12.108283 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-8f8a974d-4fcf-453b-b986-ee6bf7dbc3a5 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:09:12.109000 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-8f8a974d-4fcf-453b-b986-ee6bf7dbc3a5 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:09:12.109457 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-8f8a974d-4fcf-453b-b986-ee6bf7dbc3a5 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:09:12.109878 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-8f8a974d-4fcf-453b-b986-ee6bf7dbc3a5 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:09:12.139904 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-8f8a974d-4fcf-453b-b986-ee6bf7dbc3a5 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045265 Oct 20 06:09:12.140457 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 309/594] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:09:12 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:09:12.144871 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-35660b76-a099-4e55-adc8-5cbafdfe326c tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:09:12.145476 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-35660b76-a099-4e55-adc8-5cbafdfe326c tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:09:12.152520 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-35660b76-a099-4e55-adc8-5cbafdfe326c tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:09:12.153042 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-35660b76-a099-4e55-adc8-5cbafdfe326c tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:09:12.153482 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-35660b76-a099-4e55-adc8-5cbafdfe326c tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:09:12.154171 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-35660b76-a099-4e55-adc8-5cbafdfe326c tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:09:12.154623 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-35660b76-a099-4e55-adc8-5cbafdfe326c tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:09:12.155047 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-35660b76-a099-4e55-adc8-5cbafdfe326c tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:09:12.279858 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-35660b76-a099-4e55-adc8-5cbafdfe326c tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:09:12.288197 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-35660b76-a099-4e55-adc8-5cbafdfe326c tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:09:12.289676 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-35660b76-a099-4e55-adc8-5cbafdfe326c tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:09:12.290827 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-35660b76-a099-4e55-adc8-5cbafdfe326c tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1751 microversion: 2.20 time: 0.150146 Oct 20 06:09:12.292038 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 286/595] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:09:12 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1751 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 20 06:09:13.153141 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-da906d76-c047-4c3a-ab5b-daab81918775 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:09:13.155279 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-da906d76-c047-4c3a-ab5b-daab81918775 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:09:13.161682 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-da906d76-c047-4c3a-ab5b-daab81918775 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:09:13.162163 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-da906d76-c047-4c3a-ab5b-daab81918775 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:09:13.162605 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-da906d76-c047-4c3a-ab5b-daab81918775 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:09:13.163295 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-da906d76-c047-4c3a-ab5b-daab81918775 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:09:13.163746 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-da906d76-c047-4c3a-ab5b-daab81918775 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:09:13.164169 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-da906d76-c047-4c3a-ab5b-daab81918775 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:09:13.192888 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-da906d76-c047-4c3a-ab5b-daab81918775 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044713 Oct 20 06:09:13.193438 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 310/596] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:09:13 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:09:13.316174 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-1cbc401c-8510-4830-be89-4b822b23e939 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:09:13.316813 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-1cbc401c-8510-4830-be89-4b822b23e939 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:09:13.323842 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1cbc401c-8510-4830-be89-4b822b23e939 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:09:13.324318 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1cbc401c-8510-4830-be89-4b822b23e939 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:09:13.324783 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1cbc401c-8510-4830-be89-4b822b23e939 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:09:13.325474 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1cbc401c-8510-4830-be89-4b822b23e939 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:09:13.325924 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1cbc401c-8510-4830-be89-4b822b23e939 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:09:13.326344 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1cbc401c-8510-4830-be89-4b822b23e939 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:09:13.454984 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-1cbc401c-8510-4830-be89-4b822b23e939 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:09:13.464605 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-1cbc401c-8510-4830-be89-4b822b23e939 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:09:13.466088 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-1cbc401c-8510-4830-be89-4b822b23e939 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:09:13.467279 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-1cbc401c-8510-4830-be89-4b822b23e939 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1751 microversion: 2.20 time: 0.154969 Oct 20 06:09:13.467838 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 287/597] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:09:13 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1751 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:09:14.205800 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-a8f73f22-4a08-4859-8cdb-409f4546b64b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:09:14.207920 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-a8f73f22-4a08-4859-8cdb-409f4546b64b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:09:14.214795 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a8f73f22-4a08-4859-8cdb-409f4546b64b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:09:14.215262 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a8f73f22-4a08-4859-8cdb-409f4546b64b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:09:14.215687 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a8f73f22-4a08-4859-8cdb-409f4546b64b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:09:14.216364 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a8f73f22-4a08-4859-8cdb-409f4546b64b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:09:14.216833 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a8f73f22-4a08-4859-8cdb-409f4546b64b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:09:14.217251 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a8f73f22-4a08-4859-8cdb-409f4546b64b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:09:14.246574 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-a8f73f22-4a08-4859-8cdb-409f4546b64b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044705 Oct 20 06:09:14.247126 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 311/598] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:09:14 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:09:14.492804 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-c5d61f28-a6f2-49e6-b633-587d9182872f tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:09:14.493339 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-c5d61f28-a6f2-49e6-b633-587d9182872f tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:09:14.500072 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c5d61f28-a6f2-49e6-b633-587d9182872f tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:09:14.500569 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c5d61f28-a6f2-49e6-b633-587d9182872f tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:09:14.501018 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c5d61f28-a6f2-49e6-b633-587d9182872f tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:09:14.501712 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c5d61f28-a6f2-49e6-b633-587d9182872f tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:09:14.502161 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c5d61f28-a6f2-49e6-b633-587d9182872f tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:09:14.502584 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c5d61f28-a6f2-49e6-b633-587d9182872f tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:09:14.628988 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-c5d61f28-a6f2-49e6-b633-587d9182872f tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:09:14.638489 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-c5d61f28-a6f2-49e6-b633-587d9182872f tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:09:14.639930 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-c5d61f28-a6f2-49e6-b633-587d9182872f tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:09:14.641115 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-c5d61f28-a6f2-49e6-b633-587d9182872f tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1751 microversion: 2.20 time: 0.152300 Oct 20 06:09:14.641668 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 288/599] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:09:14 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1751 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:09:15.258770 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-a2d0d7b8-f28b-4508-91a5-19c63dc3a0df tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:09:15.261659 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-a2d0d7b8-f28b-4508-91a5-19c63dc3a0df tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:09:15.267978 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a2d0d7b8-f28b-4508-91a5-19c63dc3a0df tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:09:15.268464 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a2d0d7b8-f28b-4508-91a5-19c63dc3a0df tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:09:15.268944 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a2d0d7b8-f28b-4508-91a5-19c63dc3a0df tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:09:15.269640 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a2d0d7b8-f28b-4508-91a5-19c63dc3a0df tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:09:15.270094 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a2d0d7b8-f28b-4508-91a5-19c63dc3a0df tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:09:15.270521 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a2d0d7b8-f28b-4508-91a5-19c63dc3a0df tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:09:15.299379 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-a2d0d7b8-f28b-4508-91a5-19c63dc3a0df tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044868 Oct 20 06:09:15.299937 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 312/600] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:09:15 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:09:15.667364 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-44a2980b-2167-420d-963f-ebd56b5b172f tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:09:15.667970 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-44a2980b-2167-420d-963f-ebd56b5b172f tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:09:15.674422 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-44a2980b-2167-420d-963f-ebd56b5b172f tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:09:15.674903 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-44a2980b-2167-420d-963f-ebd56b5b172f tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:09:15.675339 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-44a2980b-2167-420d-963f-ebd56b5b172f tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:09:15.676025 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-44a2980b-2167-420d-963f-ebd56b5b172f tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:09:15.676478 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-44a2980b-2167-420d-963f-ebd56b5b172f tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:09:15.676930 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-44a2980b-2167-420d-963f-ebd56b5b172f tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:09:15.801941 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-44a2980b-2167-420d-963f-ebd56b5b172f tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:09:15.810666 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-44a2980b-2167-420d-963f-ebd56b5b172f tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:09:15.812092 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-44a2980b-2167-420d-963f-ebd56b5b172f tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:09:15.813340 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-44a2980b-2167-420d-963f-ebd56b5b172f tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1751 microversion: 2.20 time: 0.150494 Oct 20 06:09:15.813888 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 289/601] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:09:15 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1751 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:09:16.311380 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-d8af91a0-79c4-4019-8d02-ce5a9d8b7902 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:09:16.313536 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-d8af91a0-79c4-4019-8d02-ce5a9d8b7902 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:09:16.319866 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d8af91a0-79c4-4019-8d02-ce5a9d8b7902 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:09:16.320349 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d8af91a0-79c4-4019-8d02-ce5a9d8b7902 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:09:16.320814 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d8af91a0-79c4-4019-8d02-ce5a9d8b7902 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:09:16.321506 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d8af91a0-79c4-4019-8d02-ce5a9d8b7902 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:09:16.321955 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d8af91a0-79c4-4019-8d02-ce5a9d8b7902 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:09:16.323124 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d8af91a0-79c4-4019-8d02-ce5a9d8b7902 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:09:16.352285 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-d8af91a0-79c4-4019-8d02-ce5a9d8b7902 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044967 Oct 20 06:09:16.352857 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 313/602] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:09:16 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:09:16.839861 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-2ed7233e-d265-4b33-80a5-18f82db3d106 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:09:16.840469 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-2ed7233e-d265-4b33-80a5-18f82db3d106 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:09:16.846906 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2ed7233e-d265-4b33-80a5-18f82db3d106 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:09:16.847386 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2ed7233e-d265-4b33-80a5-18f82db3d106 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:09:16.847823 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2ed7233e-d265-4b33-80a5-18f82db3d106 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:09:16.848513 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2ed7233e-d265-4b33-80a5-18f82db3d106 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:09:16.848998 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2ed7233e-d265-4b33-80a5-18f82db3d106 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:09:16.849424 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2ed7233e-d265-4b33-80a5-18f82db3d106 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:09:16.984176 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-2ed7233e-d265-4b33-80a5-18f82db3d106 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:09:16.992594 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-2ed7233e-d265-4b33-80a5-18f82db3d106 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:09:16.994226 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-2ed7233e-d265-4b33-80a5-18f82db3d106 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:09:16.995487 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-2ed7233e-d265-4b33-80a5-18f82db3d106 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1751 microversion: 2.20 time: 0.160184 Oct 20 06:09:16.996034 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 290/603] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:09:16 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1751 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:09:17.364951 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-79b455f8-d47b-433c-9d3b-fda715622b57 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:09:17.367023 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-79b455f8-d47b-433c-9d3b-fda715622b57 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:09:17.374479 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-79b455f8-d47b-433c-9d3b-fda715622b57 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:09:17.374970 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-79b455f8-d47b-433c-9d3b-fda715622b57 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:09:17.375407 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-79b455f8-d47b-433c-9d3b-fda715622b57 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:09:17.376113 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-79b455f8-d47b-433c-9d3b-fda715622b57 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:09:17.376566 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-79b455f8-d47b-433c-9d3b-fda715622b57 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:09:17.377018 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-79b455f8-d47b-433c-9d3b-fda715622b57 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:09:17.406706 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-79b455f8-d47b-433c-9d3b-fda715622b57 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045866 Oct 20 06:09:17.407256 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 314/604] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:09:17 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:09:18.022155 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-5b57577d-b2af-49f7-8337-a9effb20b3d1 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:09:18.022708 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-5b57577d-b2af-49f7-8337-a9effb20b3d1 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:09:18.029344 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5b57577d-b2af-49f7-8337-a9effb20b3d1 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:09:18.029827 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5b57577d-b2af-49f7-8337-a9effb20b3d1 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:09:18.030268 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5b57577d-b2af-49f7-8337-a9effb20b3d1 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:09:18.030963 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5b57577d-b2af-49f7-8337-a9effb20b3d1 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:09:18.031415 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5b57577d-b2af-49f7-8337-a9effb20b3d1 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:09:18.031883 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5b57577d-b2af-49f7-8337-a9effb20b3d1 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:09:18.167700 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-5b57577d-b2af-49f7-8337-a9effb20b3d1 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:09:18.176295 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-5b57577d-b2af-49f7-8337-a9effb20b3d1 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:09:18.177779 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-5b57577d-b2af-49f7-8337-a9effb20b3d1 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:09:18.179023 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-5b57577d-b2af-49f7-8337-a9effb20b3d1 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1751 microversion: 2.20 time: 0.160780 Oct 20 06:09:18.179566 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 291/605] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:09:18 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1751 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:09:18.420085 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-7286ee3b-b4f2-4f24-9522-74ef495f0a17 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:09:18.422227 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-7286ee3b-b4f2-4f24-9522-74ef495f0a17 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:09:18.428446 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7286ee3b-b4f2-4f24-9522-74ef495f0a17 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:09:18.428957 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7286ee3b-b4f2-4f24-9522-74ef495f0a17 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:09:18.429390 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7286ee3b-b4f2-4f24-9522-74ef495f0a17 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:09:18.430082 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7286ee3b-b4f2-4f24-9522-74ef495f0a17 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:09:18.430530 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7286ee3b-b4f2-4f24-9522-74ef495f0a17 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:09:18.430950 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7286ee3b-b4f2-4f24-9522-74ef495f0a17 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:09:18.459585 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-7286ee3b-b4f2-4f24-9522-74ef495f0a17 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044296 Oct 20 06:09:18.460124 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 315/606] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:09:18 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:09:19.205000 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-933539e2-5672-47fb-8aa2-48213cf7414d tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:09:19.205607 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-933539e2-5672-47fb-8aa2-48213cf7414d tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:09:19.212185 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-933539e2-5672-47fb-8aa2-48213cf7414d tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:09:19.212825 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-933539e2-5672-47fb-8aa2-48213cf7414d tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:09:19.213374 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-933539e2-5672-47fb-8aa2-48213cf7414d tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:09:19.214081 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-933539e2-5672-47fb-8aa2-48213cf7414d tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:09:19.214539 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-933539e2-5672-47fb-8aa2-48213cf7414d tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:09:19.214973 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-933539e2-5672-47fb-8aa2-48213cf7414d tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:09:19.343335 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-933539e2-5672-47fb-8aa2-48213cf7414d tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:09:19.351802 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-933539e2-5672-47fb-8aa2-48213cf7414d tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:09:19.353839 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-933539e2-5672-47fb-8aa2-48213cf7414d tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:09:19.354995 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-933539e2-5672-47fb-8aa2-48213cf7414d tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1751 microversion: 2.20 time: 0.154010 Oct 20 06:09:19.355541 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 292/607] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:09:19 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1751 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:09:19.471767 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-ea505ee4-6b36-434a-bad8-973e3d7e04ca tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:09:19.473913 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-ea505ee4-6b36-434a-bad8-973e3d7e04ca tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:09:19.481049 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ea505ee4-6b36-434a-bad8-973e3d7e04ca tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:09:19.481529 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ea505ee4-6b36-434a-bad8-973e3d7e04ca tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:09:19.481962 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ea505ee4-6b36-434a-bad8-973e3d7e04ca tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:09:19.482644 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ea505ee4-6b36-434a-bad8-973e3d7e04ca tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:09:19.483095 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ea505ee4-6b36-434a-bad8-973e3d7e04ca tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:09:19.483518 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ea505ee4-6b36-434a-bad8-973e3d7e04ca tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:09:19.512488 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-ea505ee4-6b36-434a-bad8-973e3d7e04ca tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044758 Oct 20 06:09:19.513222 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 316/608] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:09:19 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:09:20.380980 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-68c93fc3-af64-4aea-a5ae-557c83c27e34 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:09:20.382094 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-68c93fc3-af64-4aea-a5ae-557c83c27e34 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:09:20.389138 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-68c93fc3-af64-4aea-a5ae-557c83c27e34 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:09:20.389623 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-68c93fc3-af64-4aea-a5ae-557c83c27e34 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:09:20.390065 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-68c93fc3-af64-4aea-a5ae-557c83c27e34 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:09:20.390765 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-68c93fc3-af64-4aea-a5ae-557c83c27e34 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:09:20.391219 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-68c93fc3-af64-4aea-a5ae-557c83c27e34 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:09:20.391648 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-68c93fc3-af64-4aea-a5ae-557c83c27e34 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:09:20.519555 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-68c93fc3-af64-4aea-a5ae-557c83c27e34 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:09:20.524237 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-962d1751-9b5c-44c0-9a89-594e1719229a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:09:20.526785 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-962d1751-9b5c-44c0-9a89-594e1719229a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:09:20.528541 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-68c93fc3-af64-4aea-a5ae-557c83c27e34 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:09:20.530017 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-68c93fc3-af64-4aea-a5ae-557c83c27e34 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:09:20.531180 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-68c93fc3-af64-4aea-a5ae-557c83c27e34 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1751 microversion: 2.20 time: 0.154335 Oct 20 06:09:20.540630 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 293/609] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:09:20 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1751 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:09:20.540933 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-962d1751-9b5c-44c0-9a89-594e1719229a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:09:20.540933 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-962d1751-9b5c-44c0-9a89-594e1719229a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:09:20.540933 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-962d1751-9b5c-44c0-9a89-594e1719229a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:09:20.540933 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-962d1751-9b5c-44c0-9a89-594e1719229a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:09:20.541560 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-962d1751-9b5c-44c0-9a89-594e1719229a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:09:20.541560 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-962d1751-9b5c-44c0-9a89-594e1719229a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:09:20.565656 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-962d1751-9b5c-44c0-9a89-594e1719229a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045371 Oct 20 06:09:20.566420 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 317/610] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:09:20 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 20 06:09:21.556257 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-ea8ba1fe-845a-494b-b231-90e3ef9ac24a tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:09:21.556893 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-ea8ba1fe-845a-494b-b231-90e3ef9ac24a tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:09:21.562941 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-ea8ba1fe-845a-494b-b231-90e3ef9ac24a tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:09:21.563416 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-ea8ba1fe-845a-494b-b231-90e3ef9ac24a tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:09:21.563846 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-ea8ba1fe-845a-494b-b231-90e3ef9ac24a tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:09:21.564523 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-ea8ba1fe-845a-494b-b231-90e3ef9ac24a tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:09:21.564998 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-ea8ba1fe-845a-494b-b231-90e3ef9ac24a tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:09:21.565420 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-ea8ba1fe-845a-494b-b231-90e3ef9ac24a tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:09:21.578686 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-f1d05645-b30c-4ee0-9588-b00bd9000001 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:09:21.580875 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-f1d05645-b30c-4ee0-9588-b00bd9000001 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:09:21.587171 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f1d05645-b30c-4ee0-9588-b00bd9000001 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:09:21.588315 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f1d05645-b30c-4ee0-9588-b00bd9000001 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:09:21.588809 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f1d05645-b30c-4ee0-9588-b00bd9000001 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:09:21.589518 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f1d05645-b30c-4ee0-9588-b00bd9000001 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:09:21.589977 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f1d05645-b30c-4ee0-9588-b00bd9000001 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:09:21.590405 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f1d05645-b30c-4ee0-9588-b00bd9000001 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:09:21.620035 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-f1d05645-b30c-4ee0-9588-b00bd9000001 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045167 Oct 20 06:09:21.620609 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 318/611] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:09:21 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 20 06:09:21.691096 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-ea8ba1fe-845a-494b-b231-90e3ef9ac24a tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:09:21.700191 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-ea8ba1fe-845a-494b-b231-90e3ef9ac24a tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:09:21.701646 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-ea8ba1fe-845a-494b-b231-90e3ef9ac24a tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:09:21.702783 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-ea8ba1fe-845a-494b-b231-90e3ef9ac24a tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1751 microversion: 2.20 time: 0.150298 Oct 20 06:09:21.703334 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 294/612] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:09:21 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1751 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:09:22.633058 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-5d129e8f-6b27-426d-914f-673e5158983a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:09:22.635927 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-5d129e8f-6b27-426d-914f-673e5158983a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:09:22.642301 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5d129e8f-6b27-426d-914f-673e5158983a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:09:22.642784 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5d129e8f-6b27-426d-914f-673e5158983a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:09:22.643234 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5d129e8f-6b27-426d-914f-673e5158983a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:09:22.643963 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5d129e8f-6b27-426d-914f-673e5158983a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:09:22.644419 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5d129e8f-6b27-426d-914f-673e5158983a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:09:22.644880 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5d129e8f-6b27-426d-914f-673e5158983a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:09:22.661100 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG dbcounter [-] [118861] Writing DB stats nova_cell1:SELECT=100 {{(pid=118861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:09:22.675090 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-5d129e8f-6b27-426d-914f-673e5158983a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046323 Oct 20 06:09:22.675646 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 319/613] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:09:22 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:09:22.728978 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-c6187687-ac64-498c-8e9c-48cc6de6e13c tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:09:22.729575 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-c6187687-ac64-498c-8e9c-48cc6de6e13c tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:09:22.735907 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c6187687-ac64-498c-8e9c-48cc6de6e13c tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:09:22.736383 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c6187687-ac64-498c-8e9c-48cc6de6e13c tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:09:22.736845 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c6187687-ac64-498c-8e9c-48cc6de6e13c tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:09:22.737526 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c6187687-ac64-498c-8e9c-48cc6de6e13c tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:09:22.737979 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c6187687-ac64-498c-8e9c-48cc6de6e13c tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:09:22.738396 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c6187687-ac64-498c-8e9c-48cc6de6e13c tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:09:22.866652 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-c6187687-ac64-498c-8e9c-48cc6de6e13c tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:09:22.875754 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-c6187687-ac64-498c-8e9c-48cc6de6e13c tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:09:22.877302 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-c6187687-ac64-498c-8e9c-48cc6de6e13c tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:09:22.878467 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-c6187687-ac64-498c-8e9c-48cc6de6e13c tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1751 microversion: 2.20 time: 0.153310 Oct 20 06:09:22.879025 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 295/614] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:09:22 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1751 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:09:23.687527 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-ef470a74-3460-4f5e-b55e-8f268b370e25 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:09:23.689686 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-ef470a74-3460-4f5e-b55e-8f268b370e25 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:09:23.695917 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ef470a74-3460-4f5e-b55e-8f268b370e25 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:09:23.696396 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ef470a74-3460-4f5e-b55e-8f268b370e25 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:09:23.697653 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ef470a74-3460-4f5e-b55e-8f268b370e25 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:09:23.698150 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ef470a74-3460-4f5e-b55e-8f268b370e25 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:09:23.698598 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ef470a74-3460-4f5e-b55e-8f268b370e25 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:09:23.699019 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ef470a74-3460-4f5e-b55e-8f268b370e25 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:09:23.727483 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-ef470a74-3460-4f5e-b55e-8f268b370e25 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043918 Oct 20 06:09:23.728061 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 320/615] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:09:23 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:09:23.903862 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-48c334d0-951c-4761-9161-fa5787be99e7 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:09:23.904471 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-48c334d0-951c-4761-9161-fa5787be99e7 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:09:23.910990 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-48c334d0-951c-4761-9161-fa5787be99e7 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:09:23.911472 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-48c334d0-951c-4761-9161-fa5787be99e7 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:09:23.911911 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-48c334d0-951c-4761-9161-fa5787be99e7 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:09:23.912599 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-48c334d0-951c-4761-9161-fa5787be99e7 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:09:23.913078 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-48c334d0-951c-4761-9161-fa5787be99e7 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:09:23.913505 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-48c334d0-951c-4761-9161-fa5787be99e7 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:09:24.041345 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-48c334d0-951c-4761-9161-fa5787be99e7 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:09:24.049646 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-48c334d0-951c-4761-9161-fa5787be99e7 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:09:24.051080 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-48c334d0-951c-4761-9161-fa5787be99e7 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:09:24.052222 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-48c334d0-951c-4761-9161-fa5787be99e7 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1751 microversion: 2.20 time: 0.152873 Oct 20 06:09:24.052790 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 296/616] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:09:23 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1751 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:09:24.739774 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-de253433-ef13-486e-8123-ecdbec54157c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:09:24.741972 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-de253433-ef13-486e-8123-ecdbec54157c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:09:24.748287 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-de253433-ef13-486e-8123-ecdbec54157c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:09:24.749064 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-de253433-ef13-486e-8123-ecdbec54157c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:09:24.749499 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-de253433-ef13-486e-8123-ecdbec54157c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:09:24.750178 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-de253433-ef13-486e-8123-ecdbec54157c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:09:24.750624 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-de253433-ef13-486e-8123-ecdbec54157c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:09:24.751040 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-de253433-ef13-486e-8123-ecdbec54157c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:09:24.779833 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-de253433-ef13-486e-8123-ecdbec54157c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044048 Oct 20 06:09:24.780372 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 321/617] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:09:24 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:09:25.078497 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-8a258b1b-806c-485f-ae07-bd9565ed0c6e tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:09:25.079010 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-8a258b1b-806c-485f-ae07-bd9565ed0c6e tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:09:25.085422 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-8a258b1b-806c-485f-ae07-bd9565ed0c6e tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:09:25.085905 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-8a258b1b-806c-485f-ae07-bd9565ed0c6e tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:09:25.086336 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-8a258b1b-806c-485f-ae07-bd9565ed0c6e tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:09:25.087022 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-8a258b1b-806c-485f-ae07-bd9565ed0c6e tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:09:25.087474 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-8a258b1b-806c-485f-ae07-bd9565ed0c6e tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:09:25.087896 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-8a258b1b-806c-485f-ae07-bd9565ed0c6e tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:09:25.219321 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-8a258b1b-806c-485f-ae07-bd9565ed0c6e tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:09:25.227641 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-8a258b1b-806c-485f-ae07-bd9565ed0c6e tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:09:25.229743 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-8a258b1b-806c-485f-ae07-bd9565ed0c6e tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:09:25.230885 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-8a258b1b-806c-485f-ae07-bd9565ed0c6e tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1751 microversion: 2.20 time: 0.156391 Oct 20 06:09:25.231433 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 297/618] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:09:25 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1751 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:09:25.792859 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-ca6be426-b48f-44f2-b6d9-555e489c7c86 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:09:25.795095 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-ca6be426-b48f-44f2-b6d9-555e489c7c86 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:09:25.801520 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ca6be426-b48f-44f2-b6d9-555e489c7c86 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:09:25.801995 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ca6be426-b48f-44f2-b6d9-555e489c7c86 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:09:25.802427 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ca6be426-b48f-44f2-b6d9-555e489c7c86 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:09:25.803110 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ca6be426-b48f-44f2-b6d9-555e489c7c86 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:09:25.803555 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ca6be426-b48f-44f2-b6d9-555e489c7c86 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:09:25.803970 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ca6be426-b48f-44f2-b6d9-555e489c7c86 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:09:25.833815 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-ca6be426-b48f-44f2-b6d9-555e489c7c86 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045464 Oct 20 06:09:25.834365 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 322/619] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:09:25 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 20 06:09:26.256834 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-964806b6-8b61-4a6f-929b-9283d3101f2e tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:09:26.257436 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-964806b6-8b61-4a6f-929b-9283d3101f2e tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:09:26.264640 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-964806b6-8b61-4a6f-929b-9283d3101f2e tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:09:26.265149 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-964806b6-8b61-4a6f-929b-9283d3101f2e tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:09:26.265584 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-964806b6-8b61-4a6f-929b-9283d3101f2e tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:09:26.266270 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-964806b6-8b61-4a6f-929b-9283d3101f2e tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:09:26.266724 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-964806b6-8b61-4a6f-929b-9283d3101f2e tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:09:26.267149 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-964806b6-8b61-4a6f-929b-9283d3101f2e tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:09:26.393541 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-964806b6-8b61-4a6f-929b-9283d3101f2e tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:09:26.402984 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-964806b6-8b61-4a6f-929b-9283d3101f2e tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:09:26.404429 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-964806b6-8b61-4a6f-929b-9283d3101f2e tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:09:26.405613 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-964806b6-8b61-4a6f-929b-9283d3101f2e tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1751 microversion: 2.20 time: 0.153068 Oct 20 06:09:26.406458 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 298/620] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:09:26 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1751 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:09:26.846374 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-28b3776a-e81e-4fc9-b4e9-eff10bd36f8a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:09:26.848541 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-28b3776a-e81e-4fc9-b4e9-eff10bd36f8a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:09:26.855525 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-28b3776a-e81e-4fc9-b4e9-eff10bd36f8a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:09:26.856012 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-28b3776a-e81e-4fc9-b4e9-eff10bd36f8a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:09:26.856450 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-28b3776a-e81e-4fc9-b4e9-eff10bd36f8a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:09:26.857178 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-28b3776a-e81e-4fc9-b4e9-eff10bd36f8a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:09:26.857638 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-28b3776a-e81e-4fc9-b4e9-eff10bd36f8a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:09:26.858064 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-28b3776a-e81e-4fc9-b4e9-eff10bd36f8a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:09:26.888026 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-28b3776a-e81e-4fc9-b4e9-eff10bd36f8a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045797 Oct 20 06:09:26.888572 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 323/621] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:09:26 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:09:27.432475 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-d9e32033-087a-4912-b230-a53463efd56d tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:09:27.433085 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-d9e32033-087a-4912-b230-a53463efd56d tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:09:27.439540 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-d9e32033-087a-4912-b230-a53463efd56d tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:09:27.440021 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-d9e32033-087a-4912-b230-a53463efd56d tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:09:27.440455 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-d9e32033-087a-4912-b230-a53463efd56d tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:09:27.441172 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-d9e32033-087a-4912-b230-a53463efd56d tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:09:27.441627 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-d9e32033-087a-4912-b230-a53463efd56d tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:09:27.442049 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-d9e32033-087a-4912-b230-a53463efd56d tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:09:27.575490 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-d9e32033-087a-4912-b230-a53463efd56d tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:09:27.584340 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-d9e32033-087a-4912-b230-a53463efd56d tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:09:27.585826 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-d9e32033-087a-4912-b230-a53463efd56d tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:09:27.586968 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-d9e32033-087a-4912-b230-a53463efd56d tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1751 microversion: 2.20 time: 0.159196 Oct 20 06:09:27.587887 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 299/622] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:09:27 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1751 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:09:27.901241 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-47f68c82-5d9b-4ee9-995c-3ff1a070567b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:09:27.903468 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-47f68c82-5d9b-4ee9-995c-3ff1a070567b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:09:27.909387 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-47f68c82-5d9b-4ee9-995c-3ff1a070567b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:09:27.909871 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-47f68c82-5d9b-4ee9-995c-3ff1a070567b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:09:27.910309 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-47f68c82-5d9b-4ee9-995c-3ff1a070567b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:09:27.910997 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-47f68c82-5d9b-4ee9-995c-3ff1a070567b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:09:27.911479 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-47f68c82-5d9b-4ee9-995c-3ff1a070567b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:09:27.911908 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-47f68c82-5d9b-4ee9-995c-3ff1a070567b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:09:27.941135 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-47f68c82-5d9b-4ee9-995c-3ff1a070567b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044858 Oct 20 06:09:27.941682 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 324/623] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:09:27 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:09:28.612636 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-b104de21-962c-4baa-87da-9da884c87449 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:09:28.613268 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-b104de21-962c-4baa-87da-9da884c87449 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:09:28.615656 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG dbcounter [-] [118860] Writing DB stats nova_api:SELECT=52 {{(pid=118860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:09:28.621587 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b104de21-962c-4baa-87da-9da884c87449 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:09:28.622070 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b104de21-962c-4baa-87da-9da884c87449 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:09:28.622500 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b104de21-962c-4baa-87da-9da884c87449 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:09:28.623192 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b104de21-962c-4baa-87da-9da884c87449 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:09:28.623665 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b104de21-962c-4baa-87da-9da884c87449 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:09:28.624069 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b104de21-962c-4baa-87da-9da884c87449 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:09:28.750818 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-b104de21-962c-4baa-87da-9da884c87449 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:09:28.760471 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-b104de21-962c-4baa-87da-9da884c87449 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:09:28.761956 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-b104de21-962c-4baa-87da-9da884c87449 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:09:28.763100 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-b104de21-962c-4baa-87da-9da884c87449 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1751 microversion: 2.20 time: 0.154290 Oct 20 06:09:28.763758 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 300/624] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:09:28 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1751 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:09:28.952821 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-af378d7d-458b-4ff7-933c-e073a7c693cd tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:09:28.955046 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-af378d7d-458b-4ff7-933c-e073a7c693cd tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:09:28.957399 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG dbcounter [-] [118861] Writing DB stats nova_api:SELECT=58 {{(pid=118861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:09:28.963348 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-af378d7d-458b-4ff7-933c-e073a7c693cd tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:09:28.963832 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-af378d7d-458b-4ff7-933c-e073a7c693cd tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:09:28.964267 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-af378d7d-458b-4ff7-933c-e073a7c693cd tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:09:28.964984 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-af378d7d-458b-4ff7-933c-e073a7c693cd tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:09:28.965435 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-af378d7d-458b-4ff7-933c-e073a7c693cd tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:09:28.965856 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-af378d7d-458b-4ff7-933c-e073a7c693cd tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:09:28.995543 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-af378d7d-458b-4ff7-933c-e073a7c693cd tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046676 Oct 20 06:09:28.996101 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 325/625] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:09:28 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:09:29.788134 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-de2f398c-e6a2-4ca4-9d15-65ba51ef224b tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:09:29.788761 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-de2f398c-e6a2-4ca4-9d15-65ba51ef224b tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:09:29.795691 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-de2f398c-e6a2-4ca4-9d15-65ba51ef224b tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:09:29.796177 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-de2f398c-e6a2-4ca4-9d15-65ba51ef224b tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:09:29.796621 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-de2f398c-e6a2-4ca4-9d15-65ba51ef224b tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:09:29.797347 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-de2f398c-e6a2-4ca4-9d15-65ba51ef224b tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:09:29.797802 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-de2f398c-e6a2-4ca4-9d15-65ba51ef224b tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:09:29.798406 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-de2f398c-e6a2-4ca4-9d15-65ba51ef224b tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:09:29.978217 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-de2f398c-e6a2-4ca4-9d15-65ba51ef224b tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:09:29.981635 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG dbcounter [-] [118860] Writing DB stats nova_cell1:SELECT=100 {{(pid=118860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:09:29.987576 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-de2f398c-e6a2-4ca4-9d15-65ba51ef224b tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:09:29.989029 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-de2f398c-e6a2-4ca4-9d15-65ba51ef224b tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:09:29.990173 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-de2f398c-e6a2-4ca4-9d15-65ba51ef224b tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1751 microversion: 2.20 time: 0.205892 Oct 20 06:09:29.990719 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 301/626] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:09:29 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1751 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:09:30.007856 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-50324905-84ac-48ab-8510-8d1433cc91f2 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:09:30.010719 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-50324905-84ac-48ab-8510-8d1433cc91f2 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:09:30.017080 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-50324905-84ac-48ab-8510-8d1433cc91f2 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:09:30.017563 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-50324905-84ac-48ab-8510-8d1433cc91f2 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:09:30.017998 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-50324905-84ac-48ab-8510-8d1433cc91f2 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:09:30.018681 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-50324905-84ac-48ab-8510-8d1433cc91f2 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:09:30.019139 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-50324905-84ac-48ab-8510-8d1433cc91f2 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:09:30.019562 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-50324905-84ac-48ab-8510-8d1433cc91f2 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:09:30.049856 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-50324905-84ac-48ab-8510-8d1433cc91f2 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046214 Oct 20 06:09:30.050416 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 326/627] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:09:30 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:09:31.017470 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-3e9879a4-450b-4dfd-ae7f-6f135b5de94c tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:09:31.018074 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-3e9879a4-450b-4dfd-ae7f-6f135b5de94c tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:09:31.024379 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3e9879a4-450b-4dfd-ae7f-6f135b5de94c tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:09:31.025165 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3e9879a4-450b-4dfd-ae7f-6f135b5de94c tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:09:31.025640 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3e9879a4-450b-4dfd-ae7f-6f135b5de94c tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:09:31.026332 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3e9879a4-450b-4dfd-ae7f-6f135b5de94c tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:09:31.026787 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3e9879a4-450b-4dfd-ae7f-6f135b5de94c tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:09:31.027212 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3e9879a4-450b-4dfd-ae7f-6f135b5de94c tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:09:31.061924 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-2cc8e683-7fd6-4407-8248-c0f09009c95f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:09:31.064126 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-2cc8e683-7fd6-4407-8248-c0f09009c95f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:09:31.070592 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-2cc8e683-7fd6-4407-8248-c0f09009c95f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:09:31.071073 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-2cc8e683-7fd6-4407-8248-c0f09009c95f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:09:31.071818 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-2cc8e683-7fd6-4407-8248-c0f09009c95f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:09:31.072606 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-2cc8e683-7fd6-4407-8248-c0f09009c95f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:09:31.073082 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-2cc8e683-7fd6-4407-8248-c0f09009c95f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:09:31.073502 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-2cc8e683-7fd6-4407-8248-c0f09009c95f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:09:31.102466 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-2cc8e683-7fd6-4407-8248-c0f09009c95f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044393 Oct 20 06:09:31.103514 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 327/628] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:09:31 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 20 06:09:31.158013 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-3e9879a4-450b-4dfd-ae7f-6f135b5de94c tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:09:31.167345 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-3e9879a4-450b-4dfd-ae7f-6f135b5de94c tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:09:31.168790 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-3e9879a4-450b-4dfd-ae7f-6f135b5de94c tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:09:31.170101 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-3e9879a4-450b-4dfd-ae7f-6f135b5de94c tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1751 microversion: 2.20 time: 0.156836 Oct 20 06:09:31.170650 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 302/629] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:09:31 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1751 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:09:32.195204 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-42731568-2949-4e28-a1e0-868fdc6cf502 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:09:32.195824 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-42731568-2949-4e28-a1e0-868fdc6cf502 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:09:32.203221 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-42731568-2949-4e28-a1e0-868fdc6cf502 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:09:32.203704 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-42731568-2949-4e28-a1e0-868fdc6cf502 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:09:32.204142 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-42731568-2949-4e28-a1e0-868fdc6cf502 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:09:32.204866 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-42731568-2949-4e28-a1e0-868fdc6cf502 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:09:32.205325 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-42731568-2949-4e28-a1e0-868fdc6cf502 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:09:32.205750 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-42731568-2949-4e28-a1e0-868fdc6cf502 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:09:32.218891 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-ae05ef6b-e660-4d2a-b995-2b45d7ef8fef tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:09:32.221120 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-ae05ef6b-e660-4d2a-b995-2b45d7ef8fef tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:09:32.226943 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ae05ef6b-e660-4d2a-b995-2b45d7ef8fef tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:09:32.227989 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ae05ef6b-e660-4d2a-b995-2b45d7ef8fef tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:09:32.228365 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ae05ef6b-e660-4d2a-b995-2b45d7ef8fef tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:09:32.229077 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ae05ef6b-e660-4d2a-b995-2b45d7ef8fef tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:09:32.229523 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ae05ef6b-e660-4d2a-b995-2b45d7ef8fef tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:09:32.229937 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ae05ef6b-e660-4d2a-b995-2b45d7ef8fef tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:09:32.260187 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-ae05ef6b-e660-4d2a-b995-2b45d7ef8fef tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.148704 Oct 20 06:09:32.260758 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 328/630] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:09:32 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:09:32.335979 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-42731568-2949-4e28-a1e0-868fdc6cf502 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:09:32.344501 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-42731568-2949-4e28-a1e0-868fdc6cf502 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:09:32.345958 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-42731568-2949-4e28-a1e0-868fdc6cf502 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:09:32.347101 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-42731568-2949-4e28-a1e0-868fdc6cf502 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1751 microversion: 2.20 time: 0.155792 Oct 20 06:09:32.347646 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 303/631] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:09:32 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1751 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 20 06:09:33.272621 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-50c63075-ce7a-4ac5-aa63-d88e770c3e0a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:09:33.275588 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-50c63075-ce7a-4ac5-aa63-d88e770c3e0a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:09:33.281973 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-50c63075-ce7a-4ac5-aa63-d88e770c3e0a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:09:33.282452 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-50c63075-ce7a-4ac5-aa63-d88e770c3e0a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:09:33.282886 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-50c63075-ce7a-4ac5-aa63-d88e770c3e0a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:09:33.283566 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-50c63075-ce7a-4ac5-aa63-d88e770c3e0a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:09:33.284013 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-50c63075-ce7a-4ac5-aa63-d88e770c3e0a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:09:33.284427 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-50c63075-ce7a-4ac5-aa63-d88e770c3e0a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:09:33.313241 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-50c63075-ce7a-4ac5-aa63-d88e770c3e0a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044452 Oct 20 06:09:33.313796 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 329/632] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:09:33 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:09:33.372850 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-1016d924-1d7a-478c-bb02-8c898b91e11f tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:09:33.373449 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-1016d924-1d7a-478c-bb02-8c898b91e11f tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:09:33.379673 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1016d924-1d7a-478c-bb02-8c898b91e11f tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:09:33.380146 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1016d924-1d7a-478c-bb02-8c898b91e11f tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:09:33.380578 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1016d924-1d7a-478c-bb02-8c898b91e11f tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:09:33.381538 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1016d924-1d7a-478c-bb02-8c898b91e11f tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:09:33.381985 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1016d924-1d7a-478c-bb02-8c898b91e11f tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:09:33.382402 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1016d924-1d7a-478c-bb02-8c898b91e11f tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:09:33.510031 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-1016d924-1d7a-478c-bb02-8c898b91e11f tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:09:33.518441 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-1016d924-1d7a-478c-bb02-8c898b91e11f tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:09:33.519864 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-1016d924-1d7a-478c-bb02-8c898b91e11f tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:09:33.521028 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-1016d924-1d7a-478c-bb02-8c898b91e11f tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1751 microversion: 2.20 time: 0.152045 Oct 20 06:09:33.521579 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 304/633] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:09:33 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1751 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:09:34.325409 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-3d2ccfbe-c2be-43de-bf0a-11d32a8edc7c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:09:34.327672 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-3d2ccfbe-c2be-43de-bf0a-11d32a8edc7c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:09:34.334158 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-3d2ccfbe-c2be-43de-bf0a-11d32a8edc7c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:09:34.334643 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-3d2ccfbe-c2be-43de-bf0a-11d32a8edc7c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:09:34.335124 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-3d2ccfbe-c2be-43de-bf0a-11d32a8edc7c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:09:34.335819 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-3d2ccfbe-c2be-43de-bf0a-11d32a8edc7c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:09:34.336276 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-3d2ccfbe-c2be-43de-bf0a-11d32a8edc7c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:09:34.336715 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-3d2ccfbe-c2be-43de-bf0a-11d32a8edc7c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:09:34.365044 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-3d2ccfbe-c2be-43de-bf0a-11d32a8edc7c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044045 Oct 20 06:09:34.365594 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 330/634] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:09:34 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:09:34.546651 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-65d47fc1-1207-4f09-b046-0d8d1faf9446 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:09:34.547247 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-65d47fc1-1207-4f09-b046-0d8d1faf9446 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:09:34.553966 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-65d47fc1-1207-4f09-b046-0d8d1faf9446 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:09:34.554393 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-65d47fc1-1207-4f09-b046-0d8d1faf9446 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:09:34.554824 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-65d47fc1-1207-4f09-b046-0d8d1faf9446 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:09:34.556101 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-65d47fc1-1207-4f09-b046-0d8d1faf9446 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:09:34.556554 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-65d47fc1-1207-4f09-b046-0d8d1faf9446 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:09:34.557023 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-65d47fc1-1207-4f09-b046-0d8d1faf9446 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:09:34.680043 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-65d47fc1-1207-4f09-b046-0d8d1faf9446 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:09:34.689172 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-65d47fc1-1207-4f09-b046-0d8d1faf9446 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:09:34.690639 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-65d47fc1-1207-4f09-b046-0d8d1faf9446 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:09:34.691779 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-65d47fc1-1207-4f09-b046-0d8d1faf9446 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1751 microversion: 2.20 time: 0.149054 Oct 20 06:09:34.692326 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 305/635] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:09:34 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1751 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:09:35.378179 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-284508da-0a02-4bf0-80f6-461eaf4c177b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:09:35.380461 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-284508da-0a02-4bf0-80f6-461eaf4c177b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:09:35.387920 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-284508da-0a02-4bf0-80f6-461eaf4c177b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:09:35.388403 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-284508da-0a02-4bf0-80f6-461eaf4c177b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:09:35.388897 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-284508da-0a02-4bf0-80f6-461eaf4c177b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:09:35.389598 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-284508da-0a02-4bf0-80f6-461eaf4c177b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:09:35.390052 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-284508da-0a02-4bf0-80f6-461eaf4c177b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:09:35.390476 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-284508da-0a02-4bf0-80f6-461eaf4c177b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:09:35.420782 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-284508da-0a02-4bf0-80f6-461eaf4c177b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046504 Oct 20 06:09:35.421342 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 331/636] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:09:35 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:09:35.716781 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-67b59f50-52f3-456c-87ff-6cba7619c825 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:09:35.717368 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-67b59f50-52f3-456c-87ff-6cba7619c825 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:09:35.719574 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 20 06:09:35.719726 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: Thu Oct 20 06:09:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d (ip 10.222.0.20) !!! Oct 20 06:09:35.726337 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-67b59f50-52f3-456c-87ff-6cba7619c825 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:09:35.726827 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-67b59f50-52f3-456c-87ff-6cba7619c825 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:09:35.727263 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-67b59f50-52f3-456c-87ff-6cba7619c825 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:09:35.728053 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-67b59f50-52f3-456c-87ff-6cba7619c825 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:09:35.728502 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-67b59f50-52f3-456c-87ff-6cba7619c825 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:09:35.728944 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-67b59f50-52f3-456c-87ff-6cba7619c825 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:09:35.854615 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-67b59f50-52f3-456c-87ff-6cba7619c825 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:09:35.863365 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-67b59f50-52f3-456c-87ff-6cba7619c825 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:09:35.864991 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-67b59f50-52f3-456c-87ff-6cba7619c825 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:09:35.866157 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-67b59f50-52f3-456c-87ff-6cba7619c825 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1751 microversion: 2.20 time: 0.153403 Oct 20 06:09:35.866704 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 306/637] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:09:35 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1751 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:09:36.433088 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-3e953663-5d52-4112-a874-e15da8450c9e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:09:36.435280 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-3e953663-5d52-4112-a874-e15da8450c9e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:09:36.441613 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-3e953663-5d52-4112-a874-e15da8450c9e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:09:36.442095 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-3e953663-5d52-4112-a874-e15da8450c9e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:09:36.442532 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-3e953663-5d52-4112-a874-e15da8450c9e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:09:36.443223 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-3e953663-5d52-4112-a874-e15da8450c9e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:09:36.443678 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-3e953663-5d52-4112-a874-e15da8450c9e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:09:36.444109 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-3e953663-5d52-4112-a874-e15da8450c9e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:09:36.473654 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-3e953663-5d52-4112-a874-e15da8450c9e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044549 Oct 20 06:09:36.474227 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 332/638] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:09:36 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:09:36.893344 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-fde8b4ce-f20e-456e-911e-5ba3834e9f5e tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:09:36.893946 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-fde8b4ce-f20e-456e-911e-5ba3834e9f5e tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:09:36.901005 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-fde8b4ce-f20e-456e-911e-5ba3834e9f5e tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:09:36.901478 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-fde8b4ce-f20e-456e-911e-5ba3834e9f5e tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:09:36.901903 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-fde8b4ce-f20e-456e-911e-5ba3834e9f5e tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:09:36.902581 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-fde8b4ce-f20e-456e-911e-5ba3834e9f5e tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:09:36.903026 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-fde8b4ce-f20e-456e-911e-5ba3834e9f5e tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:09:36.903476 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-fde8b4ce-f20e-456e-911e-5ba3834e9f5e tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:09:37.035483 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-fde8b4ce-f20e-456e-911e-5ba3834e9f5e tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:09:37.045489 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-fde8b4ce-f20e-456e-911e-5ba3834e9f5e tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:09:37.046918 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-fde8b4ce-f20e-456e-911e-5ba3834e9f5e tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:09:37.048070 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-fde8b4ce-f20e-456e-911e-5ba3834e9f5e tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1751 microversion: 2.20 time: 0.158705 Oct 20 06:09:37.054906 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 307/639] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:09:36 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1751 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:09:37.487039 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-7144bf84-9133-459f-beb0-7e605a66ac0c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:09:37.489192 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-7144bf84-9133-459f-beb0-7e605a66ac0c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:09:37.496112 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7144bf84-9133-459f-beb0-7e605a66ac0c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:09:37.496589 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7144bf84-9133-459f-beb0-7e605a66ac0c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:09:37.497057 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7144bf84-9133-459f-beb0-7e605a66ac0c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:09:37.497735 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7144bf84-9133-459f-beb0-7e605a66ac0c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:09:37.498181 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7144bf84-9133-459f-beb0-7e605a66ac0c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:09:37.498600 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7144bf84-9133-459f-beb0-7e605a66ac0c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:09:37.527032 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-7144bf84-9133-459f-beb0-7e605a66ac0c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043968 Oct 20 06:09:37.527579 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 333/640] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:09:37 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:09:38.081151 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-5ed5101e-e1df-42b5-baaf-945092a0676e tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:09:38.081151 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-5ed5101e-e1df-42b5-baaf-945092a0676e tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:09:38.081686 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5ed5101e-e1df-42b5-baaf-945092a0676e tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:09:38.082064 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5ed5101e-e1df-42b5-baaf-945092a0676e tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:09:38.082745 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5ed5101e-e1df-42b5-baaf-945092a0676e tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:09:38.083665 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5ed5101e-e1df-42b5-baaf-945092a0676e tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:09:38.084124 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5ed5101e-e1df-42b5-baaf-945092a0676e tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:09:38.084548 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5ed5101e-e1df-42b5-baaf-945092a0676e tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:09:38.305886 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-5ed5101e-e1df-42b5-baaf-945092a0676e tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:09:38.315026 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-5ed5101e-e1df-42b5-baaf-945092a0676e tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:09:38.316512 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-5ed5101e-e1df-42b5-baaf-945092a0676e tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:09:38.317740 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-5ed5101e-e1df-42b5-baaf-945092a0676e tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1751 microversion: 2.20 time: 0.249268 Oct 20 06:09:38.318296 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 308/641] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:09:38 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1751 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:09:38.539543 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-c50cd03e-a662-4cf8-b958-7868f1ce1d4d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:09:38.541720 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-c50cd03e-a662-4cf8-b958-7868f1ce1d4d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:09:38.548013 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c50cd03e-a662-4cf8-b958-7868f1ce1d4d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:09:38.548495 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c50cd03e-a662-4cf8-b958-7868f1ce1d4d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:09:38.548967 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c50cd03e-a662-4cf8-b958-7868f1ce1d4d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:09:38.549677 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c50cd03e-a662-4cf8-b958-7868f1ce1d4d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:09:38.550130 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c50cd03e-a662-4cf8-b958-7868f1ce1d4d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:09:38.550559 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c50cd03e-a662-4cf8-b958-7868f1ce1d4d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:09:38.581414 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-c50cd03e-a662-4cf8-b958-7868f1ce1d4d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045811 Oct 20 06:09:38.581985 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 334/642] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:09:38 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:09:39.343795 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-5d5307ce-ecb8-45cf-b5dc-f745167a6611 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:09:39.344464 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-5d5307ce-ecb8-45cf-b5dc-f745167a6611 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:09:39.350854 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5d5307ce-ecb8-45cf-b5dc-f745167a6611 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:09:39.351334 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5d5307ce-ecb8-45cf-b5dc-f745167a6611 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:09:39.351768 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5d5307ce-ecb8-45cf-b5dc-f745167a6611 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:09:39.352682 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5d5307ce-ecb8-45cf-b5dc-f745167a6611 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:09:39.353252 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5d5307ce-ecb8-45cf-b5dc-f745167a6611 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:09:39.353679 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5d5307ce-ecb8-45cf-b5dc-f745167a6611 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:09:39.479321 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-5d5307ce-ecb8-45cf-b5dc-f745167a6611 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:09:39.487757 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-5d5307ce-ecb8-45cf-b5dc-f745167a6611 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:09:39.489241 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-5d5307ce-ecb8-45cf-b5dc-f745167a6611 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:09:39.490426 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-5d5307ce-ecb8-45cf-b5dc-f745167a6611 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1751 microversion: 2.20 time: 0.150559 Oct 20 06:09:39.490978 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 309/643] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:09:39 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1751 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:09:39.594023 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-0749b7ee-c171-47dc-8905-308a23f90c24 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:09:39.596126 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-0749b7ee-c171-47dc-8905-308a23f90c24 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:09:39.603414 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-0749b7ee-c171-47dc-8905-308a23f90c24 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:09:39.603917 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-0749b7ee-c171-47dc-8905-308a23f90c24 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:09:39.604361 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-0749b7ee-c171-47dc-8905-308a23f90c24 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:09:39.605084 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-0749b7ee-c171-47dc-8905-308a23f90c24 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:09:39.605539 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-0749b7ee-c171-47dc-8905-308a23f90c24 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:09:39.605966 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-0749b7ee-c171-47dc-8905-308a23f90c24 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:09:39.635188 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-0749b7ee-c171-47dc-8905-308a23f90c24 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045179 Oct 20 06:09:39.635736 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 335/644] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:09:39 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:09:40.517569 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-c685919e-bf77-437f-bd22-1dae29d23ff1 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:09:40.518192 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-c685919e-bf77-437f-bd22-1dae29d23ff1 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:09:40.524515 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c685919e-bf77-437f-bd22-1dae29d23ff1 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:09:40.525032 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c685919e-bf77-437f-bd22-1dae29d23ff1 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:09:40.525465 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c685919e-bf77-437f-bd22-1dae29d23ff1 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:09:40.526146 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c685919e-bf77-437f-bd22-1dae29d23ff1 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:09:40.526595 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c685919e-bf77-437f-bd22-1dae29d23ff1 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:09:40.527011 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c685919e-bf77-437f-bd22-1dae29d23ff1 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:09:40.647750 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-8e8611bc-36ce-495d-a01e-e9a4625b35f2 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:09:40.649786 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-c685919e-bf77-437f-bd22-1dae29d23ff1 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:09:40.650390 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-8e8611bc-36ce-495d-a01e-e9a4625b35f2 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:09:40.656656 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-8e8611bc-36ce-495d-a01e-e9a4625b35f2 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:09:40.657174 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-8e8611bc-36ce-495d-a01e-e9a4625b35f2 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:09:40.657640 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-8e8611bc-36ce-495d-a01e-e9a4625b35f2 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:09:40.658339 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-8e8611bc-36ce-495d-a01e-e9a4625b35f2 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:09:40.658455 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-c685919e-bf77-437f-bd22-1dae29d23ff1 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:09:40.658789 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-8e8611bc-36ce-495d-a01e-e9a4625b35f2 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:09:40.659219 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-8e8611bc-36ce-495d-a01e-e9a4625b35f2 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:09:40.659754 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-c685919e-bf77-437f-bd22-1dae29d23ff1 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:09:40.660923 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-c685919e-bf77-437f-bd22-1dae29d23ff1 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1751 microversion: 2.20 time: 0.147236 Oct 20 06:09:40.661472 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 310/645] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:09:40 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1751 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:09:40.662835 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG dbcounter [-] [118861] Writing DB stats nova_cell1:SELECT=100 {{(pid=118861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:09:40.690561 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-8e8611bc-36ce-495d-a01e-e9a4625b35f2 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047003 Oct 20 06:09:40.691110 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 336/646] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:09:40 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 20 06:09:41.686639 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-cc53a253-d558-44cb-be21-9c7d1ba55122 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:09:41.687237 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-cc53a253-d558-44cb-be21-9c7d1ba55122 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:09:41.693621 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-cc53a253-d558-44cb-be21-9c7d1ba55122 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:09:41.694098 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-cc53a253-d558-44cb-be21-9c7d1ba55122 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:09:41.694530 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-cc53a253-d558-44cb-be21-9c7d1ba55122 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:09:41.695215 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-cc53a253-d558-44cb-be21-9c7d1ba55122 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:09:41.695664 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-cc53a253-d558-44cb-be21-9c7d1ba55122 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:09:41.696418 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-cc53a253-d558-44cb-be21-9c7d1ba55122 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:09:41.703146 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-ad294fc5-db22-4eff-9488-3a1e8c5cc29e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:09:41.705325 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-ad294fc5-db22-4eff-9488-3a1e8c5cc29e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:09:41.712428 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ad294fc5-db22-4eff-9488-3a1e8c5cc29e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:09:41.712621 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ad294fc5-db22-4eff-9488-3a1e8c5cc29e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:09:41.713069 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ad294fc5-db22-4eff-9488-3a1e8c5cc29e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:09:41.713772 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ad294fc5-db22-4eff-9488-3a1e8c5cc29e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:09:41.714225 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ad294fc5-db22-4eff-9488-3a1e8c5cc29e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:09:41.714649 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ad294fc5-db22-4eff-9488-3a1e8c5cc29e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:09:41.744234 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-ad294fc5-db22-4eff-9488-3a1e8c5cc29e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044955 Oct 20 06:09:41.748737 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 337/647] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:09:41 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 20 06:09:41.824160 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-cc53a253-d558-44cb-be21-9c7d1ba55122 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:09:41.832513 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-cc53a253-d558-44cb-be21-9c7d1ba55122 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:09:41.833960 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-cc53a253-d558-44cb-be21-9c7d1ba55122 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:09:41.835107 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-cc53a253-d558-44cb-be21-9c7d1ba55122 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1751 microversion: 2.20 time: 0.152531 Oct 20 06:09:41.835660 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 311/648] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:09:41 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1751 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:09:42.757015 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-5580f5ad-c221-46c4-b36c-34d5df0f29d8 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:09:42.759256 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-5580f5ad-c221-46c4-b36c-34d5df0f29d8 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:09:42.765544 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5580f5ad-c221-46c4-b36c-34d5df0f29d8 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:09:42.766017 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5580f5ad-c221-46c4-b36c-34d5df0f29d8 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:09:42.766453 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5580f5ad-c221-46c4-b36c-34d5df0f29d8 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:09:42.767130 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5580f5ad-c221-46c4-b36c-34d5df0f29d8 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:09:42.767575 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5580f5ad-c221-46c4-b36c-34d5df0f29d8 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:09:42.767991 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5580f5ad-c221-46c4-b36c-34d5df0f29d8 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:09:42.796639 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-5580f5ad-c221-46c4-b36c-34d5df0f29d8 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043986 Oct 20 06:09:42.797218 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 338/649] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:09:42 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:09:42.962798 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-dff1a8ab-fe18-4f28-ae08-459bf66ddb8e tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:09:42.963405 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-dff1a8ab-fe18-4f28-ae08-459bf66ddb8e tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:09:42.969368 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-dff1a8ab-fe18-4f28-ae08-459bf66ddb8e tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:09:42.969850 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-dff1a8ab-fe18-4f28-ae08-459bf66ddb8e tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:09:42.970286 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-dff1a8ab-fe18-4f28-ae08-459bf66ddb8e tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:09:42.970974 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-dff1a8ab-fe18-4f28-ae08-459bf66ddb8e tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:09:42.971425 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-dff1a8ab-fe18-4f28-ae08-459bf66ddb8e tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:09:42.971849 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-dff1a8ab-fe18-4f28-ae08-459bf66ddb8e tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:09:43.097535 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-dff1a8ab-fe18-4f28-ae08-459bf66ddb8e tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:09:43.106647 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-dff1a8ab-fe18-4f28-ae08-459bf66ddb8e tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:09:43.108081 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-dff1a8ab-fe18-4f28-ae08-459bf66ddb8e tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:09:43.109271 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-dff1a8ab-fe18-4f28-ae08-459bf66ddb8e tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1751 microversion: 2.20 time: 0.251861 Oct 20 06:09:43.109828 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 312/650] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:09:42 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1751 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:09:43.809073 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-3950d43a-841a-4909-9f4b-b91325e1c18c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:09:43.811121 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-3950d43a-841a-4909-9f4b-b91325e1c18c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:09:43.818042 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-3950d43a-841a-4909-9f4b-b91325e1c18c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:09:43.818528 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-3950d43a-841a-4909-9f4b-b91325e1c18c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:09:43.818966 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-3950d43a-841a-4909-9f4b-b91325e1c18c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:09:43.819653 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-3950d43a-841a-4909-9f4b-b91325e1c18c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:09:43.820104 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-3950d43a-841a-4909-9f4b-b91325e1c18c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:09:43.821074 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-3950d43a-841a-4909-9f4b-b91325e1c18c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:09:43.850074 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-3950d43a-841a-4909-9f4b-b91325e1c18c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045176 Oct 20 06:09:43.850618 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 339/651] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:09:43 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:09:44.137031 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-e99a2cce-dfad-46bc-8574-a547658cc0da tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:09:44.137636 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-e99a2cce-dfad-46bc-8574-a547658cc0da tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:09:44.144028 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e99a2cce-dfad-46bc-8574-a547658cc0da tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:09:44.144503 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e99a2cce-dfad-46bc-8574-a547658cc0da tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:09:44.144975 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e99a2cce-dfad-46bc-8574-a547658cc0da tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:09:44.145659 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e99a2cce-dfad-46bc-8574-a547658cc0da tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:09:44.146107 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e99a2cce-dfad-46bc-8574-a547658cc0da tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:09:44.146526 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e99a2cce-dfad-46bc-8574-a547658cc0da tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:09:44.279176 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-e99a2cce-dfad-46bc-8574-a547658cc0da tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:09:44.287650 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-e99a2cce-dfad-46bc-8574-a547658cc0da tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:09:44.289095 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-e99a2cce-dfad-46bc-8574-a547658cc0da tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:09:44.290725 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-e99a2cce-dfad-46bc-8574-a547658cc0da tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1751 microversion: 2.20 time: 0.158319 Oct 20 06:09:44.291268 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 313/652] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:09:44 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1751 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:09:44.862579 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-3138a529-64a4-4775-ad07-71ca2699f64c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:09:44.864627 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-3138a529-64a4-4775-ad07-71ca2699f64c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:09:44.871275 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-3138a529-64a4-4775-ad07-71ca2699f64c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:09:44.871752 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-3138a529-64a4-4775-ad07-71ca2699f64c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:09:44.872183 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-3138a529-64a4-4775-ad07-71ca2699f64c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:09:44.872904 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-3138a529-64a4-4775-ad07-71ca2699f64c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:09:44.873354 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-3138a529-64a4-4775-ad07-71ca2699f64c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:09:44.873767 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-3138a529-64a4-4775-ad07-71ca2699f64c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:09:44.903222 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-3138a529-64a4-4775-ad07-71ca2699f64c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044666 Oct 20 06:09:44.903769 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 340/653] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:09:44 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:09:45.316195 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-3c91ad35-723b-4e2c-92ff-f04d6611f708 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:09:45.316828 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-3c91ad35-723b-4e2c-92ff-f04d6611f708 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:09:45.323696 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3c91ad35-723b-4e2c-92ff-f04d6611f708 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:09:45.324176 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3c91ad35-723b-4e2c-92ff-f04d6611f708 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:09:45.324610 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3c91ad35-723b-4e2c-92ff-f04d6611f708 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:09:45.325326 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3c91ad35-723b-4e2c-92ff-f04d6611f708 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:09:45.325781 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3c91ad35-723b-4e2c-92ff-f04d6611f708 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:09:45.326207 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3c91ad35-723b-4e2c-92ff-f04d6611f708 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:09:45.451665 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-3c91ad35-723b-4e2c-92ff-f04d6611f708 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:09:45.460273 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-3c91ad35-723b-4e2c-92ff-f04d6611f708 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:09:45.462445 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-3c91ad35-723b-4e2c-92ff-f04d6611f708 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:09:45.463605 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-3c91ad35-723b-4e2c-92ff-f04d6611f708 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1751 microversion: 2.20 time: 0.151473 Oct 20 06:09:45.464168 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 314/654] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:09:45 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1751 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:09:45.915619 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-f9643544-cbed-4966-8cab-60971baa1156 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:09:45.917951 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-f9643544-cbed-4966-8cab-60971baa1156 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:09:45.924299 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f9643544-cbed-4966-8cab-60971baa1156 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:09:45.924824 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f9643544-cbed-4966-8cab-60971baa1156 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:09:45.925262 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f9643544-cbed-4966-8cab-60971baa1156 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:09:45.925950 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f9643544-cbed-4966-8cab-60971baa1156 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:09:45.926402 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f9643544-cbed-4966-8cab-60971baa1156 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:09:45.926856 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f9643544-cbed-4966-8cab-60971baa1156 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:09:45.955934 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-f9643544-cbed-4966-8cab-60971baa1156 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044411 Oct 20 06:09:45.956484 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 341/655] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:09:45 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:09:46.492237 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-8fcc2101-f2d2-4ed5-83bf-cf4350e725fd tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:09:46.493473 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-8fcc2101-f2d2-4ed5-83bf-cf4350e725fd tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:09:46.499897 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-8fcc2101-f2d2-4ed5-83bf-cf4350e725fd tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:09:46.500378 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-8fcc2101-f2d2-4ed5-83bf-cf4350e725fd tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:09:46.500847 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-8fcc2101-f2d2-4ed5-83bf-cf4350e725fd tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:09:46.501538 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-8fcc2101-f2d2-4ed5-83bf-cf4350e725fd tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:09:46.502216 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-8fcc2101-f2d2-4ed5-83bf-cf4350e725fd tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:09:46.502398 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-8fcc2101-f2d2-4ed5-83bf-cf4350e725fd tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:09:46.642669 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-8fcc2101-f2d2-4ed5-83bf-cf4350e725fd tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:09:46.647334 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-8fcc2101-f2d2-4ed5-83bf-cf4350e725fd tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:09:46.649083 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-8fcc2101-f2d2-4ed5-83bf-cf4350e725fd tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:09:46.650252 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-8fcc2101-f2d2-4ed5-83bf-cf4350e725fd tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1751 microversion: 2.20 time: 0.161867 Oct 20 06:09:46.650801 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 315/656] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:09:46 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1751 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:09:46.968305 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-efbc055a-e09b-48e2-9391-b742d61b04f1 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:09:46.970440 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-efbc055a-e09b-48e2-9391-b742d61b04f1 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:09:46.976766 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-efbc055a-e09b-48e2-9391-b742d61b04f1 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:09:46.977248 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-efbc055a-e09b-48e2-9391-b742d61b04f1 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:09:46.977679 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-efbc055a-e09b-48e2-9391-b742d61b04f1 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:09:46.978355 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-efbc055a-e09b-48e2-9391-b742d61b04f1 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:09:46.978801 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-efbc055a-e09b-48e2-9391-b742d61b04f1 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:09:46.979228 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-efbc055a-e09b-48e2-9391-b742d61b04f1 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:09:47.009356 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-efbc055a-e09b-48e2-9391-b742d61b04f1 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044977 Oct 20 06:09:47.010231 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 342/657] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:09:46 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:09:47.675730 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-8567a54d-0549-42af-b124-a91af537a728 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:09:47.676340 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-8567a54d-0549-42af-b124-a91af537a728 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:09:47.683220 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-8567a54d-0549-42af-b124-a91af537a728 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:09:47.683708 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-8567a54d-0549-42af-b124-a91af537a728 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:09:47.684141 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-8567a54d-0549-42af-b124-a91af537a728 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:09:47.684862 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-8567a54d-0549-42af-b124-a91af537a728 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:09:47.685311 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-8567a54d-0549-42af-b124-a91af537a728 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:09:47.685734 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-8567a54d-0549-42af-b124-a91af537a728 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:09:48.021721 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-20c386aa-8964-463b-af6f-6ff58a33ff10 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:09:48.024594 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-20c386aa-8964-463b-af6f-6ff58a33ff10 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:09:48.030968 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-20c386aa-8964-463b-af6f-6ff58a33ff10 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:09:48.031456 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-20c386aa-8964-463b-af6f-6ff58a33ff10 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:09:48.031898 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-20c386aa-8964-463b-af6f-6ff58a33ff10 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:09:48.032596 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-20c386aa-8964-463b-af6f-6ff58a33ff10 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:09:48.033081 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-20c386aa-8964-463b-af6f-6ff58a33ff10 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:09:48.033514 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-20c386aa-8964-463b-af6f-6ff58a33ff10 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:09:48.048346 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-8567a54d-0549-42af-b124-a91af537a728 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:09:48.056873 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-8567a54d-0549-42af-b124-a91af537a728 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:09:48.058290 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-8567a54d-0549-42af-b124-a91af537a728 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:09:48.059430 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-8567a54d-0549-42af-b124-a91af537a728 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1751 microversion: 2.20 time: 0.387567 Oct 20 06:09:48.060007 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 316/658] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:09:47 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1751 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:09:48.063734 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-20c386aa-8964-463b-af6f-6ff58a33ff10 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045924 Oct 20 06:09:48.064290 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 343/659] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:09:48 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 20 06:09:49.076005 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-93d0cbea-a824-49a8-acf5-5b7f49532881 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:09:49.078377 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-93d0cbea-a824-49a8-acf5-5b7f49532881 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:09:49.084818 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-93d0cbea-a824-49a8-acf5-5b7f49532881 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:09:49.085294 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-93d0cbea-a824-49a8-acf5-5b7f49532881 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:09:49.085699 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-b7f1d1c6-4af3-4a48-9e58-2c5d085a9e97 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:09:49.086674 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-93d0cbea-a824-49a8-acf5-5b7f49532881 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:09:49.087017 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-93d0cbea-a824-49a8-acf5-5b7f49532881 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:09:49.087164 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-b7f1d1c6-4af3-4a48-9e58-2c5d085a9e97 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:09:49.087575 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-93d0cbea-a824-49a8-acf5-5b7f49532881 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:09:49.088001 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-93d0cbea-a824-49a8-acf5-5b7f49532881 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:09:49.093297 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b7f1d1c6-4af3-4a48-9e58-2c5d085a9e97 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:09:49.093777 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b7f1d1c6-4af3-4a48-9e58-2c5d085a9e97 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:09:49.094213 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b7f1d1c6-4af3-4a48-9e58-2c5d085a9e97 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:09:49.094905 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b7f1d1c6-4af3-4a48-9e58-2c5d085a9e97 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:09:49.095356 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b7f1d1c6-4af3-4a48-9e58-2c5d085a9e97 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:09:49.095780 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b7f1d1c6-4af3-4a48-9e58-2c5d085a9e97 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:09:49.116962 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-93d0cbea-a824-49a8-acf5-5b7f49532881 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044865 Oct 20 06:09:49.118228 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 317/660] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:09:49 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:09:49.275019 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-b7f1d1c6-4af3-4a48-9e58-2c5d085a9e97 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:09:49.283572 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-b7f1d1c6-4af3-4a48-9e58-2c5d085a9e97 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:09:49.285060 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-b7f1d1c6-4af3-4a48-9e58-2c5d085a9e97 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:09:49.286215 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-b7f1d1c6-4af3-4a48-9e58-2c5d085a9e97 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1751 microversion: 2.20 time: 0.204350 Oct 20 06:09:49.286801 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 344/661] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:09:49 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1751 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 20 06:09:50.130333 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-c2346970-3cb8-4dec-9258-868791956ad0 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:09:50.133464 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-c2346970-3cb8-4dec-9258-868791956ad0 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:09:50.139908 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c2346970-3cb8-4dec-9258-868791956ad0 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:09:50.140378 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c2346970-3cb8-4dec-9258-868791956ad0 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:09:50.140845 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c2346970-3cb8-4dec-9258-868791956ad0 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:09:50.141526 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c2346970-3cb8-4dec-9258-868791956ad0 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:09:50.141971 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c2346970-3cb8-4dec-9258-868791956ad0 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:09:50.142389 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c2346970-3cb8-4dec-9258-868791956ad0 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:09:50.158729 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG dbcounter [-] [118860] Writing DB stats nova_cell1:SELECT=100 {{(pid=118860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:09:50.172194 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-c2346970-3cb8-4dec-9258-868791956ad0 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045835 Oct 20 06:09:50.172757 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 318/662] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:09:50 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:09:50.312034 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-7c6dc373-2355-4f28-910e-2efe4a1390ec tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:09:50.312640 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-7c6dc373-2355-4f28-910e-2efe4a1390ec tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:09:50.319096 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7c6dc373-2355-4f28-910e-2efe4a1390ec tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:09:50.319571 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7c6dc373-2355-4f28-910e-2efe4a1390ec tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:09:50.320004 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7c6dc373-2355-4f28-910e-2efe4a1390ec tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:09:50.320956 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7c6dc373-2355-4f28-910e-2efe4a1390ec tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:09:50.321296 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7c6dc373-2355-4f28-910e-2efe4a1390ec tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:09:50.321716 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7c6dc373-2355-4f28-910e-2efe4a1390ec tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:09:50.450747 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-7c6dc373-2355-4f28-910e-2efe4a1390ec tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:09:50.461629 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-7c6dc373-2355-4f28-910e-2efe4a1390ec tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:09:50.463084 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-7c6dc373-2355-4f28-910e-2efe4a1390ec tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:09:50.464688 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-7c6dc373-2355-4f28-910e-2efe4a1390ec tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1751 microversion: 2.20 time: 0.156223 Oct 20 06:09:50.464844 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 345/663] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:09:50 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1751 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:09:51.184635 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-368988dc-54dd-4fd8-bcc0-0f75b387fa36 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:09:51.186806 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-368988dc-54dd-4fd8-bcc0-0f75b387fa36 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:09:51.192858 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-368988dc-54dd-4fd8-bcc0-0f75b387fa36 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:09:51.193341 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-368988dc-54dd-4fd8-bcc0-0f75b387fa36 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:09:51.193778 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-368988dc-54dd-4fd8-bcc0-0f75b387fa36 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:09:51.194463 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-368988dc-54dd-4fd8-bcc0-0f75b387fa36 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:09:51.194914 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-368988dc-54dd-4fd8-bcc0-0f75b387fa36 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:09:51.196258 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-368988dc-54dd-4fd8-bcc0-0f75b387fa36 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:09:51.225630 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-368988dc-54dd-4fd8-bcc0-0f75b387fa36 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044929 Oct 20 06:09:51.226166 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 319/664] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:09:51 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:09:51.490546 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-68898119-6cde-4e29-be31-655c1a8d1acf tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:09:51.491118 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-68898119-6cde-4e29-be31-655c1a8d1acf tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:09:51.498121 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-68898119-6cde-4e29-be31-655c1a8d1acf tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:09:51.498613 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-68898119-6cde-4e29-be31-655c1a8d1acf tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:09:51.499042 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-68898119-6cde-4e29-be31-655c1a8d1acf tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:09:51.499734 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-68898119-6cde-4e29-be31-655c1a8d1acf tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:09:51.500192 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-68898119-6cde-4e29-be31-655c1a8d1acf tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:09:51.500615 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-68898119-6cde-4e29-be31-655c1a8d1acf tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:09:51.628510 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-68898119-6cde-4e29-be31-655c1a8d1acf tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:09:51.637595 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-68898119-6cde-4e29-be31-655c1a8d1acf tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:09:51.639044 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-68898119-6cde-4e29-be31-655c1a8d1acf tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:09:51.640195 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-68898119-6cde-4e29-be31-655c1a8d1acf tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1751 microversion: 2.20 time: 0.153738 Oct 20 06:09:51.640765 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 346/665] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:09:51 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1751 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:09:52.238313 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-24243573-0463-4e91-8882-bb99107f1141 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:09:52.240484 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-24243573-0463-4e91-8882-bb99107f1141 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:09:52.247454 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-24243573-0463-4e91-8882-bb99107f1141 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:09:52.247937 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-24243573-0463-4e91-8882-bb99107f1141 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:09:52.248381 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-24243573-0463-4e91-8882-bb99107f1141 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:09:52.249105 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-24243573-0463-4e91-8882-bb99107f1141 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:09:52.249557 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-24243573-0463-4e91-8882-bb99107f1141 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:09:52.249984 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-24243573-0463-4e91-8882-bb99107f1141 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:09:52.279959 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-24243573-0463-4e91-8882-bb99107f1141 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045615 Oct 20 06:09:52.280499 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 320/666] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:09:52 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:09:52.666071 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-a795445e-ee20-4792-a8d9-d750f8752b4b tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:09:52.666707 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-a795445e-ee20-4792-a8d9-d750f8752b4b tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:09:52.673204 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a795445e-ee20-4792-a8d9-d750f8752b4b tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:09:52.673687 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a795445e-ee20-4792-a8d9-d750f8752b4b tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:09:52.674117 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a795445e-ee20-4792-a8d9-d750f8752b4b tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:09:52.674803 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a795445e-ee20-4792-a8d9-d750f8752b4b tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:09:52.675247 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a795445e-ee20-4792-a8d9-d750f8752b4b tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:09:52.675665 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a795445e-ee20-4792-a8d9-d750f8752b4b tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:09:52.802631 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-a795445e-ee20-4792-a8d9-d750f8752b4b tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:09:52.811028 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-a795445e-ee20-4792-a8d9-d750f8752b4b tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:09:52.812458 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-a795445e-ee20-4792-a8d9-d750f8752b4b tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:09:52.813622 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-a795445e-ee20-4792-a8d9-d750f8752b4b tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1751 microversion: 2.20 time: 0.151601 Oct 20 06:09:52.814174 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 347/667] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:09:52 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1751 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 20 06:09:53.292285 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-7ab2c4b7-7cdd-46db-a0cc-5336f04115f0 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:09:53.294739 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-7ab2c4b7-7cdd-46db-a0cc-5336f04115f0 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:09:53.301931 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7ab2c4b7-7cdd-46db-a0cc-5336f04115f0 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:09:53.302423 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7ab2c4b7-7cdd-46db-a0cc-5336f04115f0 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:09:53.302865 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7ab2c4b7-7cdd-46db-a0cc-5336f04115f0 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:09:53.303579 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7ab2c4b7-7cdd-46db-a0cc-5336f04115f0 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:09:53.304030 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7ab2c4b7-7cdd-46db-a0cc-5336f04115f0 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:09:53.304511 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7ab2c4b7-7cdd-46db-a0cc-5336f04115f0 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:09:53.337502 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-7ab2c4b7-7cdd-46db-a0cc-5336f04115f0 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049679 Oct 20 06:09:53.338075 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 321/668] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:09:53 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:09:53.839265 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-70341307-0a95-4b81-9861-e383a76bfe59 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:09:53.839852 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-70341307-0a95-4b81-9861-e383a76bfe59 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:09:53.846299 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-70341307-0a95-4b81-9861-e383a76bfe59 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:09:53.846778 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-70341307-0a95-4b81-9861-e383a76bfe59 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:09:53.847208 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-70341307-0a95-4b81-9861-e383a76bfe59 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:09:53.847893 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-70341307-0a95-4b81-9861-e383a76bfe59 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:09:53.848338 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-70341307-0a95-4b81-9861-e383a76bfe59 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:09:53.848784 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-70341307-0a95-4b81-9861-e383a76bfe59 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:09:53.974462 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-70341307-0a95-4b81-9861-e383a76bfe59 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:09:53.983632 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-70341307-0a95-4b81-9861-e383a76bfe59 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:09:53.985272 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-70341307-0a95-4b81-9861-e383a76bfe59 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:09:53.986258 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-70341307-0a95-4b81-9861-e383a76bfe59 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1751 microversion: 2.20 time: 0.151504 Oct 20 06:09:53.986826 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 348/669] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:09:53 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1751 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:09:54.350144 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-1d61e466-f1dc-40bf-a2f4-e01e46d52686 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:09:54.352333 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-1d61e466-f1dc-40bf-a2f4-e01e46d52686 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:09:54.358735 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1d61e466-f1dc-40bf-a2f4-e01e46d52686 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:09:54.359221 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1d61e466-f1dc-40bf-a2f4-e01e46d52686 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:09:54.359661 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1d61e466-f1dc-40bf-a2f4-e01e46d52686 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:09:54.360354 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1d61e466-f1dc-40bf-a2f4-e01e46d52686 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:09:54.360842 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1d61e466-f1dc-40bf-a2f4-e01e46d52686 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:09:54.361272 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1d61e466-f1dc-40bf-a2f4-e01e46d52686 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:09:54.391478 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-1d61e466-f1dc-40bf-a2f4-e01e46d52686 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045370 Oct 20 06:09:54.392028 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 322/670] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:09:54 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:09:55.012163 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-f49b7a8d-8178-40d3-af9e-4a21a02c7f9b tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:09:55.012791 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-f49b7a8d-8178-40d3-af9e-4a21a02c7f9b tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:09:55.019110 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f49b7a8d-8178-40d3-af9e-4a21a02c7f9b tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:09:55.019589 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f49b7a8d-8178-40d3-af9e-4a21a02c7f9b tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:09:55.020021 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f49b7a8d-8178-40d3-af9e-4a21a02c7f9b tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:09:55.020719 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f49b7a8d-8178-40d3-af9e-4a21a02c7f9b tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:09:55.021177 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f49b7a8d-8178-40d3-af9e-4a21a02c7f9b tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:09:55.021599 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f49b7a8d-8178-40d3-af9e-4a21a02c7f9b tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:09:55.156271 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-f49b7a8d-8178-40d3-af9e-4a21a02c7f9b tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:09:55.166237 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-f49b7a8d-8178-40d3-af9e-4a21a02c7f9b tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:09:55.167837 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-f49b7a8d-8178-40d3-af9e-4a21a02c7f9b tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:09:55.169041 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-f49b7a8d-8178-40d3-af9e-4a21a02c7f9b tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1751 microversion: 2.20 time: 0.161335 Oct 20 06:09:55.169601 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 349/671] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:09:55 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1751 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:09:55.404118 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-78e3ab5b-293e-4dd1-814d-bb2f6f46a6ad tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:09:55.406257 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-78e3ab5b-293e-4dd1-814d-bb2f6f46a6ad tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:09:55.412561 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-78e3ab5b-293e-4dd1-814d-bb2f6f46a6ad tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:09:55.413079 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-78e3ab5b-293e-4dd1-814d-bb2f6f46a6ad tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:09:55.413514 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-78e3ab5b-293e-4dd1-814d-bb2f6f46a6ad tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:09:55.415149 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-78e3ab5b-293e-4dd1-814d-bb2f6f46a6ad tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:09:55.415608 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-78e3ab5b-293e-4dd1-814d-bb2f6f46a6ad tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:09:55.416035 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-78e3ab5b-293e-4dd1-814d-bb2f6f46a6ad tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:09:55.444843 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-78e3ab5b-293e-4dd1-814d-bb2f6f46a6ad tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044686 Oct 20 06:09:55.445651 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 323/672] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:09:55 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:09:56.195495 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-8736844e-aba7-49be-b782-8589ca6b8b7a tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:09:56.196278 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-8736844e-aba7-49be-b782-8589ca6b8b7a tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:09:56.204127 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-8736844e-aba7-49be-b782-8589ca6b8b7a tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:09:56.204932 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-8736844e-aba7-49be-b782-8589ca6b8b7a tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:09:56.205370 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-8736844e-aba7-49be-b782-8589ca6b8b7a tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:09:56.206091 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-8736844e-aba7-49be-b782-8589ca6b8b7a tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:09:56.206535 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-8736844e-aba7-49be-b782-8589ca6b8b7a tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:09:56.206949 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-8736844e-aba7-49be-b782-8589ca6b8b7a tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:09:56.337706 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-8736844e-aba7-49be-b782-8589ca6b8b7a tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:09:56.346076 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-8736844e-aba7-49be-b782-8589ca6b8b7a tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:09:56.347515 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-8736844e-aba7-49be-b782-8589ca6b8b7a tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:09:56.348635 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-8736844e-aba7-49be-b782-8589ca6b8b7a tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1751 microversion: 2.20 time: 0.157035 Oct 20 06:09:56.349212 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 350/673] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:09:56 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1751 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:09:56.457680 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-efe936af-ae75-47b7-8ae8-b539fcef14cb tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:09:56.459857 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-efe936af-ae75-47b7-8ae8-b539fcef14cb tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:09:56.467090 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-efe936af-ae75-47b7-8ae8-b539fcef14cb tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:09:56.467569 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-efe936af-ae75-47b7-8ae8-b539fcef14cb tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:09:56.468007 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-efe936af-ae75-47b7-8ae8-b539fcef14cb tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:09:56.468712 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-efe936af-ae75-47b7-8ae8-b539fcef14cb tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:09:56.469172 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-efe936af-ae75-47b7-8ae8-b539fcef14cb tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:09:56.469597 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-efe936af-ae75-47b7-8ae8-b539fcef14cb tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:09:56.498306 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-efe936af-ae75-47b7-8ae8-b539fcef14cb tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044573 Oct 20 06:09:56.498852 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 324/674] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:09:56 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:09:57.373810 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-fa06ac6a-1789-4abd-b53b-db43f7529099 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:09:57.374417 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-fa06ac6a-1789-4abd-b53b-db43f7529099 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:09:57.380837 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-fa06ac6a-1789-4abd-b53b-db43f7529099 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:09:57.381329 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-fa06ac6a-1789-4abd-b53b-db43f7529099 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:09:57.381767 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-fa06ac6a-1789-4abd-b53b-db43f7529099 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:09:57.382524 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-fa06ac6a-1789-4abd-b53b-db43f7529099 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:09:57.382981 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-fa06ac6a-1789-4abd-b53b-db43f7529099 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:09:57.383408 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-fa06ac6a-1789-4abd-b53b-db43f7529099 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:09:57.510663 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-9e344c06-a311-4e76-bd58-9dddf43bc1fb tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:09:57.512924 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-9e344c06-a311-4e76-bd58-9dddf43bc1fb tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:09:57.514272 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-fa06ac6a-1789-4abd-b53b-db43f7529099 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:09:57.519315 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-9e344c06-a311-4e76-bd58-9dddf43bc1fb tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:09:57.519808 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-9e344c06-a311-4e76-bd58-9dddf43bc1fb tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:09:57.520250 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-9e344c06-a311-4e76-bd58-9dddf43bc1fb tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:09:57.520981 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-9e344c06-a311-4e76-bd58-9dddf43bc1fb tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:09:57.521436 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-9e344c06-a311-4e76-bd58-9dddf43bc1fb tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:09:57.522038 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-9e344c06-a311-4e76-bd58-9dddf43bc1fb tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:09:57.522806 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-fa06ac6a-1789-4abd-b53b-db43f7529099 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:09:57.524888 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-fa06ac6a-1789-4abd-b53b-db43f7529099 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:09:57.526036 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-fa06ac6a-1789-4abd-b53b-db43f7529099 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1751 microversion: 2.20 time: 0.156093 Oct 20 06:09:57.526592 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 351/675] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:09:57 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1751 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:09:57.552247 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-9e344c06-a311-4e76-bd58-9dddf43bc1fb tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045729 Oct 20 06:09:57.552822 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 325/676] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:09:57 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 20 06:09:58.551324 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-bae1abd5-9143-4c0a-add7-9f9775818e74 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:09:58.551820 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-bae1abd5-9143-4c0a-add7-9f9775818e74 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:09:58.558840 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-bae1abd5-9143-4c0a-add7-9f9775818e74 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:09:58.559324 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-bae1abd5-9143-4c0a-add7-9f9775818e74 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:09:58.559756 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-bae1abd5-9143-4c0a-add7-9f9775818e74 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:09:58.560441 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-bae1abd5-9143-4c0a-add7-9f9775818e74 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:09:58.560914 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-bae1abd5-9143-4c0a-add7-9f9775818e74 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:09:58.561332 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-bae1abd5-9143-4c0a-add7-9f9775818e74 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:09:58.564424 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-853ea2f4-e4e7-4546-9c83-8b9956a3b3f2 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:09:58.566635 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-853ea2f4-e4e7-4546-9c83-8b9956a3b3f2 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:09:58.572985 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-853ea2f4-e4e7-4546-9c83-8b9956a3b3f2 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:09:58.573470 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-853ea2f4-e4e7-4546-9c83-8b9956a3b3f2 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:09:58.573909 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-853ea2f4-e4e7-4546-9c83-8b9956a3b3f2 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:09:58.574608 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-853ea2f4-e4e7-4546-9c83-8b9956a3b3f2 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:09:58.575064 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-853ea2f4-e4e7-4546-9c83-8b9956a3b3f2 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:09:58.575493 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-853ea2f4-e4e7-4546-9c83-8b9956a3b3f2 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:09:58.606577 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-853ea2f4-e4e7-4546-9c83-8b9956a3b3f2 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046029 Oct 20 06:09:58.607152 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 326/677] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:09:58 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 20 06:09:58.692365 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-bae1abd5-9143-4c0a-add7-9f9775818e74 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:09:58.696031 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG dbcounter [-] [118861] Writing DB stats nova_cell1:SELECT=100 {{(pid=118861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:09:58.702103 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-bae1abd5-9143-4c0a-add7-9f9775818e74 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:09:58.703529 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-bae1abd5-9143-4c0a-add7-9f9775818e74 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:09:58.704810 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-bae1abd5-9143-4c0a-add7-9f9775818e74 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1751 microversion: 2.20 time: 0.157316 Oct 20 06:09:58.705265 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 352/678] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:09:58 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1751 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:09:59.619514 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-86eec537-36d7-4bb8-b6ad-61d76e82a8da tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:09:59.621685 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-86eec537-36d7-4bb8-b6ad-61d76e82a8da tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:09:59.623936 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG dbcounter [-] [118860] Writing DB stats nova_api:SELECT=54 {{(pid=118860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:09:59.629117 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-86eec537-36d7-4bb8-b6ad-61d76e82a8da tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:09:59.629593 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-86eec537-36d7-4bb8-b6ad-61d76e82a8da tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:09:59.630024 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-86eec537-36d7-4bb8-b6ad-61d76e82a8da tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:09:59.630965 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-86eec537-36d7-4bb8-b6ad-61d76e82a8da tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:09:59.631412 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-86eec537-36d7-4bb8-b6ad-61d76e82a8da tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:09:59.631829 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-86eec537-36d7-4bb8-b6ad-61d76e82a8da tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:09:59.661340 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-86eec537-36d7-4bb8-b6ad-61d76e82a8da tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046364 Oct 20 06:09:59.661883 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 327/679] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:09:59 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:09:59.730218 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-09c31656-3a4f-40ef-9a12-53c8c74d9c59 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:09:59.730774 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-09c31656-3a4f-40ef-9a12-53c8c74d9c59 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:09:59.733329 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG dbcounter [-] [118861] Writing DB stats nova_api:SELECT=56 {{(pid=118861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:09:59.738474 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-09c31656-3a4f-40ef-9a12-53c8c74d9c59 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:09:59.738948 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-09c31656-3a4f-40ef-9a12-53c8c74d9c59 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:09:59.739377 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-09c31656-3a4f-40ef-9a12-53c8c74d9c59 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:09:59.740056 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-09c31656-3a4f-40ef-9a12-53c8c74d9c59 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:09:59.740502 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-09c31656-3a4f-40ef-9a12-53c8c74d9c59 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:09:59.740948 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-09c31656-3a4f-40ef-9a12-53c8c74d9c59 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:09:59.871035 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-09c31656-3a4f-40ef-9a12-53c8c74d9c59 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:09:59.880078 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-09c31656-3a4f-40ef-9a12-53c8c74d9c59 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:09:59.881824 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-09c31656-3a4f-40ef-9a12-53c8c74d9c59 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:09:59.883582 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-09c31656-3a4f-40ef-9a12-53c8c74d9c59 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1751 microversion: 2.20 time: 0.157410 Oct 20 06:09:59.884140 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 353/680] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:09:59 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1751 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:10:00.673709 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-cbeec4b6-2883-47b2-8e56-4b659255b495 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:10:00.675888 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-cbeec4b6-2883-47b2-8e56-4b659255b495 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:10:00.682288 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-cbeec4b6-2883-47b2-8e56-4b659255b495 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:10:00.682763 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-cbeec4b6-2883-47b2-8e56-4b659255b495 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:10:00.683193 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-cbeec4b6-2883-47b2-8e56-4b659255b495 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:10:00.683874 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-cbeec4b6-2883-47b2-8e56-4b659255b495 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:10:00.684323 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-cbeec4b6-2883-47b2-8e56-4b659255b495 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:10:00.684764 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-cbeec4b6-2883-47b2-8e56-4b659255b495 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:10:00.713473 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-cbeec4b6-2883-47b2-8e56-4b659255b495 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043684 Oct 20 06:10:00.714006 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 328/681] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:10:00 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:10:00.908626 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-e8350aa3-2f8e-45f3-8f0a-58520216cf89 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:10:00.909255 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-e8350aa3-2f8e-45f3-8f0a-58520216cf89 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:10:00.915630 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e8350aa3-2f8e-45f3-8f0a-58520216cf89 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:10:00.916109 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e8350aa3-2f8e-45f3-8f0a-58520216cf89 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:10:00.916539 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e8350aa3-2f8e-45f3-8f0a-58520216cf89 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:10:00.917245 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e8350aa3-2f8e-45f3-8f0a-58520216cf89 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:10:00.917694 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e8350aa3-2f8e-45f3-8f0a-58520216cf89 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:10:00.918111 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e8350aa3-2f8e-45f3-8f0a-58520216cf89 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:10:01.044472 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-e8350aa3-2f8e-45f3-8f0a-58520216cf89 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:10:01.052969 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-e8350aa3-2f8e-45f3-8f0a-58520216cf89 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:10:01.054398 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-e8350aa3-2f8e-45f3-8f0a-58520216cf89 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:10:01.055537 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-e8350aa3-2f8e-45f3-8f0a-58520216cf89 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1751 microversion: 2.20 time: 0.150813 Oct 20 06:10:01.056087 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 354/682] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:10:00 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1751 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:10:01.725733 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-7a471b91-3b73-43cb-b366-37b1e981c1cb tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:10:01.727972 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-7a471b91-3b73-43cb-b366-37b1e981c1cb tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:10:01.734267 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7a471b91-3b73-43cb-b366-37b1e981c1cb tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:10:01.734745 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7a471b91-3b73-43cb-b366-37b1e981c1cb tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:10:01.735178 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7a471b91-3b73-43cb-b366-37b1e981c1cb tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:10:01.735857 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7a471b91-3b73-43cb-b366-37b1e981c1cb tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:10:01.736302 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7a471b91-3b73-43cb-b366-37b1e981c1cb tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:10:01.736746 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7a471b91-3b73-43cb-b366-37b1e981c1cb tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:10:01.765690 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-7a471b91-3b73-43cb-b366-37b1e981c1cb tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043892 Oct 20 06:10:01.766227 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 329/683] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:10:01 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:10:02.081513 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-dd449852-04ad-4790-b4d6-75328dbae748 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:10:02.082046 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-dd449852-04ad-4790-b4d6-75328dbae748 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:10:02.088338 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-dd449852-04ad-4790-b4d6-75328dbae748 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:10:02.088844 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-dd449852-04ad-4790-b4d6-75328dbae748 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:10:02.089277 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-dd449852-04ad-4790-b4d6-75328dbae748 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:10:02.089962 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-dd449852-04ad-4790-b4d6-75328dbae748 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:10:02.090408 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-dd449852-04ad-4790-b4d6-75328dbae748 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:10:02.090831 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-dd449852-04ad-4790-b4d6-75328dbae748 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:10:02.218776 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-dd449852-04ad-4790-b4d6-75328dbae748 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:10:02.227811 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-dd449852-04ad-4790-b4d6-75328dbae748 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:10:02.229266 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-dd449852-04ad-4790-b4d6-75328dbae748 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:10:02.230439 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-dd449852-04ad-4790-b4d6-75328dbae748 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1751 microversion: 2.20 time: 0.152943 Oct 20 06:10:02.230996 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 355/684] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:10:02 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1751 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:10:02.778302 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-7c76eb66-60da-4937-89c7-3160df6885e3 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:10:02.780357 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-7c76eb66-60da-4937-89c7-3160df6885e3 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:10:02.786666 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7c76eb66-60da-4937-89c7-3160df6885e3 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:10:02.787142 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7c76eb66-60da-4937-89c7-3160df6885e3 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:10:02.787574 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7c76eb66-60da-4937-89c7-3160df6885e3 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:10:02.788302 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7c76eb66-60da-4937-89c7-3160df6885e3 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:10:02.788781 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7c76eb66-60da-4937-89c7-3160df6885e3 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:10:02.789236 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7c76eb66-60da-4937-89c7-3160df6885e3 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:10:02.818216 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-7c76eb66-60da-4937-89c7-3160df6885e3 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043967 Oct 20 06:10:02.818764 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 330/685] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:10:02 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:10:03.256305 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-c4761c39-6dd0-4e2c-8580-6e89b0f003de tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:10:03.256941 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-c4761c39-6dd0-4e2c-8580-6e89b0f003de tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:10:03.263627 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c4761c39-6dd0-4e2c-8580-6e89b0f003de tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:10:03.264103 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c4761c39-6dd0-4e2c-8580-6e89b0f003de tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:10:03.264530 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c4761c39-6dd0-4e2c-8580-6e89b0f003de tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:10:03.265243 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c4761c39-6dd0-4e2c-8580-6e89b0f003de tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:10:03.265696 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c4761c39-6dd0-4e2c-8580-6e89b0f003de tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:10:03.266114 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c4761c39-6dd0-4e2c-8580-6e89b0f003de tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:10:03.394969 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-c4761c39-6dd0-4e2c-8580-6e89b0f003de tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:10:03.404022 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-c4761c39-6dd0-4e2c-8580-6e89b0f003de tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:10:03.405543 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-c4761c39-6dd0-4e2c-8580-6e89b0f003de tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:10:03.406678 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-c4761c39-6dd0-4e2c-8580-6e89b0f003de tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1751 microversion: 2.20 time: 0.154582 Oct 20 06:10:03.407229 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 356/686] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:10:03 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1751 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:10:03.831382 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-fd3b269f-4243-4439-866b-7662e674edb7 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:10:03.833524 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-fd3b269f-4243-4439-866b-7662e674edb7 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:10:03.840100 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-fd3b269f-4243-4439-866b-7662e674edb7 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:10:03.840573 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-fd3b269f-4243-4439-866b-7662e674edb7 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:10:03.841041 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-fd3b269f-4243-4439-866b-7662e674edb7 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:10:03.841753 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-fd3b269f-4243-4439-866b-7662e674edb7 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:10:03.842202 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-fd3b269f-4243-4439-866b-7662e674edb7 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:10:03.842623 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-fd3b269f-4243-4439-866b-7662e674edb7 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:10:03.873047 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-fd3b269f-4243-4439-866b-7662e674edb7 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045537 Oct 20 06:10:03.873845 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 331/687] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:10:03 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:10:04.432272 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-7bca18ad-ec14-479c-aa80-4afba80b7b8a tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:10:04.432920 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-7bca18ad-ec14-479c-aa80-4afba80b7b8a tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:10:04.439341 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7bca18ad-ec14-479c-aa80-4afba80b7b8a tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:10:04.439817 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7bca18ad-ec14-479c-aa80-4afba80b7b8a tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:10:04.440255 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7bca18ad-ec14-479c-aa80-4afba80b7b8a tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:10:04.440977 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7bca18ad-ec14-479c-aa80-4afba80b7b8a tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:10:04.441433 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7bca18ad-ec14-479c-aa80-4afba80b7b8a tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:10:04.441863 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7bca18ad-ec14-479c-aa80-4afba80b7b8a tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:10:04.568633 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-7bca18ad-ec14-479c-aa80-4afba80b7b8a tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:10:04.577938 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-7bca18ad-ec14-479c-aa80-4afba80b7b8a tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:10:04.579394 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-7bca18ad-ec14-479c-aa80-4afba80b7b8a tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:10:04.580561 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-7bca18ad-ec14-479c-aa80-4afba80b7b8a tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1751 microversion: 2.20 time: 0.152349 Oct 20 06:10:04.581151 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 357/688] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:10:04 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1751 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:10:04.886188 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-bcf965dd-fede-4507-b7fe-f22b7a89abbd tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:10:04.888366 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-bcf965dd-fede-4507-b7fe-f22b7a89abbd tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:10:04.895101 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-bcf965dd-fede-4507-b7fe-f22b7a89abbd tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:10:04.895577 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-bcf965dd-fede-4507-b7fe-f22b7a89abbd tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:10:04.896008 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-bcf965dd-fede-4507-b7fe-f22b7a89abbd tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:10:04.896689 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-bcf965dd-fede-4507-b7fe-f22b7a89abbd tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:10:04.897159 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-bcf965dd-fede-4507-b7fe-f22b7a89abbd tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:10:04.897587 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-bcf965dd-fede-4507-b7fe-f22b7a89abbd tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:10:04.925808 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-bcf965dd-fede-4507-b7fe-f22b7a89abbd tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044083 Oct 20 06:10:04.926351 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 332/689] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:10:04 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 20 06:10:05.607330 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-e6c87268-6e2b-4b81-92af-55821dfa772f tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:10:05.607860 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-e6c87268-6e2b-4b81-92af-55821dfa772f tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:10:05.614358 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e6c87268-6e2b-4b81-92af-55821dfa772f tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:10:05.614843 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e6c87268-6e2b-4b81-92af-55821dfa772f tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:10:05.615279 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e6c87268-6e2b-4b81-92af-55821dfa772f tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:10:05.615980 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e6c87268-6e2b-4b81-92af-55821dfa772f tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:10:05.617270 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e6c87268-6e2b-4b81-92af-55821dfa772f tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:10:05.617750 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e6c87268-6e2b-4b81-92af-55821dfa772f tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:10:05.754981 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-e6c87268-6e2b-4b81-92af-55821dfa772f tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:10:05.764565 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-e6c87268-6e2b-4b81-92af-55821dfa772f tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:10:05.766390 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-e6c87268-6e2b-4b81-92af-55821dfa772f tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:10:05.767769 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-e6c87268-6e2b-4b81-92af-55821dfa772f tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1751 microversion: 2.20 time: 0.164423 Oct 20 06:10:05.768845 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 358/690] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:10:05 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1751 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:10:05.938897 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-ff868994-91e0-403c-9ade-da31e9bb518a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:10:05.941055 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-ff868994-91e0-403c-9ade-da31e9bb518a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:10:05.947971 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-ff868994-91e0-403c-9ade-da31e9bb518a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:10:05.948445 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-ff868994-91e0-403c-9ade-da31e9bb518a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:10:05.948908 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-ff868994-91e0-403c-9ade-da31e9bb518a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:10:05.949597 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-ff868994-91e0-403c-9ade-da31e9bb518a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:10:05.950048 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-ff868994-91e0-403c-9ade-da31e9bb518a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:10:05.950474 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-ff868994-91e0-403c-9ade-da31e9bb518a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:10:05.979489 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-ff868994-91e0-403c-9ade-da31e9bb518a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044568 Oct 20 06:10:05.980035 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 333/691] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:10:05 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 20 06:10:06.797664 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-e2896122-9b53-4075-a33b-84efbad123af tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:10:06.798270 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-e2896122-9b53-4075-a33b-84efbad123af tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:10:06.805499 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e2896122-9b53-4075-a33b-84efbad123af tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:10:06.806015 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e2896122-9b53-4075-a33b-84efbad123af tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:10:06.806450 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e2896122-9b53-4075-a33b-84efbad123af tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:10:06.807140 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e2896122-9b53-4075-a33b-84efbad123af tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:10:06.807588 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e2896122-9b53-4075-a33b-84efbad123af tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:10:06.808010 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e2896122-9b53-4075-a33b-84efbad123af tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:10:06.934896 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-e2896122-9b53-4075-a33b-84efbad123af tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:10:06.943235 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-e2896122-9b53-4075-a33b-84efbad123af tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:10:06.944661 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-e2896122-9b53-4075-a33b-84efbad123af tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:10:06.945816 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-e2896122-9b53-4075-a33b-84efbad123af tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1745 microversion: 2.20 time: 0.152143 Oct 20 06:10:06.946373 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 359/692] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:10:06 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1745 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:10:06.992124 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-e1209f91-bef5-44fc-ba53-4326d8167591 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:10:06.994338 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-e1209f91-bef5-44fc-ba53-4326d8167591 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:10:07.000589 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e1209f91-bef5-44fc-ba53-4326d8167591 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:10:07.001105 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e1209f91-bef5-44fc-ba53-4326d8167591 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:10:07.001544 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e1209f91-bef5-44fc-ba53-4326d8167591 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:10:07.002245 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e1209f91-bef5-44fc-ba53-4326d8167591 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:10:07.002701 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e1209f91-bef5-44fc-ba53-4326d8167591 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:10:07.003128 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e1209f91-bef5-44fc-ba53-4326d8167591 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:10:07.032196 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-e1209f91-bef5-44fc-ba53-4326d8167591 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044752 Oct 20 06:10:07.032752 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 334/693] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:10:06 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:10:07.971079 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-2941db81-0017-46ed-bea5-f60aa551c5bd tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:10:07.971689 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-2941db81-0017-46ed-bea5-f60aa551c5bd tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:10:07.978717 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-2941db81-0017-46ed-bea5-f60aa551c5bd tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:10:07.979199 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-2941db81-0017-46ed-bea5-f60aa551c5bd tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:10:07.979636 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-2941db81-0017-46ed-bea5-f60aa551c5bd tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:10:07.980329 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-2941db81-0017-46ed-bea5-f60aa551c5bd tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:10:07.980811 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-2941db81-0017-46ed-bea5-f60aa551c5bd tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:10:07.981235 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-2941db81-0017-46ed-bea5-f60aa551c5bd tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:10:08.045020 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-06cef8c1-29d1-4999-b803-dd036fdafc4e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:10:08.047085 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-06cef8c1-29d1-4999-b803-dd036fdafc4e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:10:08.053354 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-06cef8c1-29d1-4999-b803-dd036fdafc4e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:10:08.053859 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-06cef8c1-29d1-4999-b803-dd036fdafc4e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:10:08.054294 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-06cef8c1-29d1-4999-b803-dd036fdafc4e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:10:08.054987 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-06cef8c1-29d1-4999-b803-dd036fdafc4e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:10:08.055437 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-06cef8c1-29d1-4999-b803-dd036fdafc4e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:10:08.055856 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-06cef8c1-29d1-4999-b803-dd036fdafc4e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:10:08.059762 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG dbcounter [-] [118860] Writing DB stats nova_cell1:SELECT=100 {{(pid=118860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:10:08.087731 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-06cef8c1-29d1-4999-b803-dd036fdafc4e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046777 Oct 20 06:10:08.088293 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 335/694] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:10:08 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 20 06:10:08.110750 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-2941db81-0017-46ed-bea5-f60aa551c5bd tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:10:08.119590 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-2941db81-0017-46ed-bea5-f60aa551c5bd tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:10:08.121050 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-2941db81-0017-46ed-bea5-f60aa551c5bd tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:10:08.122192 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-2941db81-0017-46ed-bea5-f60aa551c5bd tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1745 microversion: 2.20 time: 0.155025 Oct 20 06:10:08.122745 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 360/695] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:10:07 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1745 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:10:09.100035 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-6b8f9822-ef08-40c9-85f6-297d28842425 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:10:09.102707 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-6b8f9822-ef08-40c9-85f6-297d28842425 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:10:09.109048 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-6b8f9822-ef08-40c9-85f6-297d28842425 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:10:09.109529 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-6b8f9822-ef08-40c9-85f6-297d28842425 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:10:09.109957 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-6b8f9822-ef08-40c9-85f6-297d28842425 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:10:09.110640 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-6b8f9822-ef08-40c9-85f6-297d28842425 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:10:09.111087 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-6b8f9822-ef08-40c9-85f6-297d28842425 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:10:09.111506 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-6b8f9822-ef08-40c9-85f6-297d28842425 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:10:09.140316 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-6b8f9822-ef08-40c9-85f6-297d28842425 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044237 Oct 20 06:10:09.140877 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 336/696] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:10:09 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:10:09.147268 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-1d1668bb-0c92-472c-be77-e8b1e2b44af0 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:10:09.147906 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-1d1668bb-0c92-472c-be77-e8b1e2b44af0 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:10:09.154241 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1d1668bb-0c92-472c-be77-e8b1e2b44af0 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:10:09.154722 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1d1668bb-0c92-472c-be77-e8b1e2b44af0 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:10:09.155162 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1d1668bb-0c92-472c-be77-e8b1e2b44af0 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:10:09.155856 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1d1668bb-0c92-472c-be77-e8b1e2b44af0 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:10:09.156314 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1d1668bb-0c92-472c-be77-e8b1e2b44af0 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:10:09.156769 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1d1668bb-0c92-472c-be77-e8b1e2b44af0 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:10:09.284146 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-1d1668bb-0c92-472c-be77-e8b1e2b44af0 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:10:09.293194 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-1d1668bb-0c92-472c-be77-e8b1e2b44af0 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:10:09.294642 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-1d1668bb-0c92-472c-be77-e8b1e2b44af0 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:10:09.295828 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-1d1668bb-0c92-472c-be77-e8b1e2b44af0 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1745 microversion: 2.20 time: 0.152465 Oct 20 06:10:09.296388 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 361/697] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:10:09 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1745 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:10:10.151787 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-207d359b-0f69-4e59-af77-4d36a29b15de tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:10:10.153985 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-207d359b-0f69-4e59-af77-4d36a29b15de tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:10:10.160350 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-207d359b-0f69-4e59-af77-4d36a29b15de tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:10:10.160863 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-207d359b-0f69-4e59-af77-4d36a29b15de tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:10:10.161297 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-207d359b-0f69-4e59-af77-4d36a29b15de tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:10:10.161974 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-207d359b-0f69-4e59-af77-4d36a29b15de tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:10:10.162417 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-207d359b-0f69-4e59-af77-4d36a29b15de tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:10:10.162835 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-207d359b-0f69-4e59-af77-4d36a29b15de tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:10:10.196062 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-207d359b-0f69-4e59-af77-4d36a29b15de tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048106 Oct 20 06:10:10.196622 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 337/698] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:10:10 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:10:10.322790 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-94087aab-a0f6-4d23-ae23-389c46eba48f tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:10:10.323388 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-94087aab-a0f6-4d23-ae23-389c46eba48f tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:10:10.329766 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-94087aab-a0f6-4d23-ae23-389c46eba48f tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:10:10.330247 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-94087aab-a0f6-4d23-ae23-389c46eba48f tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:10:10.330681 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-94087aab-a0f6-4d23-ae23-389c46eba48f tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:10:10.331390 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-94087aab-a0f6-4d23-ae23-389c46eba48f tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:10:10.331824 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-94087aab-a0f6-4d23-ae23-389c46eba48f tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:10:10.332245 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-94087aab-a0f6-4d23-ae23-389c46eba48f tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:10:10.458497 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-94087aab-a0f6-4d23-ae23-389c46eba48f tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:10:10.467098 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-94087aab-a0f6-4d23-ae23-389c46eba48f tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:10:10.468529 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-94087aab-a0f6-4d23-ae23-389c46eba48f tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:10:10.469706 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-94087aab-a0f6-4d23-ae23-389c46eba48f tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1745 microversion: 2.20 time: 0.151828 Oct 20 06:10:10.470257 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 362/699] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:10:10 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1745 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 20 06:10:11.208544 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-49bff174-5a06-4b29-848d-5cb43b010ab3 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:10:11.210709 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-49bff174-5a06-4b29-848d-5cb43b010ab3 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:10:11.217121 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-49bff174-5a06-4b29-848d-5cb43b010ab3 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:10:11.217598 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-49bff174-5a06-4b29-848d-5cb43b010ab3 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:10:11.218033 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-49bff174-5a06-4b29-848d-5cb43b010ab3 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:10:11.218717 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-49bff174-5a06-4b29-848d-5cb43b010ab3 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:10:11.219169 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-49bff174-5a06-4b29-848d-5cb43b010ab3 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:10:11.219597 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-49bff174-5a06-4b29-848d-5cb43b010ab3 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:10:11.248948 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-49bff174-5a06-4b29-848d-5cb43b010ab3 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044336 Oct 20 06:10:11.249485 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 338/700] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:10:11 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:10:11.501370 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-f434c103-494d-4aa6-a6d3-ca32bae6c739 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:10:11.501921 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-f434c103-494d-4aa6-a6d3-ca32bae6c739 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:10:11.508837 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f434c103-494d-4aa6-a6d3-ca32bae6c739 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:10:11.509315 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f434c103-494d-4aa6-a6d3-ca32bae6c739 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:10:11.509751 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f434c103-494d-4aa6-a6d3-ca32bae6c739 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:10:11.510433 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f434c103-494d-4aa6-a6d3-ca32bae6c739 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:10:11.510881 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f434c103-494d-4aa6-a6d3-ca32bae6c739 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:10:11.511297 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f434c103-494d-4aa6-a6d3-ca32bae6c739 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:10:11.641078 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-f434c103-494d-4aa6-a6d3-ca32bae6c739 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:10:11.650225 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-f434c103-494d-4aa6-a6d3-ca32bae6c739 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:10:11.651677 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-f434c103-494d-4aa6-a6d3-ca32bae6c739 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:10:11.652847 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-f434c103-494d-4aa6-a6d3-ca32bae6c739 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1745 microversion: 2.20 time: 0.155480 Oct 20 06:10:11.653394 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 363/701] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:10:11 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1745 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:10:12.261834 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-7b65e433-b461-407c-bcab-5db9cb6c835e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:10:12.263987 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-7b65e433-b461-407c-bcab-5db9cb6c835e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:10:12.270330 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7b65e433-b461-407c-bcab-5db9cb6c835e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:10:12.270808 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7b65e433-b461-407c-bcab-5db9cb6c835e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:10:12.271248 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7b65e433-b461-407c-bcab-5db9cb6c835e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:10:12.271932 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7b65e433-b461-407c-bcab-5db9cb6c835e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:10:12.273017 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7b65e433-b461-407c-bcab-5db9cb6c835e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:10:12.273443 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7b65e433-b461-407c-bcab-5db9cb6c835e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:10:12.302303 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-7b65e433-b461-407c-bcab-5db9cb6c835e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044394 Oct 20 06:10:12.302872 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 339/702] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:10:12 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:10:12.678185 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-f9098494-753f-4f64-950d-6602ab0d44ff tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:10:12.679357 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-f9098494-753f-4f64-950d-6602ab0d44ff tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:10:12.685643 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f9098494-753f-4f64-950d-6602ab0d44ff tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:10:12.686125 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f9098494-753f-4f64-950d-6602ab0d44ff tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:10:12.686569 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f9098494-753f-4f64-950d-6602ab0d44ff tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:10:12.687262 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f9098494-753f-4f64-950d-6602ab0d44ff tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:10:12.687715 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f9098494-753f-4f64-950d-6602ab0d44ff tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:10:12.688141 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f9098494-753f-4f64-950d-6602ab0d44ff tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:10:12.812157 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-f9098494-753f-4f64-950d-6602ab0d44ff tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:10:12.821247 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-f9098494-753f-4f64-950d-6602ab0d44ff tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:10:12.822691 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-f9098494-753f-4f64-950d-6602ab0d44ff tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:10:12.823847 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-f9098494-753f-4f64-950d-6602ab0d44ff tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1745 microversion: 2.20 time: 0.149620 Oct 20 06:10:12.824414 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 364/703] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:10:12 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1745 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:10:13.314484 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-10bdbe1e-0670-4782-806e-aaa301f4a13a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:10:13.316621 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-10bdbe1e-0670-4782-806e-aaa301f4a13a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:10:13.323777 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-10bdbe1e-0670-4782-806e-aaa301f4a13a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:10:13.324256 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-10bdbe1e-0670-4782-806e-aaa301f4a13a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:10:13.324710 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-10bdbe1e-0670-4782-806e-aaa301f4a13a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:10:13.325398 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-10bdbe1e-0670-4782-806e-aaa301f4a13a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:10:13.325847 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-10bdbe1e-0670-4782-806e-aaa301f4a13a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:10:13.326271 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-10bdbe1e-0670-4782-806e-aaa301f4a13a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:10:13.355037 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-10bdbe1e-0670-4782-806e-aaa301f4a13a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044548 Oct 20 06:10:13.355578 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 340/704] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:10:13 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:10:13.849966 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-e0581969-53e3-4d44-9c7d-beee5e973a51 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:10:13.851112 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-e0581969-53e3-4d44-9c7d-beee5e973a51 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:10:13.857561 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e0581969-53e3-4d44-9c7d-beee5e973a51 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:10:13.858036 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e0581969-53e3-4d44-9c7d-beee5e973a51 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:10:13.858468 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e0581969-53e3-4d44-9c7d-beee5e973a51 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:10:13.859155 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e0581969-53e3-4d44-9c7d-beee5e973a51 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:10:13.859605 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e0581969-53e3-4d44-9c7d-beee5e973a51 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:10:13.860029 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e0581969-53e3-4d44-9c7d-beee5e973a51 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:10:13.991508 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-e0581969-53e3-4d44-9c7d-beee5e973a51 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:10:13.999976 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-e0581969-53e3-4d44-9c7d-beee5e973a51 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:10:14.001462 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-e0581969-53e3-4d44-9c7d-beee5e973a51 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:10:14.002649 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-e0581969-53e3-4d44-9c7d-beee5e973a51 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1745 microversion: 2.20 time: 0.156664 Oct 20 06:10:14.003202 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 365/705] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:10:13 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1745 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:10:14.367539 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-df072529-dacc-4fd6-b6c1-0ddf25a9913f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:10:14.369753 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-df072529-dacc-4fd6-b6c1-0ddf25a9913f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:10:14.376013 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-df072529-dacc-4fd6-b6c1-0ddf25a9913f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:10:14.376488 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-df072529-dacc-4fd6-b6c1-0ddf25a9913f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:10:14.376958 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-df072529-dacc-4fd6-b6c1-0ddf25a9913f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:10:14.377638 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-df072529-dacc-4fd6-b6c1-0ddf25a9913f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:10:14.378091 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-df072529-dacc-4fd6-b6c1-0ddf25a9913f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:10:14.378508 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-df072529-dacc-4fd6-b6c1-0ddf25a9913f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:10:14.408051 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-df072529-dacc-4fd6-b6c1-0ddf25a9913f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044618 Oct 20 06:10:14.408580 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 341/706] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:10:14 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:10:15.029073 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-d5e64288-c9d1-4742-852a-5cbbf956d9c9 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:10:15.029704 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-d5e64288-c9d1-4742-852a-5cbbf956d9c9 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:10:15.036101 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d5e64288-c9d1-4742-852a-5cbbf956d9c9 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:10:15.036831 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d5e64288-c9d1-4742-852a-5cbbf956d9c9 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:10:15.037417 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d5e64288-c9d1-4742-852a-5cbbf956d9c9 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:10:15.038892 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d5e64288-c9d1-4742-852a-5cbbf956d9c9 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:10:15.039377 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d5e64288-c9d1-4742-852a-5cbbf956d9c9 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:10:15.039802 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d5e64288-c9d1-4742-852a-5cbbf956d9c9 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:10:15.165896 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-d5e64288-c9d1-4742-852a-5cbbf956d9c9 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:10:15.174535 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-d5e64288-c9d1-4742-852a-5cbbf956d9c9 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:10:15.175984 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-d5e64288-c9d1-4742-852a-5cbbf956d9c9 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:10:15.177275 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-d5e64288-c9d1-4742-852a-5cbbf956d9c9 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1745 microversion: 2.20 time: 0.152051 Oct 20 06:10:15.177836 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 366/707] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:10:15 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1745 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:10:15.419877 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-f9aa314c-f0f4-4eaa-969b-32857ef225aa tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:10:15.422081 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-f9aa314c-f0f4-4eaa-969b-32857ef225aa tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:10:15.428428 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f9aa314c-f0f4-4eaa-969b-32857ef225aa tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:10:15.428938 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f9aa314c-f0f4-4eaa-969b-32857ef225aa tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:10:15.429376 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f9aa314c-f0f4-4eaa-969b-32857ef225aa tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:10:15.430067 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f9aa314c-f0f4-4eaa-969b-32857ef225aa tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:10:15.430515 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f9aa314c-f0f4-4eaa-969b-32857ef225aa tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:10:15.430940 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f9aa314c-f0f4-4eaa-969b-32857ef225aa tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:10:15.459154 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-f9aa314c-f0f4-4eaa-969b-32857ef225aa tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043196 Oct 20 06:10:15.460196 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 342/708] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:10:15 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:10:16.202651 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-3ed8a56a-5cda-4cc5-a761-84e609c4e092 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:10:16.203253 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-3ed8a56a-5cda-4cc5-a761-84e609c4e092 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:10:16.209574 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-3ed8a56a-5cda-4cc5-a761-84e609c4e092 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:10:16.210049 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-3ed8a56a-5cda-4cc5-a761-84e609c4e092 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:10:16.210514 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-3ed8a56a-5cda-4cc5-a761-84e609c4e092 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:10:16.211267 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-3ed8a56a-5cda-4cc5-a761-84e609c4e092 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:10:16.211712 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-3ed8a56a-5cda-4cc5-a761-84e609c4e092 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:10:16.212130 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-3ed8a56a-5cda-4cc5-a761-84e609c4e092 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:10:16.344547 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-3ed8a56a-5cda-4cc5-a761-84e609c4e092 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:10:16.353549 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-3ed8a56a-5cda-4cc5-a761-84e609c4e092 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:10:16.355003 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-3ed8a56a-5cda-4cc5-a761-84e609c4e092 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:10:16.356163 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-3ed8a56a-5cda-4cc5-a761-84e609c4e092 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1745 microversion: 2.20 time: 0.157503 Oct 20 06:10:16.356756 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 367/709] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:10:16 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1745 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:10:16.471379 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-095e8f3b-2158-48d3-9b76-56317a0e70a1 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:10:16.473502 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-095e8f3b-2158-48d3-9b76-56317a0e70a1 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:10:16.480577 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-095e8f3b-2158-48d3-9b76-56317a0e70a1 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:10:16.481094 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-095e8f3b-2158-48d3-9b76-56317a0e70a1 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:10:16.481531 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-095e8f3b-2158-48d3-9b76-56317a0e70a1 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:10:16.482226 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-095e8f3b-2158-48d3-9b76-56317a0e70a1 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:10:16.482679 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-095e8f3b-2158-48d3-9b76-56317a0e70a1 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:10:16.483110 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-095e8f3b-2158-48d3-9b76-56317a0e70a1 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:10:16.512370 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-095e8f3b-2158-48d3-9b76-56317a0e70a1 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044920 Oct 20 06:10:16.512957 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 343/710] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:10:16 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:10:17.382247 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-6e75ffad-8a47-4b46-b9eb-e7de641644e3 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:10:17.382854 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-6e75ffad-8a47-4b46-b9eb-e7de641644e3 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:10:17.389261 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-6e75ffad-8a47-4b46-b9eb-e7de641644e3 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:10:17.389758 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-6e75ffad-8a47-4b46-b9eb-e7de641644e3 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:10:17.390162 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-6e75ffad-8a47-4b46-b9eb-e7de641644e3 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:10:17.390853 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-6e75ffad-8a47-4b46-b9eb-e7de641644e3 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:10:17.391310 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-6e75ffad-8a47-4b46-b9eb-e7de641644e3 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:10:17.391735 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-6e75ffad-8a47-4b46-b9eb-e7de641644e3 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:10:17.524738 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-7f2e89ec-8aa6-4e73-bb76-dac4af7868d7 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:10:17.526914 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-7f2e89ec-8aa6-4e73-bb76-dac4af7868d7 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:10:17.528103 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-6e75ffad-8a47-4b46-b9eb-e7de641644e3 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:10:17.532987 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7f2e89ec-8aa6-4e73-bb76-dac4af7868d7 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:10:17.533464 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7f2e89ec-8aa6-4e73-bb76-dac4af7868d7 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:10:17.533898 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7f2e89ec-8aa6-4e73-bb76-dac4af7868d7 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:10:17.534588 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7f2e89ec-8aa6-4e73-bb76-dac4af7868d7 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:10:17.535033 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7f2e89ec-8aa6-4e73-bb76-dac4af7868d7 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:10:17.535451 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7f2e89ec-8aa6-4e73-bb76-dac4af7868d7 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:10:17.536792 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-6e75ffad-8a47-4b46-b9eb-e7de641644e3 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:10:17.538328 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-6e75ffad-8a47-4b46-b9eb-e7de641644e3 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:10:17.540168 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-6e75ffad-8a47-4b46-b9eb-e7de641644e3 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1745 microversion: 2.20 time: 0.161961 Oct 20 06:10:17.540749 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 368/711] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:10:17 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1745 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:10:17.565463 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-7f2e89ec-8aa6-4e73-bb76-dac4af7868d7 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044685 Oct 20 06:10:17.566005 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 344/712] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:10:17 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 20 06:10:18.565857 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-e8546189-3fc8-43e4-9aa8-766fb7768d20 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:10:18.566391 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-e8546189-3fc8-43e4-9aa8-766fb7768d20 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:10:18.572795 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e8546189-3fc8-43e4-9aa8-766fb7768d20 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:10:18.573275 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e8546189-3fc8-43e4-9aa8-766fb7768d20 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:10:18.573703 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e8546189-3fc8-43e4-9aa8-766fb7768d20 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:10:18.574393 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e8546189-3fc8-43e4-9aa8-766fb7768d20 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:10:18.574842 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e8546189-3fc8-43e4-9aa8-766fb7768d20 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:10:18.575255 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e8546189-3fc8-43e4-9aa8-766fb7768d20 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:10:18.577805 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-6ca55c9c-897e-4bf3-a790-ec4b2d58db4c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:10:18.579971 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-6ca55c9c-897e-4bf3-a790-ec4b2d58db4c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:10:18.587116 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-6ca55c9c-897e-4bf3-a790-ec4b2d58db4c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:10:18.587598 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-6ca55c9c-897e-4bf3-a790-ec4b2d58db4c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:10:18.588033 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-6ca55c9c-897e-4bf3-a790-ec4b2d58db4c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:10:18.588750 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-6ca55c9c-897e-4bf3-a790-ec4b2d58db4c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:10:18.589206 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-6ca55c9c-897e-4bf3-a790-ec4b2d58db4c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:10:18.589628 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-6ca55c9c-897e-4bf3-a790-ec4b2d58db4c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:10:18.594196 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG dbcounter [-] [118861] Writing DB stats nova_cell1:SELECT=100 {{(pid=118861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:10:18.620019 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-6ca55c9c-897e-4bf3-a790-ec4b2d58db4c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046045 Oct 20 06:10:18.620590 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 345/713] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:10:18 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 20 06:10:18.705904 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-e8546189-3fc8-43e4-9aa8-766fb7768d20 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:10:18.714952 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-e8546189-3fc8-43e4-9aa8-766fb7768d20 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:10:18.716397 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-e8546189-3fc8-43e4-9aa8-766fb7768d20 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:10:18.717584 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-e8546189-3fc8-43e4-9aa8-766fb7768d20 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1745 microversion: 2.20 time: 0.155669 Oct 20 06:10:18.718143 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 369/714] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:10:18 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1745 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:10:19.631806 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-6ec2f1eb-ac10-4017-8c83-ace97e114298 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:10:19.634198 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-6ec2f1eb-ac10-4017-8c83-ace97e114298 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:10:19.640630 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-6ec2f1eb-ac10-4017-8c83-ace97e114298 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:10:19.641137 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-6ec2f1eb-ac10-4017-8c83-ace97e114298 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:10:19.641571 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-6ec2f1eb-ac10-4017-8c83-ace97e114298 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:10:19.642249 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-6ec2f1eb-ac10-4017-8c83-ace97e114298 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:10:19.642694 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-6ec2f1eb-ac10-4017-8c83-ace97e114298 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:10:19.643117 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-6ec2f1eb-ac10-4017-8c83-ace97e114298 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:10:19.672279 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-6ec2f1eb-ac10-4017-8c83-ace97e114298 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044666 Oct 20 06:10:19.672772 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 346/715] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:10:19 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:10:19.743919 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-cdd1a34a-fd84-4ed0-8934-42b811da6efe tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:10:19.744520 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-cdd1a34a-fd84-4ed0-8934-42b811da6efe tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:10:19.750928 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-cdd1a34a-fd84-4ed0-8934-42b811da6efe tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:10:19.751403 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-cdd1a34a-fd84-4ed0-8934-42b811da6efe tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:10:19.751835 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-cdd1a34a-fd84-4ed0-8934-42b811da6efe tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:10:19.752544 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-cdd1a34a-fd84-4ed0-8934-42b811da6efe tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:10:19.753030 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-cdd1a34a-fd84-4ed0-8934-42b811da6efe tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:10:19.753448 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-cdd1a34a-fd84-4ed0-8934-42b811da6efe tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:10:19.883885 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-cdd1a34a-fd84-4ed0-8934-42b811da6efe tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:10:19.892471 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-cdd1a34a-fd84-4ed0-8934-42b811da6efe tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:10:19.893950 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-cdd1a34a-fd84-4ed0-8934-42b811da6efe tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:10:19.895098 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-cdd1a34a-fd84-4ed0-8934-42b811da6efe tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1745 microversion: 2.20 time: 0.155710 Oct 20 06:10:19.895651 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 370/716] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:10:19 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1745 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:10:20.685142 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-0276598f-723c-4724-9fae-bc03da0defba tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:10:20.687326 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-0276598f-723c-4724-9fae-bc03da0defba tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:10:20.693640 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0276598f-723c-4724-9fae-bc03da0defba tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:10:20.694126 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0276598f-723c-4724-9fae-bc03da0defba tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:10:20.695136 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0276598f-723c-4724-9fae-bc03da0defba tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:10:20.695850 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0276598f-723c-4724-9fae-bc03da0defba tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:10:20.696308 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0276598f-723c-4724-9fae-bc03da0defba tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:10:20.696769 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0276598f-723c-4724-9fae-bc03da0defba tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:10:20.725276 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-0276598f-723c-4724-9fae-bc03da0defba tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044135 Oct 20 06:10:20.725825 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 347/717] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:10:20 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:10:20.922746 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-0c060e90-1eb3-449a-adf2-0a27b16549a3 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:10:20.923360 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-0c060e90-1eb3-449a-adf2-0a27b16549a3 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:10:20.930517 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-0c060e90-1eb3-449a-adf2-0a27b16549a3 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:10:20.930999 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-0c060e90-1eb3-449a-adf2-0a27b16549a3 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:10:20.931442 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-0c060e90-1eb3-449a-adf2-0a27b16549a3 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:10:20.932135 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-0c060e90-1eb3-449a-adf2-0a27b16549a3 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:10:20.932612 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-0c060e90-1eb3-449a-adf2-0a27b16549a3 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:10:20.933065 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-0c060e90-1eb3-449a-adf2-0a27b16549a3 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:10:21.059712 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-0c060e90-1eb3-449a-adf2-0a27b16549a3 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:10:21.068159 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-0c060e90-1eb3-449a-adf2-0a27b16549a3 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:10:21.069630 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-0c060e90-1eb3-449a-adf2-0a27b16549a3 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:10:21.070776 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-0c060e90-1eb3-449a-adf2-0a27b16549a3 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1745 microversion: 2.20 time: 0.151950 Oct 20 06:10:21.071335 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 371/718] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:10:20 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1745 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:10:21.737508 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-82dabfc1-3f14-457f-81c4-3637500884e6 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:10:21.739657 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-82dabfc1-3f14-457f-81c4-3637500884e6 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:10:21.746851 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-82dabfc1-3f14-457f-81c4-3637500884e6 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:10:21.747331 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-82dabfc1-3f14-457f-81c4-3637500884e6 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:10:21.747771 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-82dabfc1-3f14-457f-81c4-3637500884e6 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:10:21.748463 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-82dabfc1-3f14-457f-81c4-3637500884e6 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:10:21.748956 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-82dabfc1-3f14-457f-81c4-3637500884e6 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:10:21.749380 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-82dabfc1-3f14-457f-81c4-3637500884e6 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:10:21.778960 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-82dabfc1-3f14-457f-81c4-3637500884e6 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045310 Oct 20 06:10:21.779498 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 348/719] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:10:21 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:10:22.095782 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-a99ffd53-5b57-4776-9077-221f5bb9c550 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:10:22.096383 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-a99ffd53-5b57-4776-9077-221f5bb9c550 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:10:22.103587 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a99ffd53-5b57-4776-9077-221f5bb9c550 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:10:22.104063 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a99ffd53-5b57-4776-9077-221f5bb9c550 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:10:22.104494 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a99ffd53-5b57-4776-9077-221f5bb9c550 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:10:22.105201 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a99ffd53-5b57-4776-9077-221f5bb9c550 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:10:22.105645 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a99ffd53-5b57-4776-9077-221f5bb9c550 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:10:22.106063 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a99ffd53-5b57-4776-9077-221f5bb9c550 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:10:22.232210 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-a99ffd53-5b57-4776-9077-221f5bb9c550 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:10:22.240646 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-a99ffd53-5b57-4776-9077-221f5bb9c550 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:10:22.242111 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-a99ffd53-5b57-4776-9077-221f5bb9c550 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:10:22.243264 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-a99ffd53-5b57-4776-9077-221f5bb9c550 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1745 microversion: 2.20 time: 0.151392 Oct 20 06:10:22.243822 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 372/720] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:10:22 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1745 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:10:22.791186 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-d6af1b47-a8e6-4e82-8ea2-7ce2cfc89b85 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:10:22.793360 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-d6af1b47-a8e6-4e82-8ea2-7ce2cfc89b85 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:10:22.799685 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-d6af1b47-a8e6-4e82-8ea2-7ce2cfc89b85 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:10:22.800170 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-d6af1b47-a8e6-4e82-8ea2-7ce2cfc89b85 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:10:22.800605 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-d6af1b47-a8e6-4e82-8ea2-7ce2cfc89b85 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:10:22.801318 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-d6af1b47-a8e6-4e82-8ea2-7ce2cfc89b85 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:10:22.801766 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-d6af1b47-a8e6-4e82-8ea2-7ce2cfc89b85 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:10:22.802190 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-d6af1b47-a8e6-4e82-8ea2-7ce2cfc89b85 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:10:22.832048 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-d6af1b47-a8e6-4e82-8ea2-7ce2cfc89b85 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044725 Oct 20 06:10:22.832534 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 349/721] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:10:22 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:10:23.268919 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-f64b856b-61cc-4154-aded-11c9cbaa8aec tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:10:23.269526 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-f64b856b-61cc-4154-aded-11c9cbaa8aec tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:10:23.276179 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f64b856b-61cc-4154-aded-11c9cbaa8aec tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:10:23.276658 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f64b856b-61cc-4154-aded-11c9cbaa8aec tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:10:23.277125 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f64b856b-61cc-4154-aded-11c9cbaa8aec tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:10:23.277812 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f64b856b-61cc-4154-aded-11c9cbaa8aec tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:10:23.278259 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f64b856b-61cc-4154-aded-11c9cbaa8aec tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:10:23.278682 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f64b856b-61cc-4154-aded-11c9cbaa8aec tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:10:23.407454 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-f64b856b-61cc-4154-aded-11c9cbaa8aec tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:10:23.416657 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-f64b856b-61cc-4154-aded-11c9cbaa8aec tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:10:23.418120 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-f64b856b-61cc-4154-aded-11c9cbaa8aec tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:10:23.419264 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-f64b856b-61cc-4154-aded-11c9cbaa8aec tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1745 microversion: 2.20 time: 0.154326 Oct 20 06:10:23.419816 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 373/722] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:10:23 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1745 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:10:23.844918 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-34a88c51-f713-457f-84fd-18ea4b7632a5 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:10:23.847053 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-34a88c51-f713-457f-84fd-18ea4b7632a5 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:10:23.854147 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-34a88c51-f713-457f-84fd-18ea4b7632a5 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:10:23.854619 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-34a88c51-f713-457f-84fd-18ea4b7632a5 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:10:23.855050 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-34a88c51-f713-457f-84fd-18ea4b7632a5 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:10:23.855728 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-34a88c51-f713-457f-84fd-18ea4b7632a5 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:10:23.856175 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-34a88c51-f713-457f-84fd-18ea4b7632a5 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:10:23.856592 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-34a88c51-f713-457f-84fd-18ea4b7632a5 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:10:23.885192 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-34a88c51-f713-457f-84fd-18ea4b7632a5 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044213 Oct 20 06:10:23.885764 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 350/723] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:10:23 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 20 06:10:24.446172 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-13f0c565-c0d6-4cce-a851-c7ebebf3adc9 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:10:24.446779 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-13f0c565-c0d6-4cce-a851-c7ebebf3adc9 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:10:24.453412 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-13f0c565-c0d6-4cce-a851-c7ebebf3adc9 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:10:24.453901 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-13f0c565-c0d6-4cce-a851-c7ebebf3adc9 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:10:24.454341 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-13f0c565-c0d6-4cce-a851-c7ebebf3adc9 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:10:24.455041 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-13f0c565-c0d6-4cce-a851-c7ebebf3adc9 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:10:24.455493 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-13f0c565-c0d6-4cce-a851-c7ebebf3adc9 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:10:24.455918 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-13f0c565-c0d6-4cce-a851-c7ebebf3adc9 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:10:24.580051 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-13f0c565-c0d6-4cce-a851-c7ebebf3adc9 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:10:24.589245 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-13f0c565-c0d6-4cce-a851-c7ebebf3adc9 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:10:24.590716 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-13f0c565-c0d6-4cce-a851-c7ebebf3adc9 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:10:24.591868 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-13f0c565-c0d6-4cce-a851-c7ebebf3adc9 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1745 microversion: 2.20 time: 0.149947 Oct 20 06:10:24.592420 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 374/724] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:10:24 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1745 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:10:24.897407 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-0565c93d-999d-4b45-8812-3be3f6a20e6c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:10:24.900132 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-0565c93d-999d-4b45-8812-3be3f6a20e6c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:10:24.906505 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0565c93d-999d-4b45-8812-3be3f6a20e6c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:10:24.906984 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0565c93d-999d-4b45-8812-3be3f6a20e6c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:10:24.907410 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0565c93d-999d-4b45-8812-3be3f6a20e6c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:10:24.908091 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0565c93d-999d-4b45-8812-3be3f6a20e6c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:10:24.908537 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0565c93d-999d-4b45-8812-3be3f6a20e6c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:10:24.908993 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0565c93d-999d-4b45-8812-3be3f6a20e6c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:10:24.933322 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG dbcounter [-] [118860] Writing DB stats nova_cell1:SELECT=100 {{(pid=118860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:10:24.938503 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-0565c93d-999d-4b45-8812-3be3f6a20e6c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045044 Oct 20 06:10:24.939056 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 351/725] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:10:24 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:10:25.616658 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-eef124ea-c665-4271-b8af-37908980fee2 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:10:25.617227 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-eef124ea-c665-4271-b8af-37908980fee2 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:10:25.623810 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-eef124ea-c665-4271-b8af-37908980fee2 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:10:25.624293 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-eef124ea-c665-4271-b8af-37908980fee2 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:10:25.624762 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-eef124ea-c665-4271-b8af-37908980fee2 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:10:25.625463 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-eef124ea-c665-4271-b8af-37908980fee2 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:10:25.625925 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-eef124ea-c665-4271-b8af-37908980fee2 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:10:25.626353 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-eef124ea-c665-4271-b8af-37908980fee2 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:10:25.756508 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-eef124ea-c665-4271-b8af-37908980fee2 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:10:25.766324 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-eef124ea-c665-4271-b8af-37908980fee2 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:10:25.767754 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-eef124ea-c665-4271-b8af-37908980fee2 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:10:25.768934 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-eef124ea-c665-4271-b8af-37908980fee2 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1745 microversion: 2.20 time: 0.156275 Oct 20 06:10:25.769496 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 375/726] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:10:25 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1745 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:10:25.951924 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-763fd133-0ba9-4293-9e7e-c9debe1cc9c0 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:10:25.954128 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-763fd133-0ba9-4293-9e7e-c9debe1cc9c0 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:10:25.960463 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-763fd133-0ba9-4293-9e7e-c9debe1cc9c0 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:10:25.960983 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-763fd133-0ba9-4293-9e7e-c9debe1cc9c0 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:10:25.961441 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-763fd133-0ba9-4293-9e7e-c9debe1cc9c0 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:10:25.962140 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-763fd133-0ba9-4293-9e7e-c9debe1cc9c0 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:10:25.962589 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-763fd133-0ba9-4293-9e7e-c9debe1cc9c0 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:10:25.963014 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-763fd133-0ba9-4293-9e7e-c9debe1cc9c0 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:10:25.991535 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-763fd133-0ba9-4293-9e7e-c9debe1cc9c0 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043988 Oct 20 06:10:25.992084 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 352/727] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:10:25 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:10:26.796262 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-0be77208-119b-49db-b75c-d7235e866a46 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:10:26.796927 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-0be77208-119b-49db-b75c-d7235e866a46 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:10:26.803316 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-0be77208-119b-49db-b75c-d7235e866a46 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:10:26.803801 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-0be77208-119b-49db-b75c-d7235e866a46 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:10:26.804236 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-0be77208-119b-49db-b75c-d7235e866a46 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:10:26.804960 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-0be77208-119b-49db-b75c-d7235e866a46 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:10:26.806064 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-0be77208-119b-49db-b75c-d7235e866a46 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:10:26.806495 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-0be77208-119b-49db-b75c-d7235e866a46 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:10:26.944265 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-0be77208-119b-49db-b75c-d7235e866a46 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:10:26.954453 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-0be77208-119b-49db-b75c-d7235e866a46 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:10:26.955858 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-0be77208-119b-49db-b75c-d7235e866a46 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:10:26.957027 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-0be77208-119b-49db-b75c-d7235e866a46 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1745 microversion: 2.20 time: 0.164642 Oct 20 06:10:26.957573 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 376/728] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:10:26 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1745 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:10:27.004361 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-6399def3-b026-4887-bda5-2e00fe9bbefd tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:10:27.006969 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-6399def3-b026-4887-bda5-2e00fe9bbefd tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:10:27.013546 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-6399def3-b026-4887-bda5-2e00fe9bbefd tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:10:27.014044 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-6399def3-b026-4887-bda5-2e00fe9bbefd tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:10:27.014466 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-6399def3-b026-4887-bda5-2e00fe9bbefd tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:10:27.015165 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-6399def3-b026-4887-bda5-2e00fe9bbefd tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:10:27.015616 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-6399def3-b026-4887-bda5-2e00fe9bbefd tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:10:27.016045 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-6399def3-b026-4887-bda5-2e00fe9bbefd tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:10:27.046462 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-6399def3-b026-4887-bda5-2e00fe9bbefd tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045907 Oct 20 06:10:27.046951 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 353/729] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:10:26 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:10:27.982894 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-30c83d04-4e5b-4a64-931b-0bc4f5c525db tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:10:27.983509 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-30c83d04-4e5b-4a64-931b-0bc4f5c525db tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:10:27.990666 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-30c83d04-4e5b-4a64-931b-0bc4f5c525db tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:10:27.991162 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-30c83d04-4e5b-4a64-931b-0bc4f5c525db tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:10:27.991603 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-30c83d04-4e5b-4a64-931b-0bc4f5c525db tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:10:27.992307 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-30c83d04-4e5b-4a64-931b-0bc4f5c525db tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:10:27.992980 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-30c83d04-4e5b-4a64-931b-0bc4f5c525db tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:10:27.993604 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-30c83d04-4e5b-4a64-931b-0bc4f5c525db tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:10:28.059264 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-2681daf4-cea9-44c4-825d-a1e242de4be5 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:10:28.061428 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-2681daf4-cea9-44c4-825d-a1e242de4be5 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:10:28.067649 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2681daf4-cea9-44c4-825d-a1e242de4be5 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:10:28.068127 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2681daf4-cea9-44c4-825d-a1e242de4be5 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:10:28.068559 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2681daf4-cea9-44c4-825d-a1e242de4be5 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:10:28.069279 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2681daf4-cea9-44c4-825d-a1e242de4be5 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:10:28.069725 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2681daf4-cea9-44c4-825d-a1e242de4be5 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:10:28.070144 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2681daf4-cea9-44c4-825d-a1e242de4be5 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:10:28.100485 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-2681daf4-cea9-44c4-825d-a1e242de4be5 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045646 Oct 20 06:10:28.101089 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 354/730] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:10:28 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 20 06:10:28.126428 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-30c83d04-4e5b-4a64-931b-0bc4f5c525db tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:10:28.135228 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-30c83d04-4e5b-4a64-931b-0bc4f5c525db tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:10:28.136669 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-30c83d04-4e5b-4a64-931b-0bc4f5c525db tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:10:28.137841 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-30c83d04-4e5b-4a64-931b-0bc4f5c525db tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1745 microversion: 2.20 time: 0.158788 Oct 20 06:10:28.138399 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 377/731] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:10:27 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1745 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:10:29.113471 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-7beb9fa7-a86e-4067-ac62-cf0f3540b974 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:10:29.115691 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-7beb9fa7-a86e-4067-ac62-cf0f3540b974 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:10:29.122268 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7beb9fa7-a86e-4067-ac62-cf0f3540b974 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:10:29.122756 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7beb9fa7-a86e-4067-ac62-cf0f3540b974 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:10:29.123199 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7beb9fa7-a86e-4067-ac62-cf0f3540b974 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:10:29.123895 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7beb9fa7-a86e-4067-ac62-cf0f3540b974 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:10:29.124353 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7beb9fa7-a86e-4067-ac62-cf0f3540b974 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:10:29.124843 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7beb9fa7-a86e-4067-ac62-cf0f3540b974 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:10:29.153980 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-7beb9fa7-a86e-4067-ac62-cf0f3540b974 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044371 Oct 20 06:10:29.154523 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 355/732] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:10:29 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:10:29.163263 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-9341018e-ecc5-4a32-b28f-f5284a31cf70 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:10:29.163919 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-9341018e-ecc5-4a32-b28f-f5284a31cf70 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:10:29.170873 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-9341018e-ecc5-4a32-b28f-f5284a31cf70 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:10:29.171348 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-9341018e-ecc5-4a32-b28f-f5284a31cf70 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:10:29.171779 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-9341018e-ecc5-4a32-b28f-f5284a31cf70 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:10:29.172464 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-9341018e-ecc5-4a32-b28f-f5284a31cf70 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:10:29.172953 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-9341018e-ecc5-4a32-b28f-f5284a31cf70 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:10:29.173377 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-9341018e-ecc5-4a32-b28f-f5284a31cf70 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:10:29.297430 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-9341018e-ecc5-4a32-b28f-f5284a31cf70 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:10:29.306420 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-9341018e-ecc5-4a32-b28f-f5284a31cf70 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:10:29.307849 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-9341018e-ecc5-4a32-b28f-f5284a31cf70 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:10:29.309025 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-9341018e-ecc5-4a32-b28f-f5284a31cf70 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1745 microversion: 2.20 time: 0.149641 Oct 20 06:10:29.309575 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 378/733] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:10:29 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1745 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:10:30.166959 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-8d2c6a44-7f3c-4cfb-aea9-b1423fe30d97 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:10:30.169135 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-8d2c6a44-7f3c-4cfb-aea9-b1423fe30d97 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:10:30.171468 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG dbcounter [-] [118860] Writing DB stats nova_api:SELECT=58 {{(pid=118860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:10:30.176666 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-8d2c6a44-7f3c-4cfb-aea9-b1423fe30d97 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:10:30.177182 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-8d2c6a44-7f3c-4cfb-aea9-b1423fe30d97 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:10:30.177618 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-8d2c6a44-7f3c-4cfb-aea9-b1423fe30d97 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:10:30.178309 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-8d2c6a44-7f3c-4cfb-aea9-b1423fe30d97 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:10:30.178761 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-8d2c6a44-7f3c-4cfb-aea9-b1423fe30d97 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:10:30.179220 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-8d2c6a44-7f3c-4cfb-aea9-b1423fe30d97 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:10:30.208675 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-8d2c6a44-7f3c-4cfb-aea9-b1423fe30d97 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046068 Oct 20 06:10:30.209246 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 356/734] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:10:30 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:10:30.334710 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-b70e55a2-5412-4db0-9b94-0ae77bb7731a tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:10:30.335309 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-b70e55a2-5412-4db0-9b94-0ae77bb7731a tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:10:30.338229 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG dbcounter [-] [118861] Writing DB stats nova_api:SELECT=52 {{(pid=118861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:10:30.343731 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b70e55a2-5412-4db0-9b94-0ae77bb7731a tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:10:30.344214 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b70e55a2-5412-4db0-9b94-0ae77bb7731a tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:10:30.344643 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b70e55a2-5412-4db0-9b94-0ae77bb7731a tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:10:30.345354 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b70e55a2-5412-4db0-9b94-0ae77bb7731a tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:10:30.345800 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b70e55a2-5412-4db0-9b94-0ae77bb7731a tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:10:30.346220 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b70e55a2-5412-4db0-9b94-0ae77bb7731a tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:10:30.472472 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-b70e55a2-5412-4db0-9b94-0ae77bb7731a tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:10:30.482030 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-b70e55a2-5412-4db0-9b94-0ae77bb7731a tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:10:30.483469 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-b70e55a2-5412-4db0-9b94-0ae77bb7731a tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:10:30.484628 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-b70e55a2-5412-4db0-9b94-0ae77bb7731a tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1745 microversion: 2.20 time: 0.153913 Oct 20 06:10:30.485234 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 379/735] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:10:30 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1745 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:10:31.221214 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-5f56cb13-9a5d-4b4d-a220-634ddd73d3a9 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:10:31.223440 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-5f56cb13-9a5d-4b4d-a220-634ddd73d3a9 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:10:31.229957 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5f56cb13-9a5d-4b4d-a220-634ddd73d3a9 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:10:31.230437 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5f56cb13-9a5d-4b4d-a220-634ddd73d3a9 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:10:31.230874 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5f56cb13-9a5d-4b4d-a220-634ddd73d3a9 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:10:31.231564 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5f56cb13-9a5d-4b4d-a220-634ddd73d3a9 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:10:31.232025 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5f56cb13-9a5d-4b4d-a220-634ddd73d3a9 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:10:31.232454 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5f56cb13-9a5d-4b4d-a220-634ddd73d3a9 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:10:31.262471 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-5f56cb13-9a5d-4b4d-a220-634ddd73d3a9 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045222 Oct 20 06:10:31.263014 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 357/736] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:10:31 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:10:31.510452 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-acd726b2-3d70-4387-9e73-cbb54488a066 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:10:31.511057 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-acd726b2-3d70-4387-9e73-cbb54488a066 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:10:31.517515 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-acd726b2-3d70-4387-9e73-cbb54488a066 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:10:31.517998 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-acd726b2-3d70-4387-9e73-cbb54488a066 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:10:31.518429 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-acd726b2-3d70-4387-9e73-cbb54488a066 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:10:31.519143 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-acd726b2-3d70-4387-9e73-cbb54488a066 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:10:31.519597 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-acd726b2-3d70-4387-9e73-cbb54488a066 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:10:31.520016 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-acd726b2-3d70-4387-9e73-cbb54488a066 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:10:31.648504 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-acd726b2-3d70-4387-9e73-cbb54488a066 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:10:31.657514 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-acd726b2-3d70-4387-9e73-cbb54488a066 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:10:31.658960 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-acd726b2-3d70-4387-9e73-cbb54488a066 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:10:31.660099 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-acd726b2-3d70-4387-9e73-cbb54488a066 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1745 microversion: 2.20 time: 0.153581 Oct 20 06:10:31.660652 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 380/737] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:10:31 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1745 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:10:32.274953 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-967f5a71-3bc1-4d4c-8d72-2e61d5969b1f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:10:32.277162 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-967f5a71-3bc1-4d4c-8d72-2e61d5969b1f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:10:32.283490 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-967f5a71-3bc1-4d4c-8d72-2e61d5969b1f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:10:32.283965 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-967f5a71-3bc1-4d4c-8d72-2e61d5969b1f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:10:32.284397 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-967f5a71-3bc1-4d4c-8d72-2e61d5969b1f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:10:32.285243 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-967f5a71-3bc1-4d4c-8d72-2e61d5969b1f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:10:32.285694 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-967f5a71-3bc1-4d4c-8d72-2e61d5969b1f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:10:32.286118 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-967f5a71-3bc1-4d4c-8d72-2e61d5969b1f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:10:32.316635 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-967f5a71-3bc1-4d4c-8d72-2e61d5969b1f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046263 Oct 20 06:10:32.317214 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 358/738] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:10:32 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:10:32.686220 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-0030513c-d576-407e-a4f2-7a787873812b tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:10:32.686834 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-0030513c-d576-407e-a4f2-7a787873812b tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:10:32.693241 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-0030513c-d576-407e-a4f2-7a787873812b tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:10:32.693725 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-0030513c-d576-407e-a4f2-7a787873812b tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:10:32.694164 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-0030513c-d576-407e-a4f2-7a787873812b tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:10:32.694858 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-0030513c-d576-407e-a4f2-7a787873812b tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:10:32.695329 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-0030513c-d576-407e-a4f2-7a787873812b tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:10:32.695744 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-0030513c-d576-407e-a4f2-7a787873812b tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:10:32.822734 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-0030513c-d576-407e-a4f2-7a787873812b tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:10:32.831270 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-0030513c-d576-407e-a4f2-7a787873812b tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:10:32.832721 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-0030513c-d576-407e-a4f2-7a787873812b tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:10:32.833907 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-0030513c-d576-407e-a4f2-7a787873812b tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1745 microversion: 2.20 time: 0.151613 Oct 20 06:10:32.834459 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 381/739] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:10:32 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1745 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:10:33.328854 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-1743f0a7-e711-496d-8ca5-63429d6078de tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:10:33.330981 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-1743f0a7-e711-496d-8ca5-63429d6078de tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:10:33.337863 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1743f0a7-e711-496d-8ca5-63429d6078de tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:10:33.338419 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1743f0a7-e711-496d-8ca5-63429d6078de tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:10:33.338850 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1743f0a7-e711-496d-8ca5-63429d6078de tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:10:33.339534 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1743f0a7-e711-496d-8ca5-63429d6078de tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:10:33.339981 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1743f0a7-e711-496d-8ca5-63429d6078de tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:10:33.340402 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1743f0a7-e711-496d-8ca5-63429d6078de tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:10:33.369200 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-1743f0a7-e711-496d-8ca5-63429d6078de tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044229 Oct 20 06:10:33.369732 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 359/740] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:10:33 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 20 06:10:33.859891 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-bba1021b-350e-4cfe-ad58-b43b18432182 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:10:33.860502 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-bba1021b-350e-4cfe-ad58-b43b18432182 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:10:33.866895 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-bba1021b-350e-4cfe-ad58-b43b18432182 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:10:33.867397 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-bba1021b-350e-4cfe-ad58-b43b18432182 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:10:33.867939 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-bba1021b-350e-4cfe-ad58-b43b18432182 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:10:33.868638 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-bba1021b-350e-4cfe-ad58-b43b18432182 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:10:33.869123 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-bba1021b-350e-4cfe-ad58-b43b18432182 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:10:33.869551 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-bba1021b-350e-4cfe-ad58-b43b18432182 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:10:34.000106 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-bba1021b-350e-4cfe-ad58-b43b18432182 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:10:34.009470 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-bba1021b-350e-4cfe-ad58-b43b18432182 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:10:34.010912 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-bba1021b-350e-4cfe-ad58-b43b18432182 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:10:34.012077 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-bba1021b-350e-4cfe-ad58-b43b18432182 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1745 microversion: 2.20 time: 0.156082 Oct 20 06:10:34.012628 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 382/741] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:10:33 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1745 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:10:34.381700 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-b25fb0b8-415b-4796-a64d-704394eecfbe tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:10:34.385020 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-b25fb0b8-415b-4796-a64d-704394eecfbe tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:10:34.391362 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b25fb0b8-415b-4796-a64d-704394eecfbe tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:10:34.391817 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b25fb0b8-415b-4796-a64d-704394eecfbe tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:10:34.392249 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b25fb0b8-415b-4796-a64d-704394eecfbe tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:10:34.392969 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b25fb0b8-415b-4796-a64d-704394eecfbe tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:10:34.393423 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b25fb0b8-415b-4796-a64d-704394eecfbe tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:10:34.393872 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b25fb0b8-415b-4796-a64d-704394eecfbe tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:10:34.423650 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-b25fb0b8-415b-4796-a64d-704394eecfbe tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046139 Oct 20 06:10:34.424197 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 360/742] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:10:34 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:10:35.037222 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-58021d5f-ba28-4dd1-b55e-c2caa6a10ea4 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:10:35.037837 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-58021d5f-ba28-4dd1-b55e-c2caa6a10ea4 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:10:35.045436 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-58021d5f-ba28-4dd1-b55e-c2caa6a10ea4 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:10:35.045921 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-58021d5f-ba28-4dd1-b55e-c2caa6a10ea4 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:10:35.046356 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-58021d5f-ba28-4dd1-b55e-c2caa6a10ea4 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:10:35.047050 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-58021d5f-ba28-4dd1-b55e-c2caa6a10ea4 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:10:35.047505 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-58021d5f-ba28-4dd1-b55e-c2caa6a10ea4 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:10:35.047939 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-58021d5f-ba28-4dd1-b55e-c2caa6a10ea4 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:10:35.173316 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-58021d5f-ba28-4dd1-b55e-c2caa6a10ea4 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:10:35.182140 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-58021d5f-ba28-4dd1-b55e-c2caa6a10ea4 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:10:35.183606 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-58021d5f-ba28-4dd1-b55e-c2caa6a10ea4 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:10:35.184823 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-58021d5f-ba28-4dd1-b55e-c2caa6a10ea4 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1745 microversion: 2.20 time: 0.151541 Oct 20 06:10:35.185387 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 383/743] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:10:35 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1745 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:10:35.435599 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-7d8701d2-a990-488f-8cb3-8f4464991aa8 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:10:35.438075 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-7d8701d2-a990-488f-8cb3-8f4464991aa8 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:10:35.444371 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7d8701d2-a990-488f-8cb3-8f4464991aa8 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:10:35.444886 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7d8701d2-a990-488f-8cb3-8f4464991aa8 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:10:35.445823 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7d8701d2-a990-488f-8cb3-8f4464991aa8 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:10:35.446592 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7d8701d2-a990-488f-8cb3-8f4464991aa8 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:10:35.447034 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7d8701d2-a990-488f-8cb3-8f4464991aa8 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:10:35.447451 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7d8701d2-a990-488f-8cb3-8f4464991aa8 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:10:35.477004 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-7d8701d2-a990-488f-8cb3-8f4464991aa8 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045346 Oct 20 06:10:35.477561 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 361/744] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:10:35 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:10:36.211972 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-66f8d0c4-d3db-4f44-9f0c-95a5aa73a185 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:10:36.212538 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-66f8d0c4-d3db-4f44-9f0c-95a5aa73a185 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:10:36.218973 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-66f8d0c4-d3db-4f44-9f0c-95a5aa73a185 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:10:36.219452 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-66f8d0c4-d3db-4f44-9f0c-95a5aa73a185 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:10:36.219886 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-66f8d0c4-d3db-4f44-9f0c-95a5aa73a185 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:10:36.220579 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-66f8d0c4-d3db-4f44-9f0c-95a5aa73a185 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:10:36.221130 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-66f8d0c4-d3db-4f44-9f0c-95a5aa73a185 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:10:36.221556 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-66f8d0c4-d3db-4f44-9f0c-95a5aa73a185 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:10:36.348189 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-66f8d0c4-d3db-4f44-9f0c-95a5aa73a185 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:10:36.356859 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-66f8d0c4-d3db-4f44-9f0c-95a5aa73a185 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:10:36.358282 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-66f8d0c4-d3db-4f44-9f0c-95a5aa73a185 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:10:36.359429 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-66f8d0c4-d3db-4f44-9f0c-95a5aa73a185 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1745 microversion: 2.20 time: 0.152243 Oct 20 06:10:36.359983 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 384/745] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:10:36 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1745 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:10:36.488479 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-d0b1a241-fb1f-4b6c-b9a7-84328a8f8242 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:10:36.490732 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-d0b1a241-fb1f-4b6c-b9a7-84328a8f8242 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:10:36.498196 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-d0b1a241-fb1f-4b6c-b9a7-84328a8f8242 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:10:36.498760 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-d0b1a241-fb1f-4b6c-b9a7-84328a8f8242 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:10:36.499266 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-d0b1a241-fb1f-4b6c-b9a7-84328a8f8242 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:10:36.500069 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-d0b1a241-fb1f-4b6c-b9a7-84328a8f8242 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:10:36.500521 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-d0b1a241-fb1f-4b6c-b9a7-84328a8f8242 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:10:36.500992 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-d0b1a241-fb1f-4b6c-b9a7-84328a8f8242 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:10:36.530967 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-d0b1a241-fb1f-4b6c-b9a7-84328a8f8242 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046422 Oct 20 06:10:36.531518 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 362/746] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:10:36 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:10:37.386265 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-9bb8d9a8-f495-4d24-a7b5-0d0aaf023988 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:10:37.386877 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-9bb8d9a8-f495-4d24-a7b5-0d0aaf023988 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:10:37.393263 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-9bb8d9a8-f495-4d24-a7b5-0d0aaf023988 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:10:37.393749 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-9bb8d9a8-f495-4d24-a7b5-0d0aaf023988 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:10:37.394195 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-9bb8d9a8-f495-4d24-a7b5-0d0aaf023988 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:10:37.394897 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-9bb8d9a8-f495-4d24-a7b5-0d0aaf023988 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:10:37.395354 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-9bb8d9a8-f495-4d24-a7b5-0d0aaf023988 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:10:37.395778 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-9bb8d9a8-f495-4d24-a7b5-0d0aaf023988 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:10:37.534390 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-9bb8d9a8-f495-4d24-a7b5-0d0aaf023988 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:10:37.543793 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-2da0c33a-6aa7-4e2b-be3c-c60e8097f41f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:10:37.544459 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-9bb8d9a8-f495-4d24-a7b5-0d0aaf023988 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:10:37.546048 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-9bb8d9a8-f495-4d24-a7b5-0d0aaf023988 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:10:37.546229 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-2da0c33a-6aa7-4e2b-be3c-c60e8097f41f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:10:37.547369 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-9bb8d9a8-f495-4d24-a7b5-0d0aaf023988 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1745 microversion: 2.20 time: 0.165698 Oct 20 06:10:37.548108 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 385/747] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:10:37 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1745 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:10:37.553091 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2da0c33a-6aa7-4e2b-be3c-c60e8097f41f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:10:37.553579 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2da0c33a-6aa7-4e2b-be3c-c60e8097f41f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:10:37.554021 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2da0c33a-6aa7-4e2b-be3c-c60e8097f41f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:10:37.554798 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2da0c33a-6aa7-4e2b-be3c-c60e8097f41f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:10:37.555246 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2da0c33a-6aa7-4e2b-be3c-c60e8097f41f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:10:37.555675 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2da0c33a-6aa7-4e2b-be3c-c60e8097f41f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:10:37.585583 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-2da0c33a-6aa7-4e2b-be3c-c60e8097f41f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046221 Oct 20 06:10:37.586663 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 363/748] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:10:37 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 20 06:10:38.573655 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-b2867898-8064-4bd6-8d7b-cdaef564a9cc tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:10:38.574259 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-b2867898-8064-4bd6-8d7b-cdaef564a9cc tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:10:38.580570 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b2867898-8064-4bd6-8d7b-cdaef564a9cc tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:10:38.581083 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b2867898-8064-4bd6-8d7b-cdaef564a9cc tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:10:38.581513 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b2867898-8064-4bd6-8d7b-cdaef564a9cc tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:10:38.582199 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b2867898-8064-4bd6-8d7b-cdaef564a9cc tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:10:38.582648 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b2867898-8064-4bd6-8d7b-cdaef564a9cc tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:10:38.583063 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b2867898-8064-4bd6-8d7b-cdaef564a9cc tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:10:38.587538 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG dbcounter [-] [118861] Writing DB stats nova_cell1:SELECT=100 {{(pid=118861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:10:38.597665 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-413ee27d-b1cc-47f0-940e-d67d8e6de24c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:10:38.600884 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-413ee27d-b1cc-47f0-940e-d67d8e6de24c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:10:38.607487 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-413ee27d-b1cc-47f0-940e-d67d8e6de24c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:10:38.608058 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-413ee27d-b1cc-47f0-940e-d67d8e6de24c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:10:38.608591 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-413ee27d-b1cc-47f0-940e-d67d8e6de24c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:10:38.609538 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-413ee27d-b1cc-47f0-940e-d67d8e6de24c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:10:38.610067 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-413ee27d-b1cc-47f0-940e-d67d8e6de24c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:10:38.610573 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-413ee27d-b1cc-47f0-940e-d67d8e6de24c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:10:38.643848 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-413ee27d-b1cc-47f0-940e-d67d8e6de24c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050068 Oct 20 06:10:38.644608 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 364/749] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:10:38 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 20 06:10:38.724479 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-b2867898-8064-4bd6-8d7b-cdaef564a9cc tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:10:38.733656 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-b2867898-8064-4bd6-8d7b-cdaef564a9cc tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:10:38.735136 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-b2867898-8064-4bd6-8d7b-cdaef564a9cc tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:10:38.736261 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-b2867898-8064-4bd6-8d7b-cdaef564a9cc tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1745 microversion: 2.20 time: 0.166650 Oct 20 06:10:38.736832 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 386/750] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:10:38 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1745 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:10:39.655548 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-ed057228-8089-47a1-bb5e-91e6f3950f81 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:10:39.657675 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-ed057228-8089-47a1-bb5e-91e6f3950f81 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:10:39.664594 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-ed057228-8089-47a1-bb5e-91e6f3950f81 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:10:39.665139 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-ed057228-8089-47a1-bb5e-91e6f3950f81 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:10:39.665574 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-ed057228-8089-47a1-bb5e-91e6f3950f81 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:10:39.666260 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-ed057228-8089-47a1-bb5e-91e6f3950f81 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:10:39.666771 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-ed057228-8089-47a1-bb5e-91e6f3950f81 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:10:39.667198 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-ed057228-8089-47a1-bb5e-91e6f3950f81 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:10:39.699576 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-ed057228-8089-47a1-bb5e-91e6f3950f81 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048065 Oct 20 06:10:39.700141 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 365/751] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:10:39 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:10:39.762087 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-ea221834-62d2-4109-94e6-c4a6b3c98acc tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:10:39.762695 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-ea221834-62d2-4109-94e6-c4a6b3c98acc tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:10:39.769066 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ea221834-62d2-4109-94e6-c4a6b3c98acc tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:10:39.769610 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ea221834-62d2-4109-94e6-c4a6b3c98acc tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:10:39.770052 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ea221834-62d2-4109-94e6-c4a6b3c98acc tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:10:39.770753 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ea221834-62d2-4109-94e6-c4a6b3c98acc tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:10:39.771201 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ea221834-62d2-4109-94e6-c4a6b3c98acc tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:10:39.771623 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ea221834-62d2-4109-94e6-c4a6b3c98acc tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:10:39.904714 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-ea221834-62d2-4109-94e6-c4a6b3c98acc tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:10:39.913237 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-ea221834-62d2-4109-94e6-c4a6b3c98acc tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:10:39.915200 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-ea221834-62d2-4109-94e6-c4a6b3c98acc tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:10:39.916351 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-ea221834-62d2-4109-94e6-c4a6b3c98acc tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1745 microversion: 2.20 time: 0.158754 Oct 20 06:10:39.916933 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 387/752] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:10:39 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1745 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:10:40.711417 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-22c04cd4-b42d-450f-9088-9e3ec2dcbfa4 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:10:40.713580 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-22c04cd4-b42d-450f-9088-9e3ec2dcbfa4 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:10:40.719772 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-22c04cd4-b42d-450f-9088-9e3ec2dcbfa4 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:10:40.720251 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-22c04cd4-b42d-450f-9088-9e3ec2dcbfa4 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:10:40.720762 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-22c04cd4-b42d-450f-9088-9e3ec2dcbfa4 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:10:40.721472 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-22c04cd4-b42d-450f-9088-9e3ec2dcbfa4 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:10:40.721819 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-22c04cd4-b42d-450f-9088-9e3ec2dcbfa4 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:10:40.722235 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-22c04cd4-b42d-450f-9088-9e3ec2dcbfa4 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:10:40.752345 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-22c04cd4-b42d-450f-9088-9e3ec2dcbfa4 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045008 Oct 20 06:10:40.752944 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 366/753] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:10:40 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:10:40.941758 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-7a0443e2-f022-4d9e-ac4e-e9616d106296 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:10:40.942399 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-7a0443e2-f022-4d9e-ac4e-e9616d106296 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:10:40.948993 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7a0443e2-f022-4d9e-ac4e-e9616d106296 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:10:40.949477 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7a0443e2-f022-4d9e-ac4e-e9616d106296 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:10:40.949917 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7a0443e2-f022-4d9e-ac4e-e9616d106296 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:10:40.950612 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7a0443e2-f022-4d9e-ac4e-e9616d106296 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:10:40.951066 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7a0443e2-f022-4d9e-ac4e-e9616d106296 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:10:40.951492 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7a0443e2-f022-4d9e-ac4e-e9616d106296 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:10:41.223038 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-7a0443e2-f022-4d9e-ac4e-e9616d106296 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:10:41.232055 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-7a0443e2-f022-4d9e-ac4e-e9616d106296 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:10:41.233543 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-7a0443e2-f022-4d9e-ac4e-e9616d106296 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:10:41.234693 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-7a0443e2-f022-4d9e-ac4e-e9616d106296 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1745 microversion: 2.20 time: 0.296848 Oct 20 06:10:41.235243 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 388/754] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:10:40 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1745 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:10:41.764989 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-145b589f-6716-46e5-a2da-d5f525da30fc tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:10:41.767136 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-145b589f-6716-46e5-a2da-d5f525da30fc tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:10:41.773926 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-145b589f-6716-46e5-a2da-d5f525da30fc tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:10:41.774569 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-145b589f-6716-46e5-a2da-d5f525da30fc tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:10:41.775004 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-145b589f-6716-46e5-a2da-d5f525da30fc tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:10:41.775684 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-145b589f-6716-46e5-a2da-d5f525da30fc tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:10:41.776131 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-145b589f-6716-46e5-a2da-d5f525da30fc tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:10:41.776551 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-145b589f-6716-46e5-a2da-d5f525da30fc tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:10:41.805541 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-145b589f-6716-46e5-a2da-d5f525da30fc tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044743 Oct 20 06:10:41.806087 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 367/755] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:10:41 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:10:42.261104 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-fd029f60-9406-43e4-ab54-37007d43e685 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:10:42.261616 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-fd029f60-9406-43e4-ab54-37007d43e685 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:10:42.267941 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-fd029f60-9406-43e4-ab54-37007d43e685 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:10:42.268422 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-fd029f60-9406-43e4-ab54-37007d43e685 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:10:42.268899 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-fd029f60-9406-43e4-ab54-37007d43e685 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:10:42.269584 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-fd029f60-9406-43e4-ab54-37007d43e685 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:10:42.270035 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-fd029f60-9406-43e4-ab54-37007d43e685 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:10:42.270457 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-fd029f60-9406-43e4-ab54-37007d43e685 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:10:42.399988 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-fd029f60-9406-43e4-ab54-37007d43e685 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:10:42.408464 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-fd029f60-9406-43e4-ab54-37007d43e685 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:10:42.409948 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-fd029f60-9406-43e4-ab54-37007d43e685 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:10:42.411093 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-fd029f60-9406-43e4-ab54-37007d43e685 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1745 microversion: 2.20 time: 0.154608 Oct 20 06:10:42.411636 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 389/756] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:10:42 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1745 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:10:42.817319 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-a6fdb7a9-1950-4f09-ac2e-31d7333f546d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:10:42.819491 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-a6fdb7a9-1950-4f09-ac2e-31d7333f546d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:10:42.826662 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a6fdb7a9-1950-4f09-ac2e-31d7333f546d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:10:42.827171 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a6fdb7a9-1950-4f09-ac2e-31d7333f546d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:10:42.827610 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a6fdb7a9-1950-4f09-ac2e-31d7333f546d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:10:42.828303 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a6fdb7a9-1950-4f09-ac2e-31d7333f546d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:10:42.828792 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a6fdb7a9-1950-4f09-ac2e-31d7333f546d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:10:42.829221 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a6fdb7a9-1950-4f09-ac2e-31d7333f546d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:10:42.846032 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG dbcounter [-] [118860] Writing DB stats nova_cell1:SELECT=100 {{(pid=118860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:10:42.859622 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-a6fdb7a9-1950-4f09-ac2e-31d7333f546d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046284 Oct 20 06:10:42.860173 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 368/757] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:10:42 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:10:43.440387 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-fef7e950-a81d-472e-82f4-6f5eb48a574e tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:10:43.441011 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-fef7e950-a81d-472e-82f4-6f5eb48a574e tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:10:43.447427 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-fef7e950-a81d-472e-82f4-6f5eb48a574e tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:10:43.447896 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-fef7e950-a81d-472e-82f4-6f5eb48a574e tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:10:43.448447 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-fef7e950-a81d-472e-82f4-6f5eb48a574e tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:10:43.449214 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-fef7e950-a81d-472e-82f4-6f5eb48a574e tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:10:43.449681 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-fef7e950-a81d-472e-82f4-6f5eb48a574e tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:10:43.450117 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-fef7e950-a81d-472e-82f4-6f5eb48a574e tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:10:43.574739 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-fef7e950-a81d-472e-82f4-6f5eb48a574e tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:10:43.583235 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-fef7e950-a81d-472e-82f4-6f5eb48a574e tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:10:43.584678 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-fef7e950-a81d-472e-82f4-6f5eb48a574e tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:10:43.585853 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-fef7e950-a81d-472e-82f4-6f5eb48a574e tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1745 microversion: 2.20 time: 0.149420 Oct 20 06:10:43.586400 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 390/758] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:10:43 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1745 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:10:43.871457 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-ffdf6d47-9e49-4cd6-89c2-837c5c1bd0f2 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:10:43.873606 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-ffdf6d47-9e49-4cd6-89c2-837c5c1bd0f2 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:10:43.880250 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-ffdf6d47-9e49-4cd6-89c2-837c5c1bd0f2 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:10:43.880764 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-ffdf6d47-9e49-4cd6-89c2-837c5c1bd0f2 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:10:43.881207 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-ffdf6d47-9e49-4cd6-89c2-837c5c1bd0f2 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:10:43.881914 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-ffdf6d47-9e49-4cd6-89c2-837c5c1bd0f2 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:10:43.882370 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-ffdf6d47-9e49-4cd6-89c2-837c5c1bd0f2 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:10:43.882797 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-ffdf6d47-9e49-4cd6-89c2-837c5c1bd0f2 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:10:43.912388 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-ffdf6d47-9e49-4cd6-89c2-837c5c1bd0f2 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044910 Oct 20 06:10:43.913003 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 369/759] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:10:43 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:10:44.611471 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-bb312a22-f550-4f6e-9549-df7f86f2ef92 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:10:44.612010 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-bb312a22-f550-4f6e-9549-df7f86f2ef92 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:10:44.618925 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-bb312a22-f550-4f6e-9549-df7f86f2ef92 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:10:44.619405 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-bb312a22-f550-4f6e-9549-df7f86f2ef92 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:10:44.619866 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-bb312a22-f550-4f6e-9549-df7f86f2ef92 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:10:44.620556 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-bb312a22-f550-4f6e-9549-df7f86f2ef92 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:10:44.621040 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-bb312a22-f550-4f6e-9549-df7f86f2ef92 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:10:44.621463 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-bb312a22-f550-4f6e-9549-df7f86f2ef92 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:10:44.747505 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-bb312a22-f550-4f6e-9549-df7f86f2ef92 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:10:44.756243 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-bb312a22-f550-4f6e-9549-df7f86f2ef92 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:10:44.758373 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-bb312a22-f550-4f6e-9549-df7f86f2ef92 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:10:44.759545 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-bb312a22-f550-4f6e-9549-df7f86f2ef92 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1745 microversion: 2.20 time: 0.152076 Oct 20 06:10:44.760085 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 391/760] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:10:44 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1745 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:10:44.924347 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-cfd35b76-6404-49e4-bdb9-551bcc7f6904 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:10:44.926683 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-cfd35b76-6404-49e4-bdb9-551bcc7f6904 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:10:44.933592 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-cfd35b76-6404-49e4-bdb9-551bcc7f6904 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:10:44.933989 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-cfd35b76-6404-49e4-bdb9-551bcc7f6904 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:10:44.934435 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-cfd35b76-6404-49e4-bdb9-551bcc7f6904 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:10:44.935095 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-cfd35b76-6404-49e4-bdb9-551bcc7f6904 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:10:44.935655 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-cfd35b76-6404-49e4-bdb9-551bcc7f6904 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:10:44.936205 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-cfd35b76-6404-49e4-bdb9-551bcc7f6904 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:10:44.964894 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-cfd35b76-6404-49e4-bdb9-551bcc7f6904 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044277 Oct 20 06:10:44.965453 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 370/761] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:10:44 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:10:45.784823 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-f41ce730-0e5d-4cee-8f3f-15a0d508e39d tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:10:45.785439 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-f41ce730-0e5d-4cee-8f3f-15a0d508e39d tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:10:45.791894 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f41ce730-0e5d-4cee-8f3f-15a0d508e39d tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:10:45.792379 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f41ce730-0e5d-4cee-8f3f-15a0d508e39d tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:10:45.792894 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f41ce730-0e5d-4cee-8f3f-15a0d508e39d tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:10:45.793601 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f41ce730-0e5d-4cee-8f3f-15a0d508e39d tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:10:45.794055 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f41ce730-0e5d-4cee-8f3f-15a0d508e39d tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:10:45.794483 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f41ce730-0e5d-4cee-8f3f-15a0d508e39d tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:10:45.977996 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-232df71e-5deb-4ba0-b928-0e5fcea68ffa tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:10:45.982327 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-232df71e-5deb-4ba0-b928-0e5fcea68ffa tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:10:45.990532 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-232df71e-5deb-4ba0-b928-0e5fcea68ffa tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:10:45.991159 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-232df71e-5deb-4ba0-b928-0e5fcea68ffa tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:10:45.991754 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-232df71e-5deb-4ba0-b928-0e5fcea68ffa tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:10:45.992722 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-232df71e-5deb-4ba0-b928-0e5fcea68ffa tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:10:45.993245 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-232df71e-5deb-4ba0-b928-0e5fcea68ffa tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:10:45.993991 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-232df71e-5deb-4ba0-b928-0e5fcea68ffa tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:10:46.026339 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-232df71e-5deb-4ba0-b928-0e5fcea68ffa tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053015 Oct 20 06:10:46.026914 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 371/762] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:10:45 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 20 06:10:46.126668 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-f41ce730-0e5d-4cee-8f3f-15a0d508e39d tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:10:46.135370 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-f41ce730-0e5d-4cee-8f3f-15a0d508e39d tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:10:46.136840 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-f41ce730-0e5d-4cee-8f3f-15a0d508e39d tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:10:46.137992 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-f41ce730-0e5d-4cee-8f3f-15a0d508e39d tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1745 microversion: 2.20 time: 0.357124 Oct 20 06:10:46.138542 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 392/763] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:10:45 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1745 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:10:47.039299 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-bac4e6d1-fb66-4679-ad4e-97b51fda7a27 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:10:47.042494 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-bac4e6d1-fb66-4679-ad4e-97b51fda7a27 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:10:47.050218 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-bac4e6d1-fb66-4679-ad4e-97b51fda7a27 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:10:47.050604 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-bac4e6d1-fb66-4679-ad4e-97b51fda7a27 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:10:47.051037 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-bac4e6d1-fb66-4679-ad4e-97b51fda7a27 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:10:47.051734 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-bac4e6d1-fb66-4679-ad4e-97b51fda7a27 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:10:47.052190 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-bac4e6d1-fb66-4679-ad4e-97b51fda7a27 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:10:47.052730 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-bac4e6d1-fb66-4679-ad4e-97b51fda7a27 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:10:47.083011 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-bac4e6d1-fb66-4679-ad4e-97b51fda7a27 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047902 Oct 20 06:10:47.083558 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 372/764] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:10:47 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:10:47.163184 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-21159658-6183-498a-8f3d-f60cae21be72 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:10:47.164298 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-21159658-6183-498a-8f3d-f60cae21be72 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:10:47.170733 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-21159658-6183-498a-8f3d-f60cae21be72 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:10:47.171210 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-21159658-6183-498a-8f3d-f60cae21be72 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:10:47.171637 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-21159658-6183-498a-8f3d-f60cae21be72 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:10:47.172331 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-21159658-6183-498a-8f3d-f60cae21be72 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:10:47.172806 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-21159658-6183-498a-8f3d-f60cae21be72 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:10:47.173228 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-21159658-6183-498a-8f3d-f60cae21be72 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:10:47.299026 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-21159658-6183-498a-8f3d-f60cae21be72 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:10:47.307665 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-21159658-6183-498a-8f3d-f60cae21be72 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:10:47.309140 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-21159658-6183-498a-8f3d-f60cae21be72 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:10:47.310285 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-21159658-6183-498a-8f3d-f60cae21be72 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1745 microversion: 2.20 time: 0.150955 Oct 20 06:10:47.310827 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 393/765] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:10:47 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1745 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:10:48.106738 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-793b3ef1-c16b-4595-9340-8df50fd8a924 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:10:48.108966 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-793b3ef1-c16b-4595-9340-8df50fd8a924 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:10:48.115335 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-793b3ef1-c16b-4595-9340-8df50fd8a924 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:10:48.115824 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-793b3ef1-c16b-4595-9340-8df50fd8a924 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:10:48.116263 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-793b3ef1-c16b-4595-9340-8df50fd8a924 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:10:48.117065 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-793b3ef1-c16b-4595-9340-8df50fd8a924 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:10:48.117672 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-793b3ef1-c16b-4595-9340-8df50fd8a924 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:10:48.118131 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-793b3ef1-c16b-4595-9340-8df50fd8a924 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:10:48.148757 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-793b3ef1-c16b-4595-9340-8df50fd8a924 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045287 Oct 20 06:10:48.149238 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 373/766] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:10:48 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:10:48.335443 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-bbdc1d68-ba85-4652-a797-8a1685258ff7 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:10:48.336049 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-bbdc1d68-ba85-4652-a797-8a1685258ff7 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:10:48.342499 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-bbdc1d68-ba85-4652-a797-8a1685258ff7 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:10:48.342982 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-bbdc1d68-ba85-4652-a797-8a1685258ff7 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:10:48.343420 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-bbdc1d68-ba85-4652-a797-8a1685258ff7 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:10:48.344118 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-bbdc1d68-ba85-4652-a797-8a1685258ff7 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:10:48.344573 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-bbdc1d68-ba85-4652-a797-8a1685258ff7 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:10:48.345031 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-bbdc1d68-ba85-4652-a797-8a1685258ff7 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:10:48.473188 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-bbdc1d68-ba85-4652-a797-8a1685258ff7 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:10:48.481860 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-bbdc1d68-ba85-4652-a797-8a1685258ff7 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:10:48.483285 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-bbdc1d68-ba85-4652-a797-8a1685258ff7 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:10:48.484424 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-bbdc1d68-ba85-4652-a797-8a1685258ff7 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1745 microversion: 2.20 time: 0.152925 Oct 20 06:10:48.485005 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 394/767] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:10:48 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1745 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:10:49.161873 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-d50646b3-e08f-42be-b57f-dccef55b8f22 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:10:49.164039 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-d50646b3-e08f-42be-b57f-dccef55b8f22 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:10:49.170448 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-d50646b3-e08f-42be-b57f-dccef55b8f22 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:10:49.170961 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-d50646b3-e08f-42be-b57f-dccef55b8f22 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:10:49.171403 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-d50646b3-e08f-42be-b57f-dccef55b8f22 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:10:49.172226 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-d50646b3-e08f-42be-b57f-dccef55b8f22 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:10:49.172686 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-d50646b3-e08f-42be-b57f-dccef55b8f22 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:10:49.173141 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-d50646b3-e08f-42be-b57f-dccef55b8f22 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:10:49.203084 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-d50646b3-e08f-42be-b57f-dccef55b8f22 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046010 Oct 20 06:10:49.203629 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 374/768] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:10:49 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 20 06:10:49.511679 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-0280639d-4704-49d1-9671-cd4b2459f29e tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:10:49.512292 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-0280639d-4704-49d1-9671-cd4b2459f29e tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:10:49.518797 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-0280639d-4704-49d1-9671-cd4b2459f29e tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:10:49.519275 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-0280639d-4704-49d1-9671-cd4b2459f29e tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:10:49.519716 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-0280639d-4704-49d1-9671-cd4b2459f29e tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:10:49.520405 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-0280639d-4704-49d1-9671-cd4b2459f29e tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:10:49.520903 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-0280639d-4704-49d1-9671-cd4b2459f29e tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:10:49.521330 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-0280639d-4704-49d1-9671-cd4b2459f29e tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:10:49.648926 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-0280639d-4704-49d1-9671-cd4b2459f29e tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:10:49.657283 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-0280639d-4704-49d1-9671-cd4b2459f29e tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:10:49.658721 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-0280639d-4704-49d1-9671-cd4b2459f29e tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:10:49.659904 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-0280639d-4704-49d1-9671-cd4b2459f29e tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1745 microversion: 2.20 time: 0.153045 Oct 20 06:10:49.660473 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 395/769] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:10:49 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1745 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:10:50.217025 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-11f407ac-84f3-4c82-b523-6bc67e362ce5 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:10:50.220433 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-11f407ac-84f3-4c82-b523-6bc67e362ce5 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:10:50.227388 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-11f407ac-84f3-4c82-b523-6bc67e362ce5 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:10:50.227893 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-11f407ac-84f3-4c82-b523-6bc67e362ce5 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:10:50.228325 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-11f407ac-84f3-4c82-b523-6bc67e362ce5 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:10:50.229057 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-11f407ac-84f3-4c82-b523-6bc67e362ce5 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:10:50.229505 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-11f407ac-84f3-4c82-b523-6bc67e362ce5 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:10:50.229928 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-11f407ac-84f3-4c82-b523-6bc67e362ce5 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:10:50.259621 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-11f407ac-84f3-4c82-b523-6bc67e362ce5 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047841 Oct 20 06:10:50.260161 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 375/770] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:10:50 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:10:50.685915 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-c982ac18-6149-4623-a5eb-3cf56b00f790 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:10:50.686549 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-c982ac18-6149-4623-a5eb-3cf56b00f790 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:10:50.692964 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c982ac18-6149-4623-a5eb-3cf56b00f790 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:10:50.693447 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c982ac18-6149-4623-a5eb-3cf56b00f790 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:10:50.693880 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c982ac18-6149-4623-a5eb-3cf56b00f790 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:10:50.695243 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c982ac18-6149-4623-a5eb-3cf56b00f790 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:10:50.695999 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c982ac18-6149-4623-a5eb-3cf56b00f790 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:10:50.696430 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c982ac18-6149-4623-a5eb-3cf56b00f790 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:10:50.823057 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-c982ac18-6149-4623-a5eb-3cf56b00f790 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:10:50.831578 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-c982ac18-6149-4623-a5eb-3cf56b00f790 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:10:50.833062 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-c982ac18-6149-4623-a5eb-3cf56b00f790 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:10:50.834216 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-c982ac18-6149-4623-a5eb-3cf56b00f790 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1745 microversion: 2.20 time: 0.152310 Oct 20 06:10:50.834766 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 396/771] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:10:50 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1745 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:10:51.272013 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-dfeb1980-6542-4710-808c-108a541eccec tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:10:51.274211 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-dfeb1980-6542-4710-808c-108a541eccec tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:10:51.280215 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-dfeb1980-6542-4710-808c-108a541eccec tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:10:51.280683 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-dfeb1980-6542-4710-808c-108a541eccec tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:10:51.281182 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-dfeb1980-6542-4710-808c-108a541eccec tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:10:51.281850 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-dfeb1980-6542-4710-808c-108a541eccec tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:10:51.282295 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-dfeb1980-6542-4710-808c-108a541eccec tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:10:51.282721 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-dfeb1980-6542-4710-808c-108a541eccec tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:10:51.312974 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-dfeb1980-6542-4710-808c-108a541eccec tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045271 Oct 20 06:10:51.313528 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 376/772] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:10:51 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:10:51.859854 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-909297c8-f887-4133-987a-28148bbfe8c4 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:10:51.860464 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-909297c8-f887-4133-987a-28148bbfe8c4 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:10:51.867436 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-909297c8-f887-4133-987a-28148bbfe8c4 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:10:51.867911 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-909297c8-f887-4133-987a-28148bbfe8c4 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:10:51.868343 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-909297c8-f887-4133-987a-28148bbfe8c4 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:10:51.869117 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-909297c8-f887-4133-987a-28148bbfe8c4 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:10:51.869565 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-909297c8-f887-4133-987a-28148bbfe8c4 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:10:51.869978 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-909297c8-f887-4133-987a-28148bbfe8c4 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:10:51.995638 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-909297c8-f887-4133-987a-28148bbfe8c4 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:10:52.004187 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-909297c8-f887-4133-987a-28148bbfe8c4 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:10:52.005900 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-909297c8-f887-4133-987a-28148bbfe8c4 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:10:52.007658 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-909297c8-f887-4133-987a-28148bbfe8c4 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1745 microversion: 2.20 time: 0.151101 Oct 20 06:10:52.008208 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 397/773] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:10:51 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1745 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 20 06:10:52.325465 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-5014b893-38e3-4dfd-bad2-1d77ef3af22c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:10:52.327617 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-5014b893-38e3-4dfd-bad2-1d77ef3af22c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:10:52.334158 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5014b893-38e3-4dfd-bad2-1d77ef3af22c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:10:52.334633 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5014b893-38e3-4dfd-bad2-1d77ef3af22c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:10:52.335621 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5014b893-38e3-4dfd-bad2-1d77ef3af22c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:10:52.336361 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5014b893-38e3-4dfd-bad2-1d77ef3af22c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:10:52.336840 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5014b893-38e3-4dfd-bad2-1d77ef3af22c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:10:52.337263 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5014b893-38e3-4dfd-bad2-1d77ef3af22c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:10:52.367871 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-5014b893-38e3-4dfd-bad2-1d77ef3af22c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046488 Oct 20 06:10:52.368553 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 377/774] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:10:52 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:10:53.032470 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-744346ab-eea8-45e1-8b4d-1d609375e4d7 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:10:53.033087 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-744346ab-eea8-45e1-8b4d-1d609375e4d7 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:10:53.040163 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-744346ab-eea8-45e1-8b4d-1d609375e4d7 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:10:53.040641 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-744346ab-eea8-45e1-8b4d-1d609375e4d7 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:10:53.041105 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-744346ab-eea8-45e1-8b4d-1d609375e4d7 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:10:53.041807 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-744346ab-eea8-45e1-8b4d-1d609375e4d7 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:10:53.042293 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-744346ab-eea8-45e1-8b4d-1d609375e4d7 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:10:53.042807 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-744346ab-eea8-45e1-8b4d-1d609375e4d7 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:10:53.170355 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-744346ab-eea8-45e1-8b4d-1d609375e4d7 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:10:53.179363 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-744346ab-eea8-45e1-8b4d-1d609375e4d7 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:10:53.180848 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-744346ab-eea8-45e1-8b4d-1d609375e4d7 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:10:53.182037 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-744346ab-eea8-45e1-8b4d-1d609375e4d7 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1745 microversion: 2.20 time: 0.153520 Oct 20 06:10:53.182704 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 398/775] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:10:53 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1745 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:10:53.379522 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-5ef3fc17-107e-44c2-b042-f43f5ceb69ad tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:10:53.383087 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-5ef3fc17-107e-44c2-b042-f43f5ceb69ad tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:10:53.389355 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5ef3fc17-107e-44c2-b042-f43f5ceb69ad tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:10:53.389546 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5ef3fc17-107e-44c2-b042-f43f5ceb69ad tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:10:53.390160 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5ef3fc17-107e-44c2-b042-f43f5ceb69ad tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:10:53.390871 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5ef3fc17-107e-44c2-b042-f43f5ceb69ad tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:10:53.391359 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5ef3fc17-107e-44c2-b042-f43f5ceb69ad tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:10:53.391783 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5ef3fc17-107e-44c2-b042-f43f5ceb69ad tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:10:53.423246 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-5ef3fc17-107e-44c2-b042-f43f5ceb69ad tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047739 Oct 20 06:10:53.423801 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 378/776] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:10:53 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:10:54.207880 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-6076d881-2066-4748-a9e3-295549177abd tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:10:54.208519 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-6076d881-2066-4748-a9e3-295549177abd tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:10:54.214965 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-6076d881-2066-4748-a9e3-295549177abd tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:10:54.215443 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-6076d881-2066-4748-a9e3-295549177abd tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:10:54.215885 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-6076d881-2066-4748-a9e3-295549177abd tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:10:54.216575 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-6076d881-2066-4748-a9e3-295549177abd tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:10:54.217057 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-6076d881-2066-4748-a9e3-295549177abd tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:10:54.217485 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-6076d881-2066-4748-a9e3-295549177abd tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:10:54.347689 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-6076d881-2066-4748-a9e3-295549177abd tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:10:54.357356 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-6076d881-2066-4748-a9e3-295549177abd tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:10:54.358948 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-6076d881-2066-4748-a9e3-295549177abd tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:10:54.360120 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-6076d881-2066-4748-a9e3-295549177abd tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1745 microversion: 2.20 time: 0.156169 Oct 20 06:10:54.360676 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 399/777] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:10:54 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1745 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:10:54.436163 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-2956f7c6-3035-4f21-9bab-cfb1258feb4f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:10:54.438576 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-2956f7c6-3035-4f21-9bab-cfb1258feb4f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:10:54.445566 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2956f7c6-3035-4f21-9bab-cfb1258feb4f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:10:54.446131 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2956f7c6-3035-4f21-9bab-cfb1258feb4f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:10:54.447304 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2956f7c6-3035-4f21-9bab-cfb1258feb4f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:10:54.447433 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2956f7c6-3035-4f21-9bab-cfb1258feb4f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:10:54.447793 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2956f7c6-3035-4f21-9bab-cfb1258feb4f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:10:54.448219 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2956f7c6-3035-4f21-9bab-cfb1258feb4f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:10:54.479681 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-2956f7c6-3035-4f21-9bab-cfb1258feb4f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047858 Oct 20 06:10:54.480235 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 379/778] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:10:54 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:10:55.388160 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-09559d02-10ab-446e-844a-59a53e703444 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:10:55.388910 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-09559d02-10ab-446e-844a-59a53e703444 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:10:55.395438 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-09559d02-10ab-446e-844a-59a53e703444 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:10:55.396295 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-09559d02-10ab-446e-844a-59a53e703444 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:10:55.396857 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-09559d02-10ab-446e-844a-59a53e703444 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:10:55.397945 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-09559d02-10ab-446e-844a-59a53e703444 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:10:55.398532 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-09559d02-10ab-446e-844a-59a53e703444 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:10:55.399279 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-09559d02-10ab-446e-844a-59a53e703444 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:10:55.491848 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-7c583f89-facd-44f6-961d-20cd6b50b12c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:10:55.494049 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-7c583f89-facd-44f6-961d-20cd6b50b12c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:10:55.502362 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7c583f89-facd-44f6-961d-20cd6b50b12c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:10:55.503641 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7c583f89-facd-44f6-961d-20cd6b50b12c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:10:55.504164 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7c583f89-facd-44f6-961d-20cd6b50b12c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:10:55.505415 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7c583f89-facd-44f6-961d-20cd6b50b12c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:10:55.506128 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7c583f89-facd-44f6-961d-20cd6b50b12c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:10:55.507196 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7c583f89-facd-44f6-961d-20cd6b50b12c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:10:55.545458 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-7c583f89-facd-44f6-961d-20cd6b50b12c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057723 Oct 20 06:10:55.550519 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 380/779] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:10:55 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 20 06:10:55.567059 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-09559d02-10ab-446e-844a-59a53e703444 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:10:55.577242 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-09559d02-10ab-446e-844a-59a53e703444 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:10:55.578756 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-09559d02-10ab-446e-844a-59a53e703444 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:10:55.582050 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-09559d02-10ab-446e-844a-59a53e703444 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1745 microversion: 2.20 time: 0.199533 Oct 20 06:10:55.583664 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 400/780] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:10:55 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1745 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:10:56.558768 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-57ca68d0-a614-4bb9-8d89-7acb4bc22c02 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:10:56.561066 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-57ca68d0-a614-4bb9-8d89-7acb4bc22c02 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:10:56.567495 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-57ca68d0-a614-4bb9-8d89-7acb4bc22c02 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:10:56.567978 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-57ca68d0-a614-4bb9-8d89-7acb4bc22c02 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:10:56.568418 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-57ca68d0-a614-4bb9-8d89-7acb4bc22c02 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:10:56.569232 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-57ca68d0-a614-4bb9-8d89-7acb4bc22c02 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:10:56.569799 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-57ca68d0-a614-4bb9-8d89-7acb4bc22c02 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:10:56.570313 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-57ca68d0-a614-4bb9-8d89-7acb4bc22c02 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:10:56.601912 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-57ca68d0-a614-4bb9-8d89-7acb4bc22c02 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047784 Oct 20 06:10:56.602464 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 381/781] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:10:56 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:10:56.614366 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-e14178ae-3a5b-4a16-95c3-e8c6fc51f9ba tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:10:56.615040 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-e14178ae-3a5b-4a16-95c3-e8c6fc51f9ba tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:10:56.621693 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e14178ae-3a5b-4a16-95c3-e8c6fc51f9ba tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:10:56.622175 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e14178ae-3a5b-4a16-95c3-e8c6fc51f9ba tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:10:56.622613 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e14178ae-3a5b-4a16-95c3-e8c6fc51f9ba tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:10:56.623308 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e14178ae-3a5b-4a16-95c3-e8c6fc51f9ba tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:10:56.623763 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e14178ae-3a5b-4a16-95c3-e8c6fc51f9ba tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:10:56.624206 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e14178ae-3a5b-4a16-95c3-e8c6fc51f9ba tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:10:56.753263 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-e14178ae-3a5b-4a16-95c3-e8c6fc51f9ba tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:10:56.762137 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-e14178ae-3a5b-4a16-95c3-e8c6fc51f9ba tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:10:56.763588 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-e14178ae-3a5b-4a16-95c3-e8c6fc51f9ba tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:10:56.764778 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-e14178ae-3a5b-4a16-95c3-e8c6fc51f9ba tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1745 microversion: 2.20 time: 0.154478 Oct 20 06:10:56.765329 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 401/782] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:10:56 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1745 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:10:57.613802 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-b97abe13-683d-40c2-bc93-3f535c5f4dac tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:10:57.615995 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-b97abe13-683d-40c2-bc93-3f535c5f4dac tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:10:57.622363 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b97abe13-683d-40c2-bc93-3f535c5f4dac tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:10:57.622843 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b97abe13-683d-40c2-bc93-3f535c5f4dac tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:10:57.623333 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b97abe13-683d-40c2-bc93-3f535c5f4dac tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:10:57.623964 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b97abe13-683d-40c2-bc93-3f535c5f4dac tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:10:57.624420 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b97abe13-683d-40c2-bc93-3f535c5f4dac tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:10:57.624877 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b97abe13-683d-40c2-bc93-3f535c5f4dac tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:10:57.655222 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-b97abe13-683d-40c2-bc93-3f535c5f4dac tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045341 Oct 20 06:10:57.655764 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 382/783] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:10:57 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:10:57.791139 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-f0087cda-6ffd-4e53-9981-2d17390075a2 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:10:57.791739 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-f0087cda-6ffd-4e53-9981-2d17390075a2 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:10:57.797644 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f0087cda-6ffd-4e53-9981-2d17390075a2 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:10:57.798119 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f0087cda-6ffd-4e53-9981-2d17390075a2 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:10:57.798550 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f0087cda-6ffd-4e53-9981-2d17390075a2 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:10:57.799236 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f0087cda-6ffd-4e53-9981-2d17390075a2 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:10:57.799684 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f0087cda-6ffd-4e53-9981-2d17390075a2 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:10:57.800104 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f0087cda-6ffd-4e53-9981-2d17390075a2 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:10:57.923525 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-f0087cda-6ffd-4e53-9981-2d17390075a2 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:10:57.926934 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG dbcounter [-] [118861] Writing DB stats nova_cell1:SELECT=100 {{(pid=118861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:10:57.933886 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-f0087cda-6ffd-4e53-9981-2d17390075a2 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:10:57.935328 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-f0087cda-6ffd-4e53-9981-2d17390075a2 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:10:57.936480 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-f0087cda-6ffd-4e53-9981-2d17390075a2 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1745 microversion: 2.20 time: 0.149667 Oct 20 06:10:57.937059 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 402/784] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:10:57 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1745 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:10:58.667435 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-cc6c4fd1-a870-473d-b965-6a0abf97a16e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:10:58.669537 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-cc6c4fd1-a870-473d-b965-6a0abf97a16e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:10:58.675722 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-cc6c4fd1-a870-473d-b965-6a0abf97a16e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:10:58.676197 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-cc6c4fd1-a870-473d-b965-6a0abf97a16e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:10:58.676629 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-cc6c4fd1-a870-473d-b965-6a0abf97a16e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:10:58.677343 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-cc6c4fd1-a870-473d-b965-6a0abf97a16e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:10:58.677863 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-cc6c4fd1-a870-473d-b965-6a0abf97a16e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:10:58.678330 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-cc6c4fd1-a870-473d-b965-6a0abf97a16e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:10:58.708801 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-cc6c4fd1-a870-473d-b965-6a0abf97a16e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045310 Oct 20 06:10:58.709346 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 383/785] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:10:58 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:10:58.962072 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-3ce032f6-d761-44e7-a4f0-1b5fb0a7de65 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:10:58.962859 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-3ce032f6-d761-44e7-a4f0-1b5fb0a7de65 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:10:58.969364 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-3ce032f6-d761-44e7-a4f0-1b5fb0a7de65 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:10:58.969850 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-3ce032f6-d761-44e7-a4f0-1b5fb0a7de65 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:10:58.970407 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-3ce032f6-d761-44e7-a4f0-1b5fb0a7de65 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:10:58.971118 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-3ce032f6-d761-44e7-a4f0-1b5fb0a7de65 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:10:58.971569 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-3ce032f6-d761-44e7-a4f0-1b5fb0a7de65 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:10:58.971995 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-3ce032f6-d761-44e7-a4f0-1b5fb0a7de65 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:10:59.105060 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-3ce032f6-d761-44e7-a4f0-1b5fb0a7de65 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:10:59.113652 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-3ce032f6-d761-44e7-a4f0-1b5fb0a7de65 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:10:59.115075 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-3ce032f6-d761-44e7-a4f0-1b5fb0a7de65 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:10:59.116735 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-3ce032f6-d761-44e7-a4f0-1b5fb0a7de65 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1745 microversion: 2.20 time: 0.158297 Oct 20 06:10:59.117288 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 403/786] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:10:58 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1745 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 20 06:10:59.721563 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-c7cacd70-18e6-4dbe-9fef-c259c9632254 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:10:59.723703 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-c7cacd70-18e6-4dbe-9fef-c259c9632254 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:10:59.730540 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c7cacd70-18e6-4dbe-9fef-c259c9632254 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:10:59.731038 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c7cacd70-18e6-4dbe-9fef-c259c9632254 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:10:59.731472 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c7cacd70-18e6-4dbe-9fef-c259c9632254 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:10:59.732163 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c7cacd70-18e6-4dbe-9fef-c259c9632254 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:10:59.732614 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c7cacd70-18e6-4dbe-9fef-c259c9632254 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:10:59.733057 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c7cacd70-18e6-4dbe-9fef-c259c9632254 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:10:59.763903 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-c7cacd70-18e6-4dbe-9fef-c259c9632254 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046225 Oct 20 06:10:59.764524 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 384/787] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:10:59 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:11:00.142399 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-a12bfe7d-bc07-4a76-ba13-d38ee0e6c466 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:11:00.143006 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-a12bfe7d-bc07-4a76-ba13-d38ee0e6c466 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:11:00.149587 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a12bfe7d-bc07-4a76-ba13-d38ee0e6c466 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:11:00.150005 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a12bfe7d-bc07-4a76-ba13-d38ee0e6c466 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:11:00.150434 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a12bfe7d-bc07-4a76-ba13-d38ee0e6c466 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:11:00.151116 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a12bfe7d-bc07-4a76-ba13-d38ee0e6c466 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:11:00.151561 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a12bfe7d-bc07-4a76-ba13-d38ee0e6c466 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:11:00.151998 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a12bfe7d-bc07-4a76-ba13-d38ee0e6c466 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:11:00.280964 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-a12bfe7d-bc07-4a76-ba13-d38ee0e6c466 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:11:00.289935 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-a12bfe7d-bc07-4a76-ba13-d38ee0e6c466 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:11:00.291366 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-a12bfe7d-bc07-4a76-ba13-d38ee0e6c466 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:11:00.292508 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-a12bfe7d-bc07-4a76-ba13-d38ee0e6c466 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1745 microversion: 2.20 time: 0.154059 Oct 20 06:11:00.293086 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 404/788] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:11:00 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1745 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:11:00.776126 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-e652058a-ced6-47de-ab8a-87c02a471e6f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:11:00.778287 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-e652058a-ced6-47de-ab8a-87c02a471e6f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:11:00.780572 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG dbcounter [-] [118860] Writing DB stats nova_api:SELECT=58 {{(pid=118860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:11:00.785733 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e652058a-ced6-47de-ab8a-87c02a471e6f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:11:00.786216 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e652058a-ced6-47de-ab8a-87c02a471e6f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:11:00.786644 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e652058a-ced6-47de-ab8a-87c02a471e6f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:11:00.787325 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e652058a-ced6-47de-ab8a-87c02a471e6f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:11:00.787803 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e652058a-ced6-47de-ab8a-87c02a471e6f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:11:00.788226 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e652058a-ced6-47de-ab8a-87c02a471e6f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:11:00.792128 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG dbcounter [-] [118860] Writing DB stats nova_cell1:SELECT=100 {{(pid=118860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:11:00.819715 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-e652058a-ced6-47de-ab8a-87c02a471e6f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047441 Oct 20 06:11:00.820304 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 385/789] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:11:00 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:11:01.318155 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-1ab4030c-bfcb-4a24-be4f-485c626b9a33 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:11:01.318801 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-1ab4030c-bfcb-4a24-be4f-485c626b9a33 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:11:01.321298 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG dbcounter [-] [118861] Writing DB stats nova_api:SELECT=52 {{(pid=118861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:11:01.326698 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1ab4030c-bfcb-4a24-be4f-485c626b9a33 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:11:01.327178 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1ab4030c-bfcb-4a24-be4f-485c626b9a33 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:11:01.327611 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1ab4030c-bfcb-4a24-be4f-485c626b9a33 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:11:01.328304 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1ab4030c-bfcb-4a24-be4f-485c626b9a33 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:11:01.328778 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1ab4030c-bfcb-4a24-be4f-485c626b9a33 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:11:01.329208 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1ab4030c-bfcb-4a24-be4f-485c626b9a33 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:11:01.457241 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-1ab4030c-bfcb-4a24-be4f-485c626b9a33 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:11:01.466892 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-1ab4030c-bfcb-4a24-be4f-485c626b9a33 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:11:01.468334 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-1ab4030c-bfcb-4a24-be4f-485c626b9a33 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:11:01.469503 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-1ab4030c-bfcb-4a24-be4f-485c626b9a33 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1745 microversion: 2.20 time: 0.155271 Oct 20 06:11:01.470049 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 405/790] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:11:01 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1745 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:11:01.831392 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-60a71dc7-95dd-4767-ac9f-a78e0d0f5dea tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:11:01.833603 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-60a71dc7-95dd-4767-ac9f-a78e0d0f5dea tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:11:01.839921 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-60a71dc7-95dd-4767-ac9f-a78e0d0f5dea tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:11:01.840403 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-60a71dc7-95dd-4767-ac9f-a78e0d0f5dea tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:11:01.840896 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-60a71dc7-95dd-4767-ac9f-a78e0d0f5dea tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:11:01.841603 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-60a71dc7-95dd-4767-ac9f-a78e0d0f5dea tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:11:01.842060 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-60a71dc7-95dd-4767-ac9f-a78e0d0f5dea tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:11:01.842486 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-60a71dc7-95dd-4767-ac9f-a78e0d0f5dea tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:11:01.873202 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-60a71dc7-95dd-4767-ac9f-a78e0d0f5dea tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045717 Oct 20 06:11:01.874089 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 386/791] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:11:01 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:11:02.498293 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-a863f31d-5b1b-4c71-a3c3-589836632f2c tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:11:02.498898 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-a863f31d-5b1b-4c71-a3c3-589836632f2c tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:11:02.505546 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a863f31d-5b1b-4c71-a3c3-589836632f2c tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:11:02.506020 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a863f31d-5b1b-4c71-a3c3-589836632f2c tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:11:02.506543 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a863f31d-5b1b-4c71-a3c3-589836632f2c tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:11:02.507261 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a863f31d-5b1b-4c71-a3c3-589836632f2c tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:11:02.507763 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a863f31d-5b1b-4c71-a3c3-589836632f2c tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:11:02.508185 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a863f31d-5b1b-4c71-a3c3-589836632f2c tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:11:02.636145 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-a863f31d-5b1b-4c71-a3c3-589836632f2c tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:11:02.644487 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-a863f31d-5b1b-4c71-a3c3-589836632f2c tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:11:02.645946 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-a863f31d-5b1b-4c71-a3c3-589836632f2c tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:11:02.647592 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-a863f31d-5b1b-4c71-a3c3-589836632f2c tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1745 microversion: 2.20 time: 0.155051 Oct 20 06:11:02.648207 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 406/792] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:11:02 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1745 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:11:02.885545 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-4f067fcd-579e-488f-8950-aab4d4a1a747 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:11:02.888336 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-4f067fcd-579e-488f-8950-aab4d4a1a747 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:11:02.894714 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-4f067fcd-579e-488f-8950-aab4d4a1a747 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:11:02.895198 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-4f067fcd-579e-488f-8950-aab4d4a1a747 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:11:02.895663 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-4f067fcd-579e-488f-8950-aab4d4a1a747 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:11:02.896515 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-4f067fcd-579e-488f-8950-aab4d4a1a747 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:11:02.897619 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-4f067fcd-579e-488f-8950-aab4d4a1a747 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:11:02.898052 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-4f067fcd-579e-488f-8950-aab4d4a1a747 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:11:02.929074 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-4f067fcd-579e-488f-8950-aab4d4a1a747 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047415 Oct 20 06:11:02.929841 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 387/793] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:11:02 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:11:03.675670 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-dfb91b8d-813b-490e-b0ca-61128be7b363 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:11:03.676275 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-dfb91b8d-813b-490e-b0ca-61128be7b363 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:11:03.683056 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-dfb91b8d-813b-490e-b0ca-61128be7b363 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:11:03.683547 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-dfb91b8d-813b-490e-b0ca-61128be7b363 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:11:03.683986 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-dfb91b8d-813b-490e-b0ca-61128be7b363 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:11:03.684686 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-dfb91b8d-813b-490e-b0ca-61128be7b363 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:11:03.685194 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-dfb91b8d-813b-490e-b0ca-61128be7b363 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:11:03.685621 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-dfb91b8d-813b-490e-b0ca-61128be7b363 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:11:03.815081 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-dfb91b8d-813b-490e-b0ca-61128be7b363 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:11:03.824200 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-dfb91b8d-813b-490e-b0ca-61128be7b363 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:11:03.825675 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-dfb91b8d-813b-490e-b0ca-61128be7b363 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:11:03.826842 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-dfb91b8d-813b-490e-b0ca-61128be7b363 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1745 microversion: 2.20 time: 0.155555 Oct 20 06:11:03.827394 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 407/794] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:11:03 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1745 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:11:03.941449 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-f8bef338-2875-48d6-a243-effb1f0396af tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:11:03.944487 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-f8bef338-2875-48d6-a243-effb1f0396af tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:11:03.951381 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f8bef338-2875-48d6-a243-effb1f0396af tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:11:03.951868 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f8bef338-2875-48d6-a243-effb1f0396af tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:11:03.952310 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f8bef338-2875-48d6-a243-effb1f0396af tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:11:03.953036 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f8bef338-2875-48d6-a243-effb1f0396af tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:11:03.953587 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f8bef338-2875-48d6-a243-effb1f0396af tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:11:03.954019 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f8bef338-2875-48d6-a243-effb1f0396af tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:11:03.984597 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-f8bef338-2875-48d6-a243-effb1f0396af tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046895 Oct 20 06:11:03.985182 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 388/795] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:11:03 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:11:04.853552 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-8167767d-b930-4a6a-bf68-45c63bca0463 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:11:04.854163 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-8167767d-b930-4a6a-bf68-45c63bca0463 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:11:04.860492 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-8167767d-b930-4a6a-bf68-45c63bca0463 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:11:04.861024 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-8167767d-b930-4a6a-bf68-45c63bca0463 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:11:04.861465 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-8167767d-b930-4a6a-bf68-45c63bca0463 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:11:04.862165 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-8167767d-b930-4a6a-bf68-45c63bca0463 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:11:04.862620 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-8167767d-b930-4a6a-bf68-45c63bca0463 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:11:04.863048 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-8167767d-b930-4a6a-bf68-45c63bca0463 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:11:04.997838 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-8167767d-b930-4a6a-bf68-45c63bca0463 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:11:04.998032 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-448b9366-29d9-43bc-ba3f-6d745eefecc0 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:11:05.000264 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-448b9366-29d9-43bc-ba3f-6d745eefecc0 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:11:05.006562 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-448b9366-29d9-43bc-ba3f-6d745eefecc0 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:11:05.007062 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-448b9366-29d9-43bc-ba3f-6d745eefecc0 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:11:05.007505 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-448b9366-29d9-43bc-ba3f-6d745eefecc0 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:11:05.008217 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-448b9366-29d9-43bc-ba3f-6d745eefecc0 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:11:05.008677 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-448b9366-29d9-43bc-ba3f-6d745eefecc0 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:11:05.009134 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-448b9366-29d9-43bc-ba3f-6d745eefecc0 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:11:05.017113 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-8167767d-b930-4a6a-bf68-45c63bca0463 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:11:05.018563 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-8167767d-b930-4a6a-bf68-45c63bca0463 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:11:05.019736 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-8167767d-b930-4a6a-bf68-45c63bca0463 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1745 microversion: 2.20 time: 0.170852 Oct 20 06:11:05.020291 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 408/796] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:11:04 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1745 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:11:05.040530 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-448b9366-29d9-43bc-ba3f-6d745eefecc0 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046393 Oct 20 06:11:05.041116 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 389/797] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:11:04 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 20 06:11:06.047566 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-1475a651-f394-458d-b56f-24577be22ca9 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:11:06.048253 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-1475a651-f394-458d-b56f-24577be22ca9 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:11:06.054905 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1475a651-f394-458d-b56f-24577be22ca9 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:11:06.055306 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-2288e0e3-029e-42c8-9cab-e5854797eee8 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:11:06.055760 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1475a651-f394-458d-b56f-24577be22ca9 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:11:06.056178 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1475a651-f394-458d-b56f-24577be22ca9 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:11:06.056994 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1475a651-f394-458d-b56f-24577be22ca9 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:11:06.057556 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1475a651-f394-458d-b56f-24577be22ca9 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:11:06.058025 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-2288e0e3-029e-42c8-9cab-e5854797eee8 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:11:06.058137 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1475a651-f394-458d-b56f-24577be22ca9 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:11:06.071501 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2288e0e3-029e-42c8-9cab-e5854797eee8 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:11:06.071995 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2288e0e3-029e-42c8-9cab-e5854797eee8 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:11:06.072635 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2288e0e3-029e-42c8-9cab-e5854797eee8 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:11:06.073377 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2288e0e3-029e-42c8-9cab-e5854797eee8 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:11:06.073835 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2288e0e3-029e-42c8-9cab-e5854797eee8 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:11:06.074270 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2288e0e3-029e-42c8-9cab-e5854797eee8 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:11:06.106322 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-2288e0e3-029e-42c8-9cab-e5854797eee8 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056412 Oct 20 06:11:06.107195 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 390/798] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:11:06 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:11:06.201258 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-1475a651-f394-458d-b56f-24577be22ca9 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:11:06.210333 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-1475a651-f394-458d-b56f-24577be22ca9 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:11:06.211942 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-1475a651-f394-458d-b56f-24577be22ca9 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:11:06.213165 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-1475a651-f394-458d-b56f-24577be22ca9 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1745 microversion: 2.20 time: 0.170283 Oct 20 06:11:06.213722 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 409/799] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:11:06 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1745 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:11:07.118960 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-9419cbcd-9973-4f9d-bc64-8cce553b8d00 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:11:07.121202 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-9419cbcd-9973-4f9d-bc64-8cce553b8d00 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:11:07.127639 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-9419cbcd-9973-4f9d-bc64-8cce553b8d00 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:11:07.128125 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-9419cbcd-9973-4f9d-bc64-8cce553b8d00 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:11:07.128563 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-9419cbcd-9973-4f9d-bc64-8cce553b8d00 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:11:07.129295 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-9419cbcd-9973-4f9d-bc64-8cce553b8d00 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:11:07.130003 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-9419cbcd-9973-4f9d-bc64-8cce553b8d00 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:11:07.130540 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-9419cbcd-9973-4f9d-bc64-8cce553b8d00 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:11:07.160461 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-9419cbcd-9973-4f9d-bc64-8cce553b8d00 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046005 Oct 20 06:11:07.165413 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 391/800] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:11:07 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:11:07.238470 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-2687096e-76c8-49c7-999e-d971130ba1e5 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:11:07.239083 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-2687096e-76c8-49c7-999e-d971130ba1e5 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:11:07.245760 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-2687096e-76c8-49c7-999e-d971130ba1e5 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:11:07.246237 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-2687096e-76c8-49c7-999e-d971130ba1e5 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:11:07.246667 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-2687096e-76c8-49c7-999e-d971130ba1e5 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:11:07.247356 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-2687096e-76c8-49c7-999e-d971130ba1e5 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:11:07.247803 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-2687096e-76c8-49c7-999e-d971130ba1e5 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:11:07.248223 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-2687096e-76c8-49c7-999e-d971130ba1e5 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:11:07.374812 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-2687096e-76c8-49c7-999e-d971130ba1e5 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:11:07.383770 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-2687096e-76c8-49c7-999e-d971130ba1e5 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:11:07.385246 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-2687096e-76c8-49c7-999e-d971130ba1e5 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:11:07.386399 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-2687096e-76c8-49c7-999e-d971130ba1e5 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1745 microversion: 2.20 time: 0.151785 Oct 20 06:11:07.386954 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 410/801] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:11:07 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1745 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:11:08.173647 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-f22949e6-bb30-4a13-99a3-bdd8c1653c36 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:11:08.175839 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-f22949e6-bb30-4a13-99a3-bdd8c1653c36 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:11:08.183302 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f22949e6-bb30-4a13-99a3-bdd8c1653c36 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:11:08.183791 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f22949e6-bb30-4a13-99a3-bdd8c1653c36 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:11:08.184241 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f22949e6-bb30-4a13-99a3-bdd8c1653c36 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:11:08.184978 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f22949e6-bb30-4a13-99a3-bdd8c1653c36 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:11:08.185438 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f22949e6-bb30-4a13-99a3-bdd8c1653c36 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:11:08.185862 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f22949e6-bb30-4a13-99a3-bdd8c1653c36 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:11:08.216755 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-f22949e6-bb30-4a13-99a3-bdd8c1653c36 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047573 Oct 20 06:11:08.217507 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 392/802] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:11:08 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:11:08.412905 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-dfad7a33-47bc-47b5-8ff9-f9577abacd64 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:11:08.413616 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-dfad7a33-47bc-47b5-8ff9-f9577abacd64 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:11:08.420051 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-dfad7a33-47bc-47b5-8ff9-f9577abacd64 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:11:08.420534 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-dfad7a33-47bc-47b5-8ff9-f9577abacd64 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:11:08.421006 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-dfad7a33-47bc-47b5-8ff9-f9577abacd64 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:11:08.421698 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-dfad7a33-47bc-47b5-8ff9-f9577abacd64 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:11:08.422151 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-dfad7a33-47bc-47b5-8ff9-f9577abacd64 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:11:08.422570 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-dfad7a33-47bc-47b5-8ff9-f9577abacd64 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:11:08.555813 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-dfad7a33-47bc-47b5-8ff9-f9577abacd64 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:11:08.564315 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-dfad7a33-47bc-47b5-8ff9-f9577abacd64 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:11:08.565775 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-dfad7a33-47bc-47b5-8ff9-f9577abacd64 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:11:08.566926 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-dfad7a33-47bc-47b5-8ff9-f9577abacd64 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1745 microversion: 2.20 time: 0.158526 Oct 20 06:11:08.567483 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 411/803] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:11:08 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1745 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:11:09.228612 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-7c3ee2ad-1b08-48dc-8e80-306c574c3f70 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:11:09.230817 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-7c3ee2ad-1b08-48dc-8e80-306c574c3f70 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:11:09.237370 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7c3ee2ad-1b08-48dc-8e80-306c574c3f70 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:11:09.237813 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7c3ee2ad-1b08-48dc-8e80-306c574c3f70 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:11:09.238245 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7c3ee2ad-1b08-48dc-8e80-306c574c3f70 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:11:09.238939 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7c3ee2ad-1b08-48dc-8e80-306c574c3f70 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:11:09.239384 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7c3ee2ad-1b08-48dc-8e80-306c574c3f70 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:11:09.239804 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7c3ee2ad-1b08-48dc-8e80-306c574c3f70 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:11:09.270095 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-7c3ee2ad-1b08-48dc-8e80-306c574c3f70 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045876 Oct 20 06:11:09.270654 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 393/804] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:11:09 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:11:09.593090 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-dd68b505-b404-4222-b098-6d8b3d5384a9 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:11:09.593722 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-dd68b505-b404-4222-b098-6d8b3d5384a9 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:11:09.600074 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-dd68b505-b404-4222-b098-6d8b3d5384a9 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:11:09.601338 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-dd68b505-b404-4222-b098-6d8b3d5384a9 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:11:09.601623 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-dd68b505-b404-4222-b098-6d8b3d5384a9 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:11:09.602303 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-dd68b505-b404-4222-b098-6d8b3d5384a9 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:11:09.602749 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-dd68b505-b404-4222-b098-6d8b3d5384a9 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:11:09.603166 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-dd68b505-b404-4222-b098-6d8b3d5384a9 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:11:09.729807 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-dd68b505-b404-4222-b098-6d8b3d5384a9 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:11:09.738153 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-dd68b505-b404-4222-b098-6d8b3d5384a9 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:11:09.739577 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-dd68b505-b404-4222-b098-6d8b3d5384a9 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:11:09.740737 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-dd68b505-b404-4222-b098-6d8b3d5384a9 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1745 microversion: 2.20 time: 0.151676 Oct 20 06:11:09.741297 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 412/805] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:11:09 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1745 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:11:10.283790 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-8c563066-3060-4db8-ad4b-29cbe49df2f1 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:11:10.286263 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-8c563066-3060-4db8-ad4b-29cbe49df2f1 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:11:10.293749 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-8c563066-3060-4db8-ad4b-29cbe49df2f1 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:11:10.294441 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-8c563066-3060-4db8-ad4b-29cbe49df2f1 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:11:10.295043 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-8c563066-3060-4db8-ad4b-29cbe49df2f1 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:11:10.295748 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-8c563066-3060-4db8-ad4b-29cbe49df2f1 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:11:10.296239 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-8c563066-3060-4db8-ad4b-29cbe49df2f1 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:11:10.296818 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-8c563066-3060-4db8-ad4b-29cbe49df2f1 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:11:10.331317 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-8c563066-3060-4db8-ad4b-29cbe49df2f1 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052597 Oct 20 06:11:10.331875 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 394/806] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:11:10 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:11:10.766885 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-53746db4-775d-4229-a764-78354f1b311d tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:11:10.767492 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-53746db4-775d-4229-a764-78354f1b311d tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:11:10.774459 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-53746db4-775d-4229-a764-78354f1b311d tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:11:10.774939 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-53746db4-775d-4229-a764-78354f1b311d tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:11:10.775376 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-53746db4-775d-4229-a764-78354f1b311d tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:11:10.776067 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-53746db4-775d-4229-a764-78354f1b311d tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:11:10.776523 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-53746db4-775d-4229-a764-78354f1b311d tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:11:10.777006 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-53746db4-775d-4229-a764-78354f1b311d tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:11:10.906029 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-53746db4-775d-4229-a764-78354f1b311d tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:11:10.915294 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-53746db4-775d-4229-a764-78354f1b311d tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:11:10.916788 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-53746db4-775d-4229-a764-78354f1b311d tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:11:10.917943 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-53746db4-775d-4229-a764-78354f1b311d tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1745 microversion: 2.20 time: 0.155023 Oct 20 06:11:10.918496 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 413/807] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:11:10 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1745 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:11:11.343301 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-4ea06d3a-da93-4a4a-b1e2-96b954ca37e4 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:11:11.345459 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-4ea06d3a-da93-4a4a-b1e2-96b954ca37e4 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:11:11.353750 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-4ea06d3a-da93-4a4a-b1e2-96b954ca37e4 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:11:11.354236 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-4ea06d3a-da93-4a4a-b1e2-96b954ca37e4 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:11:11.354668 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-4ea06d3a-da93-4a4a-b1e2-96b954ca37e4 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:11:11.355368 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-4ea06d3a-da93-4a4a-b1e2-96b954ca37e4 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:11:11.355815 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-4ea06d3a-da93-4a4a-b1e2-96b954ca37e4 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:11:11.356235 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-4ea06d3a-da93-4a4a-b1e2-96b954ca37e4 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:11:11.386420 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-4ea06d3a-da93-4a4a-b1e2-96b954ca37e4 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046976 Oct 20 06:11:11.386973 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 395/808] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:11:11 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:11:11.943712 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-1aef5df3-627d-4791-86ad-7e790f9c16cb tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:11:11.944926 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-1aef5df3-627d-4791-86ad-7e790f9c16cb tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:11:11.951323 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1aef5df3-627d-4791-86ad-7e790f9c16cb tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:11:11.951799 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1aef5df3-627d-4791-86ad-7e790f9c16cb tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:11:11.952235 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1aef5df3-627d-4791-86ad-7e790f9c16cb tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:11:11.952950 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1aef5df3-627d-4791-86ad-7e790f9c16cb tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:11:11.953406 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1aef5df3-627d-4791-86ad-7e790f9c16cb tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:11:11.953831 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1aef5df3-627d-4791-86ad-7e790f9c16cb tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:11:12.081043 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-1aef5df3-627d-4791-86ad-7e790f9c16cb tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:11:12.089734 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-1aef5df3-627d-4791-86ad-7e790f9c16cb tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:11:12.091182 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-1aef5df3-627d-4791-86ad-7e790f9c16cb tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:11:12.092339 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-1aef5df3-627d-4791-86ad-7e790f9c16cb tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1745 microversion: 2.20 time: 0.152525 Oct 20 06:11:12.092914 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 414/809] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:11:11 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1745 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:11:12.400032 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-5dfd6b54-7d33-4665-8928-a0dbd19f873c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:11:12.402319 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-5dfd6b54-7d33-4665-8928-a0dbd19f873c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:11:12.410628 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5dfd6b54-7d33-4665-8928-a0dbd19f873c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:11:12.411112 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5dfd6b54-7d33-4665-8928-a0dbd19f873c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:11:12.411592 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5dfd6b54-7d33-4665-8928-a0dbd19f873c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:11:12.412328 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5dfd6b54-7d33-4665-8928-a0dbd19f873c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:11:12.414550 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5dfd6b54-7d33-4665-8928-a0dbd19f873c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:11:12.414550 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5dfd6b54-7d33-4665-8928-a0dbd19f873c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:11:12.444818 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-5dfd6b54-7d33-4665-8928-a0dbd19f873c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049855 Oct 20 06:11:12.445377 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 396/810] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:11:12 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:11:13.118718 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-a066b341-ed30-42e0-a618-22f88e4a90ca tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:11:13.119322 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-a066b341-ed30-42e0-a618-22f88e4a90ca tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:11:13.125673 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a066b341-ed30-42e0-a618-22f88e4a90ca tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:11:13.126149 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a066b341-ed30-42e0-a618-22f88e4a90ca tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:11:13.126582 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a066b341-ed30-42e0-a618-22f88e4a90ca tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:11:13.127265 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a066b341-ed30-42e0-a618-22f88e4a90ca tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:11:13.127891 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a066b341-ed30-42e0-a618-22f88e4a90ca tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:11:13.128314 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a066b341-ed30-42e0-a618-22f88e4a90ca tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:11:13.252653 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-a066b341-ed30-42e0-a618-22f88e4a90ca tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:11:13.262026 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-a066b341-ed30-42e0-a618-22f88e4a90ca tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:11:13.263453 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-a066b341-ed30-42e0-a618-22f88e4a90ca tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:11:13.264596 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-a066b341-ed30-42e0-a618-22f88e4a90ca tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1745 microversion: 2.20 time: 0.150497 Oct 20 06:11:13.265186 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 415/811] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:11:13 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1745 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:11:13.457195 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-9f5fa1b4-3af5-4ac2-909b-b6a25539932d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:11:13.459621 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-9f5fa1b4-3af5-4ac2-909b-b6a25539932d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:11:13.467035 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-9f5fa1b4-3af5-4ac2-909b-b6a25539932d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:11:13.467814 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-9f5fa1b4-3af5-4ac2-909b-b6a25539932d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:11:13.468270 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-9f5fa1b4-3af5-4ac2-909b-b6a25539932d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:11:13.469001 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-9f5fa1b4-3af5-4ac2-909b-b6a25539932d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:11:13.469461 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-9f5fa1b4-3af5-4ac2-909b-b6a25539932d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:11:13.469889 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-9f5fa1b4-3af5-4ac2-909b-b6a25539932d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:11:13.501400 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-9f5fa1b4-3af5-4ac2-909b-b6a25539932d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048016 Oct 20 06:11:13.501990 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 397/812] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:11:13 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:11:14.290664 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-742efdee-3304-4f59-8657-b1e3d18782c3 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:11:14.291198 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-742efdee-3304-4f59-8657-b1e3d18782c3 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:11:14.297636 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-742efdee-3304-4f59-8657-b1e3d18782c3 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:11:14.298123 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-742efdee-3304-4f59-8657-b1e3d18782c3 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:11:14.298565 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-742efdee-3304-4f59-8657-b1e3d18782c3 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:11:14.299268 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-742efdee-3304-4f59-8657-b1e3d18782c3 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:11:14.299725 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-742efdee-3304-4f59-8657-b1e3d18782c3 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:11:14.300163 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-742efdee-3304-4f59-8657-b1e3d18782c3 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:11:14.428950 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-742efdee-3304-4f59-8657-b1e3d18782c3 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:11:14.437961 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-742efdee-3304-4f59-8657-b1e3d18782c3 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:11:14.439391 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-742efdee-3304-4f59-8657-b1e3d18782c3 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:11:14.440530 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-742efdee-3304-4f59-8657-b1e3d18782c3 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1745 microversion: 2.20 time: 0.154415 Oct 20 06:11:14.441124 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 416/813] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:11:14 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1745 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:11:14.514094 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-a1996850-ce9f-4fa9-baa9-f1eca4eee654 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:11:14.516222 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-a1996850-ce9f-4fa9-baa9-f1eca4eee654 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:11:14.524346 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a1996850-ce9f-4fa9-baa9-f1eca4eee654 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:11:14.525311 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a1996850-ce9f-4fa9-baa9-f1eca4eee654 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:11:14.526047 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a1996850-ce9f-4fa9-baa9-f1eca4eee654 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:11:14.527142 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a1996850-ce9f-4fa9-baa9-f1eca4eee654 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:11:14.527924 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a1996850-ce9f-4fa9-baa9-f1eca4eee654 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:11:14.528665 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a1996850-ce9f-4fa9-baa9-f1eca4eee654 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:11:14.560323 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-a1996850-ce9f-4fa9-baa9-f1eca4eee654 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050083 Oct 20 06:11:14.560948 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 398/814] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:11:14 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:11:15.466424 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-b112b2ee-ff36-421b-b657-660e3445a4cd tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:11:15.467040 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-b112b2ee-ff36-421b-b657-660e3445a4cd tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:11:15.473547 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b112b2ee-ff36-421b-b657-660e3445a4cd tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:11:15.474035 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b112b2ee-ff36-421b-b657-660e3445a4cd tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:11:15.474476 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b112b2ee-ff36-421b-b657-660e3445a4cd tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:11:15.475745 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b112b2ee-ff36-421b-b657-660e3445a4cd tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:11:15.476201 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b112b2ee-ff36-421b-b657-660e3445a4cd tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:11:15.476629 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b112b2ee-ff36-421b-b657-660e3445a4cd tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:11:15.572378 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-fb784b5e-dbbe-4060-9fd6-0da5e3178039 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:11:15.586188 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-fb784b5e-dbbe-4060-9fd6-0da5e3178039 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:11:15.586188 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-fb784b5e-dbbe-4060-9fd6-0da5e3178039 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:11:15.586188 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-fb784b5e-dbbe-4060-9fd6-0da5e3178039 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:11:15.586188 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-fb784b5e-dbbe-4060-9fd6-0da5e3178039 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:11:15.586483 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-fb784b5e-dbbe-4060-9fd6-0da5e3178039 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:11:15.586483 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-fb784b5e-dbbe-4060-9fd6-0da5e3178039 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:11:15.586483 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-fb784b5e-dbbe-4060-9fd6-0da5e3178039 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:11:15.621303 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-b112b2ee-ff36-421b-b657-660e3445a4cd tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:11:15.630091 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-b112b2ee-ff36-421b-b657-660e3445a4cd tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:11:15.630875 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-fb784b5e-dbbe-4060-9fd6-0da5e3178039 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062440 Oct 20 06:11:15.631582 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-b112b2ee-ff36-421b-b657-660e3445a4cd tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:11:15.632263 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 399/815] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:11:15 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:11:15.632776 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-b112b2ee-ff36-421b-b657-660e3445a4cd tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1745 microversion: 2.20 time: 0.170241 Oct 20 06:11:15.633463 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 417/816] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:11:15 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1745 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:11:16.653887 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-bb71a062-00a4-4987-82b2-4615a7e75c65 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:11:16.656014 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-bb71a062-00a4-4987-82b2-4615a7e75c65 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:11:16.659344 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-617a3d12-53d4-4190-aa78-a1737aa0cc96 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:11:16.660511 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-617a3d12-53d4-4190-aa78-a1737aa0cc96 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:11:16.663655 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-bb71a062-00a4-4987-82b2-4615a7e75c65 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:11:16.664143 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-bb71a062-00a4-4987-82b2-4615a7e75c65 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:11:16.664571 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-bb71a062-00a4-4987-82b2-4615a7e75c65 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:11:16.665284 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-bb71a062-00a4-4987-82b2-4615a7e75c65 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:11:16.665731 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-bb71a062-00a4-4987-82b2-4615a7e75c65 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:11:16.666146 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-bb71a062-00a4-4987-82b2-4615a7e75c65 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:11:16.668383 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-617a3d12-53d4-4190-aa78-a1737aa0cc96 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:11:16.668822 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-617a3d12-53d4-4190-aa78-a1737aa0cc96 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:11:16.669312 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-617a3d12-53d4-4190-aa78-a1737aa0cc96 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:11:16.669974 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-617a3d12-53d4-4190-aa78-a1737aa0cc96 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:11:16.670433 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-617a3d12-53d4-4190-aa78-a1737aa0cc96 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:11:16.670860 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-617a3d12-53d4-4190-aa78-a1737aa0cc96 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:11:16.700267 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-bb71a062-00a4-4987-82b2-4615a7e75c65 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050190 Oct 20 06:11:16.701721 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 400/817] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:11:16 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:11:16.809032 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-617a3d12-53d4-4190-aa78-a1737aa0cc96 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:11:16.817650 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-617a3d12-53d4-4190-aa78-a1737aa0cc96 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:11:16.819100 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-617a3d12-53d4-4190-aa78-a1737aa0cc96 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:11:16.820256 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-617a3d12-53d4-4190-aa78-a1737aa0cc96 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1745 microversion: 2.20 time: 0.164855 Oct 20 06:11:16.820838 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 418/818] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:11:16 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1745 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:11:17.713246 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-34eae088-d6f7-4e06-b995-1b5824246106 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:11:17.715573 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-34eae088-d6f7-4e06-b995-1b5824246106 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:11:17.722021 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-34eae088-d6f7-4e06-b995-1b5824246106 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:11:17.722503 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-34eae088-d6f7-4e06-b995-1b5824246106 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:11:17.722941 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-34eae088-d6f7-4e06-b995-1b5824246106 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:11:17.723635 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-34eae088-d6f7-4e06-b995-1b5824246106 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:11:17.724086 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-34eae088-d6f7-4e06-b995-1b5824246106 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:11:17.724510 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-34eae088-d6f7-4e06-b995-1b5824246106 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:11:17.750478 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG dbcounter [-] [118860] Writing DB stats nova_cell1:SELECT=100 {{(pid=118860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:11:17.755924 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-34eae088-d6f7-4e06-b995-1b5824246106 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046823 Oct 20 06:11:17.757635 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 401/819] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:11:17 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:11:17.845766 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-10a7a63e-f8c1-40b1-805c-7b6ba34fadb0 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:11:17.846371 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-10a7a63e-f8c1-40b1-805c-7b6ba34fadb0 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:11:17.853210 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-10a7a63e-f8c1-40b1-805c-7b6ba34fadb0 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:11:17.853692 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-10a7a63e-f8c1-40b1-805c-7b6ba34fadb0 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:11:17.854131 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-10a7a63e-f8c1-40b1-805c-7b6ba34fadb0 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:11:17.854822 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-10a7a63e-f8c1-40b1-805c-7b6ba34fadb0 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:11:17.855282 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-10a7a63e-f8c1-40b1-805c-7b6ba34fadb0 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:11:17.855711 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-10a7a63e-f8c1-40b1-805c-7b6ba34fadb0 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:11:17.873795 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG dbcounter [-] [118861] Writing DB stats nova_cell1:SELECT=100 {{(pid=118861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:11:17.983944 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-10a7a63e-f8c1-40b1-805c-7b6ba34fadb0 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:11:17.992493 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-10a7a63e-f8c1-40b1-805c-7b6ba34fadb0 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:11:17.993959 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-10a7a63e-f8c1-40b1-805c-7b6ba34fadb0 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:11:17.995103 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-10a7a63e-f8c1-40b1-805c-7b6ba34fadb0 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1745 microversion: 2.20 time: 0.153276 Oct 20 06:11:17.995649 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 419/820] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:11:17 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1745 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:11:18.768902 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-cd55e141-c3d6-462c-afe2-3fe1e399c175 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:11:18.771049 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-cd55e141-c3d6-462c-afe2-3fe1e399c175 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:11:18.778614 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-cd55e141-c3d6-462c-afe2-3fe1e399c175 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:11:18.779101 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-cd55e141-c3d6-462c-afe2-3fe1e399c175 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:11:18.779542 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-cd55e141-c3d6-462c-afe2-3fe1e399c175 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:11:18.780239 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-cd55e141-c3d6-462c-afe2-3fe1e399c175 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:11:18.780718 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-cd55e141-c3d6-462c-afe2-3fe1e399c175 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:11:18.781207 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-cd55e141-c3d6-462c-afe2-3fe1e399c175 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:11:18.812318 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-cd55e141-c3d6-462c-afe2-3fe1e399c175 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047486 Oct 20 06:11:18.813095 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 402/821] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:11:18 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:11:19.020468 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-82dea249-6e5b-4a5e-a8f3-98e39d856159 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:11:19.021028 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-82dea249-6e5b-4a5e-a8f3-98e39d856159 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:11:19.028482 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-82dea249-6e5b-4a5e-a8f3-98e39d856159 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:11:19.029008 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-82dea249-6e5b-4a5e-a8f3-98e39d856159 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:11:19.029448 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-82dea249-6e5b-4a5e-a8f3-98e39d856159 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:11:19.030143 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-82dea249-6e5b-4a5e-a8f3-98e39d856159 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:11:19.030599 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-82dea249-6e5b-4a5e-a8f3-98e39d856159 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:11:19.031043 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-82dea249-6e5b-4a5e-a8f3-98e39d856159 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:11:19.160930 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-82dea249-6e5b-4a5e-a8f3-98e39d856159 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:11:19.170074 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-82dea249-6e5b-4a5e-a8f3-98e39d856159 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:11:19.171517 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-82dea249-6e5b-4a5e-a8f3-98e39d856159 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:11:19.172725 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-82dea249-6e5b-4a5e-a8f3-98e39d856159 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1745 microversion: 2.20 time: 0.156199 Oct 20 06:11:19.173278 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 420/822] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:11:19 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1745 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:11:19.825377 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-e3446ce0-c3bf-4b1a-82bb-968731d7e451 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:11:19.827572 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-e3446ce0-c3bf-4b1a-82bb-968731d7e451 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:11:19.833969 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e3446ce0-c3bf-4b1a-82bb-968731d7e451 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:11:19.834561 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e3446ce0-c3bf-4b1a-82bb-968731d7e451 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:11:19.835247 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e3446ce0-c3bf-4b1a-82bb-968731d7e451 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:11:19.835952 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e3446ce0-c3bf-4b1a-82bb-968731d7e451 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:11:19.836405 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e3446ce0-c3bf-4b1a-82bb-968731d7e451 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:11:19.836855 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e3446ce0-c3bf-4b1a-82bb-968731d7e451 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:11:19.871300 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-e3446ce0-c3bf-4b1a-82bb-968731d7e451 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049693 Oct 20 06:11:19.872067 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 403/823] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:11:19 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:11:20.198257 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-fb1d137f-7906-4be8-ad38-d941ef1227cf tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:11:20.198872 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-fb1d137f-7906-4be8-ad38-d941ef1227cf tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:11:20.205323 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-fb1d137f-7906-4be8-ad38-d941ef1227cf tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:11:20.205839 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-fb1d137f-7906-4be8-ad38-d941ef1227cf tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:11:20.206281 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-fb1d137f-7906-4be8-ad38-d941ef1227cf tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:11:20.206983 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-fb1d137f-7906-4be8-ad38-d941ef1227cf tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:11:20.207439 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-fb1d137f-7906-4be8-ad38-d941ef1227cf tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:11:20.207868 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-fb1d137f-7906-4be8-ad38-d941ef1227cf tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:11:20.338376 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-fb1d137f-7906-4be8-ad38-d941ef1227cf tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:11:20.346886 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-fb1d137f-7906-4be8-ad38-d941ef1227cf tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:11:20.348324 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-fb1d137f-7906-4be8-ad38-d941ef1227cf tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:11:20.349540 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-fb1d137f-7906-4be8-ad38-d941ef1227cf tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1745 microversion: 2.20 time: 0.155347 Oct 20 06:11:20.350601 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 421/824] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:11:20 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1745 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:11:20.884883 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-cf02c99d-f5b6-4208-9654-55d56281d858 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:11:20.887076 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-cf02c99d-f5b6-4208-9654-55d56281d858 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:11:20.893608 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-cf02c99d-f5b6-4208-9654-55d56281d858 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:11:20.894092 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-cf02c99d-f5b6-4208-9654-55d56281d858 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:11:20.894747 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-cf02c99d-f5b6-4208-9654-55d56281d858 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:11:20.895220 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-cf02c99d-f5b6-4208-9654-55d56281d858 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:11:20.895672 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-cf02c99d-f5b6-4208-9654-55d56281d858 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:11:20.896094 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-cf02c99d-f5b6-4208-9654-55d56281d858 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:11:20.926528 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-cf02c99d-f5b6-4208-9654-55d56281d858 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045560 Oct 20 06:11:20.927090 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 404/825] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:11:20 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:11:21.376065 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-2f1851c9-7d2d-49c9-8ff1-9622ae5ce9a2 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:11:21.376724 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-2f1851c9-7d2d-49c9-8ff1-9622ae5ce9a2 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:11:21.383616 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-2f1851c9-7d2d-49c9-8ff1-9622ae5ce9a2 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:11:21.384098 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-2f1851c9-7d2d-49c9-8ff1-9622ae5ce9a2 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:11:21.384534 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-2f1851c9-7d2d-49c9-8ff1-9622ae5ce9a2 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:11:21.385256 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-2f1851c9-7d2d-49c9-8ff1-9622ae5ce9a2 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:11:21.385711 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-2f1851c9-7d2d-49c9-8ff1-9622ae5ce9a2 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:11:21.386137 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-2f1851c9-7d2d-49c9-8ff1-9622ae5ce9a2 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:11:21.511313 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-2f1851c9-7d2d-49c9-8ff1-9622ae5ce9a2 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:11:21.519882 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-2f1851c9-7d2d-49c9-8ff1-9622ae5ce9a2 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:11:21.521355 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-2f1851c9-7d2d-49c9-8ff1-9622ae5ce9a2 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:11:21.523214 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-2f1851c9-7d2d-49c9-8ff1-9622ae5ce9a2 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1745 microversion: 2.20 time: 0.151142 Oct 20 06:11:21.523774 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 422/826] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:11:21 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1745 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:11:21.938838 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-5b3e13c0-a040-4e8c-a6f2-3f26198c8bc0 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:11:21.941036 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-5b3e13c0-a040-4e8c-a6f2-3f26198c8bc0 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:11:21.947738 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5b3e13c0-a040-4e8c-a6f2-3f26198c8bc0 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:11:21.948220 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5b3e13c0-a040-4e8c-a6f2-3f26198c8bc0 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:11:21.948657 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5b3e13c0-a040-4e8c-a6f2-3f26198c8bc0 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:11:21.949370 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5b3e13c0-a040-4e8c-a6f2-3f26198c8bc0 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:11:21.949821 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5b3e13c0-a040-4e8c-a6f2-3f26198c8bc0 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:11:21.950249 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5b3e13c0-a040-4e8c-a6f2-3f26198c8bc0 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:11:21.979897 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-5b3e13c0-a040-4e8c-a6f2-3f26198c8bc0 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045015 Oct 20 06:11:21.980449 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 405/827] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:11:21 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:11:22.549117 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-9fdcebab-9dd7-4d36-b7ad-056e4d57f105 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:11:22.549723 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-9fdcebab-9dd7-4d36-b7ad-056e4d57f105 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:11:22.559152 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-9fdcebab-9dd7-4d36-b7ad-056e4d57f105 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:11:22.559558 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-9fdcebab-9dd7-4d36-b7ad-056e4d57f105 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:11:22.559991 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-9fdcebab-9dd7-4d36-b7ad-056e4d57f105 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:11:22.560685 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-9fdcebab-9dd7-4d36-b7ad-056e4d57f105 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:11:22.561162 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-9fdcebab-9dd7-4d36-b7ad-056e4d57f105 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:11:22.561581 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-9fdcebab-9dd7-4d36-b7ad-056e4d57f105 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:11:22.694213 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-9fdcebab-9dd7-4d36-b7ad-056e4d57f105 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:11:22.702793 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-9fdcebab-9dd7-4d36-b7ad-056e4d57f105 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:11:22.704260 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-9fdcebab-9dd7-4d36-b7ad-056e4d57f105 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:11:22.705419 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-9fdcebab-9dd7-4d36-b7ad-056e4d57f105 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1745 microversion: 2.20 time: 0.160353 Oct 20 06:11:22.705967 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 423/828] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:11:22 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1745 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:11:22.991851 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-50163f40-6630-446c-9a6e-0fe36f5aeaa3 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:11:22.994016 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-50163f40-6630-446c-9a6e-0fe36f5aeaa3 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:11:23.000538 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-50163f40-6630-446c-9a6e-0fe36f5aeaa3 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:11:23.001051 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-50163f40-6630-446c-9a6e-0fe36f5aeaa3 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:11:23.001482 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-50163f40-6630-446c-9a6e-0fe36f5aeaa3 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:11:23.002166 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-50163f40-6630-446c-9a6e-0fe36f5aeaa3 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:11:23.002612 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-50163f40-6630-446c-9a6e-0fe36f5aeaa3 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:11:23.003031 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-50163f40-6630-446c-9a6e-0fe36f5aeaa3 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:11:23.033437 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-50163f40-6630-446c-9a6e-0fe36f5aeaa3 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046009 Oct 20 06:11:23.033997 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 406/829] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:11:22 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:11:23.731935 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-b9548632-5b76-4981-b419-7b8544ad4689 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:11:23.732548 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-b9548632-5b76-4981-b419-7b8544ad4689 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:11:23.738951 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b9548632-5b76-4981-b419-7b8544ad4689 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:11:23.739429 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b9548632-5b76-4981-b419-7b8544ad4689 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:11:23.739868 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b9548632-5b76-4981-b419-7b8544ad4689 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:11:23.740564 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b9548632-5b76-4981-b419-7b8544ad4689 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:11:23.741044 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b9548632-5b76-4981-b419-7b8544ad4689 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:11:23.741469 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b9548632-5b76-4981-b419-7b8544ad4689 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:11:23.816861 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 20 06:11:23.816861 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: Thu Oct 20 06:11:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d (ip 10.222.0.20) !!! Oct 20 06:11:23.818293 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 20 06:11:23.818293 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: Thu Oct 20 06:11:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d (ip 10.222.0.20) !!! Oct 20 06:11:23.871065 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-b9548632-5b76-4981-b419-7b8544ad4689 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:11:23.879850 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-b9548632-5b76-4981-b419-7b8544ad4689 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:11:23.881514 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-b9548632-5b76-4981-b419-7b8544ad4689 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:11:23.882864 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-b9548632-5b76-4981-b419-7b8544ad4689 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1745 microversion: 2.20 time: 0.154933 Oct 20 06:11:23.883416 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 424/830] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:11:23 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1745 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:11:24.045994 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-06324c2d-49b0-45d3-91de-9db6cc3f8a3e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:11:24.048421 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-06324c2d-49b0-45d3-91de-9db6cc3f8a3e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:11:24.055486 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-06324c2d-49b0-45d3-91de-9db6cc3f8a3e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:11:24.055978 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-06324c2d-49b0-45d3-91de-9db6cc3f8a3e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:11:24.056535 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-06324c2d-49b0-45d3-91de-9db6cc3f8a3e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:11:24.057159 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-06324c2d-49b0-45d3-91de-9db6cc3f8a3e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:11:24.057617 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-06324c2d-49b0-45d3-91de-9db6cc3f8a3e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:11:24.058048 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-06324c2d-49b0-45d3-91de-9db6cc3f8a3e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:11:24.089199 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-06324c2d-49b0-45d3-91de-9db6cc3f8a3e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047386 Oct 20 06:11:24.089746 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 407/831] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:11:24 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:11:24.908930 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-0bfcff9b-5cb6-4753-8cc3-430a228e5025 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:11:24.909689 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-0bfcff9b-5cb6-4753-8cc3-430a228e5025 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:11:24.916582 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-0bfcff9b-5cb6-4753-8cc3-430a228e5025 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:11:24.917108 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-0bfcff9b-5cb6-4753-8cc3-430a228e5025 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:11:24.917551 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-0bfcff9b-5cb6-4753-8cc3-430a228e5025 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:11:24.918250 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-0bfcff9b-5cb6-4753-8cc3-430a228e5025 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:11:24.918708 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-0bfcff9b-5cb6-4753-8cc3-430a228e5025 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:11:24.919136 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-0bfcff9b-5cb6-4753-8cc3-430a228e5025 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:11:25.047416 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-0bfcff9b-5cb6-4753-8cc3-430a228e5025 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:11:25.056010 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-0bfcff9b-5cb6-4753-8cc3-430a228e5025 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:11:25.057470 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-0bfcff9b-5cb6-4753-8cc3-430a228e5025 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:11:25.058650 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-0bfcff9b-5cb6-4753-8cc3-430a228e5025 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1745 microversion: 2.20 time: 0.153701 Oct 20 06:11:25.059197 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 425/832] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:11:24 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1745 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:11:25.102279 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-8dd722a9-29ad-4379-a7fd-28c6df1841ab tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:11:25.104508 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-8dd722a9-29ad-4379-a7fd-28c6df1841ab tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:11:25.111063 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-8dd722a9-29ad-4379-a7fd-28c6df1841ab tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:11:25.111552 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-8dd722a9-29ad-4379-a7fd-28c6df1841ab tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:11:25.111991 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-8dd722a9-29ad-4379-a7fd-28c6df1841ab tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:11:25.112712 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-8dd722a9-29ad-4379-a7fd-28c6df1841ab tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:11:25.113172 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-8dd722a9-29ad-4379-a7fd-28c6df1841ab tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:11:25.113599 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-8dd722a9-29ad-4379-a7fd-28c6df1841ab tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:11:25.144510 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-8dd722a9-29ad-4379-a7fd-28c6df1841ab tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046987 Oct 20 06:11:25.145102 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 408/833] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:11:25 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:11:26.083341 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-ddb1f345-95bd-46b6-b0d8-8d3133ff906e tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:11:26.083950 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-ddb1f345-95bd-46b6-b0d8-8d3133ff906e tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:11:26.090808 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ddb1f345-95bd-46b6-b0d8-8d3133ff906e tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:11:26.091286 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ddb1f345-95bd-46b6-b0d8-8d3133ff906e tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:11:26.091720 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ddb1f345-95bd-46b6-b0d8-8d3133ff906e tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:11:26.092401 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ddb1f345-95bd-46b6-b0d8-8d3133ff906e tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:11:26.092883 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ddb1f345-95bd-46b6-b0d8-8d3133ff906e tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:11:26.093309 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ddb1f345-95bd-46b6-b0d8-8d3133ff906e tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:11:26.157391 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-20a00362-1987-4c37-a1a4-efd32a8102d8 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:11:26.159665 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-20a00362-1987-4c37-a1a4-efd32a8102d8 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:11:26.168033 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-20a00362-1987-4c37-a1a4-efd32a8102d8 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:11:26.168724 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-20a00362-1987-4c37-a1a4-efd32a8102d8 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:11:26.170108 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-20a00362-1987-4c37-a1a4-efd32a8102d8 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:11:26.171605 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-20a00362-1987-4c37-a1a4-efd32a8102d8 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:11:26.172148 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-20a00362-1987-4c37-a1a4-efd32a8102d8 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:11:26.172880 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-20a00362-1987-4c37-a1a4-efd32a8102d8 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:11:26.205135 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-20a00362-1987-4c37-a1a4-efd32a8102d8 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051537 Oct 20 06:11:26.205697 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 409/834] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:11:26 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 20 06:11:26.231480 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-ddb1f345-95bd-46b6-b0d8-8d3133ff906e tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:11:26.239877 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-ddb1f345-95bd-46b6-b0d8-8d3133ff906e tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:11:26.241337 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-ddb1f345-95bd-46b6-b0d8-8d3133ff906e tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:11:26.242518 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-ddb1f345-95bd-46b6-b0d8-8d3133ff906e tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1745 microversion: 2.20 time: 0.163105 Oct 20 06:11:26.243207 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 426/835] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:11:26 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1745 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:11:27.217605 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-d5ca9519-c87f-4c36-929e-2276b97262ed tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:11:27.219865 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-d5ca9519-c87f-4c36-929e-2276b97262ed tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:11:27.226877 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-d5ca9519-c87f-4c36-929e-2276b97262ed tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:11:27.227333 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-d5ca9519-c87f-4c36-929e-2276b97262ed tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:11:27.227776 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-d5ca9519-c87f-4c36-929e-2276b97262ed tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:11:27.228479 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-d5ca9519-c87f-4c36-929e-2276b97262ed tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:11:27.229083 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-d5ca9519-c87f-4c36-929e-2276b97262ed tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:11:27.229515 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-d5ca9519-c87f-4c36-929e-2276b97262ed tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:11:27.260664 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-d5ca9519-c87f-4c36-929e-2276b97262ed tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046956 Oct 20 06:11:27.261233 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 410/836] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:11:27 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:11:27.269581 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-e3d5209c-e221-4ade-b8a5-30554049d50d tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:11:27.270196 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-e3d5209c-e221-4ade-b8a5-30554049d50d tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:11:27.276043 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e3d5209c-e221-4ade-b8a5-30554049d50d tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:11:27.276526 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e3d5209c-e221-4ade-b8a5-30554049d50d tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:11:27.277014 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e3d5209c-e221-4ade-b8a5-30554049d50d tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:11:27.277710 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e3d5209c-e221-4ade-b8a5-30554049d50d tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:11:27.278164 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e3d5209c-e221-4ade-b8a5-30554049d50d tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:11:27.278592 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e3d5209c-e221-4ade-b8a5-30554049d50d tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:11:27.416309 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-e3d5209c-e221-4ade-b8a5-30554049d50d tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:11:27.425286 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-e3d5209c-e221-4ade-b8a5-30554049d50d tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:11:27.426729 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-e3d5209c-e221-4ade-b8a5-30554049d50d tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:11:27.427887 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-e3d5209c-e221-4ade-b8a5-30554049d50d tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1745 microversion: 2.20 time: 0.162343 Oct 20 06:11:27.428459 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 427/837] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:11:27 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1745 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:11:28.274619 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-283fdfe2-5420-48f4-9984-77bc0fd1a496 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:11:28.276888 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-283fdfe2-5420-48f4-9984-77bc0fd1a496 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:11:28.283156 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-283fdfe2-5420-48f4-9984-77bc0fd1a496 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:11:28.283635 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-283fdfe2-5420-48f4-9984-77bc0fd1a496 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:11:28.284066 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-283fdfe2-5420-48f4-9984-77bc0fd1a496 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:11:28.284783 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-283fdfe2-5420-48f4-9984-77bc0fd1a496 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:11:28.285233 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-283fdfe2-5420-48f4-9984-77bc0fd1a496 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:11:28.285654 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-283fdfe2-5420-48f4-9984-77bc0fd1a496 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:11:28.317091 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-283fdfe2-5420-48f4-9984-77bc0fd1a496 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047890 Oct 20 06:11:28.317638 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 411/838] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:11:28 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:11:28.453745 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-e9dd9f8b-3148-46d0-8664-5e4aa3919a13 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:11:28.454354 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-e9dd9f8b-3148-46d0-8664-5e4aa3919a13 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:11:28.460877 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e9dd9f8b-3148-46d0-8664-5e4aa3919a13 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:11:28.461368 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e9dd9f8b-3148-46d0-8664-5e4aa3919a13 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:11:28.461803 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e9dd9f8b-3148-46d0-8664-5e4aa3919a13 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:11:28.462497 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e9dd9f8b-3148-46d0-8664-5e4aa3919a13 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:11:28.462949 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e9dd9f8b-3148-46d0-8664-5e4aa3919a13 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:11:28.463372 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e9dd9f8b-3148-46d0-8664-5e4aa3919a13 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:11:28.591805 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-e9dd9f8b-3148-46d0-8664-5e4aa3919a13 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:11:28.600245 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-e9dd9f8b-3148-46d0-8664-5e4aa3919a13 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:11:28.602232 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-e9dd9f8b-3148-46d0-8664-5e4aa3919a13 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:11:28.603381 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-e9dd9f8b-3148-46d0-8664-5e4aa3919a13 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1745 microversion: 2.20 time: 0.153472 Oct 20 06:11:28.603926 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 428/839] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:11:28 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1745 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:11:29.329651 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-9053b8e0-2a4b-42af-8680-f7d15db0250c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:11:29.332044 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-9053b8e0-2a4b-42af-8680-f7d15db0250c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:11:29.338543 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-9053b8e0-2a4b-42af-8680-f7d15db0250c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:11:29.339106 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-9053b8e0-2a4b-42af-8680-f7d15db0250c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:11:29.339621 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-9053b8e0-2a4b-42af-8680-f7d15db0250c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:11:29.340396 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-9053b8e0-2a4b-42af-8680-f7d15db0250c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:11:29.340943 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-9053b8e0-2a4b-42af-8680-f7d15db0250c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:11:29.341376 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-9053b8e0-2a4b-42af-8680-f7d15db0250c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:11:29.372191 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-9053b8e0-2a4b-42af-8680-f7d15db0250c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046528 Oct 20 06:11:29.372767 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 412/840] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:11:29 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:11:29.629950 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-f21e4b6e-3c43-471b-b55b-1c8b47ff9b40 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:11:29.630555 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-f21e4b6e-3c43-471b-b55b-1c8b47ff9b40 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:11:29.637660 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f21e4b6e-3c43-471b-b55b-1c8b47ff9b40 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:11:29.638138 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f21e4b6e-3c43-471b-b55b-1c8b47ff9b40 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:11:29.638568 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f21e4b6e-3c43-471b-b55b-1c8b47ff9b40 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:11:29.639252 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f21e4b6e-3c43-471b-b55b-1c8b47ff9b40 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:11:29.639699 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f21e4b6e-3c43-471b-b55b-1c8b47ff9b40 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:11:29.640122 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f21e4b6e-3c43-471b-b55b-1c8b47ff9b40 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:11:29.766983 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-f21e4b6e-3c43-471b-b55b-1c8b47ff9b40 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:11:29.775872 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-f21e4b6e-3c43-471b-b55b-1c8b47ff9b40 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:11:29.777329 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-f21e4b6e-3c43-471b-b55b-1c8b47ff9b40 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:11:29.778467 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-f21e4b6e-3c43-471b-b55b-1c8b47ff9b40 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1745 microversion: 2.20 time: 0.152744 Oct 20 06:11:29.779012 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 429/841] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:11:29 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1745 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:11:30.385439 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-9d252dda-6395-4f28-b32e-93f7f01ba376 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:11:30.387657 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-9d252dda-6395-4f28-b32e-93f7f01ba376 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:11:30.394106 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-9d252dda-6395-4f28-b32e-93f7f01ba376 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:11:30.394632 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-9d252dda-6395-4f28-b32e-93f7f01ba376 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:11:30.395007 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-9d252dda-6395-4f28-b32e-93f7f01ba376 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:11:30.395730 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-9d252dda-6395-4f28-b32e-93f7f01ba376 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:11:30.396176 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-9d252dda-6395-4f28-b32e-93f7f01ba376 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:11:30.396600 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-9d252dda-6395-4f28-b32e-93f7f01ba376 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:11:30.433477 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-9d252dda-6395-4f28-b32e-93f7f01ba376 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052629 Oct 20 06:11:30.434038 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 413/842] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:11:30 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:11:30.805183 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-687eac96-1034-4e2f-b7d3-ed7bd80d0506 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:11:30.805782 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-687eac96-1034-4e2f-b7d3-ed7bd80d0506 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:11:30.812115 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-687eac96-1034-4e2f-b7d3-ed7bd80d0506 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:11:30.812535 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-687eac96-1034-4e2f-b7d3-ed7bd80d0506 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:11:30.813055 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-687eac96-1034-4e2f-b7d3-ed7bd80d0506 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:11:30.813741 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-687eac96-1034-4e2f-b7d3-ed7bd80d0506 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:11:30.814187 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-687eac96-1034-4e2f-b7d3-ed7bd80d0506 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:11:30.814606 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-687eac96-1034-4e2f-b7d3-ed7bd80d0506 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:11:30.944228 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-687eac96-1034-4e2f-b7d3-ed7bd80d0506 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:11:30.952672 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-687eac96-1034-4e2f-b7d3-ed7bd80d0506 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:11:30.954133 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-687eac96-1034-4e2f-b7d3-ed7bd80d0506 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:11:30.955284 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-687eac96-1034-4e2f-b7d3-ed7bd80d0506 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1745 microversion: 2.20 time: 0.154732 Oct 20 06:11:30.955838 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 430/843] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:11:30 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1745 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:11:31.446709 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-4d72d144-58c1-46fd-80af-f1fe055b2442 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:11:31.448551 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-4d72d144-58c1-46fd-80af-f1fe055b2442 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:11:31.451818 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG dbcounter [-] [118860] Writing DB stats nova_api:SELECT=58 {{(pid=118860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:11:31.455585 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-4d72d144-58c1-46fd-80af-f1fe055b2442 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:11:31.456065 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-4d72d144-58c1-46fd-80af-f1fe055b2442 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:11:31.456494 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-4d72d144-58c1-46fd-80af-f1fe055b2442 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:11:31.457209 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-4d72d144-58c1-46fd-80af-f1fe055b2442 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:11:31.457655 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-4d72d144-58c1-46fd-80af-f1fe055b2442 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:11:31.458078 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-4d72d144-58c1-46fd-80af-f1fe055b2442 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:11:31.489045 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-4d72d144-58c1-46fd-80af-f1fe055b2442 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046963 Oct 20 06:11:31.489599 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 414/844] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:11:31 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:11:31.981307 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-3c47ef61-2ffc-4b78-8ba2-8a7ff848935d tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:11:31.981914 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-3c47ef61-2ffc-4b78-8ba2-8a7ff848935d tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:11:31.984225 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG dbcounter [-] [118861] Writing DB stats nova_api:SELECT=52 {{(pid=118861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:11:31.989516 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-3c47ef61-2ffc-4b78-8ba2-8a7ff848935d tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:11:31.989998 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-3c47ef61-2ffc-4b78-8ba2-8a7ff848935d tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:11:31.990436 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-3c47ef61-2ffc-4b78-8ba2-8a7ff848935d tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:11:31.991632 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-3c47ef61-2ffc-4b78-8ba2-8a7ff848935d tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:11:31.992217 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-3c47ef61-2ffc-4b78-8ba2-8a7ff848935d tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:11:31.992651 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-3c47ef61-2ffc-4b78-8ba2-8a7ff848935d tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:11:32.118086 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-3c47ef61-2ffc-4b78-8ba2-8a7ff848935d tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:11:32.126579 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-3c47ef61-2ffc-4b78-8ba2-8a7ff848935d tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:11:32.128013 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-3c47ef61-2ffc-4b78-8ba2-8a7ff848935d tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:11:32.129465 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-3c47ef61-2ffc-4b78-8ba2-8a7ff848935d tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1745 microversion: 2.20 time: 0.151828 Oct 20 06:11:32.130014 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 431/845] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:11:31 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1745 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:11:32.501982 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-d50a3e63-5574-4efd-8e14-e2f5931846b4 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:11:32.504484 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-d50a3e63-5574-4efd-8e14-e2f5931846b4 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:11:32.510930 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-d50a3e63-5574-4efd-8e14-e2f5931846b4 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:11:32.511420 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-d50a3e63-5574-4efd-8e14-e2f5931846b4 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:11:32.511861 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-d50a3e63-5574-4efd-8e14-e2f5931846b4 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:11:32.512566 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-d50a3e63-5574-4efd-8e14-e2f5931846b4 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:11:32.513053 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-d50a3e63-5574-4efd-8e14-e2f5931846b4 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:11:32.513541 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-d50a3e63-5574-4efd-8e14-e2f5931846b4 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:11:32.546086 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-d50a3e63-5574-4efd-8e14-e2f5931846b4 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048002 Oct 20 06:11:32.546673 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 415/846] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:11:32 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:11:33.155227 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-5acb67c4-2001-4531-833b-2ed71f584bc3 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:11:33.155839 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-5acb67c4-2001-4531-833b-2ed71f584bc3 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:11:33.162944 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5acb67c4-2001-4531-833b-2ed71f584bc3 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:11:33.163448 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5acb67c4-2001-4531-833b-2ed71f584bc3 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:11:33.163961 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5acb67c4-2001-4531-833b-2ed71f584bc3 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:11:33.164664 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5acb67c4-2001-4531-833b-2ed71f584bc3 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:11:33.165151 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5acb67c4-2001-4531-833b-2ed71f584bc3 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:11:33.165582 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5acb67c4-2001-4531-833b-2ed71f584bc3 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:11:33.294703 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-5acb67c4-2001-4531-833b-2ed71f584bc3 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:11:33.303310 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-5acb67c4-2001-4531-833b-2ed71f584bc3 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:11:33.304852 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-5acb67c4-2001-4531-833b-2ed71f584bc3 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:11:33.306012 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-5acb67c4-2001-4531-833b-2ed71f584bc3 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1745 microversion: 2.20 time: 0.154708 Oct 20 06:11:33.306562 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 432/847] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:11:33 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1745 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:11:33.558283 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-cc3c5d1f-c831-4a80-b39e-aa03c46c830e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:11:33.560507 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-cc3c5d1f-c831-4a80-b39e-aa03c46c830e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:11:33.566902 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-cc3c5d1f-c831-4a80-b39e-aa03c46c830e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:11:33.567385 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-cc3c5d1f-c831-4a80-b39e-aa03c46c830e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:11:33.567808 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-cc3c5d1f-c831-4a80-b39e-aa03c46c830e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:11:33.568491 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-cc3c5d1f-c831-4a80-b39e-aa03c46c830e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:11:33.568954 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-cc3c5d1f-c831-4a80-b39e-aa03c46c830e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:11:33.569370 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-cc3c5d1f-c831-4a80-b39e-aa03c46c830e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:11:33.607629 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-cc3c5d1f-c831-4a80-b39e-aa03c46c830e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053283 Oct 20 06:11:33.611244 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 416/848] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:11:33 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:11:34.331087 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-f5e6027e-cb99-4d63-a671-d9525344bc9b tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:11:34.331701 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-f5e6027e-cb99-4d63-a671-d9525344bc9b tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:11:34.338386 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f5e6027e-cb99-4d63-a671-d9525344bc9b tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:11:34.338872 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f5e6027e-cb99-4d63-a671-d9525344bc9b tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:11:34.339311 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f5e6027e-cb99-4d63-a671-d9525344bc9b tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:11:34.340014 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f5e6027e-cb99-4d63-a671-d9525344bc9b tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:11:34.340469 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f5e6027e-cb99-4d63-a671-d9525344bc9b tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:11:34.340936 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f5e6027e-cb99-4d63-a671-d9525344bc9b tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:11:34.468566 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-f5e6027e-cb99-4d63-a671-d9525344bc9b tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:11:34.477486 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-f5e6027e-cb99-4d63-a671-d9525344bc9b tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:11:34.478916 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-f5e6027e-cb99-4d63-a671-d9525344bc9b tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:11:34.480064 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-f5e6027e-cb99-4d63-a671-d9525344bc9b tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1745 microversion: 2.20 time: 0.152977 Oct 20 06:11:34.480606 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 433/849] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:11:34 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1745 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:11:34.620207 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-cdacc3e8-d4a4-4e01-a7a7-c2ddc749c0e0 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:11:34.622457 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-cdacc3e8-d4a4-4e01-a7a7-c2ddc749c0e0 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:11:34.628786 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-cdacc3e8-d4a4-4e01-a7a7-c2ddc749c0e0 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:11:34.629522 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-cdacc3e8-d4a4-4e01-a7a7-c2ddc749c0e0 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:11:34.629960 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-cdacc3e8-d4a4-4e01-a7a7-c2ddc749c0e0 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:11:34.630658 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-cdacc3e8-d4a4-4e01-a7a7-c2ddc749c0e0 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:11:34.631125 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-cdacc3e8-d4a4-4e01-a7a7-c2ddc749c0e0 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:11:34.631545 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-cdacc3e8-d4a4-4e01-a7a7-c2ddc749c0e0 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:11:34.661726 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-cdacc3e8-d4a4-4e01-a7a7-c2ddc749c0e0 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046396 Oct 20 06:11:34.662276 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 417/850] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:11:34 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:11:35.505880 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-758b2258-828a-40ea-b923-70345837821a tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:11:35.506513 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-758b2258-828a-40ea-b923-70345837821a tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:11:35.514067 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-758b2258-828a-40ea-b923-70345837821a tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:11:35.514548 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-758b2258-828a-40ea-b923-70345837821a tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:11:35.514985 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-758b2258-828a-40ea-b923-70345837821a tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:11:35.515675 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-758b2258-828a-40ea-b923-70345837821a tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:11:35.516129 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-758b2258-828a-40ea-b923-70345837821a tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:11:35.516553 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-758b2258-828a-40ea-b923-70345837821a tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:11:35.642787 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-758b2258-828a-40ea-b923-70345837821a tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:11:35.651320 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-758b2258-828a-40ea-b923-70345837821a tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:11:35.652773 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-758b2258-828a-40ea-b923-70345837821a tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:11:35.653920 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-758b2258-828a-40ea-b923-70345837821a tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1745 microversion: 2.20 time: 0.152199 Oct 20 06:11:35.654465 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 434/851] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:11:35 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1745 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:11:35.675218 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-ff51383d-6524-459b-9279-21e56daa02a4 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:11:35.677501 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-ff51383d-6524-459b-9279-21e56daa02a4 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:11:35.684831 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-ff51383d-6524-459b-9279-21e56daa02a4 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:11:35.685318 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-ff51383d-6524-459b-9279-21e56daa02a4 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:11:35.685755 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-ff51383d-6524-459b-9279-21e56daa02a4 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:11:35.686449 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-ff51383d-6524-459b-9279-21e56daa02a4 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:11:35.686925 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-ff51383d-6524-459b-9279-21e56daa02a4 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:11:35.687394 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-ff51383d-6524-459b-9279-21e56daa02a4 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:11:35.704506 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG dbcounter [-] [118860] Writing DB stats nova_cell1:SELECT=100 {{(pid=118860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:11:35.720073 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-ff51383d-6524-459b-9279-21e56daa02a4 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048948 Oct 20 06:11:35.720639 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 418/852] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:11:35 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:11:36.679377 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-f5a9480d-59f4-4b7b-abaf-5fce2f391e8c tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:11:36.680163 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-f5a9480d-59f4-4b7b-abaf-5fce2f391e8c tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:11:36.686546 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f5a9480d-59f4-4b7b-abaf-5fce2f391e8c tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:11:36.687032 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f5a9480d-59f4-4b7b-abaf-5fce2f391e8c tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:11:36.687481 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f5a9480d-59f4-4b7b-abaf-5fce2f391e8c tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:11:36.688179 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f5a9480d-59f4-4b7b-abaf-5fce2f391e8c tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:11:36.688636 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f5a9480d-59f4-4b7b-abaf-5fce2f391e8c tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:11:36.689105 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f5a9480d-59f4-4b7b-abaf-5fce2f391e8c tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:11:36.735147 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-f08bdcb5-0020-4ec2-9966-417dec2f7abf tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:11:36.737985 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-f08bdcb5-0020-4ec2-9966-417dec2f7abf tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:11:36.745484 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f08bdcb5-0020-4ec2-9966-417dec2f7abf tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:11:36.746121 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f08bdcb5-0020-4ec2-9966-417dec2f7abf tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:11:36.746622 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f08bdcb5-0020-4ec2-9966-417dec2f7abf tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:11:36.747392 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f08bdcb5-0020-4ec2-9966-417dec2f7abf tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:11:36.747913 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f08bdcb5-0020-4ec2-9966-417dec2f7abf tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:11:36.748585 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f08bdcb5-0020-4ec2-9966-417dec2f7abf tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:11:36.786343 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-f08bdcb5-0020-4ec2-9966-417dec2f7abf tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056966 Oct 20 06:11:36.786926 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 419/853] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:11:36 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 20 06:11:36.838090 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-f5a9480d-59f4-4b7b-abaf-5fce2f391e8c tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:11:36.846944 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-f5a9480d-59f4-4b7b-abaf-5fce2f391e8c tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:11:36.848413 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-f5a9480d-59f4-4b7b-abaf-5fce2f391e8c tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:11:36.849608 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-f5a9480d-59f4-4b7b-abaf-5fce2f391e8c tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1745 microversion: 2.20 time: 0.174779 Oct 20 06:11:36.850155 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 435/854] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:11:36 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1745 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:11:37.799235 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-990ec88a-84f8-4d48-af59-ab329b302bde tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:11:37.801420 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-990ec88a-84f8-4d48-af59-ab329b302bde tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:11:37.807791 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-990ec88a-84f8-4d48-af59-ab329b302bde tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:11:37.808271 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-990ec88a-84f8-4d48-af59-ab329b302bde tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:11:37.808717 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-990ec88a-84f8-4d48-af59-ab329b302bde tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:11:37.809432 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-990ec88a-84f8-4d48-af59-ab329b302bde tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:11:37.809885 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-990ec88a-84f8-4d48-af59-ab329b302bde tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:11:37.810316 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-990ec88a-84f8-4d48-af59-ab329b302bde tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:11:37.841131 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-990ec88a-84f8-4d48-af59-ab329b302bde tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045754 Oct 20 06:11:37.841855 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 420/855] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:11:37 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:11:37.875251 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-7a1405f4-879f-48d3-9d95-37d147844ed2 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:11:37.875848 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-7a1405f4-879f-48d3-9d95-37d147844ed2 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:11:37.882626 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7a1405f4-879f-48d3-9d95-37d147844ed2 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:11:37.883099 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7a1405f4-879f-48d3-9d95-37d147844ed2 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:11:37.883530 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7a1405f4-879f-48d3-9d95-37d147844ed2 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:11:37.884221 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7a1405f4-879f-48d3-9d95-37d147844ed2 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:11:37.884670 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7a1405f4-879f-48d3-9d95-37d147844ed2 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:11:37.885123 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7a1405f4-879f-48d3-9d95-37d147844ed2 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:11:37.890061 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG dbcounter [-] [118861] Writing DB stats nova_cell1:SELECT=100 {{(pid=118861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:11:38.013631 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-7a1405f4-879f-48d3-9d95-37d147844ed2 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:11:38.022575 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-7a1405f4-879f-48d3-9d95-37d147844ed2 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:11:38.024371 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-7a1405f4-879f-48d3-9d95-37d147844ed2 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:11:38.025561 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-7a1405f4-879f-48d3-9d95-37d147844ed2 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1745 microversion: 2.20 time: 0.154301 Oct 20 06:11:38.026115 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 436/856] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:11:37 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1745 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:11:38.853152 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-69a425c6-2129-4652-8ff7-b2de11da979a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:11:38.856455 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-69a425c6-2129-4652-8ff7-b2de11da979a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:11:38.862611 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-69a425c6-2129-4652-8ff7-b2de11da979a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:11:38.863093 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-69a425c6-2129-4652-8ff7-b2de11da979a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:11:38.863531 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-69a425c6-2129-4652-8ff7-b2de11da979a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:11:38.864225 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-69a425c6-2129-4652-8ff7-b2de11da979a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:11:38.864677 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-69a425c6-2129-4652-8ff7-b2de11da979a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:11:38.865125 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-69a425c6-2129-4652-8ff7-b2de11da979a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:11:38.896953 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-69a425c6-2129-4652-8ff7-b2de11da979a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047487 Oct 20 06:11:38.898102 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 421/857] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:11:38 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:11:39.051192 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-3fa442f4-d607-45a4-bb18-9e8659f56d0c tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:11:39.051799 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-3fa442f4-d607-45a4-bb18-9e8659f56d0c tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:11:39.058987 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-3fa442f4-d607-45a4-bb18-9e8659f56d0c tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:11:39.059477 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-3fa442f4-d607-45a4-bb18-9e8659f56d0c tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:11:39.059919 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-3fa442f4-d607-45a4-bb18-9e8659f56d0c tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:11:39.060623 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-3fa442f4-d607-45a4-bb18-9e8659f56d0c tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:11:39.061104 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-3fa442f4-d607-45a4-bb18-9e8659f56d0c tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:11:39.061533 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-3fa442f4-d607-45a4-bb18-9e8659f56d0c tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:11:39.189957 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-3fa442f4-d607-45a4-bb18-9e8659f56d0c tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:11:39.199120 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-3fa442f4-d607-45a4-bb18-9e8659f56d0c tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:11:39.200542 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-3fa442f4-d607-45a4-bb18-9e8659f56d0c tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:11:39.201718 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-3fa442f4-d607-45a4-bb18-9e8659f56d0c tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1745 microversion: 2.20 time: 0.154399 Oct 20 06:11:39.202260 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 437/858] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:11:39 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1745 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:11:39.909994 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-c7b282c3-0364-4614-af2a-0a99d9c797a6 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:11:39.912377 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-c7b282c3-0364-4614-af2a-0a99d9c797a6 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:11:39.919320 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c7b282c3-0364-4614-af2a-0a99d9c797a6 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:11:39.920073 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c7b282c3-0364-4614-af2a-0a99d9c797a6 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:11:39.920257 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c7b282c3-0364-4614-af2a-0a99d9c797a6 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:11:39.921948 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c7b282c3-0364-4614-af2a-0a99d9c797a6 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:11:39.921948 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c7b282c3-0364-4614-af2a-0a99d9c797a6 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:11:39.921948 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c7b282c3-0364-4614-af2a-0a99d9c797a6 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:11:39.957169 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-c7b282c3-0364-4614-af2a-0a99d9c797a6 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051263 Oct 20 06:11:39.957890 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 422/859] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:11:39 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:11:40.227514 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-5352a90a-ba78-4352-84d2-475f301cd285 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:11:40.228049 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-5352a90a-ba78-4352-84d2-475f301cd285 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:11:40.234525 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5352a90a-ba78-4352-84d2-475f301cd285 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:11:40.235013 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5352a90a-ba78-4352-84d2-475f301cd285 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:11:40.235455 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5352a90a-ba78-4352-84d2-475f301cd285 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:11:40.236151 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5352a90a-ba78-4352-84d2-475f301cd285 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:11:40.236604 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5352a90a-ba78-4352-84d2-475f301cd285 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:11:40.237058 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5352a90a-ba78-4352-84d2-475f301cd285 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:11:40.363062 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-5352a90a-ba78-4352-84d2-475f301cd285 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:11:40.371912 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-5352a90a-ba78-4352-84d2-475f301cd285 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:11:40.373404 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-5352a90a-ba78-4352-84d2-475f301cd285 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:11:40.374570 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-5352a90a-ba78-4352-84d2-475f301cd285 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1745 microversion: 2.20 time: 0.151724 Oct 20 06:11:40.375129 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 438/860] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:11:40 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1745 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:11:40.970030 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-11382be0-3b8a-4708-823e-dbf9ef3ce54f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:11:40.972253 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-11382be0-3b8a-4708-823e-dbf9ef3ce54f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:11:40.979631 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-11382be0-3b8a-4708-823e-dbf9ef3ce54f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:11:40.979934 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-11382be0-3b8a-4708-823e-dbf9ef3ce54f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:11:40.980369 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-11382be0-3b8a-4708-823e-dbf9ef3ce54f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:11:40.981097 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-11382be0-3b8a-4708-823e-dbf9ef3ce54f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:11:40.981547 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-11382be0-3b8a-4708-823e-dbf9ef3ce54f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:11:40.981968 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-11382be0-3b8a-4708-823e-dbf9ef3ce54f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:11:41.011773 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-11382be0-3b8a-4708-823e-dbf9ef3ce54f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045614 Oct 20 06:11:41.015953 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 423/861] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:11:40 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:11:41.400278 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-cd500a10-0ab3-423b-ae0c-204f012159fd tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:11:41.400912 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-cd500a10-0ab3-423b-ae0c-204f012159fd tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:11:41.407311 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-cd500a10-0ab3-423b-ae0c-204f012159fd tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:11:41.407784 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-cd500a10-0ab3-423b-ae0c-204f012159fd tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:11:41.408216 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-cd500a10-0ab3-423b-ae0c-204f012159fd tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:11:41.408927 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-cd500a10-0ab3-423b-ae0c-204f012159fd tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:11:41.409374 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-cd500a10-0ab3-423b-ae0c-204f012159fd tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:11:41.409796 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-cd500a10-0ab3-423b-ae0c-204f012159fd tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:11:41.537193 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-cd500a10-0ab3-423b-ae0c-204f012159fd tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:11:41.545732 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-cd500a10-0ab3-423b-ae0c-204f012159fd tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:11:41.547207 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-cd500a10-0ab3-423b-ae0c-204f012159fd tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:11:41.548377 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-cd500a10-0ab3-423b-ae0c-204f012159fd tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1745 microversion: 2.20 time: 0.152336 Oct 20 06:11:41.548971 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 439/862] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:11:41 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1745 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:11:42.023610 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-404a40e1-df56-4d14-b78b-7d1f86b9566f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:11:42.025837 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-404a40e1-df56-4d14-b78b-7d1f86b9566f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:11:42.032334 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-404a40e1-df56-4d14-b78b-7d1f86b9566f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:11:42.032852 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-404a40e1-df56-4d14-b78b-7d1f86b9566f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:11:42.033300 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-404a40e1-df56-4d14-b78b-7d1f86b9566f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:11:42.034013 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-404a40e1-df56-4d14-b78b-7d1f86b9566f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:11:42.034437 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-404a40e1-df56-4d14-b78b-7d1f86b9566f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:11:42.034865 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-404a40e1-df56-4d14-b78b-7d1f86b9566f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:11:42.069334 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-404a40e1-df56-4d14-b78b-7d1f86b9566f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049746 Oct 20 06:11:42.069896 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 424/863] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:11:42 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:11:42.574400 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-206b394f-1ded-4842-a84e-1984e66f13bc tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:11:42.574935 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-206b394f-1ded-4842-a84e-1984e66f13bc tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:11:42.581349 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-206b394f-1ded-4842-a84e-1984e66f13bc tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:11:42.581835 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-206b394f-1ded-4842-a84e-1984e66f13bc tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:11:42.582274 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-206b394f-1ded-4842-a84e-1984e66f13bc tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:11:42.582971 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-206b394f-1ded-4842-a84e-1984e66f13bc tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:11:42.583426 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-206b394f-1ded-4842-a84e-1984e66f13bc tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:11:42.583852 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-206b394f-1ded-4842-a84e-1984e66f13bc tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:11:42.715643 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-206b394f-1ded-4842-a84e-1984e66f13bc tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:11:42.724259 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-206b394f-1ded-4842-a84e-1984e66f13bc tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:11:42.725745 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-206b394f-1ded-4842-a84e-1984e66f13bc tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:11:42.726907 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-206b394f-1ded-4842-a84e-1984e66f13bc tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1745 microversion: 2.20 time: 0.156543 Oct 20 06:11:42.727472 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 440/864] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:11:42 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1745 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:11:43.081639 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-0a312d88-7f79-43db-b62b-e4a3a3a6b65c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:11:43.083819 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-0a312d88-7f79-43db-b62b-e4a3a3a6b65c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:11:43.090600 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0a312d88-7f79-43db-b62b-e4a3a3a6b65c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:11:43.090600 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0a312d88-7f79-43db-b62b-e4a3a3a6b65c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:11:43.091026 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0a312d88-7f79-43db-b62b-e4a3a3a6b65c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:11:43.091707 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0a312d88-7f79-43db-b62b-e4a3a3a6b65c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:11:43.092156 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0a312d88-7f79-43db-b62b-e4a3a3a6b65c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:11:43.092577 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0a312d88-7f79-43db-b62b-e4a3a3a6b65c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:11:43.122194 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-0a312d88-7f79-43db-b62b-e4a3a3a6b65c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044503 Oct 20 06:11:43.122767 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 425/865] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:11:43 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:11:43.751992 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-ed74d331-5183-422b-a13e-b1effaef4a78 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:11:43.752641 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-ed74d331-5183-422b-a13e-b1effaef4a78 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:11:43.754888 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 20 06:11:43.755040 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: Thu Oct 20 06:11:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d (ip 10.222.0.20) !!! Oct 20 06:11:43.761541 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ed74d331-5183-422b-a13e-b1effaef4a78 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:11:43.762028 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ed74d331-5183-422b-a13e-b1effaef4a78 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:11:43.762470 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ed74d331-5183-422b-a13e-b1effaef4a78 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:11:43.763172 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ed74d331-5183-422b-a13e-b1effaef4a78 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:11:43.763628 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ed74d331-5183-422b-a13e-b1effaef4a78 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:11:43.764057 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ed74d331-5183-422b-a13e-b1effaef4a78 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:11:43.890569 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-ed74d331-5183-422b-a13e-b1effaef4a78 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:11:43.899639 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-ed74d331-5183-422b-a13e-b1effaef4a78 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:11:43.901114 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-ed74d331-5183-422b-a13e-b1effaef4a78 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:11:43.902277 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-ed74d331-5183-422b-a13e-b1effaef4a78 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1745 microversion: 2.20 time: 0.154195 Oct 20 06:11:43.902841 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 441/866] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:11:43 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1745 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:11:44.135451 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-8fbff8f5-8879-4c1b-9abd-160af69184ad tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:11:44.137635 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-8fbff8f5-8879-4c1b-9abd-160af69184ad tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:11:44.139642 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 20 06:11:44.139787 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: Thu Oct 20 06:11:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments (ip 10.222.0.20) !!! Oct 20 06:11:44.146233 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-8fbff8f5-8879-4c1b-9abd-160af69184ad tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:11:44.146761 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-8fbff8f5-8879-4c1b-9abd-160af69184ad tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:11:44.147967 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-8fbff8f5-8879-4c1b-9abd-160af69184ad tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:11:44.148680 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-8fbff8f5-8879-4c1b-9abd-160af69184ad tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:11:44.149772 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-8fbff8f5-8879-4c1b-9abd-160af69184ad tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:11:44.150212 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-8fbff8f5-8879-4c1b-9abd-160af69184ad tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:11:44.181268 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-8fbff8f5-8879-4c1b-9abd-160af69184ad tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050289 Oct 20 06:11:44.181838 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 426/867] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:11:44 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:11:44.927334 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-241fa2ed-4fce-4a2f-8e41-afbe23b9b1a1 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:11:44.928594 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-241fa2ed-4fce-4a2f-8e41-afbe23b9b1a1 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:11:44.934968 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-241fa2ed-4fce-4a2f-8e41-afbe23b9b1a1 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:11:44.935445 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-241fa2ed-4fce-4a2f-8e41-afbe23b9b1a1 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:11:44.935877 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-241fa2ed-4fce-4a2f-8e41-afbe23b9b1a1 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:11:44.936568 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-241fa2ed-4fce-4a2f-8e41-afbe23b9b1a1 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:11:44.937057 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-241fa2ed-4fce-4a2f-8e41-afbe23b9b1a1 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:11:44.937474 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-241fa2ed-4fce-4a2f-8e41-afbe23b9b1a1 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:11:45.066651 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-241fa2ed-4fce-4a2f-8e41-afbe23b9b1a1 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:11:45.075197 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-241fa2ed-4fce-4a2f-8e41-afbe23b9b1a1 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:11:45.076631 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-241fa2ed-4fce-4a2f-8e41-afbe23b9b1a1 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:11:45.077803 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-241fa2ed-4fce-4a2f-8e41-afbe23b9b1a1 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1745 microversion: 2.20 time: 0.154423 Oct 20 06:11:45.078352 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 442/868] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:11:44 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1745 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:11:45.193860 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-363f9dec-1928-489e-a6b6-33947f233b18 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:11:45.196005 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-363f9dec-1928-489e-a6b6-33947f233b18 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:11:45.202296 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-363f9dec-1928-489e-a6b6-33947f233b18 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:11:45.202766 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-363f9dec-1928-489e-a6b6-33947f233b18 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:11:45.203197 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-363f9dec-1928-489e-a6b6-33947f233b18 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:11:45.203873 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-363f9dec-1928-489e-a6b6-33947f233b18 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:11:45.204320 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-363f9dec-1928-489e-a6b6-33947f233b18 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:11:45.204776 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-363f9dec-1928-489e-a6b6-33947f233b18 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:11:45.234138 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-363f9dec-1928-489e-a6b6-33947f233b18 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044340 Oct 20 06:11:45.234690 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 427/869] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:11:45 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:11:46.104011 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-87be0845-366e-453d-aa2b-76ddbae53363 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:11:46.104622 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-87be0845-366e-453d-aa2b-76ddbae53363 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:11:46.111011 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-87be0845-366e-453d-aa2b-76ddbae53363 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:11:46.111491 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-87be0845-366e-453d-aa2b-76ddbae53363 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:11:46.111929 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-87be0845-366e-453d-aa2b-76ddbae53363 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:11:46.112619 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-87be0845-366e-453d-aa2b-76ddbae53363 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:11:46.113097 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-87be0845-366e-453d-aa2b-76ddbae53363 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:11:46.113526 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-87be0845-366e-453d-aa2b-76ddbae53363 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:11:46.240174 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-87be0845-366e-453d-aa2b-76ddbae53363 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:11:46.247265 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-11ed29e6-c4f7-43c8-9342-5bc00f8dbfda tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:11:46.249438 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-11ed29e6-c4f7-43c8-9342-5bc00f8dbfda tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:11:46.249553 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-87be0845-366e-453d-aa2b-76ddbae53363 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:11:46.250876 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-87be0845-366e-453d-aa2b-76ddbae53363 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:11:46.252052 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-87be0845-366e-453d-aa2b-76ddbae53363 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1745 microversion: 2.20 time: 0.152711 Oct 20 06:11:46.252801 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 443/870] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:11:46 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1745 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:11:46.257082 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-11ed29e6-c4f7-43c8-9342-5bc00f8dbfda tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:11:46.257576 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-11ed29e6-c4f7-43c8-9342-5bc00f8dbfda tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:11:46.258017 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-11ed29e6-c4f7-43c8-9342-5bc00f8dbfda tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:11:46.258721 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-11ed29e6-c4f7-43c8-9342-5bc00f8dbfda tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:11:46.259209 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-11ed29e6-c4f7-43c8-9342-5bc00f8dbfda tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:11:46.259640 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-11ed29e6-c4f7-43c8-9342-5bc00f8dbfda tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:11:46.289657 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-11ed29e6-c4f7-43c8-9342-5bc00f8dbfda tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046536 Oct 20 06:11:46.290221 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 428/871] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:11:46 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 20 06:11:47.279012 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-3299e989-701e-4cbd-8c51-fbc15801e565 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:11:47.279625 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-3299e989-701e-4cbd-8c51-fbc15801e565 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:11:47.286255 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-3299e989-701e-4cbd-8c51-fbc15801e565 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:11:47.286735 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-3299e989-701e-4cbd-8c51-fbc15801e565 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:11:47.287173 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-3299e989-701e-4cbd-8c51-fbc15801e565 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:11:47.287863 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-3299e989-701e-4cbd-8c51-fbc15801e565 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:11:47.288336 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-3299e989-701e-4cbd-8c51-fbc15801e565 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:11:47.288785 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-3299e989-701e-4cbd-8c51-fbc15801e565 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:11:47.308875 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-d0d63243-3dac-4c4e-9677-f9d5b2aa7d53 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:11:47.311052 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-d0d63243-3dac-4c4e-9677-f9d5b2aa7d53 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:11:47.317375 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-d0d63243-3dac-4c4e-9677-f9d5b2aa7d53 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:11:47.317857 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-d0d63243-3dac-4c4e-9677-f9d5b2aa7d53 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:11:47.318293 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-d0d63243-3dac-4c4e-9677-f9d5b2aa7d53 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:11:47.319726 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-d0d63243-3dac-4c4e-9677-f9d5b2aa7d53 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:11:47.320219 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-d0d63243-3dac-4c4e-9677-f9d5b2aa7d53 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:11:47.320649 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-d0d63243-3dac-4c4e-9677-f9d5b2aa7d53 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:11:47.351990 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-d0d63243-3dac-4c4e-9677-f9d5b2aa7d53 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046991 Oct 20 06:11:47.352584 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 429/872] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:11:47 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:11:47.425771 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-3299e989-701e-4cbd-8c51-fbc15801e565 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:11:47.434981 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-3299e989-701e-4cbd-8c51-fbc15801e565 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:11:47.436428 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-3299e989-701e-4cbd-8c51-fbc15801e565 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:11:47.437643 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-3299e989-701e-4cbd-8c51-fbc15801e565 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1745 microversion: 2.20 time: 0.162590 Oct 20 06:11:47.438197 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 444/873] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:11:47 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1745 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:11:48.364367 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-9bb5825e-c858-4971-95b0-e8f8c87033b1 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:11:48.366686 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-9bb5825e-c858-4971-95b0-e8f8c87033b1 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:11:48.373061 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-9bb5825e-c858-4971-95b0-e8f8c87033b1 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:11:48.373542 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-9bb5825e-c858-4971-95b0-e8f8c87033b1 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:11:48.373980 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-9bb5825e-c858-4971-95b0-e8f8c87033b1 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:11:48.374666 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-9bb5825e-c858-4971-95b0-e8f8c87033b1 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:11:48.375120 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-9bb5825e-c858-4971-95b0-e8f8c87033b1 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:11:48.375543 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-9bb5825e-c858-4971-95b0-e8f8c87033b1 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:11:48.407399 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-9bb5825e-c858-4971-95b0-e8f8c87033b1 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046935 Oct 20 06:11:48.407976 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 430/874] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:11:48 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:11:48.464062 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-9742612f-7b29-4370-ab5c-0906b8a7cf43 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:11:48.464612 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-9742612f-7b29-4370-ab5c-0906b8a7cf43 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:11:48.470942 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-9742612f-7b29-4370-ab5c-0906b8a7cf43 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:11:48.471418 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-9742612f-7b29-4370-ab5c-0906b8a7cf43 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:11:48.471853 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-9742612f-7b29-4370-ab5c-0906b8a7cf43 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:11:48.472542 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-9742612f-7b29-4370-ab5c-0906b8a7cf43 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:11:48.473024 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-9742612f-7b29-4370-ab5c-0906b8a7cf43 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:11:48.473451 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-9742612f-7b29-4370-ab5c-0906b8a7cf43 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:11:48.617134 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-9742612f-7b29-4370-ab5c-0906b8a7cf43 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:11:48.625349 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-9742612f-7b29-4370-ab5c-0906b8a7cf43 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:11:48.626812 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-9742612f-7b29-4370-ab5c-0906b8a7cf43 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:11:48.627978 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-9742612f-7b29-4370-ab5c-0906b8a7cf43 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1745 microversion: 2.20 time: 0.168652 Oct 20 06:11:48.628536 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 445/875] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:11:48 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1745 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:11:49.419818 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-f9f08b28-de1a-4dfd-929e-d17c6a498cd2 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:11:49.421986 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-f9f08b28-de1a-4dfd-929e-d17c6a498cd2 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:11:49.428465 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f9f08b28-de1a-4dfd-929e-d17c6a498cd2 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:11:49.428972 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f9f08b28-de1a-4dfd-929e-d17c6a498cd2 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:11:49.429415 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f9f08b28-de1a-4dfd-929e-d17c6a498cd2 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:11:49.430106 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f9f08b28-de1a-4dfd-929e-d17c6a498cd2 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:11:49.430563 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f9f08b28-de1a-4dfd-929e-d17c6a498cd2 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:11:49.430989 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f9f08b28-de1a-4dfd-929e-d17c6a498cd2 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:11:49.462260 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-f9f08b28-de1a-4dfd-929e-d17c6a498cd2 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046396 Oct 20 06:11:49.462824 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 431/876] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:11:49 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:11:49.654607 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-b0f86d35-b636-463a-82ea-1606cb56190f tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:11:49.655214 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-b0f86d35-b636-463a-82ea-1606cb56190f tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:11:49.661667 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b0f86d35-b636-463a-82ea-1606cb56190f tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:11:49.662145 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b0f86d35-b636-463a-82ea-1606cb56190f tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:11:49.662582 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b0f86d35-b636-463a-82ea-1606cb56190f tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:11:49.663405 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b0f86d35-b636-463a-82ea-1606cb56190f tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:11:49.663856 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b0f86d35-b636-463a-82ea-1606cb56190f tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:11:49.664279 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b0f86d35-b636-463a-82ea-1606cb56190f tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:11:49.789263 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-b0f86d35-b636-463a-82ea-1606cb56190f tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:11:49.797594 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-b0f86d35-b636-463a-82ea-1606cb56190f tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:11:49.799027 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-b0f86d35-b636-463a-82ea-1606cb56190f tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:11:49.800171 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-b0f86d35-b636-463a-82ea-1606cb56190f tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1745 microversion: 2.20 time: 0.149497 Oct 20 06:11:49.800733 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 446/877] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:11:49 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1745 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:11:50.474726 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-1faeeb30-c16f-4a79-83e2-77f5913c753b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:11:50.476962 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-1faeeb30-c16f-4a79-83e2-77f5913c753b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:11:50.484091 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1faeeb30-c16f-4a79-83e2-77f5913c753b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:11:50.484623 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1faeeb30-c16f-4a79-83e2-77f5913c753b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:11:50.485082 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1faeeb30-c16f-4a79-83e2-77f5913c753b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:11:50.485889 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1faeeb30-c16f-4a79-83e2-77f5913c753b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:11:50.487541 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1faeeb30-c16f-4a79-83e2-77f5913c753b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:11:50.488346 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1faeeb30-c16f-4a79-83e2-77f5913c753b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:11:50.524446 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-1faeeb30-c16f-4a79-83e2-77f5913c753b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053351 Oct 20 06:11:50.524942 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 432/878] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:11:50 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:11:50.825838 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-744bd9a8-1889-4687-90a8-836c52dae23f tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:11:50.826364 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-744bd9a8-1889-4687-90a8-836c52dae23f tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:11:50.832811 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-744bd9a8-1889-4687-90a8-836c52dae23f tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:11:50.833284 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-744bd9a8-1889-4687-90a8-836c52dae23f tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:11:50.833712 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-744bd9a8-1889-4687-90a8-836c52dae23f tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:11:50.834399 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-744bd9a8-1889-4687-90a8-836c52dae23f tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:11:50.834846 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-744bd9a8-1889-4687-90a8-836c52dae23f tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:11:50.835266 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-744bd9a8-1889-4687-90a8-836c52dae23f tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:11:50.967433 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-744bd9a8-1889-4687-90a8-836c52dae23f tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:11:50.976311 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-744bd9a8-1889-4687-90a8-836c52dae23f tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:11:50.977762 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-744bd9a8-1889-4687-90a8-836c52dae23f tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:11:50.978907 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-744bd9a8-1889-4687-90a8-836c52dae23f tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1745 microversion: 2.20 time: 0.157060 Oct 20 06:11:50.979453 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 447/879] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:11:50 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1745 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 20 06:11:51.538105 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-718f1e39-d97e-48ea-b210-632dec88d2c0 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:11:51.540300 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-718f1e39-d97e-48ea-b210-632dec88d2c0 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:11:51.546158 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-718f1e39-d97e-48ea-b210-632dec88d2c0 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:11:51.546633 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-718f1e39-d97e-48ea-b210-632dec88d2c0 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:11:51.547061 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-718f1e39-d97e-48ea-b210-632dec88d2c0 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:11:51.547737 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-718f1e39-d97e-48ea-b210-632dec88d2c0 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:11:51.548184 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-718f1e39-d97e-48ea-b210-632dec88d2c0 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:11:51.548623 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-718f1e39-d97e-48ea-b210-632dec88d2c0 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:11:51.577324 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-718f1e39-d97e-48ea-b210-632dec88d2c0 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043924 Oct 20 06:11:51.577886 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 433/880] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:11:51 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:11:52.004906 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-144a16ef-2e85-47c6-b6a0-9f32e9f4de1f tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:11:52.005510 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-144a16ef-2e85-47c6-b6a0-9f32e9f4de1f tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:11:52.012883 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-144a16ef-2e85-47c6-b6a0-9f32e9f4de1f tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:11:52.013359 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-144a16ef-2e85-47c6-b6a0-9f32e9f4de1f tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:11:52.013794 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-144a16ef-2e85-47c6-b6a0-9f32e9f4de1f tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:11:52.014479 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-144a16ef-2e85-47c6-b6a0-9f32e9f4de1f tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:11:52.014930 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-144a16ef-2e85-47c6-b6a0-9f32e9f4de1f tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:11:52.015351 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-144a16ef-2e85-47c6-b6a0-9f32e9f4de1f tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:11:52.140818 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-144a16ef-2e85-47c6-b6a0-9f32e9f4de1f tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:11:52.150169 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-144a16ef-2e85-47c6-b6a0-9f32e9f4de1f tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:11:52.151602 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-144a16ef-2e85-47c6-b6a0-9f32e9f4de1f tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:11:52.152819 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-144a16ef-2e85-47c6-b6a0-9f32e9f4de1f tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1745 microversion: 2.20 time: 0.152106 Oct 20 06:11:52.153372 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 448/881] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:11:51 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1745 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:11:52.589617 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-dce19de5-9080-4b57-9cb8-77d18aef91d5 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:11:52.591668 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-dce19de5-9080-4b57-9cb8-77d18aef91d5 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:11:52.598001 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-dce19de5-9080-4b57-9cb8-77d18aef91d5 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:11:52.598500 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-dce19de5-9080-4b57-9cb8-77d18aef91d5 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:11:52.598926 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-dce19de5-9080-4b57-9cb8-77d18aef91d5 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:11:52.599610 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-dce19de5-9080-4b57-9cb8-77d18aef91d5 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:11:52.600546 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-dce19de5-9080-4b57-9cb8-77d18aef91d5 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:11:52.601002 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-dce19de5-9080-4b57-9cb8-77d18aef91d5 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:11:52.633590 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-dce19de5-9080-4b57-9cb8-77d18aef91d5 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047906 Oct 20 06:11:52.634159 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 434/882] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:11:52 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:11:53.178721 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-5c985340-7fa6-4141-96dc-63f121efa7af tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:11:53.179464 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-5c985340-7fa6-4141-96dc-63f121efa7af tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:11:53.185959 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5c985340-7fa6-4141-96dc-63f121efa7af tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:11:53.186446 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5c985340-7fa6-4141-96dc-63f121efa7af tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:11:53.186886 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5c985340-7fa6-4141-96dc-63f121efa7af tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:11:53.187579 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5c985340-7fa6-4141-96dc-63f121efa7af tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:11:53.188033 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5c985340-7fa6-4141-96dc-63f121efa7af tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:11:53.188464 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5c985340-7fa6-4141-96dc-63f121efa7af tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:11:53.317424 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-5c985340-7fa6-4141-96dc-63f121efa7af tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:11:53.326428 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-5c985340-7fa6-4141-96dc-63f121efa7af tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:11:53.327876 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-5c985340-7fa6-4141-96dc-63f121efa7af tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:11:53.329081 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-5c985340-7fa6-4141-96dc-63f121efa7af tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1745 microversion: 2.20 time: 0.154421 Oct 20 06:11:53.329668 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 449/883] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:11:53 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1745 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:11:53.647688 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-5435d478-19f1-4b96-8c65-69e8f11c0d38 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:11:53.649918 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-5435d478-19f1-4b96-8c65-69e8f11c0d38 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:11:53.656246 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5435d478-19f1-4b96-8c65-69e8f11c0d38 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:11:53.656752 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5435d478-19f1-4b96-8c65-69e8f11c0d38 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:11:53.657196 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5435d478-19f1-4b96-8c65-69e8f11c0d38 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:11:53.657882 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5435d478-19f1-4b96-8c65-69e8f11c0d38 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:11:53.658335 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5435d478-19f1-4b96-8c65-69e8f11c0d38 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:11:53.658790 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5435d478-19f1-4b96-8c65-69e8f11c0d38 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:11:53.662476 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG dbcounter [-] [118860] Writing DB stats nova_cell1:SELECT=100 {{(pid=118860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:11:53.690097 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-5435d478-19f1-4b96-8c65-69e8f11c0d38 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046455 Oct 20 06:11:53.690663 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 435/884] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:11:53 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:11:54.355114 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-9c9680d4-5533-4f03-a7ca-57a2fe3d97d1 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:11:54.355725 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-9c9680d4-5533-4f03-a7ca-57a2fe3d97d1 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:11:54.362174 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-9c9680d4-5533-4f03-a7ca-57a2fe3d97d1 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:11:54.362668 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-9c9680d4-5533-4f03-a7ca-57a2fe3d97d1 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:11:54.363110 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-9c9680d4-5533-4f03-a7ca-57a2fe3d97d1 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:11:54.363810 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-9c9680d4-5533-4f03-a7ca-57a2fe3d97d1 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:11:54.364263 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-9c9680d4-5533-4f03-a7ca-57a2fe3d97d1 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:11:54.364711 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-9c9680d4-5533-4f03-a7ca-57a2fe3d97d1 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:11:54.489430 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-9c9680d4-5533-4f03-a7ca-57a2fe3d97d1 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:11:54.498623 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-9c9680d4-5533-4f03-a7ca-57a2fe3d97d1 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:11:54.500074 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-9c9680d4-5533-4f03-a7ca-57a2fe3d97d1 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:11:54.501281 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-9c9680d4-5533-4f03-a7ca-57a2fe3d97d1 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1745 microversion: 2.20 time: 0.150109 Oct 20 06:11:54.501836 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 450/885] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:11:54 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1745 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:11:54.703229 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-cd3b0dd8-b1c5-4359-a094-db2489f4e9d0 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:11:54.705392 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-cd3b0dd8-b1c5-4359-a094-db2489f4e9d0 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:11:54.711917 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-cd3b0dd8-b1c5-4359-a094-db2489f4e9d0 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:11:54.712393 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-cd3b0dd8-b1c5-4359-a094-db2489f4e9d0 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:11:54.712858 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-cd3b0dd8-b1c5-4359-a094-db2489f4e9d0 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:11:54.713542 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-cd3b0dd8-b1c5-4359-a094-db2489f4e9d0 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:11:54.713993 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-cd3b0dd8-b1c5-4359-a094-db2489f4e9d0 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:11:54.714413 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-cd3b0dd8-b1c5-4359-a094-db2489f4e9d0 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:11:54.743981 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-cd3b0dd8-b1c5-4359-a094-db2489f4e9d0 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044689 Oct 20 06:11:54.744885 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 436/886] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:11:54 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:11:55.527384 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-1bd6692e-b956-4490-8194-3391af4a2290 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:11:55.527987 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-1bd6692e-b956-4490-8194-3391af4a2290 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:11:55.534338 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1bd6692e-b956-4490-8194-3391af4a2290 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:11:55.534815 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1bd6692e-b956-4490-8194-3391af4a2290 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:11:55.535248 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1bd6692e-b956-4490-8194-3391af4a2290 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:11:55.535934 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1bd6692e-b956-4490-8194-3391af4a2290 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:11:55.536378 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1bd6692e-b956-4490-8194-3391af4a2290 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:11:55.536848 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1bd6692e-b956-4490-8194-3391af4a2290 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:11:55.661381 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-1bd6692e-b956-4490-8194-3391af4a2290 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:11:55.670507 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-1bd6692e-b956-4490-8194-3391af4a2290 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:11:55.671936 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-1bd6692e-b956-4490-8194-3391af4a2290 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:11:55.673113 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-1bd6692e-b956-4490-8194-3391af4a2290 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1745 microversion: 2.20 time: 0.149614 Oct 20 06:11:55.673657 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 451/887] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:11:55 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1745 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:11:55.756040 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-737b8b74-ea5f-433d-a332-dfd208617d4b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:11:55.758240 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-737b8b74-ea5f-433d-a332-dfd208617d4b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:11:55.764534 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-737b8b74-ea5f-433d-a332-dfd208617d4b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:11:55.765053 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-737b8b74-ea5f-433d-a332-dfd208617d4b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:11:55.765496 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-737b8b74-ea5f-433d-a332-dfd208617d4b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:11:55.766189 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-737b8b74-ea5f-433d-a332-dfd208617d4b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:11:55.766648 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-737b8b74-ea5f-433d-a332-dfd208617d4b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:11:55.767076 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-737b8b74-ea5f-433d-a332-dfd208617d4b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:11:55.796581 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-737b8b74-ea5f-433d-a332-dfd208617d4b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044788 Oct 20 06:11:55.797153 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 437/888] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:11:55 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:11:56.699487 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-4a7e547d-5aff-4411-afb2-0776466a8d67 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:11:56.700116 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-4a7e547d-5aff-4411-afb2-0776466a8d67 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:11:56.706552 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4a7e547d-5aff-4411-afb2-0776466a8d67 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:11:56.707041 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4a7e547d-5aff-4411-afb2-0776466a8d67 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:11:56.707485 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4a7e547d-5aff-4411-afb2-0776466a8d67 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:11:56.708186 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4a7e547d-5aff-4411-afb2-0776466a8d67 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:11:56.708644 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4a7e547d-5aff-4411-afb2-0776466a8d67 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:11:56.709200 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4a7e547d-5aff-4411-afb2-0776466a8d67 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:11:56.809727 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-6568b3c6-953f-48c2-a6ee-d909fe5c00a7 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:11:56.812012 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-6568b3c6-953f-48c2-a6ee-d909fe5c00a7 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:11:56.819128 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-6568b3c6-953f-48c2-a6ee-d909fe5c00a7 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:11:56.819726 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-6568b3c6-953f-48c2-a6ee-d909fe5c00a7 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:11:56.820179 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-6568b3c6-953f-48c2-a6ee-d909fe5c00a7 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:11:56.820916 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-6568b3c6-953f-48c2-a6ee-d909fe5c00a7 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:11:56.821374 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-6568b3c6-953f-48c2-a6ee-d909fe5c00a7 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:11:56.821806 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-6568b3c6-953f-48c2-a6ee-d909fe5c00a7 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:11:56.837091 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-4a7e547d-5aff-4411-afb2-0776466a8d67 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:11:56.840465 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG dbcounter [-] [118861] Writing DB stats nova_cell1:SELECT=100 {{(pid=118861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:11:56.846966 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-4a7e547d-5aff-4411-afb2-0776466a8d67 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:11:56.848419 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-4a7e547d-5aff-4411-afb2-0776466a8d67 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:11:56.850115 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-4a7e547d-5aff-4411-afb2-0776466a8d67 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1745 microversion: 2.20 time: 0.154134 Oct 20 06:11:56.850668 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 452/889] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:11:56 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1745 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:11:56.852789 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-6568b3c6-953f-48c2-a6ee-d909fe5c00a7 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047059 Oct 20 06:11:56.853360 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 438/890] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:11:56 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 20 06:11:57.865498 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-e3edb345-bba9-4dee-a68c-fc226a7c2680 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:11:57.867777 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-e3edb345-bba9-4dee-a68c-fc226a7c2680 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:11:57.873853 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e3edb345-bba9-4dee-a68c-fc226a7c2680 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:11:57.874333 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e3edb345-bba9-4dee-a68c-fc226a7c2680 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:11:57.874761 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e3edb345-bba9-4dee-a68c-fc226a7c2680 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:11:57.875372 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-06e49799-31e0-42e7-9c6a-651c2a99bee0 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:11:57.875790 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e3edb345-bba9-4dee-a68c-fc226a7c2680 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:11:57.875902 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e3edb345-bba9-4dee-a68c-fc226a7c2680 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:11:57.876004 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-06e49799-31e0-42e7-9c6a-651c2a99bee0 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:11:57.876284 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e3edb345-bba9-4dee-a68c-fc226a7c2680 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:11:57.883278 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-06e49799-31e0-42e7-9c6a-651c2a99bee0 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:11:57.883754 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-06e49799-31e0-42e7-9c6a-651c2a99bee0 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:11:57.884186 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-06e49799-31e0-42e7-9c6a-651c2a99bee0 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:11:57.884901 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-06e49799-31e0-42e7-9c6a-651c2a99bee0 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:11:57.885352 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-06e49799-31e0-42e7-9c6a-651c2a99bee0 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:11:57.885769 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-06e49799-31e0-42e7-9c6a-651c2a99bee0 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:11:57.906391 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-e3edb345-bba9-4dee-a68c-fc226a7c2680 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045224 Oct 20 06:11:57.906959 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 453/891] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:11:57 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:11:58.023156 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-06e49799-31e0-42e7-9c6a-651c2a99bee0 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:11:58.032833 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-06e49799-31e0-42e7-9c6a-651c2a99bee0 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:11:58.034309 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-06e49799-31e0-42e7-9c6a-651c2a99bee0 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:11:58.035598 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-06e49799-31e0-42e7-9c6a-651c2a99bee0 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1745 microversion: 2.20 time: 0.164302 Oct 20 06:11:58.042329 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 439/892] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:11:57 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1745 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 20 06:11:58.919306 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-f7b466de-b946-49d4-aeb3-f839f0f268ec tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:11:58.921534 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-f7b466de-b946-49d4-aeb3-f839f0f268ec tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:11:58.927902 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f7b466de-b946-49d4-aeb3-f839f0f268ec tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:11:58.928380 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f7b466de-b946-49d4-aeb3-f839f0f268ec tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:11:58.928842 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f7b466de-b946-49d4-aeb3-f839f0f268ec tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:11:58.929523 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f7b466de-b946-49d4-aeb3-f839f0f268ec tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:11:58.929970 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f7b466de-b946-49d4-aeb3-f839f0f268ec tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:11:58.930387 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f7b466de-b946-49d4-aeb3-f839f0f268ec tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:11:58.961640 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-f7b466de-b946-49d4-aeb3-f839f0f268ec tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046299 Oct 20 06:11:58.962184 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 454/893] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:11:58 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:11:59.062224 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-068b8972-d0c2-4edc-925f-127fe9fd5d3a tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:11:59.062806 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-068b8972-d0c2-4edc-925f-127fe9fd5d3a tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:11:59.069299 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-068b8972-d0c2-4edc-925f-127fe9fd5d3a tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:11:59.069794 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-068b8972-d0c2-4edc-925f-127fe9fd5d3a tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:11:59.070233 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-068b8972-d0c2-4edc-925f-127fe9fd5d3a tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:11:59.070934 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-068b8972-d0c2-4edc-925f-127fe9fd5d3a tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:11:59.071390 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-068b8972-d0c2-4edc-925f-127fe9fd5d3a tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:11:59.071822 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-068b8972-d0c2-4edc-925f-127fe9fd5d3a tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:11:59.205971 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-068b8972-d0c2-4edc-925f-127fe9fd5d3a tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:11:59.214830 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-068b8972-d0c2-4edc-925f-127fe9fd5d3a tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:11:59.216272 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-068b8972-d0c2-4edc-925f-127fe9fd5d3a tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:11:59.217460 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-068b8972-d0c2-4edc-925f-127fe9fd5d3a tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1745 microversion: 2.20 time: 0.159099 Oct 20 06:11:59.218214 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 440/894] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:11:59 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1745 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:11:59.973924 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-31122af7-4001-4916-983e-bf558c7789dd tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:11:59.976740 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-31122af7-4001-4916-983e-bf558c7789dd tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:11:59.983069 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-31122af7-4001-4916-983e-bf558c7789dd tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:11:59.983544 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-31122af7-4001-4916-983e-bf558c7789dd tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:11:59.983978 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-31122af7-4001-4916-983e-bf558c7789dd tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:11:59.984660 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-31122af7-4001-4916-983e-bf558c7789dd tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:11:59.985141 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-31122af7-4001-4916-983e-bf558c7789dd tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:11:59.985560 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-31122af7-4001-4916-983e-bf558c7789dd tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:12:00.014883 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-31122af7-4001-4916-983e-bf558c7789dd tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044945 Oct 20 06:12:00.015426 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 455/895] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:11:59 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:12:00.243454 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-0ff4752f-1388-457c-a9ee-004c23d74502 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:12:00.244059 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-0ff4752f-1388-457c-a9ee-004c23d74502 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:12:00.250387 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0ff4752f-1388-457c-a9ee-004c23d74502 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:12:00.250862 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0ff4752f-1388-457c-a9ee-004c23d74502 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:12:00.251296 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0ff4752f-1388-457c-a9ee-004c23d74502 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:12:00.251979 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0ff4752f-1388-457c-a9ee-004c23d74502 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:12:00.252430 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0ff4752f-1388-457c-a9ee-004c23d74502 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:12:00.252880 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0ff4752f-1388-457c-a9ee-004c23d74502 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:12:00.382514 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-0ff4752f-1388-457c-a9ee-004c23d74502 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:12:00.391422 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-0ff4752f-1388-457c-a9ee-004c23d74502 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:12:00.392878 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-0ff4752f-1388-457c-a9ee-004c23d74502 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:12:00.394022 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-0ff4752f-1388-457c-a9ee-004c23d74502 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1745 microversion: 2.20 time: 0.155067 Oct 20 06:12:00.394570 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 441/896] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:12:00 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1745 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:12:01.027087 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-e62d775a-3e70-4f2b-986f-a1a6bfa7f4d0 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:12:01.029248 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-e62d775a-3e70-4f2b-986f-a1a6bfa7f4d0 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:12:01.035610 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e62d775a-3e70-4f2b-986f-a1a6bfa7f4d0 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:12:01.036090 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e62d775a-3e70-4f2b-986f-a1a6bfa7f4d0 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:12:01.036524 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e62d775a-3e70-4f2b-986f-a1a6bfa7f4d0 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:12:01.038008 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e62d775a-3e70-4f2b-986f-a1a6bfa7f4d0 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:12:01.038464 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e62d775a-3e70-4f2b-986f-a1a6bfa7f4d0 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:12:01.038888 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e62d775a-3e70-4f2b-986f-a1a6bfa7f4d0 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:12:01.068352 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-e62d775a-3e70-4f2b-986f-a1a6bfa7f4d0 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045075 Oct 20 06:12:01.069054 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 456/897] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:12:01 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:12:01.418619 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-9ad7906b-5b3b-41e2-8434-1a99ad506555 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:12:01.419338 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-9ad7906b-5b3b-41e2-8434-1a99ad506555 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:12:01.425676 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-9ad7906b-5b3b-41e2-8434-1a99ad506555 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:12:01.426155 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-9ad7906b-5b3b-41e2-8434-1a99ad506555 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:12:01.426586 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-9ad7906b-5b3b-41e2-8434-1a99ad506555 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:12:01.427266 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-9ad7906b-5b3b-41e2-8434-1a99ad506555 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:12:01.427840 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-9ad7906b-5b3b-41e2-8434-1a99ad506555 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:12:01.428267 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-9ad7906b-5b3b-41e2-8434-1a99ad506555 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:12:01.554666 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-9ad7906b-5b3b-41e2-8434-1a99ad506555 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:12:01.563236 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-9ad7906b-5b3b-41e2-8434-1a99ad506555 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:12:01.564611 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-9ad7906b-5b3b-41e2-8434-1a99ad506555 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:12:01.565794 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-9ad7906b-5b3b-41e2-8434-1a99ad506555 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1745 microversion: 2.20 time: 0.151024 Oct 20 06:12:01.566348 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 442/898] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:12:01 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1745 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:12:02.080984 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-2b3613f2-9288-496f-beb3-11a6a0465be9 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:12:02.083154 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-2b3613f2-9288-496f-beb3-11a6a0465be9 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:12:02.085569 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG dbcounter [-] [118861] Writing DB stats nova_api:SELECT=52 {{(pid=118861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:12:02.090904 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-2b3613f2-9288-496f-beb3-11a6a0465be9 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:12:02.091380 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-2b3613f2-9288-496f-beb3-11a6a0465be9 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:12:02.091812 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-2b3613f2-9288-496f-beb3-11a6a0465be9 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:12:02.092494 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-2b3613f2-9288-496f-beb3-11a6a0465be9 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:12:02.092972 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-2b3613f2-9288-496f-beb3-11a6a0465be9 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:12:02.093392 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-2b3613f2-9288-496f-beb3-11a6a0465be9 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:12:02.123464 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-2b3613f2-9288-496f-beb3-11a6a0465be9 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046526 Oct 20 06:12:02.124012 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 457/899] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:12:02 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:12:02.592441 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-faaec624-c4b2-4660-8a92-b30432fbea55 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:12:02.593047 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-faaec624-c4b2-4660-8a92-b30432fbea55 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:12:02.595291 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG dbcounter [-] [118860] Writing DB stats nova_api:SELECT=58 {{(pid=118860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:12:02.601343 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-faaec624-c4b2-4660-8a92-b30432fbea55 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:12:02.601830 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-faaec624-c4b2-4660-8a92-b30432fbea55 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:12:02.602271 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-faaec624-c4b2-4660-8a92-b30432fbea55 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:12:02.602971 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-faaec624-c4b2-4660-8a92-b30432fbea55 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:12:02.603424 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-faaec624-c4b2-4660-8a92-b30432fbea55 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:12:02.603851 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-faaec624-c4b2-4660-8a92-b30432fbea55 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:12:02.732301 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-faaec624-c4b2-4660-8a92-b30432fbea55 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:12:02.740954 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-faaec624-c4b2-4660-8a92-b30432fbea55 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:12:02.742417 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-faaec624-c4b2-4660-8a92-b30432fbea55 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:12:02.743581 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-faaec624-c4b2-4660-8a92-b30432fbea55 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1745 microversion: 2.20 time: 0.155159 Oct 20 06:12:02.744139 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 443/900] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:12:02 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1745 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:12:03.135797 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-ebd2c52f-30cd-404d-b22a-fb9111b26ad1 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:12:03.138032 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-ebd2c52f-30cd-404d-b22a-fb9111b26ad1 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:12:03.144720 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ebd2c52f-30cd-404d-b22a-fb9111b26ad1 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:12:03.145199 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ebd2c52f-30cd-404d-b22a-fb9111b26ad1 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:12:03.145629 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ebd2c52f-30cd-404d-b22a-fb9111b26ad1 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:12:03.146308 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ebd2c52f-30cd-404d-b22a-fb9111b26ad1 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:12:03.146898 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ebd2c52f-30cd-404d-b22a-fb9111b26ad1 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:12:03.147317 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ebd2c52f-30cd-404d-b22a-fb9111b26ad1 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:12:03.176330 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-ebd2c52f-30cd-404d-b22a-fb9111b26ad1 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044590 Oct 20 06:12:03.176905 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 458/901] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:12:03 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 20 06:12:03.769303 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-bc48cd5b-11c1-4566-8bff-88ae2919cce3 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:12:03.769904 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-bc48cd5b-11c1-4566-8bff-88ae2919cce3 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:12:03.776881 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-bc48cd5b-11c1-4566-8bff-88ae2919cce3 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:12:03.777359 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-bc48cd5b-11c1-4566-8bff-88ae2919cce3 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:12:03.777790 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-bc48cd5b-11c1-4566-8bff-88ae2919cce3 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:12:03.778506 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-bc48cd5b-11c1-4566-8bff-88ae2919cce3 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:12:03.778955 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-bc48cd5b-11c1-4566-8bff-88ae2919cce3 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:12:03.779376 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-bc48cd5b-11c1-4566-8bff-88ae2919cce3 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:12:03.907251 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-bc48cd5b-11c1-4566-8bff-88ae2919cce3 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:12:03.915709 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-bc48cd5b-11c1-4566-8bff-88ae2919cce3 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:12:03.917157 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-bc48cd5b-11c1-4566-8bff-88ae2919cce3 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:12:03.918287 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-bc48cd5b-11c1-4566-8bff-88ae2919cce3 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1745 microversion: 2.20 time: 0.152876 Oct 20 06:12:03.918834 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 444/902] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:12:03 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1745 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:12:04.189185 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-318c63f6-a185-4af0-a5bd-fcd659e94673 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:12:04.191410 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-318c63f6-a185-4af0-a5bd-fcd659e94673 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:12:04.198614 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-318c63f6-a185-4af0-a5bd-fcd659e94673 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:12:04.199101 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-318c63f6-a185-4af0-a5bd-fcd659e94673 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:12:04.199544 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-318c63f6-a185-4af0-a5bd-fcd659e94673 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:12:04.200239 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-318c63f6-a185-4af0-a5bd-fcd659e94673 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:12:04.200717 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-318c63f6-a185-4af0-a5bd-fcd659e94673 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:12:04.201150 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-318c63f6-a185-4af0-a5bd-fcd659e94673 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:12:04.229761 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-318c63f6-a185-4af0-a5bd-fcd659e94673 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044586 Oct 20 06:12:04.230316 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 459/903] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:12:04 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:12:04.944570 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-62990215-d1fc-42c2-aae6-5a70896e65e7 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:12:04.946198 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-62990215-d1fc-42c2-aae6-5a70896e65e7 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:12:04.952596 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-62990215-d1fc-42c2-aae6-5a70896e65e7 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:12:04.953319 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-62990215-d1fc-42c2-aae6-5a70896e65e7 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:12:04.953755 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-62990215-d1fc-42c2-aae6-5a70896e65e7 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:12:04.954477 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-62990215-d1fc-42c2-aae6-5a70896e65e7 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:12:04.954948 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-62990215-d1fc-42c2-aae6-5a70896e65e7 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:12:04.955372 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-62990215-d1fc-42c2-aae6-5a70896e65e7 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:12:05.082173 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-62990215-d1fc-42c2-aae6-5a70896e65e7 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:12:05.090678 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-62990215-d1fc-42c2-aae6-5a70896e65e7 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:12:05.092100 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-62990215-d1fc-42c2-aae6-5a70896e65e7 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:12:05.093265 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-62990215-d1fc-42c2-aae6-5a70896e65e7 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1745 microversion: 2.20 time: 0.153727 Oct 20 06:12:05.093810 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 445/904] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:12:04 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1745 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:12:05.242572 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-9b49e849-77f2-4c9b-9e56-a8510ac5030f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:12:05.244666 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-9b49e849-77f2-4c9b-9e56-a8510ac5030f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:12:05.251210 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-9b49e849-77f2-4c9b-9e56-a8510ac5030f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:12:05.251702 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-9b49e849-77f2-4c9b-9e56-a8510ac5030f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:12:05.252144 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-9b49e849-77f2-4c9b-9e56-a8510ac5030f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:12:05.252887 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-9b49e849-77f2-4c9b-9e56-a8510ac5030f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:12:05.253599 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-9b49e849-77f2-4c9b-9e56-a8510ac5030f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:12:05.254027 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-9b49e849-77f2-4c9b-9e56-a8510ac5030f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:12:05.283567 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-9b49e849-77f2-4c9b-9e56-a8510ac5030f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045033 Oct 20 06:12:05.284111 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 460/905] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:12:05 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:12:06.119049 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-b8759899-6353-44cd-9a56-32a917a78f42 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:12:06.119649 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-b8759899-6353-44cd-9a56-32a917a78f42 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:12:06.125935 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b8759899-6353-44cd-9a56-32a917a78f42 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:12:06.126407 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b8759899-6353-44cd-9a56-32a917a78f42 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:12:06.126838 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b8759899-6353-44cd-9a56-32a917a78f42 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:12:06.127525 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b8759899-6353-44cd-9a56-32a917a78f42 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:12:06.127971 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b8759899-6353-44cd-9a56-32a917a78f42 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:12:06.128647 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b8759899-6353-44cd-9a56-32a917a78f42 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:12:06.260509 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-b8759899-6353-44cd-9a56-32a917a78f42 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:12:06.268987 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-b8759899-6353-44cd-9a56-32a917a78f42 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:12:06.270430 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-b8759899-6353-44cd-9a56-32a917a78f42 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:12:06.271573 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-b8759899-6353-44cd-9a56-32a917a78f42 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1745 microversion: 2.20 time: 0.156349 Oct 20 06:12:06.272128 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 446/906] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:12:06 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1745 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:12:06.295488 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-049b0c80-d6e7-4236-810f-7ad621f6869c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:12:06.297668 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-049b0c80-d6e7-4236-810f-7ad621f6869c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:12:06.304582 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-049b0c80-d6e7-4236-810f-7ad621f6869c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:12:06.305088 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-049b0c80-d6e7-4236-810f-7ad621f6869c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:12:06.305516 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-049b0c80-d6e7-4236-810f-7ad621f6869c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:12:06.306205 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-049b0c80-d6e7-4236-810f-7ad621f6869c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:12:06.306650 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-049b0c80-d6e7-4236-810f-7ad621f6869c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:12:06.307370 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-049b0c80-d6e7-4236-810f-7ad621f6869c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:12:06.336282 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-049b0c80-d6e7-4236-810f-7ad621f6869c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044711 Oct 20 06:12:06.336856 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 461/907] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:12:06 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:12:07.296809 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-2cf77f45-e994-4944-9d4c-f69c32753ea3 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:12:07.297407 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-2cf77f45-e994-4944-9d4c-f69c32753ea3 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:12:07.304632 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2cf77f45-e994-4944-9d4c-f69c32753ea3 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:12:07.305143 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2cf77f45-e994-4944-9d4c-f69c32753ea3 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:12:07.305575 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2cf77f45-e994-4944-9d4c-f69c32753ea3 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:12:07.306263 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2cf77f45-e994-4944-9d4c-f69c32753ea3 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:12:07.306710 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2cf77f45-e994-4944-9d4c-f69c32753ea3 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:12:07.307475 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2cf77f45-e994-4944-9d4c-f69c32753ea3 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:12:07.348564 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-6437b091-eace-4a74-b0d6-89e78ebdd187 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:12:07.351462 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-6437b091-eace-4a74-b0d6-89e78ebdd187 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:12:07.357820 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-6437b091-eace-4a74-b0d6-89e78ebdd187 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:12:07.358295 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-6437b091-eace-4a74-b0d6-89e78ebdd187 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:12:07.358727 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-6437b091-eace-4a74-b0d6-89e78ebdd187 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:12:07.359414 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-6437b091-eace-4a74-b0d6-89e78ebdd187 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:12:07.359888 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-6437b091-eace-4a74-b0d6-89e78ebdd187 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:12:07.360306 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-6437b091-eace-4a74-b0d6-89e78ebdd187 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:12:07.390271 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-6437b091-eace-4a74-b0d6-89e78ebdd187 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045559 Oct 20 06:12:07.390831 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 462/908] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:12:07 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 20 06:12:07.435994 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-2cf77f45-e994-4944-9d4c-f69c32753ea3 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:12:07.445165 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-2cf77f45-e994-4944-9d4c-f69c32753ea3 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:12:07.446626 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-2cf77f45-e994-4944-9d4c-f69c32753ea3 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:12:07.447792 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-2cf77f45-e994-4944-9d4c-f69c32753ea3 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1745 microversion: 2.20 time: 0.154880 Oct 20 06:12:07.448342 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 447/909] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:12:07 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1745 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:12:08.402640 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-200a1a2f-4c42-4948-9078-251e84eb1645 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:12:08.404817 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-200a1a2f-4c42-4948-9078-251e84eb1645 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:12:08.411133 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-200a1a2f-4c42-4948-9078-251e84eb1645 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:12:08.412175 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-200a1a2f-4c42-4948-9078-251e84eb1645 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:12:08.412755 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-200a1a2f-4c42-4948-9078-251e84eb1645 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:12:08.413458 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-200a1a2f-4c42-4948-9078-251e84eb1645 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:12:08.413908 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-200a1a2f-4c42-4948-9078-251e84eb1645 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:12:08.414329 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-200a1a2f-4c42-4948-9078-251e84eb1645 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:12:08.443072 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-200a1a2f-4c42-4948-9078-251e84eb1645 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044525 Oct 20 06:12:08.443606 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 463/910] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:12:08 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:12:08.473030 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-ee12bc6b-3d79-41d2-a75a-bbe8e68cf86e tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:12:08.473636 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-ee12bc6b-3d79-41d2-a75a-bbe8e68cf86e tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:12:08.481138 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-ee12bc6b-3d79-41d2-a75a-bbe8e68cf86e tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:12:08.481618 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-ee12bc6b-3d79-41d2-a75a-bbe8e68cf86e tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:12:08.482054 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-ee12bc6b-3d79-41d2-a75a-bbe8e68cf86e tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:12:08.482748 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-ee12bc6b-3d79-41d2-a75a-bbe8e68cf86e tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:12:08.483203 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-ee12bc6b-3d79-41d2-a75a-bbe8e68cf86e tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:12:08.483626 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-ee12bc6b-3d79-41d2-a75a-bbe8e68cf86e tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:12:08.621507 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-ee12bc6b-3d79-41d2-a75a-bbe8e68cf86e tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:12:08.631280 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-ee12bc6b-3d79-41d2-a75a-bbe8e68cf86e tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:12:08.634134 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-ee12bc6b-3d79-41d2-a75a-bbe8e68cf86e tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:12:08.635323 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-ee12bc6b-3d79-41d2-a75a-bbe8e68cf86e tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1745 microversion: 2.20 time: 0.166211 Oct 20 06:12:08.635871 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 448/911] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:12:08 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1745 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:12:09.455500 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-4a26e748-4772-483f-b07c-e5d6e4da590c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:12:09.457655 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-4a26e748-4772-483f-b07c-e5d6e4da590c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:12:09.464480 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4a26e748-4772-483f-b07c-e5d6e4da590c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:12:09.464984 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4a26e748-4772-483f-b07c-e5d6e4da590c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:12:09.465412 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4a26e748-4772-483f-b07c-e5d6e4da590c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:12:09.466102 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4a26e748-4772-483f-b07c-e5d6e4da590c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:12:09.466549 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4a26e748-4772-483f-b07c-e5d6e4da590c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:12:09.466963 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4a26e748-4772-483f-b07c-e5d6e4da590c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:12:09.496219 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-4a26e748-4772-483f-b07c-e5d6e4da590c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044725 Oct 20 06:12:09.496786 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 464/912] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:12:09 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:12:09.662429 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-c79644cf-44fa-47af-9225-f087c502350d tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:12:09.663362 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-c79644cf-44fa-47af-9225-f087c502350d tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:12:09.670264 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c79644cf-44fa-47af-9225-f087c502350d tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:12:09.670892 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c79644cf-44fa-47af-9225-f087c502350d tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:12:09.671379 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c79644cf-44fa-47af-9225-f087c502350d tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:12:09.672171 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c79644cf-44fa-47af-9225-f087c502350d tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:12:09.672658 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c79644cf-44fa-47af-9225-f087c502350d tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:12:09.673153 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c79644cf-44fa-47af-9225-f087c502350d tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:12:09.801098 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-c79644cf-44fa-47af-9225-f087c502350d tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:12:09.810308 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-c79644cf-44fa-47af-9225-f087c502350d tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:12:09.811715 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-c79644cf-44fa-47af-9225-f087c502350d tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:12:09.812896 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-c79644cf-44fa-47af-9225-f087c502350d tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1745 microversion: 2.20 time: 0.155329 Oct 20 06:12:09.813449 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 449/913] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:12:09 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1745 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:12:10.509168 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-80d673fb-da5f-43f4-92a5-9c4e56a6db3c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:12:10.511320 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-80d673fb-da5f-43f4-92a5-9c4e56a6db3c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:12:10.517733 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-80d673fb-da5f-43f4-92a5-9c4e56a6db3c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:12:10.518213 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-80d673fb-da5f-43f4-92a5-9c4e56a6db3c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:12:10.518650 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-80d673fb-da5f-43f4-92a5-9c4e56a6db3c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:12:10.519342 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-80d673fb-da5f-43f4-92a5-9c4e56a6db3c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:12:10.519794 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-80d673fb-da5f-43f4-92a5-9c4e56a6db3c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:12:10.520218 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-80d673fb-da5f-43f4-92a5-9c4e56a6db3c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:12:10.549356 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-80d673fb-da5f-43f4-92a5-9c4e56a6db3c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044397 Oct 20 06:12:10.549916 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 465/914] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:12:10 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:12:10.838139 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-adddd0db-75fb-44f4-bab6-1393e26a8ce8 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:12:10.838745 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-adddd0db-75fb-44f4-bab6-1393e26a8ce8 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:12:10.845083 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-adddd0db-75fb-44f4-bab6-1393e26a8ce8 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:12:10.845560 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-adddd0db-75fb-44f4-bab6-1393e26a8ce8 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:12:10.845991 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-adddd0db-75fb-44f4-bab6-1393e26a8ce8 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:12:10.846673 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-adddd0db-75fb-44f4-bab6-1393e26a8ce8 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:12:10.847120 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-adddd0db-75fb-44f4-bab6-1393e26a8ce8 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:12:10.847543 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-adddd0db-75fb-44f4-bab6-1393e26a8ce8 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:12:10.979811 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-adddd0db-75fb-44f4-bab6-1393e26a8ce8 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:12:10.988262 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-adddd0db-75fb-44f4-bab6-1393e26a8ce8 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:12:10.989745 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-adddd0db-75fb-44f4-bab6-1393e26a8ce8 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:12:10.990890 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-adddd0db-75fb-44f4-bab6-1393e26a8ce8 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1745 microversion: 2.20 time: 0.156653 Oct 20 06:12:10.991447 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 450/915] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:12:10 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1745 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:12:11.562748 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-adcdcb3c-359d-4a33-8e59-b1d2e3f7d81b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:12:11.564862 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-adcdcb3c-359d-4a33-8e59-b1d2e3f7d81b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:12:11.571398 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-adcdcb3c-359d-4a33-8e59-b1d2e3f7d81b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:12:11.571907 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-adcdcb3c-359d-4a33-8e59-b1d2e3f7d81b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:12:11.572337 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-adcdcb3c-359d-4a33-8e59-b1d2e3f7d81b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:12:11.573061 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-adcdcb3c-359d-4a33-8e59-b1d2e3f7d81b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:12:11.573527 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-adcdcb3c-359d-4a33-8e59-b1d2e3f7d81b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:12:11.573946 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-adcdcb3c-359d-4a33-8e59-b1d2e3f7d81b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:12:11.604310 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-adcdcb3c-359d-4a33-8e59-b1d2e3f7d81b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045559 Oct 20 06:12:11.604891 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 466/916] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:12:11 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:12:12.016370 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-29730b5c-5c94-47d6-bd0f-ecd16ccaecf7 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:12:12.016994 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-29730b5c-5c94-47d6-bd0f-ecd16ccaecf7 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:12:12.023405 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-29730b5c-5c94-47d6-bd0f-ecd16ccaecf7 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:12:12.023880 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-29730b5c-5c94-47d6-bd0f-ecd16ccaecf7 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:12:12.024307 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-29730b5c-5c94-47d6-bd0f-ecd16ccaecf7 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:12:12.025018 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-29730b5c-5c94-47d6-bd0f-ecd16ccaecf7 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:12:12.025468 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-29730b5c-5c94-47d6-bd0f-ecd16ccaecf7 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:12:12.025889 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-29730b5c-5c94-47d6-bd0f-ecd16ccaecf7 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:12:12.152644 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-29730b5c-5c94-47d6-bd0f-ecd16ccaecf7 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:12:12.156017 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG dbcounter [-] [118860] Writing DB stats nova_cell1:SELECT=100 {{(pid=118860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:12:12.162555 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-29730b5c-5c94-47d6-bd0f-ecd16ccaecf7 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:12:12.163980 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-29730b5c-5c94-47d6-bd0f-ecd16ccaecf7 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:12:12.165158 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-29730b5c-5c94-47d6-bd0f-ecd16ccaecf7 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1745 microversion: 2.20 time: 0.152589 Oct 20 06:12:12.165708 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 451/917] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:12:12 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1745 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:12:12.616993 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-29e70abb-10d2-49b9-b142-5b76e0ed3000 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:12:12.619184 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-29e70abb-10d2-49b9-b142-5b76e0ed3000 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:12:12.625528 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-29e70abb-10d2-49b9-b142-5b76e0ed3000 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:12:12.626011 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-29e70abb-10d2-49b9-b142-5b76e0ed3000 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:12:12.626458 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-29e70abb-10d2-49b9-b142-5b76e0ed3000 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:12:12.627147 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-29e70abb-10d2-49b9-b142-5b76e0ed3000 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:12:12.627600 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-29e70abb-10d2-49b9-b142-5b76e0ed3000 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:12:12.628025 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-29e70abb-10d2-49b9-b142-5b76e0ed3000 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:12:12.657994 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-29e70abb-10d2-49b9-b142-5b76e0ed3000 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045199 Oct 20 06:12:12.658539 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 467/918] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:12:12 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:12:13.191285 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-faba6329-52aa-4f3b-ba89-34c4099c26ec tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:12:13.191887 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-faba6329-52aa-4f3b-ba89-34c4099c26ec tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:12:13.198705 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-faba6329-52aa-4f3b-ba89-34c4099c26ec tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:12:13.199187 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-faba6329-52aa-4f3b-ba89-34c4099c26ec tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:12:13.199626 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-faba6329-52aa-4f3b-ba89-34c4099c26ec tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:12:13.200314 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-faba6329-52aa-4f3b-ba89-34c4099c26ec tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:12:13.200799 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-faba6329-52aa-4f3b-ba89-34c4099c26ec tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:12:13.201228 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-faba6329-52aa-4f3b-ba89-34c4099c26ec tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:12:13.329910 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-faba6329-52aa-4f3b-ba89-34c4099c26ec tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:12:13.338946 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-faba6329-52aa-4f3b-ba89-34c4099c26ec tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:12:13.340374 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-faba6329-52aa-4f3b-ba89-34c4099c26ec tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:12:13.341547 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-faba6329-52aa-4f3b-ba89-34c4099c26ec tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1745 microversion: 2.20 time: 0.154389 Oct 20 06:12:13.342102 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 452/919] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:12:13 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1745 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:12:13.670475 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-2b9f5d99-92f8-4c8a-b994-b0efced60e42 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:12:13.672642 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-2b9f5d99-92f8-4c8a-b994-b0efced60e42 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:12:13.679870 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-2b9f5d99-92f8-4c8a-b994-b0efced60e42 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:12:13.680453 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-2b9f5d99-92f8-4c8a-b994-b0efced60e42 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:12:13.680999 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-2b9f5d99-92f8-4c8a-b994-b0efced60e42 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:12:13.681802 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-2b9f5d99-92f8-4c8a-b994-b0efced60e42 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:12:13.682284 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-2b9f5d99-92f8-4c8a-b994-b0efced60e42 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:12:13.682720 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-2b9f5d99-92f8-4c8a-b994-b0efced60e42 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:12:13.712234 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-2b9f5d99-92f8-4c8a-b994-b0efced60e42 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045750 Oct 20 06:12:13.712817 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 468/920] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:12:13 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:12:14.367720 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-5f92c34d-7e43-40d5-aef2-cc0ae04d6f44 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:12:14.368328 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-5f92c34d-7e43-40d5-aef2-cc0ae04d6f44 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:12:14.374757 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5f92c34d-7e43-40d5-aef2-cc0ae04d6f44 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:12:14.375239 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5f92c34d-7e43-40d5-aef2-cc0ae04d6f44 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:12:14.375676 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5f92c34d-7e43-40d5-aef2-cc0ae04d6f44 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:12:14.376366 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5f92c34d-7e43-40d5-aef2-cc0ae04d6f44 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:12:14.376851 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5f92c34d-7e43-40d5-aef2-cc0ae04d6f44 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:12:14.377277 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5f92c34d-7e43-40d5-aef2-cc0ae04d6f44 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:12:14.507829 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-5f92c34d-7e43-40d5-aef2-cc0ae04d6f44 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:12:14.516269 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-5f92c34d-7e43-40d5-aef2-cc0ae04d6f44 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:12:14.517741 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-5f92c34d-7e43-40d5-aef2-cc0ae04d6f44 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:12:14.518885 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-5f92c34d-7e43-40d5-aef2-cc0ae04d6f44 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1745 microversion: 2.20 time: 0.155446 Oct 20 06:12:14.519434 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 453/921] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:12:14 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1745 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:12:14.724788 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-9106f736-e08b-4081-afd3-585d289975d0 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:12:14.726931 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-9106f736-e08b-4081-afd3-585d289975d0 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:12:14.733308 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-9106f736-e08b-4081-afd3-585d289975d0 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:12:14.733788 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-9106f736-e08b-4081-afd3-585d289975d0 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:12:14.734223 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-9106f736-e08b-4081-afd3-585d289975d0 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:12:14.734916 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-9106f736-e08b-4081-afd3-585d289975d0 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:12:14.735365 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-9106f736-e08b-4081-afd3-585d289975d0 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:12:14.735786 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-9106f736-e08b-4081-afd3-585d289975d0 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:12:14.752523 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG dbcounter [-] [118861] Writing DB stats nova_cell1:SELECT=100 {{(pid=118861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:12:14.767040 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-9106f736-e08b-4081-afd3-585d289975d0 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046305 Oct 20 06:12:14.767591 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 469/922] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:12:14 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:12:15.543611 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-09235a96-aa15-4df2-8d1c-856e9ba5cc72 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:12:15.544384 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-09235a96-aa15-4df2-8d1c-856e9ba5cc72 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:12:15.551529 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-09235a96-aa15-4df2-8d1c-856e9ba5cc72 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:12:15.552031 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-09235a96-aa15-4df2-8d1c-856e9ba5cc72 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:12:15.552474 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-09235a96-aa15-4df2-8d1c-856e9ba5cc72 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:12:15.553215 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-09235a96-aa15-4df2-8d1c-856e9ba5cc72 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:12:15.553674 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-09235a96-aa15-4df2-8d1c-856e9ba5cc72 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:12:15.554103 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-09235a96-aa15-4df2-8d1c-856e9ba5cc72 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:12:15.679445 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-09235a96-aa15-4df2-8d1c-856e9ba5cc72 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:12:15.687982 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-09235a96-aa15-4df2-8d1c-856e9ba5cc72 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:12:15.689454 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-09235a96-aa15-4df2-8d1c-856e9ba5cc72 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:12:15.690604 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-09235a96-aa15-4df2-8d1c-856e9ba5cc72 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1745 microversion: 2.20 time: 0.150969 Oct 20 06:12:15.691153 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 454/923] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:12:15 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1745 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:12:15.779508 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-8d559cbf-a89b-4263-a4d8-437c6e6cec9c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:12:15.781721 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-8d559cbf-a89b-4263-a4d8-437c6e6cec9c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:12:15.788052 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-8d559cbf-a89b-4263-a4d8-437c6e6cec9c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:12:15.788523 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-8d559cbf-a89b-4263-a4d8-437c6e6cec9c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:12:15.788999 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-8d559cbf-a89b-4263-a4d8-437c6e6cec9c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:12:15.789688 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-8d559cbf-a89b-4263-a4d8-437c6e6cec9c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:12:15.790136 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-8d559cbf-a89b-4263-a4d8-437c6e6cec9c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:12:15.790587 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-8d559cbf-a89b-4263-a4d8-437c6e6cec9c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:12:15.819740 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-8d559cbf-a89b-4263-a4d8-437c6e6cec9c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044334 Oct 20 06:12:15.820281 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 470/924] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:12:15 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:12:16.716829 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-a9793284-bbd7-4977-841d-dd1fe3c94b90 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:12:16.717465 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-a9793284-bbd7-4977-841d-dd1fe3c94b90 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:12:16.723912 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a9793284-bbd7-4977-841d-dd1fe3c94b90 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:12:16.724408 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a9793284-bbd7-4977-841d-dd1fe3c94b90 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:12:16.724883 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a9793284-bbd7-4977-841d-dd1fe3c94b90 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:12:16.725575 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a9793284-bbd7-4977-841d-dd1fe3c94b90 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:12:16.726031 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a9793284-bbd7-4977-841d-dd1fe3c94b90 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:12:16.726456 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a9793284-bbd7-4977-841d-dd1fe3c94b90 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:12:16.831871 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-6a5816a4-b586-4c75-b49e-dfafe1c22479 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:12:16.834808 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-6a5816a4-b586-4c75-b49e-dfafe1c22479 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:12:16.841318 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-6a5816a4-b586-4c75-b49e-dfafe1c22479 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:12:16.841803 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-6a5816a4-b586-4c75-b49e-dfafe1c22479 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:12:16.842248 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-6a5816a4-b586-4c75-b49e-dfafe1c22479 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:12:16.842954 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-6a5816a4-b586-4c75-b49e-dfafe1c22479 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:12:16.843413 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-6a5816a4-b586-4c75-b49e-dfafe1c22479 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:12:16.843836 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-6a5816a4-b586-4c75-b49e-dfafe1c22479 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:12:16.854508 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-a9793284-bbd7-4977-841d-dd1fe3c94b90 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:12:16.863218 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-a9793284-bbd7-4977-841d-dd1fe3c94b90 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:12:16.865180 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-a9793284-bbd7-4977-841d-dd1fe3c94b90 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:12:16.866335 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-a9793284-bbd7-4977-841d-dd1fe3c94b90 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1745 microversion: 2.20 time: 0.153491 Oct 20 06:12:16.866886 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 455/925] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:12:16 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1745 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:12:16.874673 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-6a5816a4-b586-4c75-b49e-dfafe1c22479 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047104 Oct 20 06:12:16.875229 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 471/926] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:12:16 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 20 06:12:17.887160 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-1191e286-f83c-40a1-9cb1-bbc1e1f89720 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:12:17.889354 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-1191e286-f83c-40a1-9cb1-bbc1e1f89720 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:12:17.892732 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-cda531f0-c12e-4660-a45c-80ef4ee7843a tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:12:17.893369 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-cda531f0-c12e-4660-a45c-80ef4ee7843a tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:12:17.895873 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1191e286-f83c-40a1-9cb1-bbc1e1f89720 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:12:17.896319 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1191e286-f83c-40a1-9cb1-bbc1e1f89720 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:12:17.896786 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1191e286-f83c-40a1-9cb1-bbc1e1f89720 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:12:17.897493 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1191e286-f83c-40a1-9cb1-bbc1e1f89720 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:12:17.897940 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1191e286-f83c-40a1-9cb1-bbc1e1f89720 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:12:17.898356 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1191e286-f83c-40a1-9cb1-bbc1e1f89720 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:12:17.899921 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-cda531f0-c12e-4660-a45c-80ef4ee7843a tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:12:17.900403 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-cda531f0-c12e-4660-a45c-80ef4ee7843a tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:12:17.900884 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-cda531f0-c12e-4660-a45c-80ef4ee7843a tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:12:17.901579 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-cda531f0-c12e-4660-a45c-80ef4ee7843a tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:12:17.902035 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-cda531f0-c12e-4660-a45c-80ef4ee7843a tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:12:17.902467 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-cda531f0-c12e-4660-a45c-80ef4ee7843a tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:12:17.929032 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-1191e286-f83c-40a1-9cb1-bbc1e1f89720 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045742 Oct 20 06:12:17.929598 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 456/927] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:12:17 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:12:18.029924 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-cda531f0-c12e-4660-a45c-80ef4ee7843a tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:12:18.039127 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-cda531f0-c12e-4660-a45c-80ef4ee7843a tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:12:18.040562 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-cda531f0-c12e-4660-a45c-80ef4ee7843a tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:12:18.041753 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-cda531f0-c12e-4660-a45c-80ef4ee7843a tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1745 microversion: 2.20 time: 0.153044 Oct 20 06:12:18.042304 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 472/928] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:12:17 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1745 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:12:18.941428 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-cdc450a9-7ebe-4de7-babd-93568b0a29fa tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:12:18.943671 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-cdc450a9-7ebe-4de7-babd-93568b0a29fa tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:12:18.950034 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-cdc450a9-7ebe-4de7-babd-93568b0a29fa tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:12:18.950518 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-cdc450a9-7ebe-4de7-babd-93568b0a29fa tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:12:18.950956 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-cdc450a9-7ebe-4de7-babd-93568b0a29fa tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:12:18.951644 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-cdc450a9-7ebe-4de7-babd-93568b0a29fa tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:12:18.952095 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-cdc450a9-7ebe-4de7-babd-93568b0a29fa tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:12:18.952516 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-cdc450a9-7ebe-4de7-babd-93568b0a29fa tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:12:18.981431 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-cdc450a9-7ebe-4de7-babd-93568b0a29fa tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043922 Oct 20 06:12:18.981972 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 457/929] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:12:18 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:12:19.068687 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-73c6a43b-475f-4817-bb25-07b17794d73e tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:12:19.069325 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-73c6a43b-475f-4817-bb25-07b17794d73e tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:12:19.076362 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-73c6a43b-475f-4817-bb25-07b17794d73e tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:12:19.077295 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-73c6a43b-475f-4817-bb25-07b17794d73e tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:12:19.077447 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-73c6a43b-475f-4817-bb25-07b17794d73e tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:12:19.078151 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-73c6a43b-475f-4817-bb25-07b17794d73e tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:12:19.078605 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-73c6a43b-475f-4817-bb25-07b17794d73e tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:12:19.079030 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-73c6a43b-475f-4817-bb25-07b17794d73e tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:12:19.215358 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-73c6a43b-475f-4817-bb25-07b17794d73e tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:12:19.224229 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-73c6a43b-475f-4817-bb25-07b17794d73e tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:12:19.225686 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-73c6a43b-475f-4817-bb25-07b17794d73e tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:12:19.226865 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-73c6a43b-475f-4817-bb25-07b17794d73e tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1745 microversion: 2.20 time: 0.162264 Oct 20 06:12:19.227409 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 473/930] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:12:19 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1745 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:12:19.994056 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-b5819b03-58d1-497f-a660-0e057b8b9ef4 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:12:19.996185 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-b5819b03-58d1-497f-a660-0e057b8b9ef4 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:12:20.002600 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b5819b03-58d1-497f-a660-0e057b8b9ef4 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:12:20.003337 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b5819b03-58d1-497f-a660-0e057b8b9ef4 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:12:20.003768 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b5819b03-58d1-497f-a660-0e057b8b9ef4 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:12:20.004470 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b5819b03-58d1-497f-a660-0e057b8b9ef4 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:12:20.005045 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b5819b03-58d1-497f-a660-0e057b8b9ef4 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:12:20.005466 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b5819b03-58d1-497f-a660-0e057b8b9ef4 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:12:20.034326 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-b5819b03-58d1-497f-a660-0e057b8b9ef4 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044266 Oct 20 06:12:20.034871 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 458/931] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:12:19 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:12:20.252525 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-ffe10878-55cc-4e78-9c51-15674806df85 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:12:20.253271 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-ffe10878-55cc-4e78-9c51-15674806df85 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:12:20.260122 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ffe10878-55cc-4e78-9c51-15674806df85 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:12:20.260626 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ffe10878-55cc-4e78-9c51-15674806df85 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:12:20.261095 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ffe10878-55cc-4e78-9c51-15674806df85 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:12:20.261790 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ffe10878-55cc-4e78-9c51-15674806df85 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:12:20.262244 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ffe10878-55cc-4e78-9c51-15674806df85 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:12:20.262666 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ffe10878-55cc-4e78-9c51-15674806df85 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:12:20.392843 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-ffe10878-55cc-4e78-9c51-15674806df85 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:12:20.401832 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-ffe10878-55cc-4e78-9c51-15674806df85 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:12:20.403264 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-ffe10878-55cc-4e78-9c51-15674806df85 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:12:20.404417 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-ffe10878-55cc-4e78-9c51-15674806df85 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1745 microversion: 2.20 time: 0.155896 Oct 20 06:12:20.405028 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 474/932] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:12:20 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1745 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 20 06:12:21.047480 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-106b06f8-1197-419e-b3cc-bcac952c376b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:12:21.049816 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-106b06f8-1197-419e-b3cc-bcac952c376b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:12:21.055949 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-106b06f8-1197-419e-b3cc-bcac952c376b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:12:21.056432 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-106b06f8-1197-419e-b3cc-bcac952c376b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:12:21.056910 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-106b06f8-1197-419e-b3cc-bcac952c376b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:12:21.057613 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-106b06f8-1197-419e-b3cc-bcac952c376b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:12:21.058068 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-106b06f8-1197-419e-b3cc-bcac952c376b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:12:21.058494 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-106b06f8-1197-419e-b3cc-bcac952c376b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:12:21.088260 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-106b06f8-1197-419e-b3cc-bcac952c376b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044967 Oct 20 06:12:21.088827 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 459/933] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:12:21 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:12:21.431084 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-d25903de-b783-45f2-868d-0ba82e92fb89 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:12:21.431694 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-d25903de-b783-45f2-868d-0ba82e92fb89 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:12:21.438138 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d25903de-b783-45f2-868d-0ba82e92fb89 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:12:21.438622 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d25903de-b783-45f2-868d-0ba82e92fb89 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:12:21.439058 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d25903de-b783-45f2-868d-0ba82e92fb89 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:12:21.439751 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d25903de-b783-45f2-868d-0ba82e92fb89 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:12:21.440203 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d25903de-b783-45f2-868d-0ba82e92fb89 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:12:21.440628 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d25903de-b783-45f2-868d-0ba82e92fb89 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:12:21.572735 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-d25903de-b783-45f2-868d-0ba82e92fb89 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:12:21.581420 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-d25903de-b783-45f2-868d-0ba82e92fb89 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:12:21.582857 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-d25903de-b783-45f2-868d-0ba82e92fb89 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:12:21.584002 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-d25903de-b783-45f2-868d-0ba82e92fb89 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1745 microversion: 2.20 time: 0.157387 Oct 20 06:12:21.584556 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 475/934] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:12:21 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1745 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:12:22.099938 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-38042bb8-1fe0-4a04-b67f-ca588249982b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:12:22.102082 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-38042bb8-1fe0-4a04-b67f-ca588249982b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:12:22.108404 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-38042bb8-1fe0-4a04-b67f-ca588249982b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:12:22.108927 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-38042bb8-1fe0-4a04-b67f-ca588249982b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:12:22.109368 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-38042bb8-1fe0-4a04-b67f-ca588249982b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:12:22.110054 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-38042bb8-1fe0-4a04-b67f-ca588249982b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:12:22.110509 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-38042bb8-1fe0-4a04-b67f-ca588249982b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:12:22.110933 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-38042bb8-1fe0-4a04-b67f-ca588249982b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:12:22.140703 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-38042bb8-1fe0-4a04-b67f-ca588249982b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044789 Oct 20 06:12:22.141272 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 460/935] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:12:22 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:12:22.610052 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-39069fb5-4bb2-47e0-89e2-c7b364ca2fe1 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:12:22.610666 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-39069fb5-4bb2-47e0-89e2-c7b364ca2fe1 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:12:22.618123 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-39069fb5-4bb2-47e0-89e2-c7b364ca2fe1 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:12:22.618617 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-39069fb5-4bb2-47e0-89e2-c7b364ca2fe1 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:12:22.619062 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-39069fb5-4bb2-47e0-89e2-c7b364ca2fe1 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:12:22.619778 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-39069fb5-4bb2-47e0-89e2-c7b364ca2fe1 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:12:22.620237 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-39069fb5-4bb2-47e0-89e2-c7b364ca2fe1 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:12:22.620669 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-39069fb5-4bb2-47e0-89e2-c7b364ca2fe1 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:12:22.751364 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-39069fb5-4bb2-47e0-89e2-c7b364ca2fe1 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:12:22.760349 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-39069fb5-4bb2-47e0-89e2-c7b364ca2fe1 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:12:22.761918 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-39069fb5-4bb2-47e0-89e2-c7b364ca2fe1 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:12:22.763084 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-39069fb5-4bb2-47e0-89e2-c7b364ca2fe1 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1745 microversion: 2.20 time: 0.157108 Oct 20 06:12:22.763643 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 476/936] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:12:22 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1745 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:12:23.152898 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-dafbd8da-9fab-421d-9129-492331ac07e6 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:12:23.155026 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-dafbd8da-9fab-421d-9129-492331ac07e6 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:12:23.161604 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-dafbd8da-9fab-421d-9129-492331ac07e6 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:12:23.162086 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-dafbd8da-9fab-421d-9129-492331ac07e6 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:12:23.162521 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-dafbd8da-9fab-421d-9129-492331ac07e6 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:12:23.163205 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-dafbd8da-9fab-421d-9129-492331ac07e6 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:12:23.163652 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-dafbd8da-9fab-421d-9129-492331ac07e6 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:12:23.164072 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-dafbd8da-9fab-421d-9129-492331ac07e6 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:12:23.194395 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-dafbd8da-9fab-421d-9129-492331ac07e6 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045506 Oct 20 06:12:23.194938 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 461/937] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:12:23 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:12:23.788681 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-8f825ef4-d517-409b-b463-00334ac149de tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:12:23.789316 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-8f825ef4-d517-409b-b463-00334ac149de tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:12:23.795696 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-8f825ef4-d517-409b-b463-00334ac149de tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:12:23.796179 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-8f825ef4-d517-409b-b463-00334ac149de tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:12:23.796618 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-8f825ef4-d517-409b-b463-00334ac149de tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:12:23.797343 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-8f825ef4-d517-409b-b463-00334ac149de tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:12:23.797796 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-8f825ef4-d517-409b-b463-00334ac149de tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:12:23.798224 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-8f825ef4-d517-409b-b463-00334ac149de tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:12:23.923916 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-8f825ef4-d517-409b-b463-00334ac149de tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:12:23.933246 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-8f825ef4-d517-409b-b463-00334ac149de tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:12:23.934628 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-8f825ef4-d517-409b-b463-00334ac149de tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:12:23.935784 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-8f825ef4-d517-409b-b463-00334ac149de tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1745 microversion: 2.20 time: 0.151078 Oct 20 06:12:23.936365 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 477/938] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:12:23 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1745 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:12:24.206930 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-e0c4c40d-2a8d-4293-88c8-3180b922ffc5 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:12:24.209468 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-e0c4c40d-2a8d-4293-88c8-3180b922ffc5 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:12:24.215828 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e0c4c40d-2a8d-4293-88c8-3180b922ffc5 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:12:24.216308 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e0c4c40d-2a8d-4293-88c8-3180b922ffc5 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:12:24.216771 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e0c4c40d-2a8d-4293-88c8-3180b922ffc5 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:12:24.217458 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e0c4c40d-2a8d-4293-88c8-3180b922ffc5 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:12:24.217913 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e0c4c40d-2a8d-4293-88c8-3180b922ffc5 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:12:24.218340 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e0c4c40d-2a8d-4293-88c8-3180b922ffc5 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:12:24.248663 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-e0c4c40d-2a8d-4293-88c8-3180b922ffc5 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045772 Oct 20 06:12:24.249230 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 462/939] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:12:24 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:12:24.962358 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-91eed802-7ac0-476a-b27f-98d564d1db83 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:12:24.962967 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-91eed802-7ac0-476a-b27f-98d564d1db83 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:12:24.968951 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-91eed802-7ac0-476a-b27f-98d564d1db83 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:12:24.969437 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-91eed802-7ac0-476a-b27f-98d564d1db83 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:12:24.969880 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-91eed802-7ac0-476a-b27f-98d564d1db83 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:12:24.970576 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-91eed802-7ac0-476a-b27f-98d564d1db83 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:12:24.971036 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-91eed802-7ac0-476a-b27f-98d564d1db83 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:12:24.971464 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-91eed802-7ac0-476a-b27f-98d564d1db83 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:12:25.100597 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-91eed802-7ac0-476a-b27f-98d564d1db83 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:12:25.109349 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-91eed802-7ac0-476a-b27f-98d564d1db83 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:12:25.110802 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-91eed802-7ac0-476a-b27f-98d564d1db83 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:12:25.111964 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-91eed802-7ac0-476a-b27f-98d564d1db83 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1745 microversion: 2.20 time: 0.154724 Oct 20 06:12:25.112542 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 478/940] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:12:24 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1745 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:12:25.261871 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-4146845c-a8a3-4604-baba-ea29d3528144 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:12:25.263922 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-4146845c-a8a3-4604-baba-ea29d3528144 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:12:25.270265 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-4146845c-a8a3-4604-baba-ea29d3528144 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:12:25.270820 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-4146845c-a8a3-4604-baba-ea29d3528144 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:12:25.271251 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-4146845c-a8a3-4604-baba-ea29d3528144 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:12:25.271936 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-4146845c-a8a3-4604-baba-ea29d3528144 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:12:25.272382 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-4146845c-a8a3-4604-baba-ea29d3528144 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:12:25.272824 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-4146845c-a8a3-4604-baba-ea29d3528144 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:12:25.301833 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-4146845c-a8a3-4604-baba-ea29d3528144 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043547 Oct 20 06:12:25.302632 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 463/941] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:12:25 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:12:26.138452 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-c8c2c967-3349-4db3-aa93-15fef18f3493 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:12:26.139055 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-c8c2c967-3349-4db3-aa93-15fef18f3493 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:12:26.145431 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c8c2c967-3349-4db3-aa93-15fef18f3493 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:12:26.146005 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c8c2c967-3349-4db3-aa93-15fef18f3493 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:12:26.146463 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c8c2c967-3349-4db3-aa93-15fef18f3493 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:12:26.147154 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c8c2c967-3349-4db3-aa93-15fef18f3493 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:12:26.147601 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c8c2c967-3349-4db3-aa93-15fef18f3493 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:12:26.148023 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c8c2c967-3349-4db3-aa93-15fef18f3493 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:12:26.272629 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-c8c2c967-3349-4db3-aa93-15fef18f3493 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:12:26.281049 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-c8c2c967-3349-4db3-aa93-15fef18f3493 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:12:26.282511 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-c8c2c967-3349-4db3-aa93-15fef18f3493 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:12:26.283655 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-c8c2c967-3349-4db3-aa93-15fef18f3493 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1745 microversion: 2.20 time: 0.149172 Oct 20 06:12:26.284200 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 479/942] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:12:26 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1745 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:12:26.314540 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-75cc405c-801d-445c-bf82-99e09a11dc3c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:12:26.316681 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-75cc405c-801d-445c-bf82-99e09a11dc3c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:12:26.323079 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-75cc405c-801d-445c-bf82-99e09a11dc3c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:12:26.323572 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-75cc405c-801d-445c-bf82-99e09a11dc3c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:12:26.324014 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-75cc405c-801d-445c-bf82-99e09a11dc3c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:12:26.324719 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-75cc405c-801d-445c-bf82-99e09a11dc3c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:12:26.325181 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-75cc405c-801d-445c-bf82-99e09a11dc3c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:12:26.325611 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-75cc405c-801d-445c-bf82-99e09a11dc3c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:12:26.354556 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-75cc405c-801d-445c-bf82-99e09a11dc3c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043933 Oct 20 06:12:26.355103 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 464/943] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:12:26 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:12:27.310700 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-6d3644b5-0993-4ea7-a796-6bc20ca07e91 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:12:27.311306 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-6d3644b5-0993-4ea7-a796-6bc20ca07e91 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:12:27.317439 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-6d3644b5-0993-4ea7-a796-6bc20ca07e91 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:12:27.318637 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-6d3644b5-0993-4ea7-a796-6bc20ca07e91 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:12:27.319086 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-6d3644b5-0993-4ea7-a796-6bc20ca07e91 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:12:27.319775 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-6d3644b5-0993-4ea7-a796-6bc20ca07e91 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:12:27.320226 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-6d3644b5-0993-4ea7-a796-6bc20ca07e91 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:12:27.320645 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-6d3644b5-0993-4ea7-a796-6bc20ca07e91 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:12:27.367527 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-c42694cd-40f6-4072-82a5-a64692336d4a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:12:27.369707 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-c42694cd-40f6-4072-82a5-a64692336d4a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:12:27.375983 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c42694cd-40f6-4072-82a5-a64692336d4a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:12:27.376469 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c42694cd-40f6-4072-82a5-a64692336d4a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:12:27.376956 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c42694cd-40f6-4072-82a5-a64692336d4a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:12:27.377656 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c42694cd-40f6-4072-82a5-a64692336d4a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:12:27.378368 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c42694cd-40f6-4072-82a5-a64692336d4a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:12:27.378796 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c42694cd-40f6-4072-82a5-a64692336d4a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:12:27.409188 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-c42694cd-40f6-4072-82a5-a64692336d4a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046170 Oct 20 06:12:27.409763 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 465/944] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:12:27 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 20 06:12:27.449785 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-6d3644b5-0993-4ea7-a796-6bc20ca07e91 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:12:27.458409 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-6d3644b5-0993-4ea7-a796-6bc20ca07e91 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:12:27.459982 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-6d3644b5-0993-4ea7-a796-6bc20ca07e91 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:12:27.461167 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-6d3644b5-0993-4ea7-a796-6bc20ca07e91 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1745 microversion: 2.20 time: 0.154372 Oct 20 06:12:27.461718 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 480/945] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:12:27 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1745 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:12:28.421717 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-cc4b8a35-2456-43d4-b2c5-47b0506ead15 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:12:28.423855 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-cc4b8a35-2456-43d4-b2c5-47b0506ead15 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:12:28.431176 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-cc4b8a35-2456-43d4-b2c5-47b0506ead15 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:12:28.431660 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-cc4b8a35-2456-43d4-b2c5-47b0506ead15 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:12:28.432090 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-cc4b8a35-2456-43d4-b2c5-47b0506ead15 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:12:28.432808 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-cc4b8a35-2456-43d4-b2c5-47b0506ead15 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:12:28.433264 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-cc4b8a35-2456-43d4-b2c5-47b0506ead15 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:12:28.433689 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-cc4b8a35-2456-43d4-b2c5-47b0506ead15 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:12:28.462950 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-cc4b8a35-2456-43d4-b2c5-47b0506ead15 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045141 Oct 20 06:12:28.463426 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 466/946] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:12:28 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:12:28.486271 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-ee8b1b6b-cd9d-4947-a27d-5fdbb854bf41 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:12:28.486880 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-ee8b1b6b-cd9d-4947-a27d-5fdbb854bf41 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:12:28.493947 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ee8b1b6b-cd9d-4947-a27d-5fdbb854bf41 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:12:28.494430 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ee8b1b6b-cd9d-4947-a27d-5fdbb854bf41 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:12:28.494864 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ee8b1b6b-cd9d-4947-a27d-5fdbb854bf41 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:12:28.495557 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ee8b1b6b-cd9d-4947-a27d-5fdbb854bf41 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:12:28.496015 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ee8b1b6b-cd9d-4947-a27d-5fdbb854bf41 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:12:28.496440 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ee8b1b6b-cd9d-4947-a27d-5fdbb854bf41 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:12:28.624418 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-ee8b1b6b-cd9d-4947-a27d-5fdbb854bf41 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:12:28.633488 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-ee8b1b6b-cd9d-4947-a27d-5fdbb854bf41 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:12:28.634934 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-ee8b1b6b-cd9d-4947-a27d-5fdbb854bf41 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:12:28.636102 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-ee8b1b6b-cd9d-4947-a27d-5fdbb854bf41 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1745 microversion: 2.20 time: 0.153724 Oct 20 06:12:28.636774 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 481/947] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:12:28 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1745 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:12:29.475260 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-88045a73-97d6-4ae7-a0af-0cb22832b43c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:12:29.477480 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-88045a73-97d6-4ae7-a0af-0cb22832b43c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:12:29.483919 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-88045a73-97d6-4ae7-a0af-0cb22832b43c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:12:29.484397 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-88045a73-97d6-4ae7-a0af-0cb22832b43c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:12:29.484858 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-88045a73-97d6-4ae7-a0af-0cb22832b43c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:12:29.485543 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-88045a73-97d6-4ae7-a0af-0cb22832b43c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:12:29.485991 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-88045a73-97d6-4ae7-a0af-0cb22832b43c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:12:29.486410 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-88045a73-97d6-4ae7-a0af-0cb22832b43c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:12:29.516279 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-88045a73-97d6-4ae7-a0af-0cb22832b43c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044971 Oct 20 06:12:29.516851 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 467/948] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:12:29 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:12:29.662772 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-4c34f0fe-876e-41aa-a6b1-bf9c00a320e8 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:12:29.663417 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-4c34f0fe-876e-41aa-a6b1-bf9c00a320e8 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:12:29.669780 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4c34f0fe-876e-41aa-a6b1-bf9c00a320e8 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:12:29.670204 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4c34f0fe-876e-41aa-a6b1-bf9c00a320e8 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:12:29.670642 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4c34f0fe-876e-41aa-a6b1-bf9c00a320e8 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:12:29.671333 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4c34f0fe-876e-41aa-a6b1-bf9c00a320e8 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:12:29.671781 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4c34f0fe-876e-41aa-a6b1-bf9c00a320e8 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:12:29.672221 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4c34f0fe-876e-41aa-a6b1-bf9c00a320e8 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:12:29.803634 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-4c34f0fe-876e-41aa-a6b1-bf9c00a320e8 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:12:29.812134 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-4c34f0fe-876e-41aa-a6b1-bf9c00a320e8 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:12:29.813605 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-4c34f0fe-876e-41aa-a6b1-bf9c00a320e8 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:12:29.814764 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-4c34f0fe-876e-41aa-a6b1-bf9c00a320e8 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1745 microversion: 2.20 time: 0.156081 Oct 20 06:12:29.815317 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 482/949] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:12:29 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1745 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:12:30.529227 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-cd4b3eba-4760-41ea-ad44-c867eaed28d4 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:12:30.531390 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-cd4b3eba-4760-41ea-ad44-c867eaed28d4 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:12:30.538437 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-cd4b3eba-4760-41ea-ad44-c867eaed28d4 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:12:30.538946 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-cd4b3eba-4760-41ea-ad44-c867eaed28d4 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:12:30.539383 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-cd4b3eba-4760-41ea-ad44-c867eaed28d4 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:12:30.540076 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-cd4b3eba-4760-41ea-ad44-c867eaed28d4 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:12:30.540527 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-cd4b3eba-4760-41ea-ad44-c867eaed28d4 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:12:30.540991 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-cd4b3eba-4760-41ea-ad44-c867eaed28d4 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:12:30.557534 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG dbcounter [-] [118860] Writing DB stats nova_cell1:SELECT=100 {{(pid=118860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:12:30.572031 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-cd4b3eba-4760-41ea-ad44-c867eaed28d4 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046812 Oct 20 06:12:30.572584 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 468/950] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:12:30 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:12:30.840070 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-ae00d0b1-e72f-413b-b13c-3bb6425f114f tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:12:30.840704 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-ae00d0b1-e72f-413b-b13c-3bb6425f114f tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:12:30.847723 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ae00d0b1-e72f-413b-b13c-3bb6425f114f tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:12:30.848209 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ae00d0b1-e72f-413b-b13c-3bb6425f114f tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:12:30.848658 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ae00d0b1-e72f-413b-b13c-3bb6425f114f tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:12:30.849382 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ae00d0b1-e72f-413b-b13c-3bb6425f114f tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:12:30.849840 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ae00d0b1-e72f-413b-b13c-3bb6425f114f tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:12:30.850270 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ae00d0b1-e72f-413b-b13c-3bb6425f114f tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:12:30.981558 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-ae00d0b1-e72f-413b-b13c-3bb6425f114f tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:12:30.990210 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-ae00d0b1-e72f-413b-b13c-3bb6425f114f tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:12:30.991704 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-ae00d0b1-e72f-413b-b13c-3bb6425f114f tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:12:30.992911 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-ae00d0b1-e72f-413b-b13c-3bb6425f114f tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1745 microversion: 2.20 time: 0.156780 Oct 20 06:12:30.993464 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 483/951] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:12:30 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1745 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:12:31.585576 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-46acd30a-c70c-45f5-a138-6752bb087dbc tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:12:31.587674 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-46acd30a-c70c-45f5-a138-6752bb087dbc tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:12:31.594130 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-46acd30a-c70c-45f5-a138-6752bb087dbc tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:12:31.594640 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-46acd30a-c70c-45f5-a138-6752bb087dbc tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:12:31.595078 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-46acd30a-c70c-45f5-a138-6752bb087dbc tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:12:31.595765 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-46acd30a-c70c-45f5-a138-6752bb087dbc tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:12:31.596221 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-46acd30a-c70c-45f5-a138-6752bb087dbc tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:12:31.596643 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-46acd30a-c70c-45f5-a138-6752bb087dbc tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:12:31.626320 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-46acd30a-c70c-45f5-a138-6752bb087dbc tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045895 Oct 20 06:12:31.626873 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 469/952] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:12:31 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:12:32.018585 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-4243282d-5997-42d5-8934-de4982729704 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:12:32.019199 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-4243282d-5997-42d5-8934-de4982729704 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:12:32.026404 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4243282d-5997-42d5-8934-de4982729704 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:12:32.026888 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4243282d-5997-42d5-8934-de4982729704 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:12:32.027328 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4243282d-5997-42d5-8934-de4982729704 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:12:32.028031 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4243282d-5997-42d5-8934-de4982729704 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:12:32.028485 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4243282d-5997-42d5-8934-de4982729704 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:12:32.029018 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4243282d-5997-42d5-8934-de4982729704 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:12:32.155861 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-4243282d-5997-42d5-8934-de4982729704 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:12:32.164521 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-4243282d-5997-42d5-8934-de4982729704 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:12:32.165991 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-4243282d-5997-42d5-8934-de4982729704 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:12:32.167137 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-4243282d-5997-42d5-8934-de4982729704 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1745 microversion: 2.20 time: 0.152458 Oct 20 06:12:32.167686 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 484/953] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:12:32 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1745 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:12:32.639443 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-229b6a75-fd99-4815-9ed1-c1fc69d5e003 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:12:32.641607 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-229b6a75-fd99-4815-9ed1-c1fc69d5e003 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:12:32.643942 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG dbcounter [-] [118860] Writing DB stats nova_api:SELECT=54 {{(pid=118860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:12:32.649346 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-229b6a75-fd99-4815-9ed1-c1fc69d5e003 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:12:32.649824 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-229b6a75-fd99-4815-9ed1-c1fc69d5e003 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:12:32.650258 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-229b6a75-fd99-4815-9ed1-c1fc69d5e003 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:12:32.650946 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-229b6a75-fd99-4815-9ed1-c1fc69d5e003 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:12:32.651397 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-229b6a75-fd99-4815-9ed1-c1fc69d5e003 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:12:32.651820 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-229b6a75-fd99-4815-9ed1-c1fc69d5e003 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:12:32.681115 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-229b6a75-fd99-4815-9ed1-c1fc69d5e003 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045758 Oct 20 06:12:32.681667 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 470/954] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:12:32 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:12:33.191665 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-54650902-428d-4bdb-8fa5-7f6d9422820c tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:12:33.192212 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-54650902-428d-4bdb-8fa5-7f6d9422820c tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:12:33.194661 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG dbcounter [-] [118861] Writing DB stats nova_api:SELECT=56 {{(pid=118861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:12:33.199743 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-54650902-428d-4bdb-8fa5-7f6d9422820c tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:12:33.200233 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-54650902-428d-4bdb-8fa5-7f6d9422820c tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:12:33.200670 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-54650902-428d-4bdb-8fa5-7f6d9422820c tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:12:33.201386 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-54650902-428d-4bdb-8fa5-7f6d9422820c tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:12:33.201840 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-54650902-428d-4bdb-8fa5-7f6d9422820c tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:12:33.202266 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-54650902-428d-4bdb-8fa5-7f6d9422820c tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:12:33.331937 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-54650902-428d-4bdb-8fa5-7f6d9422820c tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:12:33.341347 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-54650902-428d-4bdb-8fa5-7f6d9422820c tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:12:33.342790 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-54650902-428d-4bdb-8fa5-7f6d9422820c tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:12:33.343955 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-54650902-428d-4bdb-8fa5-7f6d9422820c tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1745 microversion: 2.20 time: 0.156272 Oct 20 06:12:33.344521 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 485/955] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:12:33 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1745 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:12:33.694179 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-15c24e2c-4558-449c-af8e-532f0d17a963 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:12:33.696386 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-15c24e2c-4558-449c-af8e-532f0d17a963 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:12:33.702869 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-15c24e2c-4558-449c-af8e-532f0d17a963 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:12:33.703356 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-15c24e2c-4558-449c-af8e-532f0d17a963 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:12:33.703794 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-15c24e2c-4558-449c-af8e-532f0d17a963 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:12:33.704515 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-15c24e2c-4558-449c-af8e-532f0d17a963 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:12:33.705005 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-15c24e2c-4558-449c-af8e-532f0d17a963 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:12:33.705432 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-15c24e2c-4558-449c-af8e-532f0d17a963 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:12:33.734647 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-15c24e2c-4558-449c-af8e-532f0d17a963 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045075 Oct 20 06:12:33.735188 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 471/956] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:12:33 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:12:34.370373 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-418a57b5-5575-4328-94a9-2f1f4e43ab5d tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:12:34.370977 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-418a57b5-5575-4328-94a9-2f1f4e43ab5d tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:12:34.377358 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-418a57b5-5575-4328-94a9-2f1f4e43ab5d tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:12:34.378156 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-418a57b5-5575-4328-94a9-2f1f4e43ab5d tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:12:34.378589 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-418a57b5-5575-4328-94a9-2f1f4e43ab5d tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:12:34.379270 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-418a57b5-5575-4328-94a9-2f1f4e43ab5d tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:12:34.379720 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-418a57b5-5575-4328-94a9-2f1f4e43ab5d tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:12:34.380142 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-418a57b5-5575-4328-94a9-2f1f4e43ab5d tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:12:34.384147 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG dbcounter [-] [118861] Writing DB stats nova_cell1:SELECT=100 {{(pid=118861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:12:34.507006 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-418a57b5-5575-4328-94a9-2f1f4e43ab5d tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:12:34.515431 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-418a57b5-5575-4328-94a9-2f1f4e43ab5d tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:12:34.516883 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-418a57b5-5575-4328-94a9-2f1f4e43ab5d tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:12:34.518066 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-418a57b5-5575-4328-94a9-2f1f4e43ab5d tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1745 microversion: 2.20 time: 0.151624 Oct 20 06:12:34.518620 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 486/957] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:12:34 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1745 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 20 06:12:34.747026 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-45073bfb-7448-4ba4-9115-a2378f4fa270 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:12:34.749192 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-45073bfb-7448-4ba4-9115-a2378f4fa270 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:12:34.755838 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-45073bfb-7448-4ba4-9115-a2378f4fa270 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:12:34.756323 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-45073bfb-7448-4ba4-9115-a2378f4fa270 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:12:34.756788 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-45073bfb-7448-4ba4-9115-a2378f4fa270 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:12:34.757489 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-45073bfb-7448-4ba4-9115-a2378f4fa270 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:12:34.757947 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-45073bfb-7448-4ba4-9115-a2378f4fa270 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:12:34.758376 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-45073bfb-7448-4ba4-9115-a2378f4fa270 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:12:34.789373 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-45073bfb-7448-4ba4-9115-a2378f4fa270 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046340 Oct 20 06:12:34.789931 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 472/958] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:12:34 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:12:35.543283 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-ee2e8757-fe82-4ae0-8614-3ea70d8b71d1 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:12:35.543892 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-ee2e8757-fe82-4ae0-8614-3ea70d8b71d1 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:12:35.550288 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ee2e8757-fe82-4ae0-8614-3ea70d8b71d1 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:12:35.550799 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ee2e8757-fe82-4ae0-8614-3ea70d8b71d1 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:12:35.551233 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ee2e8757-fe82-4ae0-8614-3ea70d8b71d1 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:12:35.552411 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ee2e8757-fe82-4ae0-8614-3ea70d8b71d1 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:12:35.552890 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ee2e8757-fe82-4ae0-8614-3ea70d8b71d1 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:12:35.553312 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ee2e8757-fe82-4ae0-8614-3ea70d8b71d1 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:12:35.683826 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-ee2e8757-fe82-4ae0-8614-3ea70d8b71d1 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:12:35.692323 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-ee2e8757-fe82-4ae0-8614-3ea70d8b71d1 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:12:35.694489 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-ee2e8757-fe82-4ae0-8614-3ea70d8b71d1 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:12:35.695636 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-ee2e8757-fe82-4ae0-8614-3ea70d8b71d1 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1745 microversion: 2.20 time: 0.156341 Oct 20 06:12:35.696187 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 487/959] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:12:35 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1745 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:12:35.802248 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-bcbabcf2-56d4-41ae-ab5a-53b2cbd48c73 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:12:35.804411 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-bcbabcf2-56d4-41ae-ab5a-53b2cbd48c73 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:12:35.810873 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-bcbabcf2-56d4-41ae-ab5a-53b2cbd48c73 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:12:35.811348 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-bcbabcf2-56d4-41ae-ab5a-53b2cbd48c73 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:12:35.811782 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-bcbabcf2-56d4-41ae-ab5a-53b2cbd48c73 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:12:35.812460 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-bcbabcf2-56d4-41ae-ab5a-53b2cbd48c73 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:12:35.812934 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-bcbabcf2-56d4-41ae-ab5a-53b2cbd48c73 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:12:35.813357 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-bcbabcf2-56d4-41ae-ab5a-53b2cbd48c73 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:12:35.842415 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-bcbabcf2-56d4-41ae-ab5a-53b2cbd48c73 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044691 Oct 20 06:12:35.842960 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 473/960] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:12:35 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:12:36.721515 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-1f5ae4e6-1267-411a-b961-cc0c14636124 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:12:36.722117 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-1f5ae4e6-1267-411a-b961-cc0c14636124 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:12:36.731697 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1f5ae4e6-1267-411a-b961-cc0c14636124 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:12:36.732173 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1f5ae4e6-1267-411a-b961-cc0c14636124 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:12:36.732604 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1f5ae4e6-1267-411a-b961-cc0c14636124 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:12:36.733330 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1f5ae4e6-1267-411a-b961-cc0c14636124 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:12:36.733777 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1f5ae4e6-1267-411a-b961-cc0c14636124 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:12:36.734198 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1f5ae4e6-1267-411a-b961-cc0c14636124 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:12:36.855524 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-ddac7c2d-5658-496a-94fd-b38eeeb9be46 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:12:36.857698 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-ddac7c2d-5658-496a-94fd-b38eeeb9be46 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:12:36.861752 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-1f5ae4e6-1267-411a-b961-cc0c14636124 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:12:36.864068 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-ddac7c2d-5658-496a-94fd-b38eeeb9be46 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:12:36.865221 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-ddac7c2d-5658-496a-94fd-b38eeeb9be46 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:12:36.865675 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-ddac7c2d-5658-496a-94fd-b38eeeb9be46 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:12:36.866403 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-ddac7c2d-5658-496a-94fd-b38eeeb9be46 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:12:36.866859 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-ddac7c2d-5658-496a-94fd-b38eeeb9be46 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:12:36.867284 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-ddac7c2d-5658-496a-94fd-b38eeeb9be46 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:12:36.870947 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-1f5ae4e6-1267-411a-b961-cc0c14636124 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:12:36.872672 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-1f5ae4e6-1267-411a-b961-cc0c14636124 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:12:36.873861 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-1f5ae4e6-1267-411a-b961-cc0c14636124 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1745 microversion: 2.20 time: 0.156267 Oct 20 06:12:36.874416 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 488/961] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:12:36 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1745 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:12:36.897066 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-ddac7c2d-5658-496a-94fd-b38eeeb9be46 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045487 Oct 20 06:12:36.897683 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 474/962] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:12:36 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 20 06:12:37.899494 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-40c486a6-1a08-4df6-902d-b2098e4a3888 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:12:37.900096 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-40c486a6-1a08-4df6-902d-b2098e4a3888 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:12:37.906481 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-40c486a6-1a08-4df6-902d-b2098e4a3888 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:12:37.906952 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-40c486a6-1a08-4df6-902d-b2098e4a3888 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:12:37.907381 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-40c486a6-1a08-4df6-902d-b2098e4a3888 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:12:37.908070 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-40c486a6-1a08-4df6-902d-b2098e4a3888 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:12:37.908517 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-40c486a6-1a08-4df6-902d-b2098e4a3888 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:12:37.908968 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-40c486a6-1a08-4df6-902d-b2098e4a3888 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:12:37.909309 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-87c9cf0b-266a-4b50-b454-d85b437f672a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:12:37.911715 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-87c9cf0b-266a-4b50-b454-d85b437f672a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:12:37.917958 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-87c9cf0b-266a-4b50-b454-d85b437f672a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:12:37.918506 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-87c9cf0b-266a-4b50-b454-d85b437f672a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:12:37.918963 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-87c9cf0b-266a-4b50-b454-d85b437f672a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:12:37.919650 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-87c9cf0b-266a-4b50-b454-d85b437f672a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:12:37.920099 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-87c9cf0b-266a-4b50-b454-d85b437f672a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:12:37.920519 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-87c9cf0b-266a-4b50-b454-d85b437f672a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:12:37.952786 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-87c9cf0b-266a-4b50-b454-d85b437f672a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047394 Oct 20 06:12:37.953359 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 475/963] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:12:37 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 20 06:12:38.037186 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-40c486a6-1a08-4df6-902d-b2098e4a3888 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:12:38.045650 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-40c486a6-1a08-4df6-902d-b2098e4a3888 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:12:38.047082 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-40c486a6-1a08-4df6-902d-b2098e4a3888 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:12:38.048231 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-40c486a6-1a08-4df6-902d-b2098e4a3888 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1745 microversion: 2.20 time: 0.152722 Oct 20 06:12:38.048797 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 489/964] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:12:37 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1745 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:12:38.965128 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-a7513f70-1fae-498f-b8be-97d12dd0d28d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:12:38.967251 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-a7513f70-1fae-498f-b8be-97d12dd0d28d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:12:38.974295 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a7513f70-1fae-498f-b8be-97d12dd0d28d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:12:38.974780 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a7513f70-1fae-498f-b8be-97d12dd0d28d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:12:38.975221 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a7513f70-1fae-498f-b8be-97d12dd0d28d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:12:38.975910 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a7513f70-1fae-498f-b8be-97d12dd0d28d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:12:38.976407 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a7513f70-1fae-498f-b8be-97d12dd0d28d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:12:38.976867 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a7513f70-1fae-498f-b8be-97d12dd0d28d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:12:39.007275 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-a7513f70-1fae-498f-b8be-97d12dd0d28d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046107 Oct 20 06:12:39.007860 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 476/965] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:12:38 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:12:39.074376 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-c7ba8d14-83e5-42f9-baf1-5c332e17ed00 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:12:39.074977 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-c7ba8d14-83e5-42f9-baf1-5c332e17ed00 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:12:39.081294 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c7ba8d14-83e5-42f9-baf1-5c332e17ed00 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:12:39.081768 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c7ba8d14-83e5-42f9-baf1-5c332e17ed00 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:12:39.082195 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c7ba8d14-83e5-42f9-baf1-5c332e17ed00 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:12:39.083635 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c7ba8d14-83e5-42f9-baf1-5c332e17ed00 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:12:39.084234 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c7ba8d14-83e5-42f9-baf1-5c332e17ed00 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:12:39.084657 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c7ba8d14-83e5-42f9-baf1-5c332e17ed00 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:12:39.215513 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-c7ba8d14-83e5-42f9-baf1-5c332e17ed00 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:12:39.224104 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-c7ba8d14-83e5-42f9-baf1-5c332e17ed00 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:12:39.225705 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-c7ba8d14-83e5-42f9-baf1-5c332e17ed00 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:12:39.226929 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-c7ba8d14-83e5-42f9-baf1-5c332e17ed00 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1745 microversion: 2.20 time: 0.156530 Oct 20 06:12:39.227563 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 490/966] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:12:39 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1745 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:12:40.019617 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-d681f122-bd92-49c5-81cc-5cea56bbfefb tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:12:40.021849 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-d681f122-bd92-49c5-81cc-5cea56bbfefb tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:12:40.028281 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-d681f122-bd92-49c5-81cc-5cea56bbfefb tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:12:40.028799 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-d681f122-bd92-49c5-81cc-5cea56bbfefb tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:12:40.029242 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-d681f122-bd92-49c5-81cc-5cea56bbfefb tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:12:40.029933 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-d681f122-bd92-49c5-81cc-5cea56bbfefb tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:12:40.030387 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-d681f122-bd92-49c5-81cc-5cea56bbfefb tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:12:40.030808 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-d681f122-bd92-49c5-81cc-5cea56bbfefb tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:12:40.060191 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-d681f122-bd92-49c5-81cc-5cea56bbfefb tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044514 Oct 20 06:12:40.060748 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 477/967] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:12:40 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:12:40.253738 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-f72cd6db-eacd-47b3-9b05-ef30010484a7 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:12:40.254353 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-f72cd6db-eacd-47b3-9b05-ef30010484a7 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:12:40.261656 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f72cd6db-eacd-47b3-9b05-ef30010484a7 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:12:40.262225 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f72cd6db-eacd-47b3-9b05-ef30010484a7 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:12:40.262869 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f72cd6db-eacd-47b3-9b05-ef30010484a7 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:12:40.263622 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f72cd6db-eacd-47b3-9b05-ef30010484a7 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:12:40.264079 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f72cd6db-eacd-47b3-9b05-ef30010484a7 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:12:40.264508 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f72cd6db-eacd-47b3-9b05-ef30010484a7 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:12:40.406299 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-f72cd6db-eacd-47b3-9b05-ef30010484a7 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:12:40.416016 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-f72cd6db-eacd-47b3-9b05-ef30010484a7 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:12:40.417496 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-f72cd6db-eacd-47b3-9b05-ef30010484a7 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:12:40.418679 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-f72cd6db-eacd-47b3-9b05-ef30010484a7 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1745 microversion: 2.20 time: 0.169389 Oct 20 06:12:40.419214 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 491/968] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:12:40 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1745 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:12:41.073316 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-8e24a654-cccd-4e47-a23a-f41b3fd280da tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:12:41.075493 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-8e24a654-cccd-4e47-a23a-f41b3fd280da tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:12:41.081851 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-8e24a654-cccd-4e47-a23a-f41b3fd280da tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:12:41.082334 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-8e24a654-cccd-4e47-a23a-f41b3fd280da tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:12:41.082767 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-8e24a654-cccd-4e47-a23a-f41b3fd280da tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:12:41.083728 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-8e24a654-cccd-4e47-a23a-f41b3fd280da tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:12:41.084186 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-8e24a654-cccd-4e47-a23a-f41b3fd280da tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:12:41.084615 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-8e24a654-cccd-4e47-a23a-f41b3fd280da tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:12:41.114263 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-8e24a654-cccd-4e47-a23a-f41b3fd280da tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044859 Oct 20 06:12:41.115701 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 478/969] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:12:41 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 20 06:12:41.447644 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-5c848332-0f57-4572-8160-41fe91968ff7 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:12:41.448373 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-5c848332-0f57-4572-8160-41fe91968ff7 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:12:41.454759 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5c848332-0f57-4572-8160-41fe91968ff7 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:12:41.455236 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5c848332-0f57-4572-8160-41fe91968ff7 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:12:41.455666 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5c848332-0f57-4572-8160-41fe91968ff7 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:12:41.456454 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5c848332-0f57-4572-8160-41fe91968ff7 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:12:41.456930 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5c848332-0f57-4572-8160-41fe91968ff7 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:12:41.457460 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5c848332-0f57-4572-8160-41fe91968ff7 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:12:41.594898 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-5c848332-0f57-4572-8160-41fe91968ff7 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:12:41.603930 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-5c848332-0f57-4572-8160-41fe91968ff7 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:12:41.605417 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-5c848332-0f57-4572-8160-41fe91968ff7 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:12:41.606580 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-5c848332-0f57-4572-8160-41fe91968ff7 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1745 microversion: 2.20 time: 0.162802 Oct 20 06:12:41.607142 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 492/970] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:12:41 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1745 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:12:42.127464 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-2622dc73-4a68-46ee-8d26-af6fc9b1c4ce tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:12:42.129892 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-2622dc73-4a68-46ee-8d26-af6fc9b1c4ce tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:12:42.136230 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2622dc73-4a68-46ee-8d26-af6fc9b1c4ce tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:12:42.136724 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2622dc73-4a68-46ee-8d26-af6fc9b1c4ce tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:12:42.137176 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2622dc73-4a68-46ee-8d26-af6fc9b1c4ce tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:12:42.137864 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2622dc73-4a68-46ee-8d26-af6fc9b1c4ce tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:12:42.138317 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2622dc73-4a68-46ee-8d26-af6fc9b1c4ce tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:12:42.138743 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2622dc73-4a68-46ee-8d26-af6fc9b1c4ce tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:12:42.167719 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-2622dc73-4a68-46ee-8d26-af6fc9b1c4ce tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044221 Oct 20 06:12:42.168265 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 479/971] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:12:42 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:12:42.516599 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-af0c8a89-0dbc-4d62-9ccf-d92ac7e8c1cb tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:12:42.517146 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-af0c8a89-0dbc-4d62-9ccf-d92ac7e8c1cb tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:12:42.523782 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-af0c8a89-0dbc-4d62-9ccf-d92ac7e8c1cb tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:12:42.524259 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-af0c8a89-0dbc-4d62-9ccf-d92ac7e8c1cb tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:12:42.524688 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-af0c8a89-0dbc-4d62-9ccf-d92ac7e8c1cb tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:12:42.525406 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-af0c8a89-0dbc-4d62-9ccf-d92ac7e8c1cb tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:12:42.525861 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-af0c8a89-0dbc-4d62-9ccf-d92ac7e8c1cb tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:12:42.526281 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-af0c8a89-0dbc-4d62-9ccf-d92ac7e8c1cb tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:12:42.634075 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-2aa4e3c6-b804-497a-93e3-df37de968c80 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:12:42.634798 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-2aa4e3c6-b804-497a-93e3-df37de968c80 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:12:42.640649 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2aa4e3c6-b804-497a-93e3-df37de968c80 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:12:42.641236 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2aa4e3c6-b804-497a-93e3-df37de968c80 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:12:42.641750 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2aa4e3c6-b804-497a-93e3-df37de968c80 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:12:42.642532 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2aa4e3c6-b804-497a-93e3-df37de968c80 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:12:42.643067 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2aa4e3c6-b804-497a-93e3-df37de968c80 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:12:42.643498 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2aa4e3c6-b804-497a-93e3-df37de968c80 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:12:42.662952 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.objects.instance [None req-af0c8a89-0dbc-4d62-9ccf-d92ac7e8c1cb tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lazy-loading 'services' on Instance uuid 0247d13a-779d-4301-ba85-6cbcbf12252f {{(pid=118861) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 20 06:12:42.736195 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-af0c8a89-0dbc-4d62-9ccf-d92ac7e8c1cb tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "DELETE /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f/os-volume_attachments/2d33053a-13ce-4db6-a68a-0e03d774ad0b" status: 202 len: 0 microversion: 2.1 time: 0.223290 Oct 20 06:12:42.736910 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 493/972] 10.222.0.20 () {58 vars in 1416 bytes} [Thu Oct 20 06:12:42 2022] DELETE /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f/os-volume_attachments/2d33053a-13ce-4db6-a68a-0e03d774ad0b => generated 0 bytes in 225 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 20 06:12:42.789711 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-2aa4e3c6-b804-497a-93e3-df37de968c80 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:12:42.798368 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-2aa4e3c6-b804-497a-93e3-df37de968c80 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:12:42.799958 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-2aa4e3c6-b804-497a-93e3-df37de968c80 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:12:42.801152 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-2aa4e3c6-b804-497a-93e3-df37de968c80 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1745 microversion: 2.20 time: 0.171711 Oct 20 06:12:42.804457 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 480/973] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:12:42 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1745 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 20 06:12:43.181505 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-b99cd158-c3cf-4c49-a0d4-1de35a4514eb tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:12:43.183822 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-b99cd158-c3cf-4c49-a0d4-1de35a4514eb tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:12:43.190000 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b99cd158-c3cf-4c49-a0d4-1de35a4514eb tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:12:43.190487 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b99cd158-c3cf-4c49-a0d4-1de35a4514eb tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:12:43.190923 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b99cd158-c3cf-4c49-a0d4-1de35a4514eb tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:12:43.191612 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b99cd158-c3cf-4c49-a0d4-1de35a4514eb tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:12:43.192065 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b99cd158-c3cf-4c49-a0d4-1de35a4514eb tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:12:43.192490 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b99cd158-c3cf-4c49-a0d4-1de35a4514eb tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:12:43.222055 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-b99cd158-c3cf-4c49-a0d4-1de35a4514eb tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045878 Oct 20 06:12:43.222592 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 494/974] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:12:43 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:12:43.827167 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-090c9663-e085-406c-a9fd-8f8f4f96289d tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:12:43.827769 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-090c9663-e085-406c-a9fd-8f8f4f96289d tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:12:43.834639 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-090c9663-e085-406c-a9fd-8f8f4f96289d tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:12:43.835233 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-090c9663-e085-406c-a9fd-8f8f4f96289d tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:12:43.835816 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-090c9663-e085-406c-a9fd-8f8f4f96289d tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:12:43.836551 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-090c9663-e085-406c-a9fd-8f8f4f96289d tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:12:43.837054 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-090c9663-e085-406c-a9fd-8f8f4f96289d tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:12:43.837496 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-090c9663-e085-406c-a9fd-8f8f4f96289d tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:12:43.966932 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-090c9663-e085-406c-a9fd-8f8f4f96289d tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:12:43.976498 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-090c9663-e085-406c-a9fd-8f8f4f96289d tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:12:43.977973 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-090c9663-e085-406c-a9fd-8f8f4f96289d tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:12:43.979125 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-090c9663-e085-406c-a9fd-8f8f4f96289d tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1745 microversion: 2.20 time: 0.155775 Oct 20 06:12:43.979674 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 481/975] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:12:43 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1745 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:12:44.234849 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-19230789-a9ab-4ae3-bdde-2918d8068573 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:12:44.237026 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-19230789-a9ab-4ae3-bdde-2918d8068573 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:12:44.243419 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-19230789-a9ab-4ae3-bdde-2918d8068573 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:12:44.243902 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-19230789-a9ab-4ae3-bdde-2918d8068573 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:12:44.244343 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-19230789-a9ab-4ae3-bdde-2918d8068573 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:12:44.245066 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-19230789-a9ab-4ae3-bdde-2918d8068573 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:12:44.245520 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-19230789-a9ab-4ae3-bdde-2918d8068573 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:12:44.245948 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-19230789-a9ab-4ae3-bdde-2918d8068573 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:12:44.276349 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-19230789-a9ab-4ae3-bdde-2918d8068573 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045578 Oct 20 06:12:44.276932 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 495/976] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:12:44 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:12:45.004960 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-4fb19a82-04fa-4c23-8a37-281597a63f36 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:12:45.005570 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-4fb19a82-04fa-4c23-8a37-281597a63f36 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:12:45.011981 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-4fb19a82-04fa-4c23-8a37-281597a63f36 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:12:45.012463 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-4fb19a82-04fa-4c23-8a37-281597a63f36 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:12:45.012937 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-4fb19a82-04fa-4c23-8a37-281597a63f36 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:12:45.013628 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-4fb19a82-04fa-4c23-8a37-281597a63f36 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:12:45.014082 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-4fb19a82-04fa-4c23-8a37-281597a63f36 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:12:45.014515 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-4fb19a82-04fa-4c23-8a37-281597a63f36 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:12:45.141567 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-4fb19a82-04fa-4c23-8a37-281597a63f36 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:12:45.150781 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-4fb19a82-04fa-4c23-8a37-281597a63f36 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:12:45.152223 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-4fb19a82-04fa-4c23-8a37-281597a63f36 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:12:45.153499 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-4fb19a82-04fa-4c23-8a37-281597a63f36 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1745 microversion: 2.20 time: 0.152669 Oct 20 06:12:45.154074 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 482/977] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:12:44 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1745 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:12:45.289279 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-10e63d20-9466-4f40-9742-19d6527c41aa tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:12:45.291426 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-10e63d20-9466-4f40-9742-19d6527c41aa tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:12:45.297811 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-10e63d20-9466-4f40-9742-19d6527c41aa tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:12:45.298292 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-10e63d20-9466-4f40-9742-19d6527c41aa tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:12:45.298772 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-10e63d20-9466-4f40-9742-19d6527c41aa tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:12:45.299470 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-10e63d20-9466-4f40-9742-19d6527c41aa tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:12:45.299917 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-10e63d20-9466-4f40-9742-19d6527c41aa tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:12:45.300345 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-10e63d20-9466-4f40-9742-19d6527c41aa tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:12:45.329478 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-10e63d20-9466-4f40-9742-19d6527c41aa tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044816 Oct 20 06:12:45.330028 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 496/978] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:12:45 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:12:46.180078 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-af4d1955-564b-47d5-b32c-28713c138e68 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:12:46.180587 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-af4d1955-564b-47d5-b32c-28713c138e68 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:12:46.187008 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-af4d1955-564b-47d5-b32c-28713c138e68 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:12:46.187483 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-af4d1955-564b-47d5-b32c-28713c138e68 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:12:46.187913 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-af4d1955-564b-47d5-b32c-28713c138e68 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:12:46.188594 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-af4d1955-564b-47d5-b32c-28713c138e68 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:12:46.189069 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-af4d1955-564b-47d5-b32c-28713c138e68 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:12:46.189518 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-af4d1955-564b-47d5-b32c-28713c138e68 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:12:46.317733 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-af4d1955-564b-47d5-b32c-28713c138e68 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:12:46.326726 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-af4d1955-564b-47d5-b32c-28713c138e68 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:12:46.328144 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-af4d1955-564b-47d5-b32c-28713c138e68 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:12:46.329298 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-af4d1955-564b-47d5-b32c-28713c138e68 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1745 microversion: 2.20 time: 0.153290 Oct 20 06:12:46.329844 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 483/979] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:12:46 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1745 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:12:46.342174 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-4a808b19-6d6f-4050-a02c-963f5acd4010 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:12:46.344334 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-4a808b19-6d6f-4050-a02c-963f5acd4010 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:12:46.350703 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4a808b19-6d6f-4050-a02c-963f5acd4010 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:12:46.351183 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4a808b19-6d6f-4050-a02c-963f5acd4010 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:12:46.351620 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4a808b19-6d6f-4050-a02c-963f5acd4010 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:12:46.352315 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4a808b19-6d6f-4050-a02c-963f5acd4010 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:12:46.352798 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4a808b19-6d6f-4050-a02c-963f5acd4010 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:12:46.353229 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4a808b19-6d6f-4050-a02c-963f5acd4010 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:12:46.382607 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-4a808b19-6d6f-4050-a02c-963f5acd4010 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044422 Oct 20 06:12:46.383149 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 497/980] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:12:46 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:12:47.354828 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-58f782be-3264-40c6-a055-5e2e1d4c19e3 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:12:47.355430 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-58f782be-3264-40c6-a055-5e2e1d4c19e3 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:12:47.362052 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-58f782be-3264-40c6-a055-5e2e1d4c19e3 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:12:47.362551 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-58f782be-3264-40c6-a055-5e2e1d4c19e3 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:12:47.362995 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-58f782be-3264-40c6-a055-5e2e1d4c19e3 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:12:47.363910 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-58f782be-3264-40c6-a055-5e2e1d4c19e3 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:12:47.364544 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-58f782be-3264-40c6-a055-5e2e1d4c19e3 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:12:47.365018 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-58f782be-3264-40c6-a055-5e2e1d4c19e3 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:12:47.395175 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-5b1b1e4c-d7d4-4d06-93d8-ab0b84d9f336 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:12:47.398151 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-5b1b1e4c-d7d4-4d06-93d8-ab0b84d9f336 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:12:47.404346 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5b1b1e4c-d7d4-4d06-93d8-ab0b84d9f336 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:12:47.404871 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5b1b1e4c-d7d4-4d06-93d8-ab0b84d9f336 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:12:47.405312 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5b1b1e4c-d7d4-4d06-93d8-ab0b84d9f336 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:12:47.406014 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5b1b1e4c-d7d4-4d06-93d8-ab0b84d9f336 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:12:47.406472 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5b1b1e4c-d7d4-4d06-93d8-ab0b84d9f336 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:12:47.406899 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5b1b1e4c-d7d4-4d06-93d8-ab0b84d9f336 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:12:47.439804 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-5b1b1e4c-d7d4-4d06-93d8-ab0b84d9f336 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048628 Oct 20 06:12:47.440397 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 498/981] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:12:47 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 20 06:12:47.540961 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-58f782be-3264-40c6-a055-5e2e1d4c19e3 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:12:47.551674 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-58f782be-3264-40c6-a055-5e2e1d4c19e3 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:12:47.554084 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-58f782be-3264-40c6-a055-5e2e1d4c19e3 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:12:47.555343 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-58f782be-3264-40c6-a055-5e2e1d4c19e3 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1745 microversion: 2.20 time: 0.204455 Oct 20 06:12:47.556210 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 484/982] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:12:47 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1745 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:12:48.451484 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-4f584ea6-960c-4419-89c3-de646a9873be tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:12:48.453679 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-4f584ea6-960c-4419-89c3-de646a9873be tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:12:48.459940 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4f584ea6-960c-4419-89c3-de646a9873be tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:12:48.460417 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4f584ea6-960c-4419-89c3-de646a9873be tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:12:48.460892 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4f584ea6-960c-4419-89c3-de646a9873be tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:12:48.464307 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4f584ea6-960c-4419-89c3-de646a9873be tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:12:48.464307 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4f584ea6-960c-4419-89c3-de646a9873be tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:12:48.464307 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4f584ea6-960c-4419-89c3-de646a9873be tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:12:48.492094 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-4f584ea6-960c-4419-89c3-de646a9873be tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044497 Oct 20 06:12:48.492651 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 499/983] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:12:48 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:12:48.581697 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-35f68248-c736-4689-9dfd-5ce7221b11f4 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:12:48.582267 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-35f68248-c736-4689-9dfd-5ce7221b11f4 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:12:48.589096 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-35f68248-c736-4689-9dfd-5ce7221b11f4 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:12:48.589589 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-35f68248-c736-4689-9dfd-5ce7221b11f4 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:12:48.590030 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-35f68248-c736-4689-9dfd-5ce7221b11f4 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:12:48.590733 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-35f68248-c736-4689-9dfd-5ce7221b11f4 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:12:48.591193 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-35f68248-c736-4689-9dfd-5ce7221b11f4 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:12:48.591623 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-35f68248-c736-4689-9dfd-5ce7221b11f4 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:12:48.595648 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG dbcounter [-] [118860] Writing DB stats nova_cell1:SELECT=100 {{(pid=118860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:12:48.727085 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-35f68248-c736-4689-9dfd-5ce7221b11f4 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:12:48.736661 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-35f68248-c736-4689-9dfd-5ce7221b11f4 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:12:48.738165 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-35f68248-c736-4689-9dfd-5ce7221b11f4 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:12:48.739336 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-35f68248-c736-4689-9dfd-5ce7221b11f4 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1745 microversion: 2.20 time: 0.161675 Oct 20 06:12:48.739886 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 485/984] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:12:48 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1745 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:12:49.505269 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-c1928239-a79b-422d-b77c-f90660ef5e63 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:12:49.508059 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-c1928239-a79b-422d-b77c-f90660ef5e63 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:12:49.514737 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c1928239-a79b-422d-b77c-f90660ef5e63 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:12:49.515223 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c1928239-a79b-422d-b77c-f90660ef5e63 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:12:49.515652 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c1928239-a79b-422d-b77c-f90660ef5e63 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:12:49.516344 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c1928239-a79b-422d-b77c-f90660ef5e63 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:12:49.516821 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c1928239-a79b-422d-b77c-f90660ef5e63 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:12:49.517239 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c1928239-a79b-422d-b77c-f90660ef5e63 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:12:49.547461 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-c1928239-a79b-422d-b77c-f90660ef5e63 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046695 Oct 20 06:12:49.548006 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 500/985] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:12:49 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:12:49.765824 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-30714140-172d-4187-a01c-f04f386bedbc tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:12:49.766426 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-30714140-172d-4187-a01c-f04f386bedbc tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:12:49.772992 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-30714140-172d-4187-a01c-f04f386bedbc tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:12:49.773469 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-30714140-172d-4187-a01c-f04f386bedbc tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:12:49.773898 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-30714140-172d-4187-a01c-f04f386bedbc tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:12:49.774577 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-30714140-172d-4187-a01c-f04f386bedbc tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:12:49.775029 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-30714140-172d-4187-a01c-f04f386bedbc tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:12:49.775451 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-30714140-172d-4187-a01c-f04f386bedbc tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:12:49.912899 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-30714140-172d-4187-a01c-f04f386bedbc tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:12:49.921797 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-30714140-172d-4187-a01c-f04f386bedbc tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:12:49.923208 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-30714140-172d-4187-a01c-f04f386bedbc tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:12:49.924485 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-30714140-172d-4187-a01c-f04f386bedbc tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1745 microversion: 2.20 time: 0.162450 Oct 20 06:12:49.925017 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 486/986] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:12:49 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1745 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:12:50.559650 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-bf0007ad-d895-4416-8748-92f861f12371 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:12:50.561826 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-bf0007ad-d895-4416-8748-92f861f12371 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:12:50.568193 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-bf0007ad-d895-4416-8748-92f861f12371 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:12:50.568678 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-bf0007ad-d895-4416-8748-92f861f12371 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:12:50.569159 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-bf0007ad-d895-4416-8748-92f861f12371 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:12:50.569853 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-bf0007ad-d895-4416-8748-92f861f12371 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:12:50.570458 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-bf0007ad-d895-4416-8748-92f861f12371 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:12:50.570894 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-bf0007ad-d895-4416-8748-92f861f12371 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:12:50.600314 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-bf0007ad-d895-4416-8748-92f861f12371 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044785 Oct 20 06:12:50.600898 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 501/987] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:12:50 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:12:50.952848 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-2289275c-6698-48cd-accd-bbf21c0fa07c tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:12:50.953454 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-2289275c-6698-48cd-accd-bbf21c0fa07c tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:12:50.960110 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2289275c-6698-48cd-accd-bbf21c0fa07c tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:12:50.961286 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2289275c-6698-48cd-accd-bbf21c0fa07c tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:12:50.961734 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2289275c-6698-48cd-accd-bbf21c0fa07c tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:12:50.962482 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2289275c-6698-48cd-accd-bbf21c0fa07c tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:12:50.962929 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2289275c-6698-48cd-accd-bbf21c0fa07c tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:12:50.963356 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2289275c-6698-48cd-accd-bbf21c0fa07c tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:12:51.093900 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-2289275c-6698-48cd-accd-bbf21c0fa07c tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:12:51.102474 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-2289275c-6698-48cd-accd-bbf21c0fa07c tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:12:51.103916 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-2289275c-6698-48cd-accd-bbf21c0fa07c tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:12:51.105096 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-2289275c-6698-48cd-accd-bbf21c0fa07c tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1745 microversion: 2.20 time: 0.156308 Oct 20 06:12:51.105656 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 487/988] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:12:50 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1745 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:12:51.613798 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-1f37d8cd-2deb-45ec-a9dc-96ea450f9528 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:12:51.615891 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-1f37d8cd-2deb-45ec-a9dc-96ea450f9528 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:12:51.623258 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1f37d8cd-2deb-45ec-a9dc-96ea450f9528 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:12:51.623736 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1f37d8cd-2deb-45ec-a9dc-96ea450f9528 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:12:51.624172 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1f37d8cd-2deb-45ec-a9dc-96ea450f9528 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:12:51.624888 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1f37d8cd-2deb-45ec-a9dc-96ea450f9528 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:12:51.625339 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1f37d8cd-2deb-45ec-a9dc-96ea450f9528 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:12:51.625761 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1f37d8cd-2deb-45ec-a9dc-96ea450f9528 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:12:51.629770 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG dbcounter [-] [118861] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=118861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:12:51.656723 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-1f37d8cd-2deb-45ec-a9dc-96ea450f9528 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047060 Oct 20 06:12:51.657269 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 502/989] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:12:51 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:12:52.131087 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-01794e78-88ed-4fde-9cdb-347cbeb72054 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:12:52.131690 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-01794e78-88ed-4fde-9cdb-347cbeb72054 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:12:52.138187 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-01794e78-88ed-4fde-9cdb-347cbeb72054 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:12:52.138661 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-01794e78-88ed-4fde-9cdb-347cbeb72054 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:12:52.139100 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-01794e78-88ed-4fde-9cdb-347cbeb72054 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:12:52.139784 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-01794e78-88ed-4fde-9cdb-347cbeb72054 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:12:52.140233 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-01794e78-88ed-4fde-9cdb-347cbeb72054 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:12:52.140653 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-01794e78-88ed-4fde-9cdb-347cbeb72054 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:12:52.270274 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-01794e78-88ed-4fde-9cdb-347cbeb72054 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:12:52.279569 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-01794e78-88ed-4fde-9cdb-347cbeb72054 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:12:52.281054 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-01794e78-88ed-4fde-9cdb-347cbeb72054 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:12:52.282205 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-01794e78-88ed-4fde-9cdb-347cbeb72054 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1745 microversion: 2.20 time: 0.155417 Oct 20 06:12:52.282750 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 488/990] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:12:52 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1745 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:12:52.669359 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-5e10a09e-5e62-4363-adbe-bee1f1983be4 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:12:52.671490 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-5e10a09e-5e62-4363-adbe-bee1f1983be4 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:12:52.678095 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5e10a09e-5e62-4363-adbe-bee1f1983be4 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:12:52.678571 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5e10a09e-5e62-4363-adbe-bee1f1983be4 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:12:52.679004 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5e10a09e-5e62-4363-adbe-bee1f1983be4 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:12:52.679804 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5e10a09e-5e62-4363-adbe-bee1f1983be4 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:12:52.680248 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5e10a09e-5e62-4363-adbe-bee1f1983be4 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:12:52.680668 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5e10a09e-5e62-4363-adbe-bee1f1983be4 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:12:52.710987 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-5e10a09e-5e62-4363-adbe-bee1f1983be4 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045055 Oct 20 06:12:52.711651 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 503/991] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:12:52 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:12:53.307454 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-d066119c-f13b-404e-8470-fa88f61cb620 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:12:53.308053 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-d066119c-f13b-404e-8470-fa88f61cb620 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:12:53.315006 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-d066119c-f13b-404e-8470-fa88f61cb620 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:12:53.315482 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-d066119c-f13b-404e-8470-fa88f61cb620 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:12:53.315919 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-d066119c-f13b-404e-8470-fa88f61cb620 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:12:53.316600 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-d066119c-f13b-404e-8470-fa88f61cb620 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:12:53.317072 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-d066119c-f13b-404e-8470-fa88f61cb620 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:12:53.317711 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-d066119c-f13b-404e-8470-fa88f61cb620 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:12:53.450241 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-d066119c-f13b-404e-8470-fa88f61cb620 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:12:53.458903 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-d066119c-f13b-404e-8470-fa88f61cb620 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:12:53.460361 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-d066119c-f13b-404e-8470-fa88f61cb620 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:12:53.461539 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-d066119c-f13b-404e-8470-fa88f61cb620 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1745 microversion: 2.20 time: 0.157980 Oct 20 06:12:53.462085 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 489/992] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:12:53 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1745 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:12:53.723584 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-f30bc563-1af7-40f3-bdef-3297f458a410 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:12:53.725757 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-f30bc563-1af7-40f3-bdef-3297f458a410 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:12:53.732645 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f30bc563-1af7-40f3-bdef-3297f458a410 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:12:53.733170 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f30bc563-1af7-40f3-bdef-3297f458a410 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:12:53.733613 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f30bc563-1af7-40f3-bdef-3297f458a410 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:12:53.734306 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f30bc563-1af7-40f3-bdef-3297f458a410 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:12:53.734760 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f30bc563-1af7-40f3-bdef-3297f458a410 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:12:53.735185 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f30bc563-1af7-40f3-bdef-3297f458a410 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:12:53.765647 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-f30bc563-1af7-40f3-bdef-3297f458a410 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046076 Oct 20 06:12:53.766197 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 504/993] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:12:53 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:12:54.485576 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-79f5bd47-7e77-49ad-bd89-8372039598fd tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:12:54.486139 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-79f5bd47-7e77-49ad-bd89-8372039598fd tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:12:54.493415 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-79f5bd47-7e77-49ad-bd89-8372039598fd tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:12:54.493900 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-79f5bd47-7e77-49ad-bd89-8372039598fd tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:12:54.494337 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-79f5bd47-7e77-49ad-bd89-8372039598fd tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:12:54.495032 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-79f5bd47-7e77-49ad-bd89-8372039598fd tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:12:54.495484 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-79f5bd47-7e77-49ad-bd89-8372039598fd tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:12:54.495910 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-79f5bd47-7e77-49ad-bd89-8372039598fd tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:12:54.626549 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-79f5bd47-7e77-49ad-bd89-8372039598fd tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:12:54.635424 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-79f5bd47-7e77-49ad-bd89-8372039598fd tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:12:54.636897 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-79f5bd47-7e77-49ad-bd89-8372039598fd tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:12:54.638054 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-79f5bd47-7e77-49ad-bd89-8372039598fd tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1745 microversion: 2.20 time: 0.156473 Oct 20 06:12:54.638827 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 490/994] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:12:54 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1745 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:12:54.778254 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-330e2cc2-9a3d-4d92-b67c-80614b963848 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:12:54.780434 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-330e2cc2-9a3d-4d92-b67c-80614b963848 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:12:54.786715 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-330e2cc2-9a3d-4d92-b67c-80614b963848 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:12:54.787195 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-330e2cc2-9a3d-4d92-b67c-80614b963848 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:12:54.787634 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-330e2cc2-9a3d-4d92-b67c-80614b963848 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:12:54.788323 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-330e2cc2-9a3d-4d92-b67c-80614b963848 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:12:54.789804 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-330e2cc2-9a3d-4d92-b67c-80614b963848 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:12:54.790290 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-330e2cc2-9a3d-4d92-b67c-80614b963848 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:12:54.822553 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-330e2cc2-9a3d-4d92-b67c-80614b963848 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048237 Oct 20 06:12:54.823107 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 505/995] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:12:54 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 20 06:12:55.663761 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-05b6f580-840e-41c5-90ec-f4d37751b645 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:12:55.664523 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-05b6f580-840e-41c5-90ec-f4d37751b645 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:12:55.670911 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-05b6f580-840e-41c5-90ec-f4d37751b645 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:12:55.671388 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-05b6f580-840e-41c5-90ec-f4d37751b645 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:12:55.671820 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-05b6f580-840e-41c5-90ec-f4d37751b645 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:12:55.672504 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-05b6f580-840e-41c5-90ec-f4d37751b645 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:12:55.672981 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-05b6f580-840e-41c5-90ec-f4d37751b645 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:12:55.673406 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-05b6f580-840e-41c5-90ec-f4d37751b645 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:12:55.816939 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-05b6f580-840e-41c5-90ec-f4d37751b645 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:12:55.826149 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-05b6f580-840e-41c5-90ec-f4d37751b645 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:12:55.827583 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-05b6f580-840e-41c5-90ec-f4d37751b645 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:12:55.828753 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-05b6f580-840e-41c5-90ec-f4d37751b645 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1745 microversion: 2.20 time: 0.169097 Oct 20 06:12:55.829305 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 491/996] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:12:55 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1745 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:12:55.834822 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-2ff2f182-b288-447a-8b7c-3790fd088ea2 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:12:55.837151 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-2ff2f182-b288-447a-8b7c-3790fd088ea2 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:12:55.843465 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-2ff2f182-b288-447a-8b7c-3790fd088ea2 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:12:55.843984 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-2ff2f182-b288-447a-8b7c-3790fd088ea2 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:12:55.844429 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-2ff2f182-b288-447a-8b7c-3790fd088ea2 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:12:55.845152 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-2ff2f182-b288-447a-8b7c-3790fd088ea2 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:12:55.845611 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-2ff2f182-b288-447a-8b7c-3790fd088ea2 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:12:55.846039 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-2ff2f182-b288-447a-8b7c-3790fd088ea2 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:12:55.875398 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-2ff2f182-b288-447a-8b7c-3790fd088ea2 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044564 Oct 20 06:12:55.875960 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 506/997] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:12:55 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:12:56.854450 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-30eae0c8-d362-4fab-b399-a7a2a375c3fd tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:12:56.855069 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-30eae0c8-d362-4fab-b399-a7a2a375c3fd tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:12:56.859064 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 20 06:12:56.859245 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: Thu Oct 20 06:12:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d (ip 10.222.0.20) !!! Oct 20 06:12:56.863998 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-30eae0c8-d362-4fab-b399-a7a2a375c3fd tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:12:56.864737 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-30eae0c8-d362-4fab-b399-a7a2a375c3fd tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:12:56.865363 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-30eae0c8-d362-4fab-b399-a7a2a375c3fd tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:12:56.866081 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-30eae0c8-d362-4fab-b399-a7a2a375c3fd tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:12:56.866536 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-30eae0c8-d362-4fab-b399-a7a2a375c3fd tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:12:56.867133 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-30eae0c8-d362-4fab-b399-a7a2a375c3fd tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:12:56.889235 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-fb2030ac-09b7-44d6-ba85-c90c5f10b3d0 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:12:56.891724 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-fb2030ac-09b7-44d6-ba85-c90c5f10b3d0 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:12:56.897239 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-fb2030ac-09b7-44d6-ba85-c90c5f10b3d0 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:12:56.897856 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-fb2030ac-09b7-44d6-ba85-c90c5f10b3d0 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:12:56.898806 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-fb2030ac-09b7-44d6-ba85-c90c5f10b3d0 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:12:56.899508 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-fb2030ac-09b7-44d6-ba85-c90c5f10b3d0 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:12:56.899956 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-fb2030ac-09b7-44d6-ba85-c90c5f10b3d0 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:12:56.900383 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-fb2030ac-09b7-44d6-ba85-c90c5f10b3d0 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:12:56.930022 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-fb2030ac-09b7-44d6-ba85-c90c5f10b3d0 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045302 Oct 20 06:12:56.931295 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 507/998] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:12:56 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 20 06:12:56.998974 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-30eae0c8-d362-4fab-b399-a7a2a375c3fd tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:12:57.008948 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-30eae0c8-d362-4fab-b399-a7a2a375c3fd tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:12:57.010400 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-30eae0c8-d362-4fab-b399-a7a2a375c3fd tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:12:57.011565 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-30eae0c8-d362-4fab-b399-a7a2a375c3fd tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1745 microversion: 2.20 time: 0.161026 Oct 20 06:12:57.012115 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 492/999] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:12:56 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1745 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:12:57.942714 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-7ef95010-4cf5-42bd-bbd9-3dea5d7a82d0 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:12:57.945575 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-7ef95010-4cf5-42bd-bbd9-3dea5d7a82d0 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:12:57.951693 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7ef95010-4cf5-42bd-bbd9-3dea5d7a82d0 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:12:57.952175 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7ef95010-4cf5-42bd-bbd9-3dea5d7a82d0 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:12:57.952642 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7ef95010-4cf5-42bd-bbd9-3dea5d7a82d0 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:12:57.953673 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7ef95010-4cf5-42bd-bbd9-3dea5d7a82d0 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:12:57.953811 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7ef95010-4cf5-42bd-bbd9-3dea5d7a82d0 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:12:57.954245 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7ef95010-4cf5-42bd-bbd9-3dea5d7a82d0 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:12:57.988601 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-7ef95010-4cf5-42bd-bbd9-3dea5d7a82d0 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049800 Oct 20 06:12:57.989224 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 508/1000] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:12:57 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:12:58.039306 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-e3292ee4-30e3-4fa8-be2e-24dde9a550e9 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:12:58.040041 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-e3292ee4-30e3-4fa8-be2e-24dde9a550e9 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:12:58.046388 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e3292ee4-30e3-4fa8-be2e-24dde9a550e9 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:12:58.046864 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e3292ee4-30e3-4fa8-be2e-24dde9a550e9 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:12:58.047289 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e3292ee4-30e3-4fa8-be2e-24dde9a550e9 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:12:58.047968 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e3292ee4-30e3-4fa8-be2e-24dde9a550e9 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:12:58.048419 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e3292ee4-30e3-4fa8-be2e-24dde9a550e9 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:12:58.048870 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e3292ee4-30e3-4fa8-be2e-24dde9a550e9 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:12:58.176369 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-e3292ee4-30e3-4fa8-be2e-24dde9a550e9 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:12:58.185110 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-e3292ee4-30e3-4fa8-be2e-24dde9a550e9 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:12:58.186559 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-e3292ee4-30e3-4fa8-be2e-24dde9a550e9 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:12:58.187707 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-e3292ee4-30e3-4fa8-be2e-24dde9a550e9 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1745 microversion: 2.20 time: 0.152852 Oct 20 06:12:58.188259 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 493/1001] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:12:58 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1745 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 20 06:12:59.001699 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-c3659a5d-fceb-412c-a198-915dc8348f17 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:12:59.004130 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-c3659a5d-fceb-412c-a198-915dc8348f17 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:12:59.010814 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c3659a5d-fceb-412c-a198-915dc8348f17 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:12:59.011287 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c3659a5d-fceb-412c-a198-915dc8348f17 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:12:59.011717 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c3659a5d-fceb-412c-a198-915dc8348f17 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:12:59.012400 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c3659a5d-fceb-412c-a198-915dc8348f17 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:12:59.012885 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c3659a5d-fceb-412c-a198-915dc8348f17 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:12:59.013306 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c3659a5d-fceb-412c-a198-915dc8348f17 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:12:59.042399 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-c3659a5d-fceb-412c-a198-915dc8348f17 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044584 Oct 20 06:12:59.042950 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 509/1002] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:12:58 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:12:59.212589 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-b93daabd-700e-4a6e-ac4b-244b180c7040 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:12:59.213305 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-b93daabd-700e-4a6e-ac4b-244b180c7040 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:12:59.220103 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b93daabd-700e-4a6e-ac4b-244b180c7040 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:12:59.220592 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b93daabd-700e-4a6e-ac4b-244b180c7040 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:12:59.221075 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b93daabd-700e-4a6e-ac4b-244b180c7040 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:12:59.221834 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b93daabd-700e-4a6e-ac4b-244b180c7040 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:12:59.222387 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b93daabd-700e-4a6e-ac4b-244b180c7040 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:12:59.222819 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b93daabd-700e-4a6e-ac4b-244b180c7040 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:12:59.383511 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-b93daabd-700e-4a6e-ac4b-244b180c7040 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:12:59.393756 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-b93daabd-700e-4a6e-ac4b-244b180c7040 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:12:59.395291 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-b93daabd-700e-4a6e-ac4b-244b180c7040 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:12:59.396546 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-b93daabd-700e-4a6e-ac4b-244b180c7040 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1745 microversion: 2.20 time: 0.188103 Oct 20 06:12:59.401046 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 494/1003] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:12:59 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1745 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:13:00.054816 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-e72ca094-ae3e-4464-b0de-f15987061116 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:13:00.057024 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-e72ca094-ae3e-4464-b0de-f15987061116 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:13:00.063381 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e72ca094-ae3e-4464-b0de-f15987061116 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:13:00.063871 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e72ca094-ae3e-4464-b0de-f15987061116 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:13:00.064313 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e72ca094-ae3e-4464-b0de-f15987061116 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:13:00.065043 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e72ca094-ae3e-4464-b0de-f15987061116 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:13:00.065506 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e72ca094-ae3e-4464-b0de-f15987061116 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:13:00.065935 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e72ca094-ae3e-4464-b0de-f15987061116 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:13:00.095587 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-e72ca094-ae3e-4464-b0de-f15987061116 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044876 Oct 20 06:13:00.096131 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 510/1004] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:13:00 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:13:00.430719 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-2ba45038-3a16-4dd4-93f7-2bc6910904f5 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:13:00.431343 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-2ba45038-3a16-4dd4-93f7-2bc6910904f5 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:13:00.438132 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2ba45038-3a16-4dd4-93f7-2bc6910904f5 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:13:00.438616 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2ba45038-3a16-4dd4-93f7-2bc6910904f5 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:13:00.439047 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2ba45038-3a16-4dd4-93f7-2bc6910904f5 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:13:00.439747 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2ba45038-3a16-4dd4-93f7-2bc6910904f5 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:13:00.440229 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2ba45038-3a16-4dd4-93f7-2bc6910904f5 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:13:00.440652 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2ba45038-3a16-4dd4-93f7-2bc6910904f5 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:13:00.575755 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-2ba45038-3a16-4dd4-93f7-2bc6910904f5 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:13:00.584339 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-2ba45038-3a16-4dd4-93f7-2bc6910904f5 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:13:00.585816 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-2ba45038-3a16-4dd4-93f7-2bc6910904f5 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:13:00.586970 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-2ba45038-3a16-4dd4-93f7-2bc6910904f5 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1745 microversion: 2.20 time: 0.161092 Oct 20 06:13:00.587541 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 495/1005] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:13:00 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1745 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:13:01.107494 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-c4f5f905-dd5a-4771-83a8-991f92ca90b3 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:13:01.109691 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-c4f5f905-dd5a-4771-83a8-991f92ca90b3 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:13:01.116011 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c4f5f905-dd5a-4771-83a8-991f92ca90b3 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:13:01.117177 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c4f5f905-dd5a-4771-83a8-991f92ca90b3 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:13:01.117637 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c4f5f905-dd5a-4771-83a8-991f92ca90b3 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:13:01.118371 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c4f5f905-dd5a-4771-83a8-991f92ca90b3 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:13:01.118826 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c4f5f905-dd5a-4771-83a8-991f92ca90b3 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:13:01.119263 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c4f5f905-dd5a-4771-83a8-991f92ca90b3 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:13:01.148893 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-c4f5f905-dd5a-4771-83a8-991f92ca90b3 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045282 Oct 20 06:13:01.149445 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 511/1006] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:13:01 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:13:01.614973 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-0efc537c-4c28-494f-bb4c-a6114bdebc8c tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:13:01.615585 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-0efc537c-4c28-494f-bb4c-a6114bdebc8c tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:13:01.622422 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0efc537c-4c28-494f-bb4c-a6114bdebc8c tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:13:01.622905 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0efc537c-4c28-494f-bb4c-a6114bdebc8c tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:13:01.623337 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0efc537c-4c28-494f-bb4c-a6114bdebc8c tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:13:01.624030 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0efc537c-4c28-494f-bb4c-a6114bdebc8c tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:13:01.624480 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0efc537c-4c28-494f-bb4c-a6114bdebc8c tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:13:01.624937 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0efc537c-4c28-494f-bb4c-a6114bdebc8c tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:13:01.753414 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-0efc537c-4c28-494f-bb4c-a6114bdebc8c tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:13:01.762018 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-0efc537c-4c28-494f-bb4c-a6114bdebc8c tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:13:01.763437 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-0efc537c-4c28-494f-bb4c-a6114bdebc8c tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:13:01.764580 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-0efc537c-4c28-494f-bb4c-a6114bdebc8c tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1745 microversion: 2.20 time: 0.155681 Oct 20 06:13:01.765163 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 496/1007] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:13:01 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1745 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:13:02.161075 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-9e65d43d-a54d-4187-be8d-a9a708d17aff tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:13:02.163802 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-9e65d43d-a54d-4187-be8d-a9a708d17aff tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:13:02.170433 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-9e65d43d-a54d-4187-be8d-a9a708d17aff tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:13:02.170918 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-9e65d43d-a54d-4187-be8d-a9a708d17aff tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:13:02.171351 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-9e65d43d-a54d-4187-be8d-a9a708d17aff tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:13:02.172051 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-9e65d43d-a54d-4187-be8d-a9a708d17aff tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:13:02.172549 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-9e65d43d-a54d-4187-be8d-a9a708d17aff tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:13:02.173020 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-9e65d43d-a54d-4187-be8d-a9a708d17aff tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:13:02.202521 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-9e65d43d-a54d-4187-be8d-a9a708d17aff tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045326 Oct 20 06:13:02.203080 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 512/1008] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:13:02 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:13:02.790929 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-1e60f4a6-3497-4565-9bdf-b499047aa9df tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:13:02.791537 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-1e60f4a6-3497-4565-9bdf-b499047aa9df tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:13:02.793908 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG dbcounter [-] [118860] Writing DB stats nova_api:SELECT=54 {{(pid=118860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:13:02.799264 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1e60f4a6-3497-4565-9bdf-b499047aa9df tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:13:02.799749 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1e60f4a6-3497-4565-9bdf-b499047aa9df tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:13:02.800190 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1e60f4a6-3497-4565-9bdf-b499047aa9df tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:13:02.800930 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1e60f4a6-3497-4565-9bdf-b499047aa9df tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:13:02.801390 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1e60f4a6-3497-4565-9bdf-b499047aa9df tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:13:02.801822 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1e60f4a6-3497-4565-9bdf-b499047aa9df tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:13:02.927149 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-1e60f4a6-3497-4565-9bdf-b499047aa9df tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:13:02.936334 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-1e60f4a6-3497-4565-9bdf-b499047aa9df tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:13:02.937799 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-1e60f4a6-3497-4565-9bdf-b499047aa9df tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:13:02.938957 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-1e60f4a6-3497-4565-9bdf-b499047aa9df tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1745 microversion: 2.20 time: 0.152620 Oct 20 06:13:02.939519 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 497/1009] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:13:02 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1745 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:13:03.215728 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-c92d4391-5efd-4279-8029-2addb69a46c6 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:13:03.217991 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-c92d4391-5efd-4279-8029-2addb69a46c6 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:13:03.220399 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG dbcounter [-] [118861] Writing DB stats nova_api:SELECT=56 {{(pid=118861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:13:03.226511 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c92d4391-5efd-4279-8029-2addb69a46c6 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:13:03.227001 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c92d4391-5efd-4279-8029-2addb69a46c6 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:13:03.227443 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c92d4391-5efd-4279-8029-2addb69a46c6 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:13:03.228150 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c92d4391-5efd-4279-8029-2addb69a46c6 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:13:03.228605 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c92d4391-5efd-4279-8029-2addb69a46c6 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:13:03.229063 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c92d4391-5efd-4279-8029-2addb69a46c6 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:13:03.258710 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-c92d4391-5efd-4279-8029-2addb69a46c6 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047133 Oct 20 06:13:03.259271 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 513/1010] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:13:03 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:13:03.963631 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-6b5e5272-4edf-4baf-a8d1-0090d2047928 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:13:03.964245 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-6b5e5272-4edf-4baf-a8d1-0090d2047928 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:13:03.966226 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 20 06:13:03.966369 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: Thu Oct 20 06:13:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d (ip 10.222.0.20) !!! Oct 20 06:13:03.974232 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-6b5e5272-4edf-4baf-a8d1-0090d2047928 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:13:03.974721 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-6b5e5272-4edf-4baf-a8d1-0090d2047928 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:13:03.975160 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-6b5e5272-4edf-4baf-a8d1-0090d2047928 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:13:03.975976 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-6b5e5272-4edf-4baf-a8d1-0090d2047928 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:13:03.976481 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-6b5e5272-4edf-4baf-a8d1-0090d2047928 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:13:03.976940 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-6b5e5272-4edf-4baf-a8d1-0090d2047928 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:13:04.106511 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-6b5e5272-4edf-4baf-a8d1-0090d2047928 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:13:04.115004 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-6b5e5272-4edf-4baf-a8d1-0090d2047928 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:13:04.117019 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-6b5e5272-4edf-4baf-a8d1-0090d2047928 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:13:04.118164 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-6b5e5272-4edf-4baf-a8d1-0090d2047928 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1745 microversion: 2.20 time: 0.158424 Oct 20 06:13:04.118720 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 498/1011] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:13:03 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1745 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:13:04.270990 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-7996ee00-356e-4a24-bd81-3ee030beb34d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:13:04.273349 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-7996ee00-356e-4a24-bd81-3ee030beb34d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:13:04.280668 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7996ee00-356e-4a24-bd81-3ee030beb34d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:13:04.281201 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7996ee00-356e-4a24-bd81-3ee030beb34d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:13:04.281644 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7996ee00-356e-4a24-bd81-3ee030beb34d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:13:04.282354 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7996ee00-356e-4a24-bd81-3ee030beb34d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:13:04.282810 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7996ee00-356e-4a24-bd81-3ee030beb34d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:13:04.283242 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7996ee00-356e-4a24-bd81-3ee030beb34d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:13:04.314655 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-7996ee00-356e-4a24-bd81-3ee030beb34d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047494 Oct 20 06:13:04.315227 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 514/1012] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:13:04 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:13:05.144453 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-dada8f80-cd3e-4f8c-bd66-3a0d02bedd46 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:13:05.145087 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-dada8f80-cd3e-4f8c-bd66-3a0d02bedd46 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:13:05.152066 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-dada8f80-cd3e-4f8c-bd66-3a0d02bedd46 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:13:05.152543 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-dada8f80-cd3e-4f8c-bd66-3a0d02bedd46 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:13:05.153016 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-dada8f80-cd3e-4f8c-bd66-3a0d02bedd46 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:13:05.153700 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-dada8f80-cd3e-4f8c-bd66-3a0d02bedd46 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:13:05.154152 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-dada8f80-cd3e-4f8c-bd66-3a0d02bedd46 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:13:05.154570 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-dada8f80-cd3e-4f8c-bd66-3a0d02bedd46 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:13:05.279415 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-dada8f80-cd3e-4f8c-bd66-3a0d02bedd46 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:13:05.288153 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-dada8f80-cd3e-4f8c-bd66-3a0d02bedd46 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:13:05.290026 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-dada8f80-cd3e-4f8c-bd66-3a0d02bedd46 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:13:05.291170 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-dada8f80-cd3e-4f8c-bd66-3a0d02bedd46 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1745 microversion: 2.20 time: 0.150645 Oct 20 06:13:05.291722 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 499/1013] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:13:05 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1745 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:13:05.326550 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-174a1dba-ddd4-4638-bf96-7aec1b28f2bc tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:13:05.328707 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-174a1dba-ddd4-4638-bf96-7aec1b28f2bc tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:13:05.335631 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-174a1dba-ddd4-4638-bf96-7aec1b28f2bc tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:13:05.336370 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-174a1dba-ddd4-4638-bf96-7aec1b28f2bc tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:13:05.336838 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-174a1dba-ddd4-4638-bf96-7aec1b28f2bc tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:13:05.337565 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-174a1dba-ddd4-4638-bf96-7aec1b28f2bc tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:13:05.337981 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-174a1dba-ddd4-4638-bf96-7aec1b28f2bc tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:13:05.338407 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-174a1dba-ddd4-4638-bf96-7aec1b28f2bc tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:13:05.369117 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-174a1dba-ddd4-4638-bf96-7aec1b28f2bc tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046415 Oct 20 06:13:05.369668 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 515/1014] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:13:05 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:13:06.316552 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-8c7a9a46-4590-40d1-ab9f-24c167274949 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:13:06.317203 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-8c7a9a46-4590-40d1-ab9f-24c167274949 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:13:06.323747 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-8c7a9a46-4590-40d1-ab9f-24c167274949 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:13:06.324228 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-8c7a9a46-4590-40d1-ab9f-24c167274949 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:13:06.324664 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-8c7a9a46-4590-40d1-ab9f-24c167274949 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:13:06.325384 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-8c7a9a46-4590-40d1-ab9f-24c167274949 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:13:06.325838 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-8c7a9a46-4590-40d1-ab9f-24c167274949 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:13:06.326348 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-8c7a9a46-4590-40d1-ab9f-24c167274949 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:13:06.383426 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-4d59e913-708b-4cc0-af1a-894c5ea5a8a6 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:13:06.386379 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-4d59e913-708b-4cc0-af1a-894c5ea5a8a6 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:13:06.393149 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4d59e913-708b-4cc0-af1a-894c5ea5a8a6 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:13:06.393905 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4d59e913-708b-4cc0-af1a-894c5ea5a8a6 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:13:06.394479 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4d59e913-708b-4cc0-af1a-894c5ea5a8a6 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:13:06.395186 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4d59e913-708b-4cc0-af1a-894c5ea5a8a6 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:13:06.395641 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4d59e913-708b-4cc0-af1a-894c5ea5a8a6 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:13:06.396068 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4d59e913-708b-4cc0-af1a-894c5ea5a8a6 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:13:06.429078 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-4d59e913-708b-4cc0-af1a-894c5ea5a8a6 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051387 Oct 20 06:13:06.429652 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 516/1015] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:13:06 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 20 06:13:06.471548 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-8c7a9a46-4590-40d1-ab9f-24c167274949 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:13:06.480946 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-8c7a9a46-4590-40d1-ab9f-24c167274949 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:13:06.482391 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-8c7a9a46-4590-40d1-ab9f-24c167274949 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:13:06.483544 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-8c7a9a46-4590-40d1-ab9f-24c167274949 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1745 microversion: 2.20 time: 0.170904 Oct 20 06:13:06.484093 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 500/1016] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:13:06 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1745 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:13:07.442757 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-1916489b-d21f-4e35-a7ab-00f93a8f4424 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:13:07.446610 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-1916489b-d21f-4e35-a7ab-00f93a8f4424 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:13:07.453620 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1916489b-d21f-4e35-a7ab-00f93a8f4424 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:13:07.454465 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1916489b-d21f-4e35-a7ab-00f93a8f4424 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:13:07.454976 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1916489b-d21f-4e35-a7ab-00f93a8f4424 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:13:07.455739 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1916489b-d21f-4e35-a7ab-00f93a8f4424 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:13:07.456275 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1916489b-d21f-4e35-a7ab-00f93a8f4424 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:13:07.456684 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1916489b-d21f-4e35-a7ab-00f93a8f4424 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:13:07.486909 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-1916489b-d21f-4e35-a7ab-00f93a8f4424 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048202 Oct 20 06:13:07.487456 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 517/1017] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:13:07 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:13:07.509466 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-c6786281-28a0-495d-bcfe-ee6dd62466ca tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:13:07.510062 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-c6786281-28a0-495d-bcfe-ee6dd62466ca tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:13:07.516334 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c6786281-28a0-495d-bcfe-ee6dd62466ca tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:13:07.516853 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c6786281-28a0-495d-bcfe-ee6dd62466ca tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:13:07.517292 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c6786281-28a0-495d-bcfe-ee6dd62466ca tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:13:07.517965 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c6786281-28a0-495d-bcfe-ee6dd62466ca tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:13:07.518410 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c6786281-28a0-495d-bcfe-ee6dd62466ca tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:13:07.518827 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c6786281-28a0-495d-bcfe-ee6dd62466ca tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:13:07.788786 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-c6786281-28a0-495d-bcfe-ee6dd62466ca tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:13:07.792108 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG dbcounter [-] [118860] Writing DB stats nova_cell1:SELECT=100 {{(pid=118860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:13:07.798179 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-c6786281-28a0-495d-bcfe-ee6dd62466ca tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:13:07.799620 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-c6786281-28a0-495d-bcfe-ee6dd62466ca tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:13:07.800812 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-c6786281-28a0-495d-bcfe-ee6dd62466ca tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1745 microversion: 2.20 time: 0.295824 Oct 20 06:13:07.801364 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 501/1018] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:13:07 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1745 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:13:08.499862 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-fa86969f-3acd-4f3c-aa68-418b4a46d901 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:13:08.502518 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-fa86969f-3acd-4f3c-aa68-418b4a46d901 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:13:08.509682 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-fa86969f-3acd-4f3c-aa68-418b4a46d901 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:13:08.510168 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-fa86969f-3acd-4f3c-aa68-418b4a46d901 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:13:08.510728 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-fa86969f-3acd-4f3c-aa68-418b4a46d901 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:13:08.511430 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-fa86969f-3acd-4f3c-aa68-418b4a46d901 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:13:08.511874 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-fa86969f-3acd-4f3c-aa68-418b4a46d901 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:13:08.512324 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-fa86969f-3acd-4f3c-aa68-418b4a46d901 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:13:08.537226 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG dbcounter [-] [118861] Writing DB stats nova_cell1:SELECT=100 {{(pid=118861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:13:08.542593 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-fa86969f-3acd-4f3c-aa68-418b4a46d901 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047219 Oct 20 06:13:08.543154 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 518/1019] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:13:08 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:13:08.827779 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-846b3518-e4bc-43fd-a5c7-f16b0e0c4ac3 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:13:08.828309 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-846b3518-e4bc-43fd-a5c7-f16b0e0c4ac3 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:13:08.834986 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-846b3518-e4bc-43fd-a5c7-f16b0e0c4ac3 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:13:08.835649 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-846b3518-e4bc-43fd-a5c7-f16b0e0c4ac3 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:13:08.836099 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-846b3518-e4bc-43fd-a5c7-f16b0e0c4ac3 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:13:08.836784 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-846b3518-e4bc-43fd-a5c7-f16b0e0c4ac3 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:13:08.837235 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-846b3518-e4bc-43fd-a5c7-f16b0e0c4ac3 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:13:08.837654 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-846b3518-e4bc-43fd-a5c7-f16b0e0c4ac3 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:13:08.967916 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-846b3518-e4bc-43fd-a5c7-f16b0e0c4ac3 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:13:08.977217 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-846b3518-e4bc-43fd-a5c7-f16b0e0c4ac3 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:13:08.979448 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-846b3518-e4bc-43fd-a5c7-f16b0e0c4ac3 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:13:08.980753 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-846b3518-e4bc-43fd-a5c7-f16b0e0c4ac3 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1745 microversion: 2.20 time: 0.156931 Oct 20 06:13:08.981370 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 502/1020] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:13:08 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1745 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:13:09.568461 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-f1d53f1d-bf13-47db-bd64-2568e1eba364 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:13:09.571353 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-f1d53f1d-bf13-47db-bd64-2568e1eba364 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:13:09.580346 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f1d53f1d-bf13-47db-bd64-2568e1eba364 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:13:09.580926 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f1d53f1d-bf13-47db-bd64-2568e1eba364 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:13:09.581367 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f1d53f1d-bf13-47db-bd64-2568e1eba364 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:13:09.582128 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f1d53f1d-bf13-47db-bd64-2568e1eba364 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:13:09.582579 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f1d53f1d-bf13-47db-bd64-2568e1eba364 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:13:09.583196 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f1d53f1d-bf13-47db-bd64-2568e1eba364 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:13:09.614866 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-f1d53f1d-bf13-47db-bd64-2568e1eba364 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052757 Oct 20 06:13:09.615418 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 519/1021] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:13:09 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:13:10.010188 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-c36c235c-3afb-4f92-a305-09dc37be55f1 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:13:10.010791 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-c36c235c-3afb-4f92-a305-09dc37be55f1 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:13:10.017863 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c36c235c-3afb-4f92-a305-09dc37be55f1 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:13:10.018349 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c36c235c-3afb-4f92-a305-09dc37be55f1 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:13:10.018757 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c36c235c-3afb-4f92-a305-09dc37be55f1 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:13:10.019619 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c36c235c-3afb-4f92-a305-09dc37be55f1 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:13:10.020071 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c36c235c-3afb-4f92-a305-09dc37be55f1 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:13:10.020489 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c36c235c-3afb-4f92-a305-09dc37be55f1 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:13:10.151808 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-c36c235c-3afb-4f92-a305-09dc37be55f1 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:13:10.160559 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-c36c235c-3afb-4f92-a305-09dc37be55f1 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:13:10.162072 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-c36c235c-3afb-4f92-a305-09dc37be55f1 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:13:10.163462 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-c36c235c-3afb-4f92-a305-09dc37be55f1 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1745 microversion: 2.20 time: 0.159364 Oct 20 06:13:10.163995 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 503/1022] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:13:10 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1745 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:13:10.627569 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-1dc34249-c8be-4198-9579-b08c635a08bd tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:13:10.629827 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-1dc34249-c8be-4198-9579-b08c635a08bd tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:13:10.636570 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1dc34249-c8be-4198-9579-b08c635a08bd tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:13:10.637090 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1dc34249-c8be-4198-9579-b08c635a08bd tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:13:10.637532 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1dc34249-c8be-4198-9579-b08c635a08bd tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:13:10.638225 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1dc34249-c8be-4198-9579-b08c635a08bd tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:13:10.638681 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1dc34249-c8be-4198-9579-b08c635a08bd tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:13:10.639102 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1dc34249-c8be-4198-9579-b08c635a08bd tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:13:10.670407 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-1dc34249-c8be-4198-9579-b08c635a08bd tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046972 Oct 20 06:13:10.670959 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 520/1023] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:13:10 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:13:11.188949 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-7bbef152-d455-4096-abfb-461082ed34c1 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:13:11.189552 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-7bbef152-d455-4096-abfb-461082ed34c1 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:13:11.196594 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7bbef152-d455-4096-abfb-461082ed34c1 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:13:11.197102 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7bbef152-d455-4096-abfb-461082ed34c1 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:13:11.197531 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7bbef152-d455-4096-abfb-461082ed34c1 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:13:11.198216 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7bbef152-d455-4096-abfb-461082ed34c1 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:13:11.198668 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7bbef152-d455-4096-abfb-461082ed34c1 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:13:11.199088 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7bbef152-d455-4096-abfb-461082ed34c1 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:13:11.324275 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-7bbef152-d455-4096-abfb-461082ed34c1 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:13:11.333002 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-7bbef152-d455-4096-abfb-461082ed34c1 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:13:11.334438 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-7bbef152-d455-4096-abfb-461082ed34c1 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:13:11.336680 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-7bbef152-d455-4096-abfb-461082ed34c1 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1745 microversion: 2.20 time: 0.151613 Oct 20 06:13:11.337239 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 504/1024] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:13:11 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1745 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:13:11.682883 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-fc2048ad-1d3c-4694-9bb4-67f761154ccd tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:13:11.685116 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-fc2048ad-1d3c-4694-9bb4-67f761154ccd tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:13:11.691753 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-fc2048ad-1d3c-4694-9bb4-67f761154ccd tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:13:11.692235 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-fc2048ad-1d3c-4694-9bb4-67f761154ccd tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:13:11.692674 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-fc2048ad-1d3c-4694-9bb4-67f761154ccd tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:13:11.693399 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-fc2048ad-1d3c-4694-9bb4-67f761154ccd tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:13:11.693936 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-fc2048ad-1d3c-4694-9bb4-67f761154ccd tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:13:11.694404 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-fc2048ad-1d3c-4694-9bb4-67f761154ccd tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:13:11.724436 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-fc2048ad-1d3c-4694-9bb4-67f761154ccd tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045568 Oct 20 06:13:11.725151 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 521/1025] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:13:11 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:13:12.363054 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-0f9904e5-93b3-401c-961a-16e3ed6f8c4f tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:13:12.363654 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-0f9904e5-93b3-401c-961a-16e3ed6f8c4f tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:13:12.370684 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0f9904e5-93b3-401c-961a-16e3ed6f8c4f tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:13:12.371158 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0f9904e5-93b3-401c-961a-16e3ed6f8c4f tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:13:12.371590 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0f9904e5-93b3-401c-961a-16e3ed6f8c4f tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:13:12.372277 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0f9904e5-93b3-401c-961a-16e3ed6f8c4f tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:13:12.372752 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0f9904e5-93b3-401c-961a-16e3ed6f8c4f tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:13:12.373178 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0f9904e5-93b3-401c-961a-16e3ed6f8c4f tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:13:12.499795 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-0f9904e5-93b3-401c-961a-16e3ed6f8c4f tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:13:12.508665 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-0f9904e5-93b3-401c-961a-16e3ed6f8c4f tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:13:12.510127 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-0f9904e5-93b3-401c-961a-16e3ed6f8c4f tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:13:12.511269 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-0f9904e5-93b3-401c-961a-16e3ed6f8c4f tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1745 microversion: 2.20 time: 0.152086 Oct 20 06:13:12.511820 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 505/1026] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:13:12 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1745 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:13:12.737989 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-dd14f159-5f1f-4cd3-b2f7-13cdf0cc60e0 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:13:12.740174 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-dd14f159-5f1f-4cd3-b2f7-13cdf0cc60e0 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:13:12.747220 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-dd14f159-5f1f-4cd3-b2f7-13cdf0cc60e0 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:13:12.747710 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-dd14f159-5f1f-4cd3-b2f7-13cdf0cc60e0 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:13:12.748148 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-dd14f159-5f1f-4cd3-b2f7-13cdf0cc60e0 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:13:12.748882 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-dd14f159-5f1f-4cd3-b2f7-13cdf0cc60e0 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:13:12.749335 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-dd14f159-5f1f-4cd3-b2f7-13cdf0cc60e0 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:13:12.749759 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-dd14f159-5f1f-4cd3-b2f7-13cdf0cc60e0 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:13:12.779446 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-dd14f159-5f1f-4cd3-b2f7-13cdf0cc60e0 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045557 Oct 20 06:13:12.780003 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 522/1027] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:13:12 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:13:13.536585 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-6bea3f79-6ca4-4007-9d62-cb1b84fe5bbc tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:13:13.537237 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-6bea3f79-6ca4-4007-9d62-cb1b84fe5bbc tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:13:13.544128 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-6bea3f79-6ca4-4007-9d62-cb1b84fe5bbc tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:13:13.544610 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-6bea3f79-6ca4-4007-9d62-cb1b84fe5bbc tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:13:13.545083 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-6bea3f79-6ca4-4007-9d62-cb1b84fe5bbc tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:13:13.545771 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-6bea3f79-6ca4-4007-9d62-cb1b84fe5bbc tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:13:13.546227 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-6bea3f79-6ca4-4007-9d62-cb1b84fe5bbc tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:13:13.546652 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-6bea3f79-6ca4-4007-9d62-cb1b84fe5bbc tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:13:13.673263 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-6bea3f79-6ca4-4007-9d62-cb1b84fe5bbc tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:13:13.682563 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-6bea3f79-6ca4-4007-9d62-cb1b84fe5bbc tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:13:13.684180 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-6bea3f79-6ca4-4007-9d62-cb1b84fe5bbc tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:13:13.685560 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-6bea3f79-6ca4-4007-9d62-cb1b84fe5bbc tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1745 microversion: 2.20 time: 0.152548 Oct 20 06:13:13.686228 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 506/1028] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:13:13 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1745 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:13:13.791711 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-502e8bc2-caee-44f2-8115-f95da3ed0b3c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:13:13.793813 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-502e8bc2-caee-44f2-8115-f95da3ed0b3c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:13:13.800093 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-502e8bc2-caee-44f2-8115-f95da3ed0b3c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:13:13.800582 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-502e8bc2-caee-44f2-8115-f95da3ed0b3c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:13:13.801042 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-502e8bc2-caee-44f2-8115-f95da3ed0b3c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:13:13.801728 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-502e8bc2-caee-44f2-8115-f95da3ed0b3c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:13:13.802344 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-502e8bc2-caee-44f2-8115-f95da3ed0b3c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:13:13.802828 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-502e8bc2-caee-44f2-8115-f95da3ed0b3c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:13:13.833286 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-502e8bc2-caee-44f2-8115-f95da3ed0b3c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045660 Oct 20 06:13:13.833837 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 523/1029] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:13:13 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:13:14.713082 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-0d0f58c2-2eb9-40c4-bbbe-7646bf52231c tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:13:14.713684 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-0d0f58c2-2eb9-40c4-bbbe-7646bf52231c tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:13:14.720005 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0d0f58c2-2eb9-40c4-bbbe-7646bf52231c tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:13:14.720480 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0d0f58c2-2eb9-40c4-bbbe-7646bf52231c tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:13:14.720965 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0d0f58c2-2eb9-40c4-bbbe-7646bf52231c tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:13:14.721649 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0d0f58c2-2eb9-40c4-bbbe-7646bf52231c tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:13:14.722098 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0d0f58c2-2eb9-40c4-bbbe-7646bf52231c tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:13:14.722520 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0d0f58c2-2eb9-40c4-bbbe-7646bf52231c tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:13:14.845973 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-be6303a8-a092-4c71-a049-9d43d5a0b490 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:13:14.848493 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-be6303a8-a092-4c71-a049-9d43d5a0b490 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:13:14.849984 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-0d0f58c2-2eb9-40c4-bbbe-7646bf52231c tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:13:14.855118 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-be6303a8-a092-4c71-a049-9d43d5a0b490 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:13:14.855608 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-be6303a8-a092-4c71-a049-9d43d5a0b490 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:13:14.856217 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-be6303a8-a092-4c71-a049-9d43d5a0b490 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:13:14.857145 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-be6303a8-a092-4c71-a049-9d43d5a0b490 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:13:14.857608 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-be6303a8-a092-4c71-a049-9d43d5a0b490 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:13:14.858039 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-be6303a8-a092-4c71-a049-9d43d5a0b490 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:13:14.858400 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-0d0f58c2-2eb9-40c4-bbbe-7646bf52231c tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:13:14.859819 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-0d0f58c2-2eb9-40c4-bbbe-7646bf52231c tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:13:14.864955 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-0d0f58c2-2eb9-40c4-bbbe-7646bf52231c tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1745 microversion: 2.20 time: 0.152299 Oct 20 06:13:14.864955 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 507/1030] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:13:14 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1745 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:13:14.903494 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-be6303a8-a092-4c71-a049-9d43d5a0b490 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061873 Oct 20 06:13:14.904057 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 524/1031] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:13:14 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 20 06:13:15.886732 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-543aa7ca-9fba-4a02-a410-ee7cdc76979d tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:13:15.887333 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-543aa7ca-9fba-4a02-a410-ee7cdc76979d tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:13:15.893618 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-543aa7ca-9fba-4a02-a410-ee7cdc76979d tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:13:15.894095 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-543aa7ca-9fba-4a02-a410-ee7cdc76979d tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:13:15.894525 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-543aa7ca-9fba-4a02-a410-ee7cdc76979d tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:13:15.895207 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-543aa7ca-9fba-4a02-a410-ee7cdc76979d tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:13:15.895654 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-543aa7ca-9fba-4a02-a410-ee7cdc76979d tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:13:15.896068 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-543aa7ca-9fba-4a02-a410-ee7cdc76979d tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:13:15.917184 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-e2ebdcd2-7661-46cc-84d8-5ed58e4b60f1 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:13:15.919370 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-e2ebdcd2-7661-46cc-84d8-5ed58e4b60f1 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:13:15.926254 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e2ebdcd2-7661-46cc-84d8-5ed58e4b60f1 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:13:15.926961 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e2ebdcd2-7661-46cc-84d8-5ed58e4b60f1 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:13:15.927558 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e2ebdcd2-7661-46cc-84d8-5ed58e4b60f1 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:13:15.929208 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e2ebdcd2-7661-46cc-84d8-5ed58e4b60f1 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:13:15.929860 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e2ebdcd2-7661-46cc-84d8-5ed58e4b60f1 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:13:15.930448 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e2ebdcd2-7661-46cc-84d8-5ed58e4b60f1 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:13:15.963479 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-e2ebdcd2-7661-46cc-84d8-5ed58e4b60f1 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051320 Oct 20 06:13:15.964999 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 525/1032] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:13:15 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:13:16.032934 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-543aa7ca-9fba-4a02-a410-ee7cdc76979d tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:13:16.042026 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-543aa7ca-9fba-4a02-a410-ee7cdc76979d tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:13:16.043461 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-543aa7ca-9fba-4a02-a410-ee7cdc76979d tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:13:16.044611 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-543aa7ca-9fba-4a02-a410-ee7cdc76979d tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1745 microversion: 2.20 time: 0.161734 Oct 20 06:13:16.045183 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 508/1033] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:13:15 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1745 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:13:16.977254 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-14e81f28-4a8f-4ae1-8662-0de42e0b488d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:13:16.979397 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-14e81f28-4a8f-4ae1-8662-0de42e0b488d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:13:16.985749 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-14e81f28-4a8f-4ae1-8662-0de42e0b488d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:13:16.986232 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-14e81f28-4a8f-4ae1-8662-0de42e0b488d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:13:16.986669 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-14e81f28-4a8f-4ae1-8662-0de42e0b488d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:13:16.987417 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-14e81f28-4a8f-4ae1-8662-0de42e0b488d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:13:16.987848 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-14e81f28-4a8f-4ae1-8662-0de42e0b488d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:13:16.988268 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-14e81f28-4a8f-4ae1-8662-0de42e0b488d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:13:17.018389 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-14e81f28-4a8f-4ae1-8662-0de42e0b488d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046388 Oct 20 06:13:17.018949 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 526/1034] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:13:16 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:13:17.071547 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-46d11b92-ec68-4f3c-9328-02125916ff90 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:13:17.072180 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-46d11b92-ec68-4f3c-9328-02125916ff90 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:13:17.078558 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-46d11b92-ec68-4f3c-9328-02125916ff90 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:13:17.079042 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-46d11b92-ec68-4f3c-9328-02125916ff90 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:13:17.079485 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-46d11b92-ec68-4f3c-9328-02125916ff90 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:13:17.080183 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-46d11b92-ec68-4f3c-9328-02125916ff90 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:13:17.080638 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-46d11b92-ec68-4f3c-9328-02125916ff90 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:13:17.081090 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-46d11b92-ec68-4f3c-9328-02125916ff90 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:13:17.206888 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-46d11b92-ec68-4f3c-9328-02125916ff90 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:13:17.216468 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-46d11b92-ec68-4f3c-9328-02125916ff90 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:13:17.217924 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-46d11b92-ec68-4f3c-9328-02125916ff90 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:13:17.219072 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-46d11b92-ec68-4f3c-9328-02125916ff90 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1745 microversion: 2.20 time: 0.152602 Oct 20 06:13:17.219620 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 509/1035] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:13:17 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1745 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:13:18.031054 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-70241fad-60b1-42bc-89a3-469e310a7bc2 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:13:18.033263 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-70241fad-60b1-42bc-89a3-469e310a7bc2 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:13:18.039733 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-70241fad-60b1-42bc-89a3-469e310a7bc2 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:13:18.040222 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-70241fad-60b1-42bc-89a3-469e310a7bc2 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:13:18.040663 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-70241fad-60b1-42bc-89a3-469e310a7bc2 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:13:18.041422 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-70241fad-60b1-42bc-89a3-469e310a7bc2 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:13:18.041875 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-70241fad-60b1-42bc-89a3-469e310a7bc2 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:13:18.042303 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-70241fad-60b1-42bc-89a3-469e310a7bc2 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:13:18.075088 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-70241fad-60b1-42bc-89a3-469e310a7bc2 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047923 Oct 20 06:13:18.075682 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 527/1036] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:13:18 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:13:18.243837 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-8cb649f3-cd14-4545-b2ef-b6988ef2c9bc tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:13:18.244438 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-8cb649f3-cd14-4545-b2ef-b6988ef2c9bc tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:13:18.250690 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-8cb649f3-cd14-4545-b2ef-b6988ef2c9bc tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:13:18.251166 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-8cb649f3-cd14-4545-b2ef-b6988ef2c9bc tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:13:18.251598 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-8cb649f3-cd14-4545-b2ef-b6988ef2c9bc tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:13:18.252532 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-8cb649f3-cd14-4545-b2ef-b6988ef2c9bc tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:13:18.253016 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-8cb649f3-cd14-4545-b2ef-b6988ef2c9bc tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:13:18.253435 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-8cb649f3-cd14-4545-b2ef-b6988ef2c9bc tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:13:18.382161 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-8cb649f3-cd14-4545-b2ef-b6988ef2c9bc tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:13:18.390622 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-8cb649f3-cd14-4545-b2ef-b6988ef2c9bc tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:13:18.392046 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-8cb649f3-cd14-4545-b2ef-b6988ef2c9bc tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:13:18.393213 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-8cb649f3-cd14-4545-b2ef-b6988ef2c9bc tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1745 microversion: 2.20 time: 0.153776 Oct 20 06:13:18.393762 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 510/1037] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:13:18 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1745 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:13:19.087422 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-6005d0e6-21c4-41f2-9262-eb740998429d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:13:19.089626 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-6005d0e6-21c4-41f2-9262-eb740998429d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:13:19.095981 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-6005d0e6-21c4-41f2-9262-eb740998429d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:13:19.096468 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-6005d0e6-21c4-41f2-9262-eb740998429d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:13:19.096941 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-6005d0e6-21c4-41f2-9262-eb740998429d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:13:19.097646 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-6005d0e6-21c4-41f2-9262-eb740998429d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:13:19.098098 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-6005d0e6-21c4-41f2-9262-eb740998429d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:13:19.098533 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-6005d0e6-21c4-41f2-9262-eb740998429d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:13:19.129641 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-6005d0e6-21c4-41f2-9262-eb740998429d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046916 Oct 20 06:13:19.130200 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 528/1038] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:13:19 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:13:19.418715 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-5fa018a4-0faa-4b86-9593-865e8d8035be tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:13:19.419348 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-5fa018a4-0faa-4b86-9593-865e8d8035be tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:13:19.426659 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5fa018a4-0faa-4b86-9593-865e8d8035be tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:13:19.427141 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5fa018a4-0faa-4b86-9593-865e8d8035be tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:13:19.427581 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5fa018a4-0faa-4b86-9593-865e8d8035be tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:13:19.429124 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5fa018a4-0faa-4b86-9593-865e8d8035be tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:13:19.429585 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5fa018a4-0faa-4b86-9593-865e8d8035be tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:13:19.430017 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5fa018a4-0faa-4b86-9593-865e8d8035be tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:13:19.558188 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-5fa018a4-0faa-4b86-9593-865e8d8035be tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:13:19.568605 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-5fa018a4-0faa-4b86-9593-865e8d8035be tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:13:19.570099 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-5fa018a4-0faa-4b86-9593-865e8d8035be tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:13:19.571273 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-5fa018a4-0faa-4b86-9593-865e8d8035be tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1745 microversion: 2.20 time: 0.156456 Oct 20 06:13:19.571826 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 511/1039] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:13:19 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1745 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:13:20.142155 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-b35ddb48-e281-4767-8e51-ac68ac399481 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:13:20.144352 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-b35ddb48-e281-4767-8e51-ac68ac399481 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:13:20.151518 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b35ddb48-e281-4767-8e51-ac68ac399481 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:13:20.152000 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b35ddb48-e281-4767-8e51-ac68ac399481 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:13:20.152604 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b35ddb48-e281-4767-8e51-ac68ac399481 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:13:20.153147 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b35ddb48-e281-4767-8e51-ac68ac399481 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:13:20.153598 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b35ddb48-e281-4767-8e51-ac68ac399481 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:13:20.154025 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b35ddb48-e281-4767-8e51-ac68ac399481 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:13:20.183619 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-b35ddb48-e281-4767-8e51-ac68ac399481 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045447 Oct 20 06:13:20.184365 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 529/1040] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:13:20 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:13:20.599286 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-0e7d3d83-375f-4c2d-9c48-2aab07317eb7 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:13:20.599893 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-0e7d3d83-375f-4c2d-9c48-2aab07317eb7 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:13:20.606413 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0e7d3d83-375f-4c2d-9c48-2aab07317eb7 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:13:20.606891 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0e7d3d83-375f-4c2d-9c48-2aab07317eb7 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:13:20.607325 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0e7d3d83-375f-4c2d-9c48-2aab07317eb7 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:13:20.608019 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0e7d3d83-375f-4c2d-9c48-2aab07317eb7 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:13:20.608508 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0e7d3d83-375f-4c2d-9c48-2aab07317eb7 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:13:20.608959 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0e7d3d83-375f-4c2d-9c48-2aab07317eb7 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:13:20.747244 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-0e7d3d83-375f-4c2d-9c48-2aab07317eb7 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:13:20.756002 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-0e7d3d83-375f-4c2d-9c48-2aab07317eb7 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:13:20.757507 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-0e7d3d83-375f-4c2d-9c48-2aab07317eb7 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:13:20.758663 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-0e7d3d83-375f-4c2d-9c48-2aab07317eb7 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1745 microversion: 2.20 time: 0.163239 Oct 20 06:13:20.759214 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 512/1041] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:13:20 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1745 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:13:21.195959 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-c97097b8-15f8-474a-8959-625a16cd9e3a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:13:21.198143 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-c97097b8-15f8-474a-8959-625a16cd9e3a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:13:21.204491 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c97097b8-15f8-474a-8959-625a16cd9e3a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:13:21.205010 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c97097b8-15f8-474a-8959-625a16cd9e3a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:13:21.205449 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c97097b8-15f8-474a-8959-625a16cd9e3a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:13:21.206139 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c97097b8-15f8-474a-8959-625a16cd9e3a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:13:21.206588 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c97097b8-15f8-474a-8959-625a16cd9e3a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:13:21.207010 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c97097b8-15f8-474a-8959-625a16cd9e3a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:13:21.236342 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-c97097b8-15f8-474a-8959-625a16cd9e3a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044950 Oct 20 06:13:21.241430 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 530/1042] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:13:21 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:13:21.783919 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-6ca2a965-fbb6-45f9-bc9b-6952e711c252 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:13:21.784523 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-6ca2a965-fbb6-45f9-bc9b-6952e711c252 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:13:21.791439 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-6ca2a965-fbb6-45f9-bc9b-6952e711c252 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:13:21.791918 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-6ca2a965-fbb6-45f9-bc9b-6952e711c252 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:13:21.792357 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-6ca2a965-fbb6-45f9-bc9b-6952e711c252 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:13:21.793073 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-6ca2a965-fbb6-45f9-bc9b-6952e711c252 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:13:21.793524 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-6ca2a965-fbb6-45f9-bc9b-6952e711c252 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:13:21.793946 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-6ca2a965-fbb6-45f9-bc9b-6952e711c252 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:13:21.918189 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-6ca2a965-fbb6-45f9-bc9b-6952e711c252 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:13:21.926720 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-6ca2a965-fbb6-45f9-bc9b-6952e711c252 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:13:21.928168 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-6ca2a965-fbb6-45f9-bc9b-6952e711c252 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:13:21.929343 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-6ca2a965-fbb6-45f9-bc9b-6952e711c252 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1745 microversion: 2.20 time: 0.149283 Oct 20 06:13:21.929895 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 513/1043] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:13:21 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1745 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:13:22.248481 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-d90c66b5-3cc5-4163-9e75-10bf32adb5af tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:13:22.250730 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-d90c66b5-3cc5-4163-9e75-10bf32adb5af tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:13:22.258007 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d90c66b5-3cc5-4163-9e75-10bf32adb5af tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:13:22.258491 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d90c66b5-3cc5-4163-9e75-10bf32adb5af tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:13:22.258930 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d90c66b5-3cc5-4163-9e75-10bf32adb5af tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:13:22.259628 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d90c66b5-3cc5-4163-9e75-10bf32adb5af tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:13:22.260081 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d90c66b5-3cc5-4163-9e75-10bf32adb5af tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:13:22.260503 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d90c66b5-3cc5-4163-9e75-10bf32adb5af tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:13:22.290866 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-d90c66b5-3cc5-4163-9e75-10bf32adb5af tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046388 Oct 20 06:13:22.291431 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 531/1044] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:13:22 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:13:22.954483 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-5130f5a6-8352-4fcd-854c-9c000d60f378 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:13:22.955001 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-5130f5a6-8352-4fcd-854c-9c000d60f378 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:13:22.961269 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5130f5a6-8352-4fcd-854c-9c000d60f378 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:13:22.961747 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5130f5a6-8352-4fcd-854c-9c000d60f378 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:13:22.962178 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5130f5a6-8352-4fcd-854c-9c000d60f378 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:13:22.962859 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5130f5a6-8352-4fcd-854c-9c000d60f378 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:13:22.963304 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5130f5a6-8352-4fcd-854c-9c000d60f378 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:13:22.963721 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5130f5a6-8352-4fcd-854c-9c000d60f378 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:13:23.090054 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-5130f5a6-8352-4fcd-854c-9c000d60f378 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:13:23.098471 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-5130f5a6-8352-4fcd-854c-9c000d60f378 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:13:23.100552 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-5130f5a6-8352-4fcd-854c-9c000d60f378 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:13:23.101713 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-5130f5a6-8352-4fcd-854c-9c000d60f378 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1745 microversion: 2.20 time: 0.151284 Oct 20 06:13:23.102250 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 514/1045] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:13:22 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1745 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:13:23.303874 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-83a0531b-b69f-4526-98c3-26bfdd177646 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:13:23.306081 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-83a0531b-b69f-4526-98c3-26bfdd177646 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:13:23.312584 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-83a0531b-b69f-4526-98c3-26bfdd177646 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:13:23.313094 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-83a0531b-b69f-4526-98c3-26bfdd177646 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:13:23.313525 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-83a0531b-b69f-4526-98c3-26bfdd177646 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:13:23.314209 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-83a0531b-b69f-4526-98c3-26bfdd177646 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:13:23.314691 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-83a0531b-b69f-4526-98c3-26bfdd177646 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:13:23.315138 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-83a0531b-b69f-4526-98c3-26bfdd177646 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:13:23.344759 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-83a0531b-b69f-4526-98c3-26bfdd177646 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045474 Oct 20 06:13:23.345323 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 532/1046] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:13:23 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:13:24.128112 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-f2c96278-2d1a-4e6d-ba84-8329261a5489 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:13:24.128735 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-f2c96278-2d1a-4e6d-ba84-8329261a5489 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:13:24.135956 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f2c96278-2d1a-4e6d-ba84-8329261a5489 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:13:24.136434 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f2c96278-2d1a-4e6d-ba84-8329261a5489 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:13:24.136909 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f2c96278-2d1a-4e6d-ba84-8329261a5489 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:13:24.137595 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f2c96278-2d1a-4e6d-ba84-8329261a5489 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:13:24.138047 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f2c96278-2d1a-4e6d-ba84-8329261a5489 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:13:24.138473 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f2c96278-2d1a-4e6d-ba84-8329261a5489 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:13:24.266864 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-f2c96278-2d1a-4e6d-ba84-8329261a5489 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:13:24.275648 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-f2c96278-2d1a-4e6d-ba84-8329261a5489 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:13:24.277123 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-f2c96278-2d1a-4e6d-ba84-8329261a5489 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:13:24.278270 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-f2c96278-2d1a-4e6d-ba84-8329261a5489 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1745 microversion: 2.20 time: 0.154405 Oct 20 06:13:24.278821 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 515/1047] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:13:24 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1745 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:13:24.356598 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-c01bfef0-bd98-4934-92cf-6a0ff9a06e95 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:13:24.358766 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-c01bfef0-bd98-4934-92cf-6a0ff9a06e95 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:13:24.365830 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c01bfef0-bd98-4934-92cf-6a0ff9a06e95 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:13:24.366297 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c01bfef0-bd98-4934-92cf-6a0ff9a06e95 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:13:24.366723 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c01bfef0-bd98-4934-92cf-6a0ff9a06e95 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:13:24.367396 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c01bfef0-bd98-4934-92cf-6a0ff9a06e95 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:13:24.367839 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c01bfef0-bd98-4934-92cf-6a0ff9a06e95 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:13:24.368255 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c01bfef0-bd98-4934-92cf-6a0ff9a06e95 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:13:24.398101 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-c01bfef0-bd98-4934-92cf-6a0ff9a06e95 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045685 Oct 20 06:13:24.398654 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 533/1048] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:13:24 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:13:25.303009 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-dc499779-b2cd-4350-a13a-d731674c668d tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:13:25.303636 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-dc499779-b2cd-4350-a13a-d731674c668d tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:13:25.310022 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-dc499779-b2cd-4350-a13a-d731674c668d tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:13:25.310495 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-dc499779-b2cd-4350-a13a-d731674c668d tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:13:25.310926 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-dc499779-b2cd-4350-a13a-d731674c668d tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:13:25.311611 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-dc499779-b2cd-4350-a13a-d731674c668d tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:13:25.312057 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-dc499779-b2cd-4350-a13a-d731674c668d tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:13:25.312481 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-dc499779-b2cd-4350-a13a-d731674c668d tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:13:25.410352 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-769bc55f-48d0-4355-af5b-89fc920db7af tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:13:25.412655 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-769bc55f-48d0-4355-af5b-89fc920db7af tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:13:25.419096 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-769bc55f-48d0-4355-af5b-89fc920db7af tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:13:25.419658 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-769bc55f-48d0-4355-af5b-89fc920db7af tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:13:25.420164 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-769bc55f-48d0-4355-af5b-89fc920db7af tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:13:25.420895 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-769bc55f-48d0-4355-af5b-89fc920db7af tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:13:25.421348 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-769bc55f-48d0-4355-af5b-89fc920db7af tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:13:25.421774 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-769bc55f-48d0-4355-af5b-89fc920db7af tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:13:25.438282 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-dc499779-b2cd-4350-a13a-d731674c668d tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:13:25.448217 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-dc499779-b2cd-4350-a13a-d731674c668d tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:13:25.449781 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-dc499779-b2cd-4350-a13a-d731674c668d tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:13:25.451050 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-dc499779-b2cd-4350-a13a-d731674c668d tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1745 microversion: 2.20 time: 0.151984 Oct 20 06:13:25.451921 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 516/1049] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:13:25 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1745 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:13:25.453730 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-769bc55f-48d0-4355-af5b-89fc920db7af tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047254 Oct 20 06:13:25.454416 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 534/1050] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:13:25 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 20 06:13:26.466438 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-a825ecae-ce0e-4b43-ad14-ed054d9d6a52 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:13:26.468557 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-a825ecae-ce0e-4b43-ad14-ed054d9d6a52 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:13:26.475830 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a825ecae-ce0e-4b43-ad14-ed054d9d6a52 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:13:26.476315 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a825ecae-ce0e-4b43-ad14-ed054d9d6a52 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:13:26.476784 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a825ecae-ce0e-4b43-ad14-ed054d9d6a52 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:13:26.477485 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a825ecae-ce0e-4b43-ad14-ed054d9d6a52 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:13:26.477938 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a825ecae-ce0e-4b43-ad14-ed054d9d6a52 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:13:26.478107 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-95ba1d50-3a9b-48a2-95e9-5af2f3be23ff tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:13:26.478540 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a825ecae-ce0e-4b43-ad14-ed054d9d6a52 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:13:26.478730 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-95ba1d50-3a9b-48a2-95e9-5af2f3be23ff tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:13:26.485010 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-95ba1d50-3a9b-48a2-95e9-5af2f3be23ff tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:13:26.485491 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-95ba1d50-3a9b-48a2-95e9-5af2f3be23ff tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:13:26.485925 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-95ba1d50-3a9b-48a2-95e9-5af2f3be23ff tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:13:26.486617 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-95ba1d50-3a9b-48a2-95e9-5af2f3be23ff tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:13:26.487068 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-95ba1d50-3a9b-48a2-95e9-5af2f3be23ff tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:13:26.487490 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-95ba1d50-3a9b-48a2-95e9-5af2f3be23ff tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:13:26.506222 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG dbcounter [-] [118861] Writing DB stats nova_cell1:SELECT=100 {{(pid=118861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:13:26.508877 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-a825ecae-ce0e-4b43-ad14-ed054d9d6a52 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046367 Oct 20 06:13:26.509810 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 517/1051] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:13:26 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:13:26.620385 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-95ba1d50-3a9b-48a2-95e9-5af2f3be23ff tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:13:26.629351 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-95ba1d50-3a9b-48a2-95e9-5af2f3be23ff tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:13:26.630799 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-95ba1d50-3a9b-48a2-95e9-5af2f3be23ff tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:13:26.632024 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-95ba1d50-3a9b-48a2-95e9-5af2f3be23ff tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1745 microversion: 2.20 time: 0.158841 Oct 20 06:13:26.632575 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 535/1052] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:13:26 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1745 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 20 06:13:27.521130 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-357c191f-341d-43f3-8b85-f82ce81b9d6f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:13:27.523277 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-357c191f-341d-43f3-8b85-f82ce81b9d6f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:13:27.529587 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-357c191f-341d-43f3-8b85-f82ce81b9d6f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:13:27.530058 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-357c191f-341d-43f3-8b85-f82ce81b9d6f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:13:27.530488 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-357c191f-341d-43f3-8b85-f82ce81b9d6f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:13:27.531163 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-357c191f-341d-43f3-8b85-f82ce81b9d6f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:13:27.531607 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-357c191f-341d-43f3-8b85-f82ce81b9d6f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:13:27.532022 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-357c191f-341d-43f3-8b85-f82ce81b9d6f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:13:27.548548 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG dbcounter [-] [118860] Writing DB stats nova_cell1:SELECT=100 {{(pid=118860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:13:27.562877 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-357c191f-341d-43f3-8b85-f82ce81b9d6f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045746 Oct 20 06:13:27.563519 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 518/1053] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:13:27 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:13:27.657535 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-c2cff5c1-c5bd-4cf4-9aae-2fdff553b4e7 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:13:27.658143 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-c2cff5c1-c5bd-4cf4-9aae-2fdff553b4e7 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:13:27.664803 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c2cff5c1-c5bd-4cf4-9aae-2fdff553b4e7 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:13:27.665282 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c2cff5c1-c5bd-4cf4-9aae-2fdff553b4e7 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:13:27.665713 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c2cff5c1-c5bd-4cf4-9aae-2fdff553b4e7 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:13:27.666395 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c2cff5c1-c5bd-4cf4-9aae-2fdff553b4e7 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:13:27.666866 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c2cff5c1-c5bd-4cf4-9aae-2fdff553b4e7 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:13:27.667284 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c2cff5c1-c5bd-4cf4-9aae-2fdff553b4e7 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:13:27.792369 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-c2cff5c1-c5bd-4cf4-9aae-2fdff553b4e7 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:13:27.800993 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-c2cff5c1-c5bd-4cf4-9aae-2fdff553b4e7 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:13:27.802661 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-c2cff5c1-c5bd-4cf4-9aae-2fdff553b4e7 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:13:27.803928 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-c2cff5c1-c5bd-4cf4-9aae-2fdff553b4e7 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1745 microversion: 2.20 time: 0.150196 Oct 20 06:13:27.804482 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 536/1054] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:13:27 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1745 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:13:28.575441 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-62d0143b-8b06-441d-a410-c376aed2f452 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:13:28.577526 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-62d0143b-8b06-441d-a410-c376aed2f452 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:13:28.584383 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-62d0143b-8b06-441d-a410-c376aed2f452 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:13:28.584904 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-62d0143b-8b06-441d-a410-c376aed2f452 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:13:28.585341 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-62d0143b-8b06-441d-a410-c376aed2f452 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:13:28.586029 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-62d0143b-8b06-441d-a410-c376aed2f452 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:13:28.586480 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-62d0143b-8b06-441d-a410-c376aed2f452 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:13:28.586905 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-62d0143b-8b06-441d-a410-c376aed2f452 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:13:28.617516 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-62d0143b-8b06-441d-a410-c376aed2f452 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046234 Oct 20 06:13:28.618055 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 519/1055] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:13:28 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:13:28.829144 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-f1016c63-f703-4f27-887f-056896fff700 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:13:28.829678 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-f1016c63-f703-4f27-887f-056896fff700 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:13:28.836365 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f1016c63-f703-4f27-887f-056896fff700 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:13:28.836914 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f1016c63-f703-4f27-887f-056896fff700 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:13:28.837353 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f1016c63-f703-4f27-887f-056896fff700 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:13:28.838052 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f1016c63-f703-4f27-887f-056896fff700 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:13:28.838505 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f1016c63-f703-4f27-887f-056896fff700 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:13:28.838931 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f1016c63-f703-4f27-887f-056896fff700 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:13:28.971100 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-f1016c63-f703-4f27-887f-056896fff700 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:13:28.980281 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-f1016c63-f703-4f27-887f-056896fff700 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:13:28.981741 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-f1016c63-f703-4f27-887f-056896fff700 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:13:28.982883 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-f1016c63-f703-4f27-887f-056896fff700 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1745 microversion: 2.20 time: 0.157839 Oct 20 06:13:28.983435 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 537/1056] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:13:28 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1745 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:13:29.630656 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-351312ff-613c-4c18-b94f-c175f5707838 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:13:29.633532 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-351312ff-613c-4c18-b94f-c175f5707838 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:13:29.639773 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-351312ff-613c-4c18-b94f-c175f5707838 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:13:29.640255 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-351312ff-613c-4c18-b94f-c175f5707838 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:13:29.640687 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-351312ff-613c-4c18-b94f-c175f5707838 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:13:29.641408 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-351312ff-613c-4c18-b94f-c175f5707838 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:13:29.641839 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-351312ff-613c-4c18-b94f-c175f5707838 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:13:29.642257 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-351312ff-613c-4c18-b94f-c175f5707838 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:13:29.671872 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-351312ff-613c-4c18-b94f-c175f5707838 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045686 Oct 20 06:13:29.672410 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 520/1057] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:13:29 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 20 06:13:30.009569 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-dbb55615-ff6e-421c-9cff-8a4357ef1741 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:13:30.010168 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-dbb55615-ff6e-421c-9cff-8a4357ef1741 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:13:30.016631 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-dbb55615-ff6e-421c-9cff-8a4357ef1741 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:13:30.017287 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-dbb55615-ff6e-421c-9cff-8a4357ef1741 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:13:30.017743 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-dbb55615-ff6e-421c-9cff-8a4357ef1741 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:13:30.018452 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-dbb55615-ff6e-421c-9cff-8a4357ef1741 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:13:30.018908 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-dbb55615-ff6e-421c-9cff-8a4357ef1741 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:13:30.019339 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-dbb55615-ff6e-421c-9cff-8a4357ef1741 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:13:30.148901 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-dbb55615-ff6e-421c-9cff-8a4357ef1741 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:13:30.157709 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-dbb55615-ff6e-421c-9cff-8a4357ef1741 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:13:30.159146 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-dbb55615-ff6e-421c-9cff-8a4357ef1741 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:13:30.160522 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-dbb55615-ff6e-421c-9cff-8a4357ef1741 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1745 microversion: 2.20 time: 0.155659 Oct 20 06:13:30.161312 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 538/1058] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:13:30 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1745 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:13:30.683770 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-f8f70c97-f2cf-4a62-a6d9-1edccc498b97 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:13:30.685960 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-f8f70c97-f2cf-4a62-a6d9-1edccc498b97 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:13:30.692348 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f8f70c97-f2cf-4a62-a6d9-1edccc498b97 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:13:30.692867 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f8f70c97-f2cf-4a62-a6d9-1edccc498b97 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:13:30.693304 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f8f70c97-f2cf-4a62-a6d9-1edccc498b97 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:13:30.694508 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f8f70c97-f2cf-4a62-a6d9-1edccc498b97 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:13:30.695045 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f8f70c97-f2cf-4a62-a6d9-1edccc498b97 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:13:30.695476 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f8f70c97-f2cf-4a62-a6d9-1edccc498b97 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:13:30.724722 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-f8f70c97-f2cf-4a62-a6d9-1edccc498b97 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044931 Oct 20 06:13:30.725274 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 521/1059] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:13:30 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:13:31.186761 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-6a9eb63c-8299-43c4-b705-fd30b670d1c2 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:13:31.187368 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-6a9eb63c-8299-43c4-b705-fd30b670d1c2 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:13:31.193311 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-6a9eb63c-8299-43c4-b705-fd30b670d1c2 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:13:31.193837 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-6a9eb63c-8299-43c4-b705-fd30b670d1c2 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:13:31.195097 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-6a9eb63c-8299-43c4-b705-fd30b670d1c2 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:13:31.195807 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-6a9eb63c-8299-43c4-b705-fd30b670d1c2 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:13:31.196265 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-6a9eb63c-8299-43c4-b705-fd30b670d1c2 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:13:31.196713 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-6a9eb63c-8299-43c4-b705-fd30b670d1c2 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:13:31.326133 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-6a9eb63c-8299-43c4-b705-fd30b670d1c2 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:13:31.335259 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-6a9eb63c-8299-43c4-b705-fd30b670d1c2 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:13:31.336731 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-6a9eb63c-8299-43c4-b705-fd30b670d1c2 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:13:31.337890 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-6a9eb63c-8299-43c4-b705-fd30b670d1c2 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1745 microversion: 2.20 time: 0.155574 Oct 20 06:13:31.338449 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 539/1060] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:13:31 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1745 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:13:31.737061 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-f5f2d2ec-f29a-4601-8c12-588b942ab731 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:13:31.739228 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-f5f2d2ec-f29a-4601-8c12-588b942ab731 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:13:31.746549 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f5f2d2ec-f29a-4601-8c12-588b942ab731 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:13:31.747059 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f5f2d2ec-f29a-4601-8c12-588b942ab731 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:13:31.747501 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f5f2d2ec-f29a-4601-8c12-588b942ab731 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:13:31.748199 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f5f2d2ec-f29a-4601-8c12-588b942ab731 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:13:31.748652 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f5f2d2ec-f29a-4601-8c12-588b942ab731 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:13:31.749121 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f5f2d2ec-f29a-4601-8c12-588b942ab731 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:13:31.778554 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-f5f2d2ec-f29a-4601-8c12-588b942ab731 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045479 Oct 20 06:13:31.779101 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 522/1061] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:13:31 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:13:32.362871 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-ba3ff589-2711-46df-a886-796cdcf523ba tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:13:32.363510 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-ba3ff589-2711-46df-a886-796cdcf523ba tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:13:32.370813 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ba3ff589-2711-46df-a886-796cdcf523ba tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:13:32.371292 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ba3ff589-2711-46df-a886-796cdcf523ba tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:13:32.371729 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ba3ff589-2711-46df-a886-796cdcf523ba tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:13:32.372417 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ba3ff589-2711-46df-a886-796cdcf523ba tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:13:32.372915 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ba3ff589-2711-46df-a886-796cdcf523ba tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:13:32.373341 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ba3ff589-2711-46df-a886-796cdcf523ba tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:13:32.499905 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-ba3ff589-2711-46df-a886-796cdcf523ba tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:13:32.509662 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-ba3ff589-2711-46df-a886-796cdcf523ba tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:13:32.511098 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-ba3ff589-2711-46df-a886-796cdcf523ba tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:13:32.512253 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-ba3ff589-2711-46df-a886-796cdcf523ba tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1745 microversion: 2.20 time: 0.153354 Oct 20 06:13:32.512839 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 540/1062] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:13:32 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1745 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 20 06:13:32.791680 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-56cc6165-30dd-4e6d-871f-0d9202b4abf0 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:13:32.793814 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-56cc6165-30dd-4e6d-871f-0d9202b4abf0 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:13:32.800417 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-56cc6165-30dd-4e6d-871f-0d9202b4abf0 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:13:32.800937 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-56cc6165-30dd-4e6d-871f-0d9202b4abf0 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:13:32.801372 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-56cc6165-30dd-4e6d-871f-0d9202b4abf0 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:13:32.802065 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-56cc6165-30dd-4e6d-871f-0d9202b4abf0 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:13:32.802517 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-56cc6165-30dd-4e6d-871f-0d9202b4abf0 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:13:32.802945 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-56cc6165-30dd-4e6d-871f-0d9202b4abf0 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:13:32.832066 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-56cc6165-30dd-4e6d-871f-0d9202b4abf0 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045767 Oct 20 06:13:32.832623 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 523/1063] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:13:32 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:13:33.540457 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-b74747a7-a51f-4f7d-a0ce-e449da209be3 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:13:33.541007 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-b74747a7-a51f-4f7d-a0ce-e449da209be3 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:13:33.543289 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG dbcounter [-] [118861] Writing DB stats nova_api:SELECT=56 {{(pid=118861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:13:33.548471 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b74747a7-a51f-4f7d-a0ce-e449da209be3 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:13:33.548983 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b74747a7-a51f-4f7d-a0ce-e449da209be3 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:13:33.549417 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b74747a7-a51f-4f7d-a0ce-e449da209be3 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:13:33.550105 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b74747a7-a51f-4f7d-a0ce-e449da209be3 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:13:33.550552 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b74747a7-a51f-4f7d-a0ce-e449da209be3 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:13:33.550970 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b74747a7-a51f-4f7d-a0ce-e449da209be3 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:13:33.677002 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-b74747a7-a51f-4f7d-a0ce-e449da209be3 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:13:33.686817 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-b74747a7-a51f-4f7d-a0ce-e449da209be3 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:13:33.688431 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-b74747a7-a51f-4f7d-a0ce-e449da209be3 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:13:33.689890 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-b74747a7-a51f-4f7d-a0ce-e449da209be3 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1745 microversion: 2.20 time: 0.153841 Oct 20 06:13:33.690534 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 541/1064] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:13:33 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1745 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:13:33.844372 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-e7cb530c-b854-4ccc-9522-0a8035248b98 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:13:33.846433 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-e7cb530c-b854-4ccc-9522-0a8035248b98 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:13:33.848677 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG dbcounter [-] [118860] Writing DB stats nova_api:SELECT=54 {{(pid=118860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:13:33.854606 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e7cb530c-b854-4ccc-9522-0a8035248b98 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:13:33.855112 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e7cb530c-b854-4ccc-9522-0a8035248b98 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:13:33.855542 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e7cb530c-b854-4ccc-9522-0a8035248b98 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:13:33.856227 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e7cb530c-b854-4ccc-9522-0a8035248b98 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:13:33.856674 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e7cb530c-b854-4ccc-9522-0a8035248b98 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:13:33.857117 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e7cb530c-b854-4ccc-9522-0a8035248b98 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:13:33.886517 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-e7cb530c-b854-4ccc-9522-0a8035248b98 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046153 Oct 20 06:13:33.887075 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 524/1065] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:13:33 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:13:34.715746 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-bed722c5-74b4-4b22-a016-7d8b68a6ead1 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:13:34.716432 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-bed722c5-74b4-4b22-a016-7d8b68a6ead1 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:13:34.722937 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-bed722c5-74b4-4b22-a016-7d8b68a6ead1 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:13:34.723406 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-bed722c5-74b4-4b22-a016-7d8b68a6ead1 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:13:34.723839 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-bed722c5-74b4-4b22-a016-7d8b68a6ead1 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:13:34.724521 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-bed722c5-74b4-4b22-a016-7d8b68a6ead1 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:13:34.725654 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-bed722c5-74b4-4b22-a016-7d8b68a6ead1 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:13:34.726072 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-bed722c5-74b4-4b22-a016-7d8b68a6ead1 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:13:34.855006 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-bed722c5-74b4-4b22-a016-7d8b68a6ead1 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:13:34.863681 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-bed722c5-74b4-4b22-a016-7d8b68a6ead1 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:13:34.865153 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-bed722c5-74b4-4b22-a016-7d8b68a6ead1 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:13:34.866508 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-bed722c5-74b4-4b22-a016-7d8b68a6ead1 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1745 microversion: 2.20 time: 0.154749 Oct 20 06:13:34.867068 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 542/1066] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:13:34 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1745 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:13:34.899903 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-b2498e5e-fd05-4be9-9fd2-02f7dc907696 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:13:34.902098 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-b2498e5e-fd05-4be9-9fd2-02f7dc907696 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:13:34.908379 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b2498e5e-fd05-4be9-9fd2-02f7dc907696 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:13:34.908905 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b2498e5e-fd05-4be9-9fd2-02f7dc907696 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:13:34.909348 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b2498e5e-fd05-4be9-9fd2-02f7dc907696 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:13:34.910031 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b2498e5e-fd05-4be9-9fd2-02f7dc907696 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:13:34.910483 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b2498e5e-fd05-4be9-9fd2-02f7dc907696 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:13:34.910908 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b2498e5e-fd05-4be9-9fd2-02f7dc907696 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:13:34.939700 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-b2498e5e-fd05-4be9-9fd2-02f7dc907696 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044520 Oct 20 06:13:34.940239 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 525/1067] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:13:34 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:13:35.891272 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-f2001e0e-1248-4c98-9df7-daad4311f388 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:13:35.891917 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-f2001e0e-1248-4c98-9df7-daad4311f388 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:13:35.899054 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f2001e0e-1248-4c98-9df7-daad4311f388 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:13:35.899540 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f2001e0e-1248-4c98-9df7-daad4311f388 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:13:35.899981 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f2001e0e-1248-4c98-9df7-daad4311f388 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:13:35.900681 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f2001e0e-1248-4c98-9df7-daad4311f388 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:13:35.901161 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f2001e0e-1248-4c98-9df7-daad4311f388 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:13:35.901591 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f2001e0e-1248-4c98-9df7-daad4311f388 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:13:35.952552 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-ad0b3f3c-308e-43d4-8f7b-141ff5c52993 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:13:35.954686 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-ad0b3f3c-308e-43d4-8f7b-141ff5c52993 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:13:35.961758 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-ad0b3f3c-308e-43d4-8f7b-141ff5c52993 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:13:35.962229 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-ad0b3f3c-308e-43d4-8f7b-141ff5c52993 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:13:35.962660 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-ad0b3f3c-308e-43d4-8f7b-141ff5c52993 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:13:35.963353 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-ad0b3f3c-308e-43d4-8f7b-141ff5c52993 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:13:35.963800 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-ad0b3f3c-308e-43d4-8f7b-141ff5c52993 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:13:35.964222 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-ad0b3f3c-308e-43d4-8f7b-141ff5c52993 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:13:35.994265 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-ad0b3f3c-308e-43d4-8f7b-141ff5c52993 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045674 Oct 20 06:13:35.994833 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 526/1068] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:13:35 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 20 06:13:36.030658 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-f2001e0e-1248-4c98-9df7-daad4311f388 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:13:36.039145 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-f2001e0e-1248-4c98-9df7-daad4311f388 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:13:36.040585 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-f2001e0e-1248-4c98-9df7-daad4311f388 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:13:36.041779 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-f2001e0e-1248-4c98-9df7-daad4311f388 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1745 microversion: 2.20 time: 0.154390 Oct 20 06:13:36.042332 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 543/1069] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:13:35 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1745 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:13:37.007547 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-120db1ab-effb-43fa-9f2e-2076710781f7 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:13:37.009652 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-120db1ab-effb-43fa-9f2e-2076710781f7 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:13:37.015983 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-120db1ab-effb-43fa-9f2e-2076710781f7 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:13:37.016471 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-120db1ab-effb-43fa-9f2e-2076710781f7 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:13:37.016950 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-120db1ab-effb-43fa-9f2e-2076710781f7 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:13:37.017650 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-120db1ab-effb-43fa-9f2e-2076710781f7 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:13:37.018108 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-120db1ab-effb-43fa-9f2e-2076710781f7 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:13:37.018535 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-120db1ab-effb-43fa-9f2e-2076710781f7 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:13:37.048585 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-120db1ab-effb-43fa-9f2e-2076710781f7 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045475 Oct 20 06:13:37.049311 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 527/1070] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:13:37 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:13:37.066622 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-42a08a71-6a0a-4a9f-85ea-4fca26789f07 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:13:37.067265 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-42a08a71-6a0a-4a9f-85ea-4fca26789f07 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:13:37.073764 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-42a08a71-6a0a-4a9f-85ea-4fca26789f07 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:13:37.074239 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-42a08a71-6a0a-4a9f-85ea-4fca26789f07 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:13:37.074674 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-42a08a71-6a0a-4a9f-85ea-4fca26789f07 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:13:37.075361 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-42a08a71-6a0a-4a9f-85ea-4fca26789f07 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:13:37.075809 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-42a08a71-6a0a-4a9f-85ea-4fca26789f07 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:13:37.076226 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-42a08a71-6a0a-4a9f-85ea-4fca26789f07 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:13:37.206447 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-42a08a71-6a0a-4a9f-85ea-4fca26789f07 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:13:37.214971 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-42a08a71-6a0a-4a9f-85ea-4fca26789f07 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:13:37.216394 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-42a08a71-6a0a-4a9f-85ea-4fca26789f07 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:13:37.217565 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-42a08a71-6a0a-4a9f-85ea-4fca26789f07 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1745 microversion: 2.20 time: 0.154813 Oct 20 06:13:37.218117 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 544/1071] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:13:37 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1745 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:13:38.061900 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-03cdbf37-1272-42a3-b5d7-95e5a4d2045d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:13:38.064125 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-03cdbf37-1272-42a3-b5d7-95e5a4d2045d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:13:38.071154 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-03cdbf37-1272-42a3-b5d7-95e5a4d2045d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:13:38.071632 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-03cdbf37-1272-42a3-b5d7-95e5a4d2045d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:13:38.072064 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-03cdbf37-1272-42a3-b5d7-95e5a4d2045d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:13:38.072769 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-03cdbf37-1272-42a3-b5d7-95e5a4d2045d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:13:38.073220 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-03cdbf37-1272-42a3-b5d7-95e5a4d2045d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:13:38.073638 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-03cdbf37-1272-42a3-b5d7-95e5a4d2045d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:13:38.102663 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-03cdbf37-1272-42a3-b5d7-95e5a4d2045d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045198 Oct 20 06:13:38.103200 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 528/1072] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:13:38 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:13:38.243365 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-21b0ed6e-ce4d-450e-9be6-ab3a6661dbd9 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:13:38.244111 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-21b0ed6e-ce4d-450e-9be6-ab3a6661dbd9 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:13:38.250406 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-21b0ed6e-ce4d-450e-9be6-ab3a6661dbd9 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:13:38.250879 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-21b0ed6e-ce4d-450e-9be6-ab3a6661dbd9 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:13:38.251305 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-21b0ed6e-ce4d-450e-9be6-ab3a6661dbd9 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:13:38.252243 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-21b0ed6e-ce4d-450e-9be6-ab3a6661dbd9 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:13:38.252686 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-21b0ed6e-ce4d-450e-9be6-ab3a6661dbd9 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:13:38.253152 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-21b0ed6e-ce4d-450e-9be6-ab3a6661dbd9 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:13:38.380370 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-21b0ed6e-ce4d-450e-9be6-ab3a6661dbd9 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:13:38.389669 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-21b0ed6e-ce4d-450e-9be6-ab3a6661dbd9 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:13:38.391117 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-21b0ed6e-ce4d-450e-9be6-ab3a6661dbd9 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:13:38.392263 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-21b0ed6e-ce4d-450e-9be6-ab3a6661dbd9 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1745 microversion: 2.20 time: 0.153316 Oct 20 06:13:38.392833 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 545/1073] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:13:38 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1745 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:13:39.114429 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-2cf76770-8795-4a7e-8234-420260db6e4e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:13:39.116624 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-2cf76770-8795-4a7e-8234-420260db6e4e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:13:39.123024 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2cf76770-8795-4a7e-8234-420260db6e4e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:13:39.123499 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2cf76770-8795-4a7e-8234-420260db6e4e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:13:39.123935 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2cf76770-8795-4a7e-8234-420260db6e4e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:13:39.124623 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2cf76770-8795-4a7e-8234-420260db6e4e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:13:39.125108 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2cf76770-8795-4a7e-8234-420260db6e4e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:13:39.125533 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2cf76770-8795-4a7e-8234-420260db6e4e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:13:39.154661 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-2cf76770-8795-4a7e-8234-420260db6e4e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044197 Oct 20 06:13:39.155203 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 529/1074] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:13:39 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:13:39.418167 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-e44065cb-596a-4f54-b58b-d139148ab0c7 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:13:39.418771 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-e44065cb-596a-4f54-b58b-d139148ab0c7 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:13:39.425195 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e44065cb-596a-4f54-b58b-d139148ab0c7 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:13:39.425669 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e44065cb-596a-4f54-b58b-d139148ab0c7 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:13:39.426100 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e44065cb-596a-4f54-b58b-d139148ab0c7 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:13:39.426781 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e44065cb-596a-4f54-b58b-d139148ab0c7 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:13:39.427224 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e44065cb-596a-4f54-b58b-d139148ab0c7 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:13:39.427750 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e44065cb-596a-4f54-b58b-d139148ab0c7 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:13:39.555583 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-e44065cb-596a-4f54-b58b-d139148ab0c7 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:13:39.564185 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-e44065cb-596a-4f54-b58b-d139148ab0c7 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:13:39.565735 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-e44065cb-596a-4f54-b58b-d139148ab0c7 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:13:39.566958 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-e44065cb-596a-4f54-b58b-d139148ab0c7 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1745 microversion: 2.20 time: 0.152686 Oct 20 06:13:39.574011 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 546/1075] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:13:39 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1745 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:13:40.167616 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-9c6113e1-293f-4ead-9bbd-c2fc099a2ebb tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:13:40.169767 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-9c6113e1-293f-4ead-9bbd-c2fc099a2ebb tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:13:40.176066 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-9c6113e1-293f-4ead-9bbd-c2fc099a2ebb tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:13:40.176541 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-9c6113e1-293f-4ead-9bbd-c2fc099a2ebb tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:13:40.177014 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-9c6113e1-293f-4ead-9bbd-c2fc099a2ebb tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:13:40.177696 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-9c6113e1-293f-4ead-9bbd-c2fc099a2ebb tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:13:40.178183 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-9c6113e1-293f-4ead-9bbd-c2fc099a2ebb tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:13:40.178691 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-9c6113e1-293f-4ead-9bbd-c2fc099a2ebb tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:13:40.207342 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-9c6113e1-293f-4ead-9bbd-c2fc099a2ebb tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043725 Oct 20 06:13:40.207878 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 530/1076] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:13:40 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:13:40.594365 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-152abecc-0e22-43fd-a4e7-da95bafb9c55 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:13:40.594909 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-152abecc-0e22-43fd-a4e7-da95bafb9c55 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:13:40.601447 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-152abecc-0e22-43fd-a4e7-da95bafb9c55 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:13:40.601927 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-152abecc-0e22-43fd-a4e7-da95bafb9c55 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:13:40.602374 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-152abecc-0e22-43fd-a4e7-da95bafb9c55 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:13:40.603085 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-152abecc-0e22-43fd-a4e7-da95bafb9c55 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:13:40.603523 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-152abecc-0e22-43fd-a4e7-da95bafb9c55 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:13:40.603950 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-152abecc-0e22-43fd-a4e7-da95bafb9c55 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:13:40.738268 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-152abecc-0e22-43fd-a4e7-da95bafb9c55 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:13:40.747566 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-152abecc-0e22-43fd-a4e7-da95bafb9c55 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:13:40.749049 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-152abecc-0e22-43fd-a4e7-da95bafb9c55 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:13:40.750207 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-152abecc-0e22-43fd-a4e7-da95bafb9c55 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1745 microversion: 2.20 time: 0.159908 Oct 20 06:13:40.750766 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 547/1077] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:13:40 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1745 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:13:41.219640 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-c6e9f7f8-1009-43bc-b5a4-9dcf9de336e3 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:13:41.221849 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-c6e9f7f8-1009-43bc-b5a4-9dcf9de336e3 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:13:41.228627 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c6e9f7f8-1009-43bc-b5a4-9dcf9de336e3 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:13:41.229162 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c6e9f7f8-1009-43bc-b5a4-9dcf9de336e3 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:13:41.229595 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c6e9f7f8-1009-43bc-b5a4-9dcf9de336e3 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:13:41.230298 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c6e9f7f8-1009-43bc-b5a4-9dcf9de336e3 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:13:41.230752 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c6e9f7f8-1009-43bc-b5a4-9dcf9de336e3 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:13:41.231175 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c6e9f7f8-1009-43bc-b5a4-9dcf9de336e3 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:13:41.261240 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-c6e9f7f8-1009-43bc-b5a4-9dcf9de336e3 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045606 Oct 20 06:13:41.262022 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 531/1078] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:13:41 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:13:41.775334 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-c0733ef8-d49b-4108-9ab6-43b4d6d34099 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:13:41.775938 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-c0733ef8-d49b-4108-9ab6-43b4d6d34099 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:13:41.783186 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c0733ef8-d49b-4108-9ab6-43b4d6d34099 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:13:41.784230 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c0733ef8-d49b-4108-9ab6-43b4d6d34099 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:13:41.784989 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c0733ef8-d49b-4108-9ab6-43b4d6d34099 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:13:41.786050 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c0733ef8-d49b-4108-9ab6-43b4d6d34099 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:13:41.786671 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c0733ef8-d49b-4108-9ab6-43b4d6d34099 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:13:41.787098 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c0733ef8-d49b-4108-9ab6-43b4d6d34099 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:13:41.919036 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-c0733ef8-d49b-4108-9ab6-43b4d6d34099 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:13:41.927709 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-c0733ef8-d49b-4108-9ab6-43b4d6d34099 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:13:41.929908 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-c0733ef8-d49b-4108-9ab6-43b4d6d34099 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:13:41.931070 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-c0733ef8-d49b-4108-9ab6-43b4d6d34099 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1745 microversion: 2.20 time: 0.159727 Oct 20 06:13:41.931617 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 548/1079] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:13:41 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1745 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:13:42.274516 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-4dae2f39-58e8-4cf4-a039-d4fdecb04559 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:13:42.276628 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-4dae2f39-58e8-4cf4-a039-d4fdecb04559 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:13:42.283078 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-4dae2f39-58e8-4cf4-a039-d4fdecb04559 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:13:42.283556 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-4dae2f39-58e8-4cf4-a039-d4fdecb04559 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:13:42.284022 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-4dae2f39-58e8-4cf4-a039-d4fdecb04559 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:13:42.284748 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-4dae2f39-58e8-4cf4-a039-d4fdecb04559 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:13:42.285540 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-4dae2f39-58e8-4cf4-a039-d4fdecb04559 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:13:42.285646 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-4dae2f39-58e8-4cf4-a039-d4fdecb04559 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:13:42.317062 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-4dae2f39-58e8-4cf4-a039-d4fdecb04559 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047421 Oct 20 06:13:42.317624 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 532/1080] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:13:42 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:13:42.957005 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-64d4e709-0400-4b09-b2c7-8f539e9929a0 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:13:42.957607 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-64d4e709-0400-4b09-b2c7-8f539e9929a0 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:13:42.964540 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-64d4e709-0400-4b09-b2c7-8f539e9929a0 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:13:42.965088 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-64d4e709-0400-4b09-b2c7-8f539e9929a0 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:13:42.965524 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-64d4e709-0400-4b09-b2c7-8f539e9929a0 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:13:42.966217 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-64d4e709-0400-4b09-b2c7-8f539e9929a0 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:13:42.966664 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-64d4e709-0400-4b09-b2c7-8f539e9929a0 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:13:42.967091 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-64d4e709-0400-4b09-b2c7-8f539e9929a0 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:13:43.099495 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-64d4e709-0400-4b09-b2c7-8f539e9929a0 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:13:43.108839 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-64d4e709-0400-4b09-b2c7-8f539e9929a0 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:13:43.110293 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-64d4e709-0400-4b09-b2c7-8f539e9929a0 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:13:43.111461 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-64d4e709-0400-4b09-b2c7-8f539e9929a0 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1745 microversion: 2.20 time: 0.158261 Oct 20 06:13:43.112288 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 549/1081] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:13:42 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1745 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:13:43.330135 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-4c844b56-071e-444f-973d-3cc3ec8e1720 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:13:43.332260 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-4c844b56-071e-444f-973d-3cc3ec8e1720 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:13:43.339582 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-4c844b56-071e-444f-973d-3cc3ec8e1720 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:13:43.340061 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-4c844b56-071e-444f-973d-3cc3ec8e1720 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:13:43.340494 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-4c844b56-071e-444f-973d-3cc3ec8e1720 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:13:43.341211 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-4c844b56-071e-444f-973d-3cc3ec8e1720 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:13:43.341660 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-4c844b56-071e-444f-973d-3cc3ec8e1720 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:13:43.342087 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-4c844b56-071e-444f-973d-3cc3ec8e1720 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:13:43.370434 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-4c844b56-071e-444f-973d-3cc3ec8e1720 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044255 Oct 20 06:13:43.370974 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 533/1082] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:13:43 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:13:44.137472 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-4395f1e9-d14a-4cdc-8592-afc743d58907 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:13:44.138081 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-4395f1e9-d14a-4cdc-8592-afc743d58907 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:13:44.144461 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4395f1e9-d14a-4cdc-8592-afc743d58907 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:13:44.144979 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4395f1e9-d14a-4cdc-8592-afc743d58907 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:13:44.145415 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4395f1e9-d14a-4cdc-8592-afc743d58907 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:13:44.146106 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4395f1e9-d14a-4cdc-8592-afc743d58907 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:13:44.146560 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4395f1e9-d14a-4cdc-8592-afc743d58907 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:13:44.146984 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4395f1e9-d14a-4cdc-8592-afc743d58907 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:13:44.271124 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-4395f1e9-d14a-4cdc-8592-afc743d58907 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:13:44.279576 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-4395f1e9-d14a-4cdc-8592-afc743d58907 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:13:44.281056 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-4395f1e9-d14a-4cdc-8592-afc743d58907 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:13:44.282214 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-4395f1e9-d14a-4cdc-8592-afc743d58907 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1745 microversion: 2.20 time: 0.148680 Oct 20 06:13:44.282766 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 550/1083] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:13:44 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1745 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:13:44.383217 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-a6a3e806-138d-4561-8347-22535dac136d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:13:44.385479 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-a6a3e806-138d-4561-8347-22535dac136d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:13:44.391872 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a6a3e806-138d-4561-8347-22535dac136d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:13:44.392352 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a6a3e806-138d-4561-8347-22535dac136d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:13:44.392830 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a6a3e806-138d-4561-8347-22535dac136d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:13:44.393521 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a6a3e806-138d-4561-8347-22535dac136d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:13:44.393975 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a6a3e806-138d-4561-8347-22535dac136d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:13:44.394400 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a6a3e806-138d-4561-8347-22535dac136d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:13:44.423992 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-a6a3e806-138d-4561-8347-22535dac136d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044830 Oct 20 06:13:44.424537 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 534/1084] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:13:44 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:13:45.308145 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-32d59279-1d89-48ad-a49e-46e2bdcc6ce7 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:13:45.308792 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-32d59279-1d89-48ad-a49e-46e2bdcc6ce7 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:13:45.315304 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-32d59279-1d89-48ad-a49e-46e2bdcc6ce7 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:13:45.315787 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-32d59279-1d89-48ad-a49e-46e2bdcc6ce7 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:13:45.316223 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-32d59279-1d89-48ad-a49e-46e2bdcc6ce7 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:13:45.316953 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-32d59279-1d89-48ad-a49e-46e2bdcc6ce7 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:13:45.317406 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-32d59279-1d89-48ad-a49e-46e2bdcc6ce7 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:13:45.317830 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-32d59279-1d89-48ad-a49e-46e2bdcc6ce7 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:13:45.435480 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-bbb62379-439b-45a0-bcdb-1bfb84342b34 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:13:45.437684 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-bbb62379-439b-45a0-bcdb-1bfb84342b34 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:13:45.444603 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-bbb62379-439b-45a0-bcdb-1bfb84342b34 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:13:45.445135 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-bbb62379-439b-45a0-bcdb-1bfb84342b34 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:13:45.445573 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-bbb62379-439b-45a0-bcdb-1bfb84342b34 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:13:45.446282 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-bbb62379-439b-45a0-bcdb-1bfb84342b34 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:13:45.446429 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-32d59279-1d89-48ad-a49e-46e2bdcc6ce7 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:13:45.446736 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-bbb62379-439b-45a0-bcdb-1bfb84342b34 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:13:45.447159 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-bbb62379-439b-45a0-bcdb-1bfb84342b34 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:13:45.450899 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG dbcounter [-] [118860] Writing DB stats nova_cell1:SELECT=100 {{(pid=118860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:13:45.455728 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-32d59279-1d89-48ad-a49e-46e2bdcc6ce7 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:13:45.457192 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-32d59279-1d89-48ad-a49e-46e2bdcc6ce7 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:13:45.458350 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-32d59279-1d89-48ad-a49e-46e2bdcc6ce7 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1745 microversion: 2.20 time: 0.154177 Oct 20 06:13:45.459000 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 551/1085] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:13:45 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1745 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:13:45.477281 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-bbb62379-439b-45a0-bcdb-1bfb84342b34 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045720 Oct 20 06:13:45.477829 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 535/1086] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:13:45 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 20 06:13:46.484218 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-63a24558-6991-4c71-885f-be2692bc13cb tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:13:46.484867 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-63a24558-6991-4c71-885f-be2692bc13cb tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:13:46.489429 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-10fd0725-23bb-4d7c-b301-11b851ecda8d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:13:46.491711 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-10fd0725-23bb-4d7c-b301-11b851ecda8d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:13:46.492550 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-63a24558-6991-4c71-885f-be2692bc13cb tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:13:46.493074 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-63a24558-6991-4c71-885f-be2692bc13cb tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:13:46.493509 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-63a24558-6991-4c71-885f-be2692bc13cb tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:13:46.494213 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-63a24558-6991-4c71-885f-be2692bc13cb tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:13:46.494658 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-63a24558-6991-4c71-885f-be2692bc13cb tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:13:46.495079 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-63a24558-6991-4c71-885f-be2692bc13cb tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:13:46.497962 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-10fd0725-23bb-4d7c-b301-11b851ecda8d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:13:46.498428 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-10fd0725-23bb-4d7c-b301-11b851ecda8d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:13:46.500184 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-10fd0725-23bb-4d7c-b301-11b851ecda8d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:13:46.500344 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG dbcounter [-] [118861] Writing DB stats nova_cell1:SELECT=100 {{(pid=118861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:13:46.500451 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-10fd0725-23bb-4d7c-b301-11b851ecda8d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:13:46.500451 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-10fd0725-23bb-4d7c-b301-11b851ecda8d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:13:46.500893 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-10fd0725-23bb-4d7c-b301-11b851ecda8d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:13:46.532463 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-10fd0725-23bb-4d7c-b301-11b851ecda8d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046891 Oct 20 06:13:46.533165 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 536/1087] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:13:46 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 20 06:13:46.621615 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-63a24558-6991-4c71-885f-be2692bc13cb tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:13:46.630377 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-63a24558-6991-4c71-885f-be2692bc13cb tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:13:46.632430 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-63a24558-6991-4c71-885f-be2692bc13cb tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:13:46.633620 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-63a24558-6991-4c71-885f-be2692bc13cb tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1745 microversion: 2.20 time: 0.153370 Oct 20 06:13:46.634187 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 552/1088] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:13:46 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1745 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:13:47.543946 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-ac54a214-d336-4fbc-a1b1-fe511d5f9edc tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:13:47.546127 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-ac54a214-d336-4fbc-a1b1-fe511d5f9edc tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:13:47.552417 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-ac54a214-d336-4fbc-a1b1-fe511d5f9edc tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:13:47.553486 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-ac54a214-d336-4fbc-a1b1-fe511d5f9edc tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:13:47.553917 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-ac54a214-d336-4fbc-a1b1-fe511d5f9edc tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:13:47.554603 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-ac54a214-d336-4fbc-a1b1-fe511d5f9edc tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:13:47.555046 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-ac54a214-d336-4fbc-a1b1-fe511d5f9edc tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:13:47.555463 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-ac54a214-d336-4fbc-a1b1-fe511d5f9edc tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:13:47.584835 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-ac54a214-d336-4fbc-a1b1-fe511d5f9edc tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044585 Oct 20 06:13:47.585304 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 537/1089] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:13:47 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:13:47.658630 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-d0277884-ae8c-4abe-b425-9eb7d8ab3b22 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:13:47.659264 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-d0277884-ae8c-4abe-b425-9eb7d8ab3b22 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:13:47.665590 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d0277884-ae8c-4abe-b425-9eb7d8ab3b22 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:13:47.666066 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d0277884-ae8c-4abe-b425-9eb7d8ab3b22 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:13:47.666496 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d0277884-ae8c-4abe-b425-9eb7d8ab3b22 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:13:47.667179 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d0277884-ae8c-4abe-b425-9eb7d8ab3b22 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:13:47.667622 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d0277884-ae8c-4abe-b425-9eb7d8ab3b22 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:13:47.668042 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d0277884-ae8c-4abe-b425-9eb7d8ab3b22 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:13:47.803863 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-d0277884-ae8c-4abe-b425-9eb7d8ab3b22 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:13:47.812318 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-d0277884-ae8c-4abe-b425-9eb7d8ab3b22 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:13:47.813781 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-d0277884-ae8c-4abe-b425-9eb7d8ab3b22 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:13:47.814926 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-d0277884-ae8c-4abe-b425-9eb7d8ab3b22 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1745 microversion: 2.20 time: 0.160144 Oct 20 06:13:47.815470 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 553/1090] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:13:47 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1745 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:13:48.597184 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-4135dcfb-f58c-409c-aa34-515b60798815 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:13:48.599262 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-4135dcfb-f58c-409c-aa34-515b60798815 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:13:48.606155 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-4135dcfb-f58c-409c-aa34-515b60798815 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:13:48.606652 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-4135dcfb-f58c-409c-aa34-515b60798815 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:13:48.607080 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-4135dcfb-f58c-409c-aa34-515b60798815 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:13:48.607762 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-4135dcfb-f58c-409c-aa34-515b60798815 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:13:48.608207 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-4135dcfb-f58c-409c-aa34-515b60798815 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:13:48.608622 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-4135dcfb-f58c-409c-aa34-515b60798815 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:13:48.637670 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-4135dcfb-f58c-409c-aa34-515b60798815 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044543 Oct 20 06:13:48.638212 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 538/1091] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:13:48 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:13:48.840686 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-508618e1-f9bc-4aee-b133-25d5f4b051d9 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:13:48.841312 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-508618e1-f9bc-4aee-b133-25d5f4b051d9 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:13:48.847689 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-508618e1-f9bc-4aee-b133-25d5f4b051d9 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:13:48.848103 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-508618e1-f9bc-4aee-b133-25d5f4b051d9 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:13:48.848534 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-508618e1-f9bc-4aee-b133-25d5f4b051d9 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:13:48.849248 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-508618e1-f9bc-4aee-b133-25d5f4b051d9 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:13:48.850399 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-508618e1-f9bc-4aee-b133-25d5f4b051d9 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:13:48.850829 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-508618e1-f9bc-4aee-b133-25d5f4b051d9 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:13:49.188031 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-508618e1-f9bc-4aee-b133-25d5f4b051d9 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:13:49.197120 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-508618e1-f9bc-4aee-b133-25d5f4b051d9 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:13:49.198555 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-508618e1-f9bc-4aee-b133-25d5f4b051d9 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:13:49.199699 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-508618e1-f9bc-4aee-b133-25d5f4b051d9 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1745 microversion: 2.20 time: 0.363301 Oct 20 06:13:49.200246 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 554/1092] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:13:48 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1745 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:13:49.650347 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-1efbcbe5-c66d-4f2e-b729-a8ef1dabc88e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:13:49.652532 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-1efbcbe5-c66d-4f2e-b729-a8ef1dabc88e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:13:49.658852 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1efbcbe5-c66d-4f2e-b729-a8ef1dabc88e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:13:49.659322 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1efbcbe5-c66d-4f2e-b729-a8ef1dabc88e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:13:49.659751 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1efbcbe5-c66d-4f2e-b729-a8ef1dabc88e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:13:49.660430 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1efbcbe5-c66d-4f2e-b729-a8ef1dabc88e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:13:49.660922 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1efbcbe5-c66d-4f2e-b729-a8ef1dabc88e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:13:49.661342 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1efbcbe5-c66d-4f2e-b729-a8ef1dabc88e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:13:49.691230 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-1efbcbe5-c66d-4f2e-b729-a8ef1dabc88e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044872 Oct 20 06:13:49.691767 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 539/1093] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:13:49 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:13:50.225430 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-ef46a21e-3d19-4fc2-bc4c-e7b067c03669 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:13:50.226034 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-ef46a21e-3d19-4fc2-bc4c-e7b067c03669 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:13:50.232391 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ef46a21e-3d19-4fc2-bc4c-e7b067c03669 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:13:50.232842 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ef46a21e-3d19-4fc2-bc4c-e7b067c03669 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:13:50.233274 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ef46a21e-3d19-4fc2-bc4c-e7b067c03669 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:13:50.233958 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ef46a21e-3d19-4fc2-bc4c-e7b067c03669 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:13:50.234405 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ef46a21e-3d19-4fc2-bc4c-e7b067c03669 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:13:50.234826 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ef46a21e-3d19-4fc2-bc4c-e7b067c03669 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:13:50.363705 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-ef46a21e-3d19-4fc2-bc4c-e7b067c03669 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:13:50.372545 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-ef46a21e-3d19-4fc2-bc4c-e7b067c03669 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:13:50.374109 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-ef46a21e-3d19-4fc2-bc4c-e7b067c03669 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:13:50.375264 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-ef46a21e-3d19-4fc2-bc4c-e7b067c03669 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1745 microversion: 2.20 time: 0.154363 Oct 20 06:13:50.376520 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 555/1094] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:13:50 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1745 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:13:50.703533 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-a039eb4c-2b6c-4a90-bb6f-1af3e99dbbb8 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:13:50.705706 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-a039eb4c-2b6c-4a90-bb6f-1af3e99dbbb8 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:13:50.713285 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a039eb4c-2b6c-4a90-bb6f-1af3e99dbbb8 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:13:50.713790 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a039eb4c-2b6c-4a90-bb6f-1af3e99dbbb8 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:13:50.714226 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a039eb4c-2b6c-4a90-bb6f-1af3e99dbbb8 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:13:50.714915 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a039eb4c-2b6c-4a90-bb6f-1af3e99dbbb8 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:13:50.715365 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a039eb4c-2b6c-4a90-bb6f-1af3e99dbbb8 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:13:50.715785 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a039eb4c-2b6c-4a90-bb6f-1af3e99dbbb8 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:13:50.744773 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-a039eb4c-2b6c-4a90-bb6f-1af3e99dbbb8 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045103 Oct 20 06:13:50.745243 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 540/1095] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:13:50 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:13:51.401139 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-06560e4b-38e1-4084-a6fb-87a2c19c990e tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:13:51.401803 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-06560e4b-38e1-4084-a6fb-87a2c19c990e tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:13:51.408089 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-06560e4b-38e1-4084-a6fb-87a2c19c990e tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:13:51.408567 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-06560e4b-38e1-4084-a6fb-87a2c19c990e tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:13:51.409029 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-06560e4b-38e1-4084-a6fb-87a2c19c990e tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:13:51.409718 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-06560e4b-38e1-4084-a6fb-87a2c19c990e tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:13:51.410163 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-06560e4b-38e1-4084-a6fb-87a2c19c990e tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:13:51.410582 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-06560e4b-38e1-4084-a6fb-87a2c19c990e tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:13:51.539494 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-06560e4b-38e1-4084-a6fb-87a2c19c990e tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:13:51.548020 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-06560e4b-38e1-4084-a6fb-87a2c19c990e tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:13:51.549490 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-06560e4b-38e1-4084-a6fb-87a2c19c990e tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:13:51.550677 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-06560e4b-38e1-4084-a6fb-87a2c19c990e tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1745 microversion: 2.20 time: 0.153367 Oct 20 06:13:51.551229 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 556/1096] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:13:51 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1745 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:13:51.757325 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-66d94baf-2d37-4db5-9525-586566474225 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:13:51.759367 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-66d94baf-2d37-4db5-9525-586566474225 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:13:51.765314 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-66d94baf-2d37-4db5-9525-586566474225 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:13:51.765791 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-66d94baf-2d37-4db5-9525-586566474225 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:13:51.766230 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-66d94baf-2d37-4db5-9525-586566474225 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:13:51.766916 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-66d94baf-2d37-4db5-9525-586566474225 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:13:51.767367 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-66d94baf-2d37-4db5-9525-586566474225 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:13:51.767789 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-66d94baf-2d37-4db5-9525-586566474225 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:13:51.797133 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-66d94baf-2d37-4db5-9525-586566474225 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044199 Oct 20 06:13:51.797672 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 541/1097] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:13:51 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:13:52.576989 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-a54864cb-13e4-4f98-aa79-e9432137a74e tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:13:52.577516 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-a54864cb-13e4-4f98-aa79-e9432137a74e tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:13:52.585587 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a54864cb-13e4-4f98-aa79-e9432137a74e tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:13:52.586065 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a54864cb-13e4-4f98-aa79-e9432137a74e tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:13:52.586496 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a54864cb-13e4-4f98-aa79-e9432137a74e tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:13:52.587183 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a54864cb-13e4-4f98-aa79-e9432137a74e tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:13:52.587628 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a54864cb-13e4-4f98-aa79-e9432137a74e tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:13:52.588048 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a54864cb-13e4-4f98-aa79-e9432137a74e tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:13:52.715219 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-a54864cb-13e4-4f98-aa79-e9432137a74e tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:13:52.723659 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-a54864cb-13e4-4f98-aa79-e9432137a74e tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:13:52.725825 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-a54864cb-13e4-4f98-aa79-e9432137a74e tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:13:52.726970 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-a54864cb-13e4-4f98-aa79-e9432137a74e tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1745 microversion: 2.20 time: 0.153961 Oct 20 06:13:52.727693 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 557/1098] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:13:52 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1745 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:13:52.809063 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-64b1148e-eb6a-4705-b1bc-0eef7a001f93 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:13:52.811225 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-64b1148e-eb6a-4705-b1bc-0eef7a001f93 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:13:52.817521 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-64b1148e-eb6a-4705-b1bc-0eef7a001f93 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:13:52.817997 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-64b1148e-eb6a-4705-b1bc-0eef7a001f93 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:13:52.818431 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-64b1148e-eb6a-4705-b1bc-0eef7a001f93 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:13:52.819395 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-64b1148e-eb6a-4705-b1bc-0eef7a001f93 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:13:52.819846 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-64b1148e-eb6a-4705-b1bc-0eef7a001f93 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:13:52.820270 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-64b1148e-eb6a-4705-b1bc-0eef7a001f93 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:13:52.849176 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-64b1148e-eb6a-4705-b1bc-0eef7a001f93 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043918 Oct 20 06:13:52.849659 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 542/1099] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:13:52 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:13:53.752729 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-ef1d4ddc-de69-4bd4-a4ec-1167b219c7ff tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:13:53.753362 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-ef1d4ddc-de69-4bd4-a4ec-1167b219c7ff tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:13:53.759812 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ef1d4ddc-de69-4bd4-a4ec-1167b219c7ff tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:13:53.760290 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ef1d4ddc-de69-4bd4-a4ec-1167b219c7ff tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:13:53.760747 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ef1d4ddc-de69-4bd4-a4ec-1167b219c7ff tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:13:53.761451 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ef1d4ddc-de69-4bd4-a4ec-1167b219c7ff tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:13:53.761897 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ef1d4ddc-de69-4bd4-a4ec-1167b219c7ff tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:13:53.762315 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ef1d4ddc-de69-4bd4-a4ec-1167b219c7ff tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:13:53.862495 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-c1aac478-655b-4fa9-999c-e37c5419f62f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:13:53.864731 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-c1aac478-655b-4fa9-999c-e37c5419f62f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:13:53.871689 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c1aac478-655b-4fa9-999c-e37c5419f62f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:13:53.872175 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c1aac478-655b-4fa9-999c-e37c5419f62f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:13:53.872617 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c1aac478-655b-4fa9-999c-e37c5419f62f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:13:53.873342 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c1aac478-655b-4fa9-999c-e37c5419f62f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:13:53.873796 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c1aac478-655b-4fa9-999c-e37c5419f62f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:13:53.874222 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c1aac478-655b-4fa9-999c-e37c5419f62f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:13:53.893307 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-ef1d4ddc-de69-4bd4-a4ec-1167b219c7ff tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:13:53.902536 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-ef1d4ddc-de69-4bd4-a4ec-1167b219c7ff tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:13:53.903954 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-ef1d4ddc-de69-4bd4-a4ec-1167b219c7ff tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:13:53.904072 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-c1aac478-655b-4fa9-999c-e37c5419f62f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045578 Oct 20 06:13:53.904550 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 543/1100] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:13:53 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 20 06:13:53.905136 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-ef1d4ddc-de69-4bd4-a4ec-1167b219c7ff tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1745 microversion: 2.20 time: 0.156554 Oct 20 06:13:53.905679 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 558/1101] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:13:53 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1745 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:13:54.916394 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-ef614d02-ef52-442e-8ff3-334f6313dc1f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:13:54.918605 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-ef614d02-ef52-442e-8ff3-334f6313dc1f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:13:54.924961 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-ef614d02-ef52-442e-8ff3-334f6313dc1f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:13:54.925447 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-ef614d02-ef52-442e-8ff3-334f6313dc1f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:13:54.925885 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-ef614d02-ef52-442e-8ff3-334f6313dc1f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:13:54.926588 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-ef614d02-ef52-442e-8ff3-334f6313dc1f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:13:54.927043 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-ef614d02-ef52-442e-8ff3-334f6313dc1f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:13:54.927471 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-ef614d02-ef52-442e-8ff3-334f6313dc1f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:13:54.931424 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-0e128bab-4cbb-468d-8f47-1b43610bb59b tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:13:54.932065 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-0e128bab-4cbb-468d-8f47-1b43610bb59b tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:13:54.938415 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-0e128bab-4cbb-468d-8f47-1b43610bb59b tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:13:54.938887 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-0e128bab-4cbb-468d-8f47-1b43610bb59b tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:13:54.939322 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-0e128bab-4cbb-468d-8f47-1b43610bb59b tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:13:54.940016 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-0e128bab-4cbb-468d-8f47-1b43610bb59b tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:13:54.940466 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-0e128bab-4cbb-468d-8f47-1b43610bb59b tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:13:54.940916 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-0e128bab-4cbb-468d-8f47-1b43610bb59b tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:13:54.958490 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-ef614d02-ef52-442e-8ff3-334f6313dc1f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046031 Oct 20 06:13:54.959329 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 544/1102] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:13:54 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:13:55.073972 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-0e128bab-4cbb-468d-8f47-1b43610bb59b tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:13:55.082486 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-0e128bab-4cbb-468d-8f47-1b43610bb59b tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:13:55.083937 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-0e128bab-4cbb-468d-8f47-1b43610bb59b tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:13:55.085133 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-0e128bab-4cbb-468d-8f47-1b43610bb59b tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1745 microversion: 2.20 time: 0.158432 Oct 20 06:13:55.085698 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 559/1103] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:13:54 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1745 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 20 06:13:55.971210 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-70550aa3-9d94-466a-93c1-08383c890279 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:13:55.973389 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-70550aa3-9d94-466a-93c1-08383c890279 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:13:55.980338 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-70550aa3-9d94-466a-93c1-08383c890279 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:13:55.981283 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-70550aa3-9d94-466a-93c1-08383c890279 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:13:55.981283 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-70550aa3-9d94-466a-93c1-08383c890279 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:13:55.981972 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-70550aa3-9d94-466a-93c1-08383c890279 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:13:55.982426 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-70550aa3-9d94-466a-93c1-08383c890279 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:13:55.982855 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-70550aa3-9d94-466a-93c1-08383c890279 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:13:56.012988 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-70550aa3-9d94-466a-93c1-08383c890279 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045729 Oct 20 06:13:56.013535 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 545/1104] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:13:55 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:13:56.110376 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-d247ed0c-7b32-4c23-80bc-d3246ee849f8 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:13:56.110962 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-d247ed0c-7b32-4c23-80bc-d3246ee849f8 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:13:56.118340 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d247ed0c-7b32-4c23-80bc-d3246ee849f8 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:13:56.118826 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d247ed0c-7b32-4c23-80bc-d3246ee849f8 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:13:56.119274 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d247ed0c-7b32-4c23-80bc-d3246ee849f8 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:13:56.119977 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d247ed0c-7b32-4c23-80bc-d3246ee849f8 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:13:56.120432 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d247ed0c-7b32-4c23-80bc-d3246ee849f8 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:13:56.120931 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d247ed0c-7b32-4c23-80bc-d3246ee849f8 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:13:56.256318 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-d247ed0c-7b32-4c23-80bc-d3246ee849f8 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:13:56.265307 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-d247ed0c-7b32-4c23-80bc-d3246ee849f8 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:13:56.266753 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-d247ed0c-7b32-4c23-80bc-d3246ee849f8 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:13:56.267914 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-d247ed0c-7b32-4c23-80bc-d3246ee849f8 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1745 microversion: 2.20 time: 0.161436 Oct 20 06:13:56.268464 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 560/1105] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:13:56 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1745 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:13:57.026050 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-7ea95ecd-4f47-4722-9fdf-10e7040c39df tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:13:57.028234 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-7ea95ecd-4f47-4722-9fdf-10e7040c39df tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:13:57.034638 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7ea95ecd-4f47-4722-9fdf-10e7040c39df tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:13:57.035118 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7ea95ecd-4f47-4722-9fdf-10e7040c39df tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:13:57.035547 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7ea95ecd-4f47-4722-9fdf-10e7040c39df tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:13:57.036232 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7ea95ecd-4f47-4722-9fdf-10e7040c39df tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:13:57.036676 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7ea95ecd-4f47-4722-9fdf-10e7040c39df tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:13:57.037184 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7ea95ecd-4f47-4722-9fdf-10e7040c39df tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:13:57.066928 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-7ea95ecd-4f47-4722-9fdf-10e7040c39df tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045427 Oct 20 06:13:57.067477 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 546/1106] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:13:57 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:13:57.294441 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-0173d3fb-f92c-480b-8434-c3e17920bb85 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:13:57.295047 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-0173d3fb-f92c-480b-8434-c3e17920bb85 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:13:57.301022 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-0173d3fb-f92c-480b-8434-c3e17920bb85 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:13:57.301724 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-0173d3fb-f92c-480b-8434-c3e17920bb85 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:13:57.302148 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-0173d3fb-f92c-480b-8434-c3e17920bb85 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:13:57.303598 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-0173d3fb-f92c-480b-8434-c3e17920bb85 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:13:57.304048 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-0173d3fb-f92c-480b-8434-c3e17920bb85 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:13:57.304662 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-0173d3fb-f92c-480b-8434-c3e17920bb85 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:13:57.436489 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-0173d3fb-f92c-480b-8434-c3e17920bb85 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:13:57.445771 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-0173d3fb-f92c-480b-8434-c3e17920bb85 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:13:57.447212 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-0173d3fb-f92c-480b-8434-c3e17920bb85 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:13:57.448373 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-0173d3fb-f92c-480b-8434-c3e17920bb85 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1745 microversion: 2.20 time: 0.157953 Oct 20 06:13:57.448952 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 561/1107] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:13:57 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1745 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:13:58.079469 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-462cf2d5-c4b2-4750-906d-93e3bed04a66 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:13:58.081686 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-462cf2d5-c4b2-4750-906d-93e3bed04a66 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:13:58.088681 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-462cf2d5-c4b2-4750-906d-93e3bed04a66 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:13:58.089182 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-462cf2d5-c4b2-4750-906d-93e3bed04a66 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:13:58.089612 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-462cf2d5-c4b2-4750-906d-93e3bed04a66 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:13:58.090291 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-462cf2d5-c4b2-4750-906d-93e3bed04a66 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:13:58.090736 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-462cf2d5-c4b2-4750-906d-93e3bed04a66 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:13:58.091151 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-462cf2d5-c4b2-4750-906d-93e3bed04a66 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:13:58.119918 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-462cf2d5-c4b2-4750-906d-93e3bed04a66 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044432 Oct 20 06:13:58.120446 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 547/1108] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:13:58 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:13:58.473548 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-c7c264d3-79d0-41dd-b953-93ec23e9e791 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:13:58.474156 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-c7c264d3-79d0-41dd-b953-93ec23e9e791 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:13:58.480740 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c7c264d3-79d0-41dd-b953-93ec23e9e791 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:13:58.481221 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c7c264d3-79d0-41dd-b953-93ec23e9e791 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:13:58.481659 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c7c264d3-79d0-41dd-b953-93ec23e9e791 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:13:58.482349 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c7c264d3-79d0-41dd-b953-93ec23e9e791 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:13:58.482796 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c7c264d3-79d0-41dd-b953-93ec23e9e791 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:13:58.483221 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c7c264d3-79d0-41dd-b953-93ec23e9e791 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:13:58.607903 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-c7c264d3-79d0-41dd-b953-93ec23e9e791 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:13:58.616963 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-c7c264d3-79d0-41dd-b953-93ec23e9e791 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:13:58.618390 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-c7c264d3-79d0-41dd-b953-93ec23e9e791 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:13:58.619579 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-c7c264d3-79d0-41dd-b953-93ec23e9e791 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1745 microversion: 2.20 time: 0.149913 Oct 20 06:13:58.620122 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 562/1109] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:13:58 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1745 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:13:59.132593 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-1ffc0bb1-254d-4bb1-b3f1-c583a294a1ae tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:13:59.134785 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-1ffc0bb1-254d-4bb1-b3f1-c583a294a1ae tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:13:59.141181 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1ffc0bb1-254d-4bb1-b3f1-c583a294a1ae tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:13:59.141666 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1ffc0bb1-254d-4bb1-b3f1-c583a294a1ae tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:13:59.142103 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1ffc0bb1-254d-4bb1-b3f1-c583a294a1ae tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:13:59.142792 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1ffc0bb1-254d-4bb1-b3f1-c583a294a1ae tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:13:59.143242 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1ffc0bb1-254d-4bb1-b3f1-c583a294a1ae tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:13:59.143671 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1ffc0bb1-254d-4bb1-b3f1-c583a294a1ae tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:13:59.174682 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-1ffc0bb1-254d-4bb1-b3f1-c583a294a1ae tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045999 Oct 20 06:13:59.175245 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 548/1110] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:13:59 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:13:59.648029 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-b1ce7339-7915-4294-934d-9bfe1eff3820 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:13:59.649026 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-b1ce7339-7915-4294-934d-9bfe1eff3820 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:13:59.657510 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b1ce7339-7915-4294-934d-9bfe1eff3820 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:13:59.657994 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b1ce7339-7915-4294-934d-9bfe1eff3820 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:13:59.658431 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b1ce7339-7915-4294-934d-9bfe1eff3820 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:13:59.659188 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b1ce7339-7915-4294-934d-9bfe1eff3820 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:13:59.659646 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b1ce7339-7915-4294-934d-9bfe1eff3820 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:13:59.660073 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b1ce7339-7915-4294-934d-9bfe1eff3820 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:13:59.835037 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-b1ce7339-7915-4294-934d-9bfe1eff3820 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:13:59.843873 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-b1ce7339-7915-4294-934d-9bfe1eff3820 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:13:59.845419 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-b1ce7339-7915-4294-934d-9bfe1eff3820 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:13:59.846599 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-b1ce7339-7915-4294-934d-9bfe1eff3820 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1745 microversion: 2.20 time: 0.205129 Oct 20 06:13:59.847157 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 563/1111] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:13:59 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1745 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:14:00.187736 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-a04c010f-b345-4e77-9ccf-6acc4ce54f67 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:14:00.189947 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-a04c010f-b345-4e77-9ccf-6acc4ce54f67 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:14:00.196969 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a04c010f-b345-4e77-9ccf-6acc4ce54f67 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:14:00.197452 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a04c010f-b345-4e77-9ccf-6acc4ce54f67 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:14:00.197893 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a04c010f-b345-4e77-9ccf-6acc4ce54f67 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:14:00.198587 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a04c010f-b345-4e77-9ccf-6acc4ce54f67 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:14:00.199041 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a04c010f-b345-4e77-9ccf-6acc4ce54f67 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:14:00.199471 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a04c010f-b345-4e77-9ccf-6acc4ce54f67 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:14:00.227750 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-a04c010f-b345-4e77-9ccf-6acc4ce54f67 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044003 Oct 20 06:14:00.228292 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 549/1112] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:14:00 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:14:00.871746 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-a72ad78b-6ac9-485e-a7ab-98368f443023 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:14:00.872354 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-a72ad78b-6ac9-485e-a7ab-98368f443023 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:14:00.879087 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a72ad78b-6ac9-485e-a7ab-98368f443023 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:14:00.879569 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a72ad78b-6ac9-485e-a7ab-98368f443023 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:14:00.880001 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a72ad78b-6ac9-485e-a7ab-98368f443023 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:14:00.881313 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a72ad78b-6ac9-485e-a7ab-98368f443023 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:14:00.881888 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a72ad78b-6ac9-485e-a7ab-98368f443023 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:14:00.882176 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a72ad78b-6ac9-485e-a7ab-98368f443023 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:14:01.008205 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-a72ad78b-6ac9-485e-a7ab-98368f443023 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:14:01.016553 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-a72ad78b-6ac9-485e-a7ab-98368f443023 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:14:01.018014 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-a72ad78b-6ac9-485e-a7ab-98368f443023 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:14:01.019156 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-a72ad78b-6ac9-485e-a7ab-98368f443023 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 200 len: 1745 microversion: 2.20 time: 0.151247 Oct 20 06:14:01.019708 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 564/1113] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:14:00 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 1745 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:14:01.103300 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-15741303-002a-4dc6-8458-2da5066d074c tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:14:01.103818 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-15741303-002a-4dc6-8458-2da5066d074c tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:14:01.109658 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-15741303-002a-4dc6-8458-2da5066d074c tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:14:01.110132 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-15741303-002a-4dc6-8458-2da5066d074c tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:14:01.110562 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-15741303-002a-4dc6-8458-2da5066d074c tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:14:01.111240 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-15741303-002a-4dc6-8458-2da5066d074c tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:14:01.111686 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-15741303-002a-4dc6-8458-2da5066d074c tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:14:01.112106 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-15741303-002a-4dc6-8458-2da5066d074c tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:14:01.239620 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-18c48552-8f99-4e41-a75d-e28ae42feb44 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:14:01.242955 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-18c48552-8f99-4e41-a75d-e28ae42feb44 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:14:01.249401 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-18c48552-8f99-4e41-a75d-e28ae42feb44 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:14:01.249967 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-18c48552-8f99-4e41-a75d-e28ae42feb44 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:14:01.250478 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-18c48552-8f99-4e41-a75d-e28ae42feb44 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:14:01.251443 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-18c48552-8f99-4e41-a75d-e28ae42feb44 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:14:01.251967 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-18c48552-8f99-4e41-a75d-e28ae42feb44 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:14:01.252398 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-18c48552-8f99-4e41-a75d-e28ae42feb44 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:14:01.253843 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG dbcounter [-] [118860] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=118860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:14:01.283152 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-18c48552-8f99-4e41-a75d-e28ae42feb44 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047398 Oct 20 06:14:01.284022 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 565/1114] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:14:01 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 20 06:14:01.410205 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-15741303-002a-4dc6-8458-2da5066d074c tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "DELETE /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d/os-volume_attachments/ffda1749-fb55-4929-9287-47fe4ed7301f" status: 202 len: 0 microversion: 2.20 time: 0.310860 Oct 20 06:14:01.410812 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 550/1115] 10.222.0.20 () {60 vars in 1457 bytes} [Thu Oct 20 06:14:01 2022] DELETE /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d/os-volume_attachments/ffda1749-fb55-4929-9287-47fe4ed7301f => generated 0 bytes in 312 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 20 06:14:01.419586 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-95ec26f7-85bd-4343-bbba-3fa10c5ff1d2 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:14:01.421736 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-95ec26f7-85bd-4343-bbba-3fa10c5ff1d2 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:14:01.428171 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-95ec26f7-85bd-4343-bbba-3fa10c5ff1d2 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:14:01.428772 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-95ec26f7-85bd-4343-bbba-3fa10c5ff1d2 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:14:01.429211 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-95ec26f7-85bd-4343-bbba-3fa10c5ff1d2 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:14:01.429893 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-95ec26f7-85bd-4343-bbba-3fa10c5ff1d2 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:14:01.430339 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-95ec26f7-85bd-4343-bbba-3fa10c5ff1d2 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:14:01.430758 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-95ec26f7-85bd-4343-bbba-3fa10c5ff1d2 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:14:01.458707 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-95ec26f7-85bd-4343-bbba-3fa10c5ff1d2 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.043031 Oct 20 06:14:01.459242 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 566/1116] 10.222.0.20 () {60 vars in 1343 bytes} [Thu Oct 20 06:14:01 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:14:01.522264 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-cb872e9d-5eae-477c-a9ce-3d9b5049b0c6 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:14:01.522762 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-cb872e9d-5eae-477c-a9ce-3d9b5049b0c6 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:14:01.529195 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-cb872e9d-5eae-477c-a9ce-3d9b5049b0c6 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:14:01.529682 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-cb872e9d-5eae-477c-a9ce-3d9b5049b0c6 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:14:01.530123 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-cb872e9d-5eae-477c-a9ce-3d9b5049b0c6 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:14:01.530821 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-cb872e9d-5eae-477c-a9ce-3d9b5049b0c6 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:14:01.531272 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-cb872e9d-5eae-477c-a9ce-3d9b5049b0c6 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:14:01.531698 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-cb872e9d-5eae-477c-a9ce-3d9b5049b0c6 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:14:01.560041 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-cb872e9d-5eae-477c-a9ce-3d9b5049b0c6 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Going to try to terminate instance {{(pid=118860) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 20 06:14:01.566507 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.compute.api [None req-cb872e9d-5eae-477c-a9ce-3d9b5049b0c6 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Working on deleting snapshot 11c5f153-a976-4142-9472-a3ca05955beb from shelved instance... Oct 20 06:14:02.190300 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-cb872e9d-5eae-477c-a9ce-3d9b5049b0c6 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Doing local delete in cell 0427de57-e601-4680-b509-510497497143(cell1) {{(pid=118860) _delete /opt/stack/nova/nova/compute/api.py:2546}} Oct 20 06:14:02.191012 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-cb872e9d-5eae-477c-a9ce-3d9b5049b0c6 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:14:02.191481 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-cb872e9d-5eae-477c-a9ce-3d9b5049b0c6 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:14:02.191911 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-cb872e9d-5eae-477c-a9ce-3d9b5049b0c6 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:14:02.192322 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.compute.api [None req-cb872e9d-5eae-477c-a9ce-3d9b5049b0c6 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Oct 20 06:14:02.200185 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.network.neutron [None req-cb872e9d-5eae-477c-a9ce-3d9b5049b0c6 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] deallocate_for_instance() {{(pid=118860) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1780}} Oct 20 06:14:02.295880 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-49755ff1-5109-41b5-adf1-e817e81a85b7 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:14:02.298783 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-49755ff1-5109-41b5-adf1-e817e81a85b7 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:14:02.306346 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-49755ff1-5109-41b5-adf1-e817e81a85b7 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:14:02.306840 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-49755ff1-5109-41b5-adf1-e817e81a85b7 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:14:02.307648 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-49755ff1-5109-41b5-adf1-e817e81a85b7 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:14:02.307986 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-49755ff1-5109-41b5-adf1-e817e81a85b7 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:14:02.308442 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-49755ff1-5109-41b5-adf1-e817e81a85b7 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:14:02.308908 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-49755ff1-5109-41b5-adf1-e817e81a85b7 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:14:02.339168 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-49755ff1-5109-41b5-adf1-e817e81a85b7 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047482 Oct 20 06:14:02.339740 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 567/1117] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:14:02 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 20 06:14:03.276630 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.network.neutron [None req-cb872e9d-5eae-477c-a9ce-3d9b5049b0c6 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Updating instance_info_cache with network_info: [] {{(pid=118860) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 20 06:14:03.435383 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [req-f94e149d-ed09-42b2-b813-36ebf1513f34 req-08528a9d-8183-402e-9b3e-b0756690d9b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71be459d-e948-4a17-b379-182f4196411d", "name": "network-vif-deleted", "tag": "eb253026-482c-4675-acce-8325c21757fd"}]} {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 06:14:03.446113 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [req-f94e149d-ed09-42b2-b813-36ebf1513f34 req-08528a9d-8183-402e-9b3e-b0756690d9b7 service nova] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:14:03.446677 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [req-f94e149d-ed09-42b2-b813-36ebf1513f34 req-08528a9d-8183-402e-9b3e-b0756690d9b7 service nova] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:14:03.447166 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [req-f94e149d-ed09-42b2-b813-36ebf1513f34 req-08528a9d-8183-402e-9b3e-b0756690d9b7 service nova] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:14:03.459589 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.compute.server_external_events [req-f94e149d-ed09-42b2-b813-36ebf1513f34 req-08528a9d-8183-402e-9b3e-b0756690d9b7 service nova] Unable to find a host for instance 71be459d-e948-4a17-b379-182f4196411d. Dropping event network-vif-deleted {{(pid=118861) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 20 06:14:03.460549 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [req-f94e149d-ed09-42b2-b813-36ebf1513f34 req-08528a9d-8183-402e-9b3e-b0756690d9b7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.191602 Oct 20 06:14:03.461466 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 568/1118] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 20 06:14:03 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 193 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Oct 20 06:14:03.468731 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-d17ab2fc-48d0-4e2e-ba9a-8d9f72dc7750 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:14:03.470998 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-d17ab2fc-48d0-4e2e-ba9a-8d9f72dc7750 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:14:03.478961 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d17ab2fc-48d0-4e2e-ba9a-8d9f72dc7750 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:14:03.479533 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d17ab2fc-48d0-4e2e-ba9a-8d9f72dc7750 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:14:03.480073 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d17ab2fc-48d0-4e2e-ba9a-8d9f72dc7750 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:14:03.480874 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d17ab2fc-48d0-4e2e-ba9a-8d9f72dc7750 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:14:03.481397 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d17ab2fc-48d0-4e2e-ba9a-8d9f72dc7750 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:14:03.481878 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d17ab2fc-48d0-4e2e-ba9a-8d9f72dc7750 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:14:03.491659 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.scheduler.client.report [None req-cb872e9d-5eae-477c-a9ce-3d9b5049b0c6 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Deleted allocations for instance 71be459d-e948-4a17-b379-182f4196411d Oct 20 06:14:03.501424 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG dbcounter [-] [118861] Writing DB stats nova_cell1:SELECT=100 {{(pid=118861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:14:03.516165 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-d17ab2fc-48d0-4e2e-ba9a-8d9f72dc7750 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053397 Oct 20 06:14:03.517092 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 569/1119] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:14:03 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:14:03.626683 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-cb872e9d-5eae-477c-a9ce-3d9b5049b0c6 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "DELETE /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 204 len: 0 microversion: 2.20 time: 2.108111 Oct 20 06:14:03.627813 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 551/1120] 10.222.0.20 () {60 vars in 1280 bytes} [Thu Oct 20 06:14:01 2022] DELETE /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 0 bytes in 2110 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 20 06:14:03.636273 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-3fd89198-e5d0-4565-9634-04e47d97628c tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:14:03.636911 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-3fd89198-e5d0-4565-9634-04e47d97628c tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:14:03.639928 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG dbcounter [-] [118861] Writing DB stats nova_api:SELECT=58 {{(pid=118861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:14:03.644169 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-3fd89198-e5d0-4565-9634-04e47d97628c tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:14:03.644652 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-3fd89198-e5d0-4565-9634-04e47d97628c tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:14:03.645111 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-3fd89198-e5d0-4565-9634-04e47d97628c tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:14:03.645804 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-3fd89198-e5d0-4565-9634-04e47d97628c tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:14:03.646328 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-3fd89198-e5d0-4565-9634-04e47d97628c tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:14:03.647045 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-3fd89198-e5d0-4565-9634-04e47d97628c tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:14:03.663982 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.wsgi [None req-3fd89198-e5d0-4565-9634-04e47d97628c tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] HTTP exception thrown: Instance 71be459d-e948-4a17-b379-182f4196411d could not be found. Oct 20 06:14:03.665781 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-3fd89198-e5d0-4565-9634-04e47d97628c tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Request method failure captured: Oct 20 06:14:03.665781 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: request: GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d HTTP/1.1 Oct 20 06:14:03.665781 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: Accept: application/json Oct 20 06:14:03.665781 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: Accept-Encoding: identity Oct 20 06:14:03.665781 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: Connection: close Oct 20 06:14:03.665781 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: Content-Length: 0 Oct 20 06:14:03.665781 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: Content-Type: application/json Oct 20 06:14:03.665781 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: Host: 10.222.0.20 Oct 20 06:14:03.665781 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: Openstack-System-Scope: None Oct 20 06:14:03.665781 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: User-Agent: python-urllib3/1.26.12 Oct 20 06:14:03.665781 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Auth-Token: gAAAAABjUOT4WE-GeZ9nIY9RvQJPLx5cfKBHzS8w2P3ohAEeWZ7MhC3JV8mQEPTHfIaK5zuvYmNfTMyv3TZQQoGbyre2yxtMqG3RrbumkPK47M1IYrJzUzzgVth48PWOx3W0AtdNXY07UuKLEobMmvxQ_9GrsNYkeXVZIvq9kqYpG7ipSg6jPmI Oct 20 06:14:03.665781 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Domain-Id: None Oct 20 06:14:03.665781 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Domain-Name: None Oct 20 06:14:03.665781 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Identity-Status: Confirmed Oct 20 06:14:03.665781 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Is-Admin-Project: True Oct 20 06:14:03.665781 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Openstack-Nova-Api-Version: 2.20 Oct 20 06:14:03.665781 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Project-Domain-Id: default Oct 20 06:14:03.665781 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Project-Domain-Name: Default Oct 20 06:14:03.665781 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Project-Id: 66a33a727f9c40b99fb14bd2e0fc5090 Oct 20 06:14:03.665781 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1640997354 Oct 20 06:14:03.665781 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Role: reader,member Oct 20 06:14:03.665781 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Roles: reader,member Oct 20 06:14:03.667520 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/66a33a727f9c40b99fb14bd2e0fc5090"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_66a33a727f9c40b99fb14bd2e0fc5090"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/66a33a727f9c40b99fb14bd2e0fc5090"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/66a33a727f9c40b99fb14bd2e0fc5090"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 20 06:14:03.667520 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1640997354 Oct 20 06:14:03.667520 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Tenant-Id: 66a33a727f9c40b99fb14bd2e0fc5090 Oct 20 06:14:03.667520 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1640997354 Oct 20 06:14:03.667520 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-User: tempest-AttachVolumeShelveTestJSON-1640997354-project Oct 20 06:14:03.667520 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-User-Domain-Id: default Oct 20 06:14:03.667520 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-User-Domain-Name: Default Oct 20 06:14:03.667520 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-User-Id: db34ffc8f90247daac1548bbb421b015 Oct 20 06:14:03.667520 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1640997354-project Oct 20 06:14:03.667520 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: method: > Oct 20 06:14:03.667520 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: exception: Instance 71be459d-e948-4a17-b379-182f4196411d could not be found. Oct 20 06:14:03.667520 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: action_args: {'id': '71be459d-e948-4a17-b379-182f4196411d'} Oct 20 06:14:03.668492 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 20 06:14:03.668492 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 06:14:03.668492 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 20 06:14:03.668492 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 20 06:14:03.668492 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 20 06:14:03.668492 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 20 06:14:03.668492 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 20 06:14:03.668492 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 20 06:14:03.668492 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 20 06:14:03.668492 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 20 06:14:03.668492 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 71be459d-e948-4a17-b379-182f4196411d could not be found. Oct 20 06:14:03.668492 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi Oct 20 06:14:03.668492 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 06:14:03.668492 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi Oct 20 06:14:03.668492 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 06:14:03.668492 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 06:14:03.668492 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 06:14:03.668492 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 20 06:14:03.668492 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 20 06:14:03.668492 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 20 06:14:03.670059 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 20 06:14:03.670059 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 20 06:14:03.670059 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 20 06:14:03.670059 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 20 06:14:03.670059 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 20 06:14:03.670059 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 20 06:14:03.670059 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 20 06:14:03.670059 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71be459d-e948-4a17-b379-182f4196411d could not be found. Oct 20 06:14:03.670059 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi Oct 20 06:14:03.670059 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 06:14:03.670059 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi Oct 20 06:14:03.670059 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 06:14:03.670059 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 06:14:03.670059 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 06:14:03.670059 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 20 06:14:03.670059 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 20 06:14:03.670059 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71be459d-e948-4a17-b379-182f4196411d could not be found. Oct 20 06:14:03.670059 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi Oct 20 06:14:03.672035 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-3fd89198-e5d0-4565-9634-04e47d97628c tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Returning 404 to user: Instance 71be459d-e948-4a17-b379-182f4196411d could not be found. {{(pid=118861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 20 06:14:03.673142 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-3fd89198-e5d0-4565-9634-04e47d97628c tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 404 len: 111 microversion: 2.20 time: 0.040832 Oct 20 06:14:03.673843 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 570/1121] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:14:03 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 20 06:14:03.688230 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-8a66074a-b327-451b-9149-1739ddf703e8 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '.version_select at 0x7fbe4b002ee0>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:14:03.710559 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-8a66074a-b327-451b-9149-1739ddf703e8 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-530646533" status: 204 len: 0 microversion: 2.20 time: 0.027510 Oct 20 06:14:03.711442 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 552/1122] 10.222.0.20 () {60 vars in 1259 bytes} [Thu Oct 20 06:14:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-530646533 => generated 0 bytes in 29 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 20 06:14:04.431221 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-1f5346f6-b2fd-40fd-bbaa-10c98cca0c88 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Action: 'create', calling method: .version_select at 0x7fbe4ad55ca0>, body: {"keypair": {"name": "tempest-keypair-1581360041", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIDmPL5Oh03zOb7mkjky2JAJYly229RJ48+KFrlb4L4FXNd7Yqlj1Mbsf92GuITWCTWjUME6RUebmZW9y0D65hrd4sGpw+gMk4FnPtDPutoeP9vBPx2TdxbN+FTvBxbpXQ=="}} {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 06:14:04.447781 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.quota [None req-1f5346f6-b2fd-40fd-bbaa-10c98cca0c88 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Getting quotas for project 66a33a727f9c40b99fb14bd2e0fc5090. Resources: {'key_pairs'} {{(pid=118861) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 20 06:14:04.451646 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.quota [None req-1f5346f6-b2fd-40fd-bbaa-10c98cca0c88 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Getting quotas for user db34ffc8f90247daac1548bbb421b015 and project 66a33a727f9c40b99fb14bd2e0fc5090. Resources: {'key_pairs'} {{(pid=118861) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 20 06:14:04.477257 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-1f5346f6-b2fd-40fd-bbaa-10c98cca0c88 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.050430 Oct 20 06:14:04.477886 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 571/1123] 10.222.0.20 () {62 vars in 1200 bytes} [Thu Oct 20 06:14:04 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 52 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 20 06:14:04.530101 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-6b7efd23-3d09-47d4-9d7a-c49d75d5bc0f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:14:04.532362 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-6b7efd23-3d09-47d4-9d7a-c49d75d5bc0f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:14:04.534331 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG dbcounter [-] [118860] Writing DB stats nova_api:SELECT=66,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=118860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:14:04.540778 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-6b7efd23-3d09-47d4-9d7a-c49d75d5bc0f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:14:04.541354 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-6b7efd23-3d09-47d4-9d7a-c49d75d5bc0f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:14:04.541863 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-6b7efd23-3d09-47d4-9d7a-c49d75d5bc0f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:14:04.542636 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-6b7efd23-3d09-47d4-9d7a-c49d75d5bc0f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:14:04.543156 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-6b7efd23-3d09-47d4-9d7a-c49d75d5bc0f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:14:04.543679 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-6b7efd23-3d09-47d4-9d7a-c49d75d5bc0f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:14:04.575622 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-6b7efd23-3d09-47d4-9d7a-c49d75d5bc0f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050331 Oct 20 06:14:04.576186 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 553/1124] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:14:04 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:14:05.591029 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-93cb1a5d-ddd6-48f9-a269-0abda3691c92 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:14:05.593295 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-93cb1a5d-ddd6-48f9-a269-0abda3691c92 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:14:05.600948 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-93cb1a5d-ddd6-48f9-a269-0abda3691c92 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:14:05.601433 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-93cb1a5d-ddd6-48f9-a269-0abda3691c92 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:14:05.601864 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-93cb1a5d-ddd6-48f9-a269-0abda3691c92 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:14:05.602555 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-93cb1a5d-ddd6-48f9-a269-0abda3691c92 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:14:05.602999 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-93cb1a5d-ddd6-48f9-a269-0abda3691c92 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:14:05.603419 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-93cb1a5d-ddd6-48f9-a269-0abda3691c92 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:14:05.633783 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-93cb1a5d-ddd6-48f9-a269-0abda3691c92 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046669 Oct 20 06:14:05.634358 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 572/1125] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:14:05 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:14:05.678712 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-51e18d59-c446-479c-ba79-3b6c700bf64b tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1258739973", "imageRef": "9fcec276-734d-41d9-905b-10d2bbcbfba5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9c4850fd-a976-4360-b16b-9fd1520b1b08"}], "security_groups": [{"name": "tempest-securitygroup--971692794"}], "key_name": "tempest-keypair-1581360041", "user_data": "}} {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 06:14:05.782091 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.network.neutron [None req-51e18d59-c446-479c-ba79-3b6c700bf64b tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] validate_networks() for [('9c4850fd-a976-4360-b16b-9fd1520b1b08', None, None, None, None, None)] {{(pid=118860) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 20 06:14:06.278688 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.virt.hardware [None req-51e18d59-c446-479c-ba79-3b6c700bf64b tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Flavor limits 0:0:0 {{(pid=118860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 20 06:14:06.279105 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.virt.hardware [None req-51e18d59-c446-479c-ba79-3b6c700bf64b tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Image limits 0:0:0 {{(pid=118860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 20 06:14:06.279573 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.virt.hardware [None req-51e18d59-c446-479c-ba79-3b6c700bf64b tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Flavor pref 0:0:0 {{(pid=118860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 20 06:14:06.279979 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.virt.hardware [None req-51e18d59-c446-479c-ba79-3b6c700bf64b tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Image pref 0:0:0 {{(pid=118860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 20 06:14:06.280385 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.virt.hardware [None req-51e18d59-c446-479c-ba79-3b6c700bf64b tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 20 06:14:06.289725 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-51e18d59-c446-479c-ba79-3b6c700bf64b tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:14:06.290138 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-51e18d59-c446-479c-ba79-3b6c700bf64b tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:14:06.290571 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-51e18d59-c446-479c-ba79-3b6c700bf64b tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:14:06.291286 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-51e18d59-c446-479c-ba79-3b6c700bf64b tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:14:06.291730 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-51e18d59-c446-479c-ba79-3b6c700bf64b tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:14:06.292154 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-51e18d59-c446-479c-ba79-3b6c700bf64b tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:14:06.308672 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.quota [None req-51e18d59-c446-479c-ba79-3b6c700bf64b tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Getting quotas for project 66a33a727f9c40b99fb14bd2e0fc5090. Resources: {'cores', 'ram', 'instances'} {{(pid=118860) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 20 06:14:06.312558 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.quota [None req-51e18d59-c446-479c-ba79-3b6c700bf64b tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Getting quotas for user db34ffc8f90247daac1548bbb421b015 and project 66a33a727f9c40b99fb14bd2e0fc5090. Resources: {'cores', 'ram', 'instances'} {{(pid=118860) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 20 06:14:06.323361 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-51e18d59-c446-479c-ba79-3b6c700bf64b tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Going to run 1 instances... {{(pid=118860) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 20 06:14:06.325655 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-51e18d59-c446-479c-ba79-3b6c700bf64b tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: a8c74b2c-bf36-4b49-8855-9eb732003e66] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9fcec276-734d-41d9-905b-10d2bbcbfba5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118860) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 20 06:14:06.374235 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-51e18d59-c446-479c-ba79-3b6c700bf64b tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.700622 Oct 20 06:14:06.374878 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 554/1126] 10.222.0.20 () {62 vars in 1188 bytes} [Thu Oct 20 06:14:05 2022] POST /compute/v2.1/servers => generated 401 bytes in 702 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 20 06:14:06.386174 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-7e7f7640-3d87-4f49-8cca-9e4482d7ee1a tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:14:06.386784 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-7e7f7640-3d87-4f49-8cca-9e4482d7ee1a tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: a8c74b2c-bf36-4b49-8855-9eb732003e66] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:14:06.442332 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-7e7f7640-3d87-4f49-8cca-9e4482d7ee1a tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:14:06.450166 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-7e7f7640-3d87-4f49-8cca-9e4482d7ee1a tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:14:06.451612 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-7e7f7640-3d87-4f49-8cca-9e4482d7ee1a tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:14:06.452735 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-7e7f7640-3d87-4f49-8cca-9e4482d7ee1a tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/a8c74b2c-bf36-4b49-8855-9eb732003e66" status: 200 len: 1282 microversion: 2.20 time: 0.070426 Oct 20 06:14:06.453293 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 573/1127] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:14:06 2022] GET /compute/v2.1/servers/a8c74b2c-bf36-4b49-8855-9eb732003e66 => generated 1282 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:14:06.647521 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-563235ce-f52f-430b-a1a6-7251bcc65e8b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:14:06.649858 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-563235ce-f52f-430b-a1a6-7251bcc65e8b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:14:06.660879 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-563235ce-f52f-430b-a1a6-7251bcc65e8b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:14:06.661736 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-563235ce-f52f-430b-a1a6-7251bcc65e8b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:14:06.661736 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-563235ce-f52f-430b-a1a6-7251bcc65e8b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:14:06.662550 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-563235ce-f52f-430b-a1a6-7251bcc65e8b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:14:06.663244 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-563235ce-f52f-430b-a1a6-7251bcc65e8b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:14:06.663926 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-563235ce-f52f-430b-a1a6-7251bcc65e8b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:14:06.697609 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-563235ce-f52f-430b-a1a6-7251bcc65e8b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055021 Oct 20 06:14:06.698202 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 555/1128] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:14:06 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:14:07.477966 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-21fb1c3b-c25b-4e69-99fe-f0529d5e401b tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:14:07.478579 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-21fb1c3b-c25b-4e69-99fe-f0529d5e401b tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: a8c74b2c-bf36-4b49-8855-9eb732003e66] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:14:07.484965 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-21fb1c3b-c25b-4e69-99fe-f0529d5e401b tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:14:07.485438 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-21fb1c3b-c25b-4e69-99fe-f0529d5e401b tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:14:07.485866 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-21fb1c3b-c25b-4e69-99fe-f0529d5e401b tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:14:07.486551 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-21fb1c3b-c25b-4e69-99fe-f0529d5e401b tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:14:07.486994 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-21fb1c3b-c25b-4e69-99fe-f0529d5e401b tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:14:07.487411 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-21fb1c3b-c25b-4e69-99fe-f0529d5e401b tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:14:07.552620 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-21fb1c3b-c25b-4e69-99fe-f0529d5e401b tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:14:07.560620 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-21fb1c3b-c25b-4e69-99fe-f0529d5e401b tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:14:07.562072 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-21fb1c3b-c25b-4e69-99fe-f0529d5e401b tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:14:07.563868 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-21fb1c3b-c25b-4e69-99fe-f0529d5e401b tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/a8c74b2c-bf36-4b49-8855-9eb732003e66" status: 200 len: 1334 microversion: 2.20 time: 0.090084 Oct 20 06:14:07.564420 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 574/1129] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:14:07 2022] GET /compute/v2.1/servers/a8c74b2c-bf36-4b49-8855-9eb732003e66 => generated 1334 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:14:07.710144 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-05eab668-366f-4551-b718-b3f4631676dd tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:14:07.712532 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-05eab668-366f-4551-b718-b3f4631676dd tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:14:07.719091 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-05eab668-366f-4551-b718-b3f4631676dd tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:14:07.719866 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-05eab668-366f-4551-b718-b3f4631676dd tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:14:07.720472 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-05eab668-366f-4551-b718-b3f4631676dd tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:14:07.721199 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-05eab668-366f-4551-b718-b3f4631676dd tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:14:07.721657 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-05eab668-366f-4551-b718-b3f4631676dd tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:14:07.722211 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-05eab668-366f-4551-b718-b3f4631676dd tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:14:07.753955 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-05eab668-366f-4551-b718-b3f4631676dd tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047719 Oct 20 06:14:07.754424 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 556/1130] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:14:07 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:14:08.589734 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-7c3100a3-b169-4655-8029-78b012254a27 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:14:08.590550 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-7c3100a3-b169-4655-8029-78b012254a27 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: a8c74b2c-bf36-4b49-8855-9eb732003e66] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:14:08.597259 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7c3100a3-b169-4655-8029-78b012254a27 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:14:08.597663 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7c3100a3-b169-4655-8029-78b012254a27 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:14:08.598834 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7c3100a3-b169-4655-8029-78b012254a27 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:14:08.599848 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7c3100a3-b169-4655-8029-78b012254a27 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:14:08.601700 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7c3100a3-b169-4655-8029-78b012254a27 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:14:08.602245 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7c3100a3-b169-4655-8029-78b012254a27 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:14:08.733075 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-7c3100a3-b169-4655-8029-78b012254a27 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:14:08.742002 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-7c3100a3-b169-4655-8029-78b012254a27 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:14:08.743430 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-7c3100a3-b169-4655-8029-78b012254a27 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:14:08.744713 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-7c3100a3-b169-4655-8029-78b012254a27 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/a8c74b2c-bf36-4b49-8855-9eb732003e66" status: 200 len: 1407 microversion: 2.20 time: 0.158906 Oct 20 06:14:08.745271 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 575/1131] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:14:08 2022] GET /compute/v2.1/servers/a8c74b2c-bf36-4b49-8855-9eb732003e66 => generated 1407 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:14:08.767267 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-90870a6a-1cdb-4ff8-8331-18765adf79d5 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:14:08.769445 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-90870a6a-1cdb-4ff8-8331-18765adf79d5 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:14:08.775926 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-90870a6a-1cdb-4ff8-8331-18765adf79d5 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:14:08.776413 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-90870a6a-1cdb-4ff8-8331-18765adf79d5 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:14:08.776884 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-90870a6a-1cdb-4ff8-8331-18765adf79d5 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:14:08.777586 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-90870a6a-1cdb-4ff8-8331-18765adf79d5 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:14:08.778039 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-90870a6a-1cdb-4ff8-8331-18765adf79d5 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:14:08.778463 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-90870a6a-1cdb-4ff8-8331-18765adf79d5 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:14:08.809631 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-90870a6a-1cdb-4ff8-8331-18765adf79d5 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046232 Oct 20 06:14:08.810199 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 557/1132] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:14:08 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:14:08.978026 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [req-07492829-49de-4479-a5a8-dd68d4c1a507 req-65e97971-959a-43fd-ad1e-e692ed0ac05b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a8c74b2c-bf36-4b49-8855-9eb732003e66", "tag": "b16407be-86ee-4592-929b-a1450b1682e0"}]} {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 06:14:08.991150 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [req-07492829-49de-4479-a5a8-dd68d4c1a507 req-65e97971-959a-43fd-ad1e-e692ed0ac05b service nova] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:14:08.991825 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [req-07492829-49de-4479-a5a8-dd68d4c1a507 req-65e97971-959a-43fd-ad1e-e692ed0ac05b service nova] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:14:08.992433 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [req-07492829-49de-4479-a5a8-dd68d4c1a507 req-65e97971-959a-43fd-ad1e-e692ed0ac05b service nova] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:14:09.006099 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.compute.server_external_events [req-07492829-49de-4479-a5a8-dd68d4c1a507 req-65e97971-959a-43fd-ad1e-e692ed0ac05b service nova] Creating event network-changed:b16407be-86ee-4592-929b-a1450b1682e0 for instance a8c74b2c-bf36-4b49-8855-9eb732003e66 on hv-cinder-86156 Oct 20 06:14:09.025952 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [req-07492829-49de-4479-a5a8-dd68d4c1a507 req-65e97971-959a-43fd-ad1e-e692ed0ac05b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054378 Oct 20 06:14:09.027155 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 576/1133] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 20 06:14:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:14:09.770469 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-43fcaae5-9989-4a2a-a532-77752385ec65 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:14:09.771848 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-43fcaae5-9989-4a2a-a532-77752385ec65 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: a8c74b2c-bf36-4b49-8855-9eb732003e66] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:14:09.778194 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-43fcaae5-9989-4a2a-a532-77752385ec65 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:14:09.778670 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-43fcaae5-9989-4a2a-a532-77752385ec65 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:14:09.779104 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-43fcaae5-9989-4a2a-a532-77752385ec65 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:14:09.779801 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-43fcaae5-9989-4a2a-a532-77752385ec65 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:14:09.780249 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-43fcaae5-9989-4a2a-a532-77752385ec65 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:14:09.780671 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-43fcaae5-9989-4a2a-a532-77752385ec65 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:14:09.825444 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-bf63c003-9791-4e4c-8ab3-067a18308c30 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:14:09.827822 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-bf63c003-9791-4e4c-8ab3-067a18308c30 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:14:09.834817 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-bf63c003-9791-4e4c-8ab3-067a18308c30 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:14:09.835393 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-bf63c003-9791-4e4c-8ab3-067a18308c30 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:14:09.835900 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-bf63c003-9791-4e4c-8ab3-067a18308c30 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:14:09.836670 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-bf63c003-9791-4e4c-8ab3-067a18308c30 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:14:09.837239 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-bf63c003-9791-4e4c-8ab3-067a18308c30 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:14:09.837763 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-bf63c003-9791-4e4c-8ab3-067a18308c30 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:14:09.868458 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-bf63c003-9791-4e4c-8ab3-067a18308c30 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049397 Oct 20 06:14:09.869260 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 577/1134] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:14:09 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 20 06:14:09.910744 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-43fcaae5-9989-4a2a-a532-77752385ec65 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:14:09.919011 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-43fcaae5-9989-4a2a-a532-77752385ec65 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:14:09.920450 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-43fcaae5-9989-4a2a-a532-77752385ec65 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:14:09.921561 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-43fcaae5-9989-4a2a-a532-77752385ec65 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/a8c74b2c-bf36-4b49-8855-9eb732003e66" status: 200 len: 1407 microversion: 2.20 time: 0.154994 Oct 20 06:14:09.922113 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 558/1135] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:14:09 2022] GET /compute/v2.1/servers/a8c74b2c-bf36-4b49-8855-9eb732003e66 => generated 1407 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:14:10.880729 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-61c04a2f-b8ac-4d30-a38b-ea2f6f529438 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:14:10.883554 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-61c04a2f-b8ac-4d30-a38b-ea2f6f529438 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:14:10.890120 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-61c04a2f-b8ac-4d30-a38b-ea2f6f529438 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:14:10.890602 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-61c04a2f-b8ac-4d30-a38b-ea2f6f529438 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:14:10.891040 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-61c04a2f-b8ac-4d30-a38b-ea2f6f529438 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:14:10.891739 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-61c04a2f-b8ac-4d30-a38b-ea2f6f529438 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:14:10.892219 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-61c04a2f-b8ac-4d30-a38b-ea2f6f529438 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:14:10.892643 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-61c04a2f-b8ac-4d30-a38b-ea2f6f529438 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:14:10.922279 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-61c04a2f-b8ac-4d30-a38b-ea2f6f529438 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045969 Oct 20 06:14:10.922833 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 578/1136] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:14:10 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:14:10.947504 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-f9ca7f48-78b4-4fea-b733-a22f7f4bc4e5 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:14:10.948113 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-f9ca7f48-78b4-4fea-b733-a22f7f4bc4e5 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: a8c74b2c-bf36-4b49-8855-9eb732003e66] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:14:10.954547 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f9ca7f48-78b4-4fea-b733-a22f7f4bc4e5 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:14:10.955030 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f9ca7f48-78b4-4fea-b733-a22f7f4bc4e5 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:14:10.955450 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f9ca7f48-78b4-4fea-b733-a22f7f4bc4e5 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:14:10.956144 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f9ca7f48-78b4-4fea-b733-a22f7f4bc4e5 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:14:10.956601 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f9ca7f48-78b4-4fea-b733-a22f7f4bc4e5 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:14:10.957065 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f9ca7f48-78b4-4fea-b733-a22f7f4bc4e5 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:14:11.082919 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-f9ca7f48-78b4-4fea-b733-a22f7f4bc4e5 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:14:11.091867 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-f9ca7f48-78b4-4fea-b733-a22f7f4bc4e5 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:14:11.093354 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-f9ca7f48-78b4-4fea-b733-a22f7f4bc4e5 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:14:11.094470 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-f9ca7f48-78b4-4fea-b733-a22f7f4bc4e5 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/a8c74b2c-bf36-4b49-8855-9eb732003e66" status: 200 len: 1407 microversion: 2.20 time: 0.150974 Oct 20 06:14:11.095027 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 559/1137] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:14:10 2022] GET /compute/v2.1/servers/a8c74b2c-bf36-4b49-8855-9eb732003e66 => generated 1407 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:14:11.934779 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-ccdef186-3320-4ab1-af1e-19bb03f91350 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:14:11.937002 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-ccdef186-3320-4ab1-af1e-19bb03f91350 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:14:11.943541 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ccdef186-3320-4ab1-af1e-19bb03f91350 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:14:11.944030 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ccdef186-3320-4ab1-af1e-19bb03f91350 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:14:11.944472 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ccdef186-3320-4ab1-af1e-19bb03f91350 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:14:11.945199 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ccdef186-3320-4ab1-af1e-19bb03f91350 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:14:11.945670 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ccdef186-3320-4ab1-af1e-19bb03f91350 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:14:11.946083 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ccdef186-3320-4ab1-af1e-19bb03f91350 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:14:11.975715 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-ccdef186-3320-4ab1-af1e-19bb03f91350 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044892 Oct 20 06:14:11.976277 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 579/1138] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:14:11 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:14:12.119676 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-b33408d9-44be-4de9-a7a8-e1b4d0f19fec tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:14:12.120188 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-b33408d9-44be-4de9-a7a8-e1b4d0f19fec tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: a8c74b2c-bf36-4b49-8855-9eb732003e66] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:14:12.126867 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b33408d9-44be-4de9-a7a8-e1b4d0f19fec tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:14:12.127381 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b33408d9-44be-4de9-a7a8-e1b4d0f19fec tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:14:12.127816 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b33408d9-44be-4de9-a7a8-e1b4d0f19fec tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:14:12.128513 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b33408d9-44be-4de9-a7a8-e1b4d0f19fec tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:14:12.128997 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b33408d9-44be-4de9-a7a8-e1b4d0f19fec tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:14:12.129427 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b33408d9-44be-4de9-a7a8-e1b4d0f19fec tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:14:12.257817 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-b33408d9-44be-4de9-a7a8-e1b4d0f19fec tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:14:12.265883 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-b33408d9-44be-4de9-a7a8-e1b4d0f19fec tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:14:12.267332 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-b33408d9-44be-4de9-a7a8-e1b4d0f19fec tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:14:12.268430 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-b33408d9-44be-4de9-a7a8-e1b4d0f19fec tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/a8c74b2c-bf36-4b49-8855-9eb732003e66" status: 200 len: 1407 microversion: 2.20 time: 0.152801 Oct 20 06:14:12.269053 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 560/1139] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:14:12 2022] GET /compute/v2.1/servers/a8c74b2c-bf36-4b49-8855-9eb732003e66 => generated 1407 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:14:12.988124 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-10bed83a-3dd9-4fa5-b45f-49cecff5b838 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:14:12.990862 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-10bed83a-3dd9-4fa5-b45f-49cecff5b838 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:14:12.997574 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-10bed83a-3dd9-4fa5-b45f-49cecff5b838 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:14:12.998058 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-10bed83a-3dd9-4fa5-b45f-49cecff5b838 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:14:12.998495 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-10bed83a-3dd9-4fa5-b45f-49cecff5b838 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:14:12.999189 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-10bed83a-3dd9-4fa5-b45f-49cecff5b838 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:14:12.999670 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-10bed83a-3dd9-4fa5-b45f-49cecff5b838 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:14:13.000094 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-10bed83a-3dd9-4fa5-b45f-49cecff5b838 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:14:13.031675 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-10bed83a-3dd9-4fa5-b45f-49cecff5b838 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047550 Oct 20 06:14:13.032229 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 580/1140] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:14:12 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:14:13.294075 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-a97b7184-0c37-4a21-a137-6cb49539a2ee tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:14:13.295182 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-a97b7184-0c37-4a21-a137-6cb49539a2ee tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: a8c74b2c-bf36-4b49-8855-9eb732003e66] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:14:13.302841 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a97b7184-0c37-4a21-a137-6cb49539a2ee tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:14:13.303560 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a97b7184-0c37-4a21-a137-6cb49539a2ee tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:14:13.303761 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a97b7184-0c37-4a21-a137-6cb49539a2ee tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:14:13.304645 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a97b7184-0c37-4a21-a137-6cb49539a2ee tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:14:13.305132 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a97b7184-0c37-4a21-a137-6cb49539a2ee tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:14:13.305556 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a97b7184-0c37-4a21-a137-6cb49539a2ee tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:14:13.320733 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG dbcounter [-] [118860] Writing DB stats nova_cell1:UPDATE=20,nova_cell1:INSERT=1,nova_cell1:SELECT=75,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2 {{(pid=118860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:14:13.444413 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-a97b7184-0c37-4a21-a137-6cb49539a2ee tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:14:13.453333 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-a97b7184-0c37-4a21-a137-6cb49539a2ee tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:14:13.454927 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-a97b7184-0c37-4a21-a137-6cb49539a2ee tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:14:13.456092 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-a97b7184-0c37-4a21-a137-6cb49539a2ee tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/a8c74b2c-bf36-4b49-8855-9eb732003e66" status: 200 len: 1407 microversion: 2.20 time: 0.165923 Oct 20 06:14:13.456640 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 561/1141] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:14:13 2022] GET /compute/v2.1/servers/a8c74b2c-bf36-4b49-8855-9eb732003e66 => generated 1407 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:14:13.523986 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [req-8fc54233-4b35-4caa-9236-056bb7bb4d68 req-b81fd341-cea9-4571-b975-7c48c3cf37bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8c74b2c-bf36-4b49-8855-9eb732003e66", "name": "network-vif-plugged", "status": "completed", "tag": "b16407be-86ee-4592-929b-a1450b1682e0"}]} {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 06:14:13.541256 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [req-8fc54233-4b35-4caa-9236-056bb7bb4d68 req-b81fd341-cea9-4571-b975-7c48c3cf37bc service nova] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:14:13.541788 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [req-8fc54233-4b35-4caa-9236-056bb7bb4d68 req-b81fd341-cea9-4571-b975-7c48c3cf37bc service nova] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:14:13.542442 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [req-8fc54233-4b35-4caa-9236-056bb7bb4d68 req-b81fd341-cea9-4571-b975-7c48c3cf37bc service nova] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:14:13.554881 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.compute.server_external_events [req-8fc54233-4b35-4caa-9236-056bb7bb4d68 req-b81fd341-cea9-4571-b975-7c48c3cf37bc service nova] Creating event network-vif-plugged:b16407be-86ee-4592-929b-a1450b1682e0 for instance a8c74b2c-bf36-4b49-8855-9eb732003e66 on hv-cinder-86156 Oct 20 06:14:13.560098 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [req-8fc54233-4b35-4caa-9236-056bb7bb4d68 req-b81fd341-cea9-4571-b975-7c48c3cf37bc service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103772 Oct 20 06:14:13.561001 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 581/1142] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 20 06:14:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 20 06:14:14.044259 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-0f48b479-f272-4b3f-95ba-9e13049439c8 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:14:14.046406 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-0f48b479-f272-4b3f-95ba-9e13049439c8 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:14:14.052372 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0f48b479-f272-4b3f-95ba-9e13049439c8 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:14:14.052886 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0f48b479-f272-4b3f-95ba-9e13049439c8 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:14:14.053333 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0f48b479-f272-4b3f-95ba-9e13049439c8 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:14:14.054018 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0f48b479-f272-4b3f-95ba-9e13049439c8 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:14:14.054501 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0f48b479-f272-4b3f-95ba-9e13049439c8 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:14:14.054925 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0f48b479-f272-4b3f-95ba-9e13049439c8 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:14:14.086485 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-0f48b479-f272-4b3f-95ba-9e13049439c8 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046215 Oct 20 06:14:14.087027 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 562/1143] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:14:14 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:14:14.483138 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-f611c597-b1d4-43da-98ba-b0f19612466d tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:14:14.483840 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-f611c597-b1d4-43da-98ba-b0f19612466d tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: a8c74b2c-bf36-4b49-8855-9eb732003e66] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:14:14.490925 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f611c597-b1d4-43da-98ba-b0f19612466d tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:14:14.491403 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f611c597-b1d4-43da-98ba-b0f19612466d tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:14:14.491840 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f611c597-b1d4-43da-98ba-b0f19612466d tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:14:14.492532 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f611c597-b1d4-43da-98ba-b0f19612466d tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:14:14.493007 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f611c597-b1d4-43da-98ba-b0f19612466d tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:14:14.493431 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f611c597-b1d4-43da-98ba-b0f19612466d tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:14:14.621863 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-f611c597-b1d4-43da-98ba-b0f19612466d tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:14:14.631300 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-f611c597-b1d4-43da-98ba-b0f19612466d tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:14:14.632779 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-f611c597-b1d4-43da-98ba-b0f19612466d tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:14:14.633903 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-f611c597-b1d4-43da-98ba-b0f19612466d tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/a8c74b2c-bf36-4b49-8855-9eb732003e66" status: 200 len: 1407 microversion: 2.20 time: 0.155503 Oct 20 06:14:14.634452 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 582/1144] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:14:14 2022] GET /compute/v2.1/servers/a8c74b2c-bf36-4b49-8855-9eb732003e66 => generated 1407 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:14:15.098514 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-12bffffd-472d-4e56-a876-0c547d1021e2 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:14:15.102211 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-12bffffd-472d-4e56-a876-0c547d1021e2 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:14:15.108018 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-12bffffd-472d-4e56-a876-0c547d1021e2 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:14:15.108499 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-12bffffd-472d-4e56-a876-0c547d1021e2 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:14:15.108960 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-12bffffd-472d-4e56-a876-0c547d1021e2 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:14:15.109656 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-12bffffd-472d-4e56-a876-0c547d1021e2 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:14:15.110106 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-12bffffd-472d-4e56-a876-0c547d1021e2 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:14:15.110521 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-12bffffd-472d-4e56-a876-0c547d1021e2 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:14:15.139068 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-12bffffd-472d-4e56-a876-0c547d1021e2 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044652 Oct 20 06:14:15.139616 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 563/1145] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:14:15 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:14:15.658389 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-bff0b2c4-2335-4e10-921f-bc412b77a4f3 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:14:15.659010 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-bff0b2c4-2335-4e10-921f-bc412b77a4f3 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: a8c74b2c-bf36-4b49-8855-9eb732003e66] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:14:15.665702 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-bff0b2c4-2335-4e10-921f-bc412b77a4f3 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:14:15.666195 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-bff0b2c4-2335-4e10-921f-bc412b77a4f3 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:14:15.666639 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-bff0b2c4-2335-4e10-921f-bc412b77a4f3 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:14:15.667347 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-bff0b2c4-2335-4e10-921f-bc412b77a4f3 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:14:15.667803 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-bff0b2c4-2335-4e10-921f-bc412b77a4f3 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:14:15.668232 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-bff0b2c4-2335-4e10-921f-bc412b77a4f3 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:14:15.800416 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-bff0b2c4-2335-4e10-921f-bc412b77a4f3 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:14:15.809050 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-bff0b2c4-2335-4e10-921f-bc412b77a4f3 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:14:15.810503 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-bff0b2c4-2335-4e10-921f-bc412b77a4f3 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:14:15.811656 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-bff0b2c4-2335-4e10-921f-bc412b77a4f3 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/a8c74b2c-bf36-4b49-8855-9eb732003e66" status: 200 len: 1599 microversion: 2.20 time: 0.157366 Oct 20 06:14:15.812213 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 583/1146] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:14:15 2022] GET /compute/v2.1/servers/a8c74b2c-bf36-4b49-8855-9eb732003e66 => generated 1599 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:14:15.837248 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-7df182e5-e95f-4249-96e1-069d7fe3ae45 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:14:15.837729 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-7df182e5-e95f-4249-96e1-069d7fe3ae45 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: a8c74b2c-bf36-4b49-8855-9eb732003e66] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:14:15.843535 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7df182e5-e95f-4249-96e1-069d7fe3ae45 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:14:15.844008 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7df182e5-e95f-4249-96e1-069d7fe3ae45 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:14:15.844453 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7df182e5-e95f-4249-96e1-069d7fe3ae45 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:14:15.845162 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7df182e5-e95f-4249-96e1-069d7fe3ae45 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:14:15.845610 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7df182e5-e95f-4249-96e1-069d7fe3ae45 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:14:15.846028 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7df182e5-e95f-4249-96e1-069d7fe3ae45 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:14:15.925020 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-7df182e5-e95f-4249-96e1-069d7fe3ae45 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/a8c74b2c-bf36-4b49-8855-9eb732003e66/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.091788 Oct 20 06:14:15.925614 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 564/1147] 10.222.0.20 () {60 vars in 1316 bytes} [Thu Oct 20 06:14:15 2022] GET /compute/v2.1/servers/a8c74b2c-bf36-4b49-8855-9eb732003e66/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 20 06:14:16.152151 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-372e6794-0597-40aa-8009-90d3288edb74 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:14:16.154455 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-372e6794-0597-40aa-8009-90d3288edb74 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:14:16.160649 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-372e6794-0597-40aa-8009-90d3288edb74 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:14:16.161705 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-372e6794-0597-40aa-8009-90d3288edb74 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:14:16.162188 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-372e6794-0597-40aa-8009-90d3288edb74 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:14:16.162952 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-372e6794-0597-40aa-8009-90d3288edb74 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:14:16.163407 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-372e6794-0597-40aa-8009-90d3288edb74 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:14:16.163840 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-372e6794-0597-40aa-8009-90d3288edb74 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:14:16.196902 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-372e6794-0597-40aa-8009-90d3288edb74 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048670 Oct 20 06:14:16.197401 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 584/1148] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:14:16 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:14:17.068843 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG dbcounter [-] [118860] Writing DB stats nova_cell0:SELECT=2 {{(pid=118860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:14:17.069824 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG dbcounter [-] [118860] Writing DB stats nova_cell0:SELECT=6 {{(pid=118860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:14:17.074150 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [req-6042faad-58bb-4fbb-973f-52e031f1c984 req-21ee6f40-95e9-4b90-bb72-105cc16ed42c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a8c74b2c-bf36-4b49-8855-9eb732003e66", "tag": "b16407be-86ee-4592-929b-a1450b1682e0"}]} {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 06:14:17.085069 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [req-6042faad-58bb-4fbb-973f-52e031f1c984 req-21ee6f40-95e9-4b90-bb72-105cc16ed42c service nova] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:14:17.085632 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [req-6042faad-58bb-4fbb-973f-52e031f1c984 req-21ee6f40-95e9-4b90-bb72-105cc16ed42c service nova] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:14:17.086142 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [req-6042faad-58bb-4fbb-973f-52e031f1c984 req-21ee6f40-95e9-4b90-bb72-105cc16ed42c service nova] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:14:17.097102 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.compute.server_external_events [req-6042faad-58bb-4fbb-973f-52e031f1c984 req-21ee6f40-95e9-4b90-bb72-105cc16ed42c service nova] Creating event network-changed:b16407be-86ee-4592-929b-a1450b1682e0 for instance a8c74b2c-bf36-4b49-8855-9eb732003e66 on hv-cinder-86156 Oct 20 06:14:17.104043 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [req-6042faad-58bb-4fbb-973f-52e031f1c984 req-21ee6f40-95e9-4b90-bb72-105cc16ed42c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036206 Oct 20 06:14:17.104991 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 565/1149] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 20 06:14:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 20 06:14:17.209183 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-5681a8ae-6dbd-44f0-a498-627a36cb8fb2 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:14:17.211549 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-5681a8ae-6dbd-44f0-a498-627a36cb8fb2 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:14:17.213758 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG dbcounter [-] [118861] Writing DB stats nova_cell0:SELECT=6 {{(pid=118861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:14:17.220134 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5681a8ae-6dbd-44f0-a498-627a36cb8fb2 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:14:17.220823 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5681a8ae-6dbd-44f0-a498-627a36cb8fb2 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:14:17.221589 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5681a8ae-6dbd-44f0-a498-627a36cb8fb2 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:14:17.222563 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5681a8ae-6dbd-44f0-a498-627a36cb8fb2 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:14:17.223133 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5681a8ae-6dbd-44f0-a498-627a36cb8fb2 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:14:17.224384 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5681a8ae-6dbd-44f0-a498-627a36cb8fb2 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:14:17.258486 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-5681a8ae-6dbd-44f0-a498-627a36cb8fb2 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053486 Oct 20 06:14:17.259296 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 585/1150] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:14:17 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:14:18.272277 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-7ff4bce8-5be6-4c11-88df-54481df05c76 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:14:18.274597 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-7ff4bce8-5be6-4c11-88df-54481df05c76 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:14:18.280646 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7ff4bce8-5be6-4c11-88df-54481df05c76 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:14:18.281154 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7ff4bce8-5be6-4c11-88df-54481df05c76 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:14:18.281591 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7ff4bce8-5be6-4c11-88df-54481df05c76 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:14:18.282282 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7ff4bce8-5be6-4c11-88df-54481df05c76 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:14:18.282734 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7ff4bce8-5be6-4c11-88df-54481df05c76 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:14:18.283156 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7ff4bce8-5be6-4c11-88df-54481df05c76 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:14:18.314031 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-7ff4bce8-5be6-4c11-88df-54481df05c76 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046626 Oct 20 06:14:18.314581 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 566/1151] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:14:18 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:14:19.326981 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-3c103b97-f144-4a10-9ff7-2a38abccd752 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:14:19.329159 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-3c103b97-f144-4a10-9ff7-2a38abccd752 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:14:19.336276 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-3c103b97-f144-4a10-9ff7-2a38abccd752 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:14:19.336777 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-3c103b97-f144-4a10-9ff7-2a38abccd752 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:14:19.337217 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-3c103b97-f144-4a10-9ff7-2a38abccd752 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:14:19.337901 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-3c103b97-f144-4a10-9ff7-2a38abccd752 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:14:19.338395 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-3c103b97-f144-4a10-9ff7-2a38abccd752 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:14:19.338764 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-3c103b97-f144-4a10-9ff7-2a38abccd752 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:14:19.369040 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-3c103b97-f144-4a10-9ff7-2a38abccd752 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046011 Oct 20 06:14:19.369596 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 586/1152] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:14:19 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:14:20.382945 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-398c876b-a222-459a-8ddb-a08814fa108e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:14:20.385250 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-398c876b-a222-459a-8ddb-a08814fa108e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:14:20.391937 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-398c876b-a222-459a-8ddb-a08814fa108e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:14:20.392578 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-398c876b-a222-459a-8ddb-a08814fa108e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:14:20.392955 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-398c876b-a222-459a-8ddb-a08814fa108e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:14:20.393729 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-398c876b-a222-459a-8ddb-a08814fa108e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:14:20.394181 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-398c876b-a222-459a-8ddb-a08814fa108e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:14:20.394608 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-398c876b-a222-459a-8ddb-a08814fa108e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:14:20.424841 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-398c876b-a222-459a-8ddb-a08814fa108e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047010 Oct 20 06:14:20.425382 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 567/1153] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:14:20 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:14:21.437288 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-59198f02-c132-4eb4-8f66-57cd495b5f11 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:14:21.439428 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-59198f02-c132-4eb4-8f66-57cd495b5f11 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:14:21.446579 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-59198f02-c132-4eb4-8f66-57cd495b5f11 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:14:21.447055 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-59198f02-c132-4eb4-8f66-57cd495b5f11 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:14:21.447487 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-59198f02-c132-4eb4-8f66-57cd495b5f11 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:14:21.448173 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-59198f02-c132-4eb4-8f66-57cd495b5f11 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:14:21.448624 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-59198f02-c132-4eb4-8f66-57cd495b5f11 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:14:21.449079 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-59198f02-c132-4eb4-8f66-57cd495b5f11 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:14:21.478070 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-59198f02-c132-4eb4-8f66-57cd495b5f11 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044753 Oct 20 06:14:21.478620 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 587/1154] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:14:21 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:14:22.490652 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-795b5c12-adea-413b-bd9b-084a065b3daa tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:14:22.492809 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-795b5c12-adea-413b-bd9b-084a065b3daa tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:14:22.498763 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-795b5c12-adea-413b-bd9b-084a065b3daa tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:14:22.499241 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-795b5c12-adea-413b-bd9b-084a065b3daa tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:14:22.499964 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-795b5c12-adea-413b-bd9b-084a065b3daa tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:14:22.500924 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-795b5c12-adea-413b-bd9b-084a065b3daa tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:14:22.501371 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-795b5c12-adea-413b-bd9b-084a065b3daa tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:14:22.501788 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-795b5c12-adea-413b-bd9b-084a065b3daa tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:14:22.531494 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-795b5c12-adea-413b-bd9b-084a065b3daa tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045130 Oct 20 06:14:22.532033 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 568/1155] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:14:22 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:14:23.543519 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-36679bef-002a-4dfd-b47b-a23dcc713137 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:14:23.545708 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-36679bef-002a-4dfd-b47b-a23dcc713137 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:14:23.552864 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-36679bef-002a-4dfd-b47b-a23dcc713137 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:14:23.553280 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-36679bef-002a-4dfd-b47b-a23dcc713137 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:14:23.553716 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-36679bef-002a-4dfd-b47b-a23dcc713137 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:14:23.554396 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-36679bef-002a-4dfd-b47b-a23dcc713137 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:14:23.554842 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-36679bef-002a-4dfd-b47b-a23dcc713137 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:14:23.555260 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-36679bef-002a-4dfd-b47b-a23dcc713137 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:14:23.584639 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-36679bef-002a-4dfd-b47b-a23dcc713137 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045107 Oct 20 06:14:23.585414 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 588/1156] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:14:23 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:14:24.597365 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-589a9345-979a-47d2-9d5a-6d3abd6f16a1 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:14:24.599514 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-589a9345-979a-47d2-9d5a-6d3abd6f16a1 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:14:24.605849 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-589a9345-979a-47d2-9d5a-6d3abd6f16a1 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:14:24.606318 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-589a9345-979a-47d2-9d5a-6d3abd6f16a1 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:14:24.606745 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-589a9345-979a-47d2-9d5a-6d3abd6f16a1 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:14:24.607428 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-589a9345-979a-47d2-9d5a-6d3abd6f16a1 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:14:24.607877 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-589a9345-979a-47d2-9d5a-6d3abd6f16a1 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:14:24.608295 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-589a9345-979a-47d2-9d5a-6d3abd6f16a1 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:14:24.637116 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-589a9345-979a-47d2-9d5a-6d3abd6f16a1 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043677 Oct 20 06:14:24.637660 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 569/1157] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:14:24 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 20 06:14:25.650124 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-014752f0-ff66-4b41-a7af-59a135ee5f1f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:14:25.652276 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-014752f0-ff66-4b41-a7af-59a135ee5f1f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:14:25.658643 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-014752f0-ff66-4b41-a7af-59a135ee5f1f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:14:25.659121 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-014752f0-ff66-4b41-a7af-59a135ee5f1f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:14:25.659556 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-014752f0-ff66-4b41-a7af-59a135ee5f1f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:14:25.660243 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-014752f0-ff66-4b41-a7af-59a135ee5f1f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:14:25.660687 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-014752f0-ff66-4b41-a7af-59a135ee5f1f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:14:25.661134 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-014752f0-ff66-4b41-a7af-59a135ee5f1f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:14:25.689966 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-014752f0-ff66-4b41-a7af-59a135ee5f1f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043997 Oct 20 06:14:25.690515 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 589/1158] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:14:25 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:14:26.703049 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-feda237d-b61b-49bd-af6b-e8bc67789c75 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:14:26.705250 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-feda237d-b61b-49bd-af6b-e8bc67789c75 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:14:26.711531 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-feda237d-b61b-49bd-af6b-e8bc67789c75 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:14:26.711999 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-feda237d-b61b-49bd-af6b-e8bc67789c75 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:14:26.712433 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-feda237d-b61b-49bd-af6b-e8bc67789c75 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:14:26.713151 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-feda237d-b61b-49bd-af6b-e8bc67789c75 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:14:26.713595 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-feda237d-b61b-49bd-af6b-e8bc67789c75 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:14:26.714014 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-feda237d-b61b-49bd-af6b-e8bc67789c75 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:14:26.743617 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-feda237d-b61b-49bd-af6b-e8bc67789c75 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044569 Oct 20 06:14:26.744165 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 570/1159] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:14:26 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:14:27.756752 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-493a3b7d-387e-4b0a-9353-ea896a0ad129 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:14:27.759079 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-493a3b7d-387e-4b0a-9353-ea896a0ad129 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:14:27.765254 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-493a3b7d-387e-4b0a-9353-ea896a0ad129 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:14:27.765740 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-493a3b7d-387e-4b0a-9353-ea896a0ad129 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:14:27.766181 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-493a3b7d-387e-4b0a-9353-ea896a0ad129 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:14:27.766880 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-493a3b7d-387e-4b0a-9353-ea896a0ad129 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:14:27.767329 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-493a3b7d-387e-4b0a-9353-ea896a0ad129 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:14:27.767754 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-493a3b7d-387e-4b0a-9353-ea896a0ad129 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:14:27.771297 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG dbcounter [-] [118861] Writing DB stats nova_cell1:SELECT=100 {{(pid=118861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:14:27.799456 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-493a3b7d-387e-4b0a-9353-ea896a0ad129 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047268 Oct 20 06:14:27.800009 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 590/1160] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:14:27 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:14:28.812278 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-9315573b-027d-4408-80ed-20765c65f39a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:14:28.814435 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-9315573b-027d-4408-80ed-20765c65f39a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:14:28.821573 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-9315573b-027d-4408-80ed-20765c65f39a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:14:28.822056 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-9315573b-027d-4408-80ed-20765c65f39a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:14:28.822492 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-9315573b-027d-4408-80ed-20765c65f39a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:14:28.823181 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-9315573b-027d-4408-80ed-20765c65f39a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:14:28.823633 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-9315573b-027d-4408-80ed-20765c65f39a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:14:28.824055 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-9315573b-027d-4408-80ed-20765c65f39a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:14:28.852393 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-9315573b-027d-4408-80ed-20765c65f39a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044067 Oct 20 06:14:28.852971 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 571/1161] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:14:28 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:14:29.864714 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-753852ec-d862-459e-8c4e-e69f772c3e95 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:14:29.867002 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-753852ec-d862-459e-8c4e-e69f772c3e95 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:14:29.873380 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-753852ec-d862-459e-8c4e-e69f772c3e95 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:14:29.873860 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-753852ec-d862-459e-8c4e-e69f772c3e95 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:14:29.874289 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-753852ec-d862-459e-8c4e-e69f772c3e95 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:14:29.874966 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-753852ec-d862-459e-8c4e-e69f772c3e95 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:14:29.875412 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-753852ec-d862-459e-8c4e-e69f772c3e95 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:14:29.876077 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-753852ec-d862-459e-8c4e-e69f772c3e95 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:14:29.905395 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-753852ec-d862-459e-8c4e-e69f772c3e95 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044647 Oct 20 06:14:29.905940 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 591/1162] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:14:29 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:14:30.918439 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-4a8721af-e5b7-4e8d-84cc-c4e640b8fbf9 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:14:30.920623 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-4a8721af-e5b7-4e8d-84cc-c4e640b8fbf9 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:14:30.927015 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-4a8721af-e5b7-4e8d-84cc-c4e640b8fbf9 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:14:30.927495 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-4a8721af-e5b7-4e8d-84cc-c4e640b8fbf9 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:14:30.928340 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-4a8721af-e5b7-4e8d-84cc-c4e640b8fbf9 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:14:30.929069 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-4a8721af-e5b7-4e8d-84cc-c4e640b8fbf9 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:14:30.929525 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-4a8721af-e5b7-4e8d-84cc-c4e640b8fbf9 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:14:30.929950 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-4a8721af-e5b7-4e8d-84cc-c4e640b8fbf9 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:14:30.958553 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-4a8721af-e5b7-4e8d-84cc-c4e640b8fbf9 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044094 Oct 20 06:14:30.959871 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 572/1163] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:14:30 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:14:31.971491 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-a25aa03f-b21a-48f4-bf43-94e9ee5d8b7b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:14:31.973731 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-a25aa03f-b21a-48f4-bf43-94e9ee5d8b7b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:14:31.980030 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a25aa03f-b21a-48f4-bf43-94e9ee5d8b7b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:14:31.980504 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a25aa03f-b21a-48f4-bf43-94e9ee5d8b7b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:14:31.980974 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a25aa03f-b21a-48f4-bf43-94e9ee5d8b7b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:14:31.981659 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a25aa03f-b21a-48f4-bf43-94e9ee5d8b7b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:14:31.982113 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a25aa03f-b21a-48f4-bf43-94e9ee5d8b7b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:14:31.982533 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a25aa03f-b21a-48f4-bf43-94e9ee5d8b7b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:14:32.011827 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-a25aa03f-b21a-48f4-bf43-94e9ee5d8b7b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044329 Oct 20 06:14:32.012372 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 592/1164] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:14:31 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:14:33.158952 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-60b6ff02-8f4e-452c-aea9-854b28f41d87 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 06:14:33.161219 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-60b6ff02-8f4e-452c-aea9-854b28f41d87 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:14:33.168265 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-60b6ff02-8f4e-452c-aea9-854b28f41d87 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:14:33.168768 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-60b6ff02-8f4e-452c-aea9-854b28f41d87 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:14:33.169204 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-60b6ff02-8f4e-452c-aea9-854b28f41d87 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:14:33.169892 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-60b6ff02-8f4e-452c-aea9-854b28f41d87 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:14:33.170342 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-60b6ff02-8f4e-452c-aea9-854b28f41d87 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:14:33.170763 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-60b6ff02-8f4e-452c-aea9-854b28f41d87 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:14:33.251299 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-60b6ff02-8f4e-452c-aea9-854b28f41d87 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "POST /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/action" status: 200 len: 41375 microversion: 2.1 time: 0.230690 Oct 20 06:14:33.251916 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 573/1165] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Oct 20 06:14:33 2022] POST /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533/action => generated 41375 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 20 06:14:40.316868 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-331b033f-f983-46fe-a57e-24778c019dc9 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:14:40.319351 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-331b033f-f983-46fe-a57e-24778c019dc9 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:14:40.322056 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG dbcounter [-] [118861] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=1 {{(pid=118861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:14:40.327271 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-331b033f-f983-46fe-a57e-24778c019dc9 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:14:40.327746 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-331b033f-f983-46fe-a57e-24778c019dc9 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:14:40.328178 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-331b033f-f983-46fe-a57e-24778c019dc9 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:14:40.328898 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-331b033f-f983-46fe-a57e-24778c019dc9 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:14:40.329340 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-331b033f-f983-46fe-a57e-24778c019dc9 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:14:40.329759 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-331b033f-f983-46fe-a57e-24778c019dc9 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:14:40.359854 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-331b033f-f983-46fe-a57e-24778c019dc9 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046913 Oct 20 06:14:40.360404 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 593/1166] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:14:40 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:14:41.372739 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-71725588-739e-4ea6-9e9e-60b1b94a8d87 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:14:41.374981 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-71725588-739e-4ea6-9e9e-60b1b94a8d87 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:14:41.377942 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG dbcounter [-] [118860] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=3 {{(pid=118860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:14:41.384548 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-71725588-739e-4ea6-9e9e-60b1b94a8d87 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:14:41.385057 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-71725588-739e-4ea6-9e9e-60b1b94a8d87 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:14:41.385497 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-71725588-739e-4ea6-9e9e-60b1b94a8d87 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:14:41.386189 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-71725588-739e-4ea6-9e9e-60b1b94a8d87 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:14:41.386642 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-71725588-739e-4ea6-9e9e-60b1b94a8d87 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:14:41.387067 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-71725588-739e-4ea6-9e9e-60b1b94a8d87 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:14:41.418770 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-71725588-739e-4ea6-9e9e-60b1b94a8d87 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050235 Oct 20 06:14:41.419328 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 574/1167] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:14:41 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:14:42.431950 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-dd772b1b-78ec-4a67-be4c-7c632842c828 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:14:42.434215 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-dd772b1b-78ec-4a67-be4c-7c632842c828 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:14:42.440523 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-dd772b1b-78ec-4a67-be4c-7c632842c828 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:14:42.441038 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-dd772b1b-78ec-4a67-be4c-7c632842c828 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:14:42.441477 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-dd772b1b-78ec-4a67-be4c-7c632842c828 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:14:42.442175 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-dd772b1b-78ec-4a67-be4c-7c632842c828 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:14:42.442698 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-dd772b1b-78ec-4a67-be4c-7c632842c828 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:14:42.443127 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-dd772b1b-78ec-4a67-be4c-7c632842c828 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:14:42.472338 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-dd772b1b-78ec-4a67-be4c-7c632842c828 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045126 Oct 20 06:14:42.472943 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 594/1168] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:14:42 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:14:43.485126 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-0ff2a2ac-52f9-46e5-8d50-8b6409e6a146 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:14:43.487279 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-0ff2a2ac-52f9-46e5-8d50-8b6409e6a146 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:14:43.493771 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0ff2a2ac-52f9-46e5-8d50-8b6409e6a146 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:14:43.494253 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0ff2a2ac-52f9-46e5-8d50-8b6409e6a146 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:14:43.494688 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0ff2a2ac-52f9-46e5-8d50-8b6409e6a146 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:14:43.495379 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0ff2a2ac-52f9-46e5-8d50-8b6409e6a146 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:14:43.495831 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0ff2a2ac-52f9-46e5-8d50-8b6409e6a146 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:14:43.496255 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0ff2a2ac-52f9-46e5-8d50-8b6409e6a146 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:14:43.499800 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG dbcounter [-] [118860] Writing DB stats nova_cell1:SELECT=74 {{(pid=118860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:14:43.526544 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-0ff2a2ac-52f9-46e5-8d50-8b6409e6a146 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045396 Oct 20 06:14:43.527093 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 575/1169] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:14:43 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:14:44.539362 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-9e7227e1-9545-46ba-b199-fdc5b5937b83 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:14:44.541560 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-9e7227e1-9545-46ba-b199-fdc5b5937b83 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:14:44.544090 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 20 06:14:44.544223 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: Thu Oct 20 06:14:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments (ip 10.222.0.20) !!! Oct 20 06:14:44.550513 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-9e7227e1-9545-46ba-b199-fdc5b5937b83 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:14:44.550996 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-9e7227e1-9545-46ba-b199-fdc5b5937b83 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:14:44.551433 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-9e7227e1-9545-46ba-b199-fdc5b5937b83 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:14:44.552641 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-9e7227e1-9545-46ba-b199-fdc5b5937b83 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:14:44.553133 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-9e7227e1-9545-46ba-b199-fdc5b5937b83 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:14:44.553566 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-9e7227e1-9545-46ba-b199-fdc5b5937b83 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:14:44.585120 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-9e7227e1-9545-46ba-b199-fdc5b5937b83 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050703 Oct 20 06:14:44.585608 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 595/1170] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:14:44 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:14:45.597308 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-c7208de8-e467-487f-b1df-517e11c95d3c tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:14:45.600086 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-c7208de8-e467-487f-b1df-517e11c95d3c tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:14:45.606751 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c7208de8-e467-487f-b1df-517e11c95d3c tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:14:45.607296 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c7208de8-e467-487f-b1df-517e11c95d3c tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:14:45.607731 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c7208de8-e467-487f-b1df-517e11c95d3c tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:14:45.608418 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c7208de8-e467-487f-b1df-517e11c95d3c tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:14:45.608899 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c7208de8-e467-487f-b1df-517e11c95d3c tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:14:45.609318 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c7208de8-e467-487f-b1df-517e11c95d3c tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:14:45.638806 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-c7208de8-e467-487f-b1df-517e11c95d3c tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045449 Oct 20 06:14:45.639346 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 576/1171] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:14:45 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:14:46.776647 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-250c6f9c-c0f6-409b-867a-ed4ed0f85910 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:14:46.778963 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-250c6f9c-c0f6-409b-867a-ed4ed0f85910 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:14:46.784898 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-250c6f9c-c0f6-409b-867a-ed4ed0f85910 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:14:46.785376 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-250c6f9c-c0f6-409b-867a-ed4ed0f85910 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:14:46.785820 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-250c6f9c-c0f6-409b-867a-ed4ed0f85910 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:14:46.787082 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-250c6f9c-c0f6-409b-867a-ed4ed0f85910 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:14:46.787525 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-250c6f9c-c0f6-409b-867a-ed4ed0f85910 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:14:46.787948 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-250c6f9c-c0f6-409b-867a-ed4ed0f85910 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:14:46.815989 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-250c6f9c-c0f6-409b-867a-ed4ed0f85910 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.168199 Oct 20 06:14:46.816473 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 596/1172] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:14:46 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:14:47.827527 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-91ec7cc4-cdec-46d8-99df-d4f40746e5fd tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:14:47.829698 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-91ec7cc4-cdec-46d8-99df-d4f40746e5fd tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:14:47.836088 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-91ec7cc4-cdec-46d8-99df-d4f40746e5fd tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:14:47.836563 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-91ec7cc4-cdec-46d8-99df-d4f40746e5fd tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:14:47.837037 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-91ec7cc4-cdec-46d8-99df-d4f40746e5fd tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:14:47.837720 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-91ec7cc4-cdec-46d8-99df-d4f40746e5fd tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:14:47.838168 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-91ec7cc4-cdec-46d8-99df-d4f40746e5fd tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:14:47.838585 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-91ec7cc4-cdec-46d8-99df-d4f40746e5fd tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:14:47.867907 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-91ec7cc4-cdec-46d8-99df-d4f40746e5fd tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044257 Oct 20 06:14:47.868358 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 577/1173] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:14:47 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:14:48.880456 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-018bd020-c383-4613-b1f4-640b761f867d tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:14:48.882714 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-018bd020-c383-4613-b1f4-640b761f867d tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:14:48.889589 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-018bd020-c383-4613-b1f4-640b761f867d tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:14:48.890065 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-018bd020-c383-4613-b1f4-640b761f867d tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:14:48.890498 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-018bd020-c383-4613-b1f4-640b761f867d tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:14:48.891184 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-018bd020-c383-4613-b1f4-640b761f867d tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:14:48.891631 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-018bd020-c383-4613-b1f4-640b761f867d tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:14:48.892076 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-018bd020-c383-4613-b1f4-640b761f867d tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:14:48.924255 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-018bd020-c383-4613-b1f4-640b761f867d tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048224 Oct 20 06:14:48.924760 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 597/1174] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:14:48 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:14:49.936730 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-f6985001-912b-4cdb-8f55-cc2dfdc7360c tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:14:49.938989 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-f6985001-912b-4cdb-8f55-cc2dfdc7360c tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:14:49.945711 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f6985001-912b-4cdb-8f55-cc2dfdc7360c tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:14:49.946272 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f6985001-912b-4cdb-8f55-cc2dfdc7360c tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:14:49.946783 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f6985001-912b-4cdb-8f55-cc2dfdc7360c tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:14:49.947550 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f6985001-912b-4cdb-8f55-cc2dfdc7360c tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:14:49.948078 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f6985001-912b-4cdb-8f55-cc2dfdc7360c tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:14:49.948512 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f6985001-912b-4cdb-8f55-cc2dfdc7360c tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:14:49.978289 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-f6985001-912b-4cdb-8f55-cc2dfdc7360c tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045506 Oct 20 06:14:49.978793 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 578/1175] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:14:49 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:14:50.990930 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-119928e0-e5d8-435e-ae46-b760dea4b48a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:14:50.993077 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-119928e0-e5d8-435e-ae46-b760dea4b48a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:14:50.999540 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-119928e0-e5d8-435e-ae46-b760dea4b48a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:14:51.000262 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-119928e0-e5d8-435e-ae46-b760dea4b48a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:14:51.000716 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-119928e0-e5d8-435e-ae46-b760dea4b48a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:14:51.001416 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-119928e0-e5d8-435e-ae46-b760dea4b48a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:14:51.001862 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-119928e0-e5d8-435e-ae46-b760dea4b48a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:14:51.002281 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-119928e0-e5d8-435e-ae46-b760dea4b48a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:14:51.032580 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-119928e0-e5d8-435e-ae46-b760dea4b48a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045521 Oct 20 06:14:51.033092 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 598/1176] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:14:50 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:14:52.045283 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-2707c557-5794-4e65-8af5-347af9c3e81f tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:14:52.047416 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-2707c557-5794-4e65-8af5-347af9c3e81f tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:14:52.054246 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2707c557-5794-4e65-8af5-347af9c3e81f tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:14:52.054731 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2707c557-5794-4e65-8af5-347af9c3e81f tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:14:52.055170 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2707c557-5794-4e65-8af5-347af9c3e81f tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:14:52.055874 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2707c557-5794-4e65-8af5-347af9c3e81f tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:14:52.056332 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2707c557-5794-4e65-8af5-347af9c3e81f tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:14:52.056844 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2707c557-5794-4e65-8af5-347af9c3e81f tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:14:52.087807 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-2707c557-5794-4e65-8af5-347af9c3e81f tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046418 Oct 20 06:14:52.088378 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 579/1177] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:14:52 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:14:53.036001 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-9a683868-e038-4112-b657-e78a117baa71 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:14:53.036860 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-9a683868-e038-4112-b657-e78a117baa71 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: a8c74b2c-bf36-4b49-8855-9eb732003e66] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:14:53.042850 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-9a683868-e038-4112-b657-e78a117baa71 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:14:53.043334 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-9a683868-e038-4112-b657-e78a117baa71 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:14:53.043768 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-9a683868-e038-4112-b657-e78a117baa71 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:14:53.044474 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-9a683868-e038-4112-b657-e78a117baa71 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:14:53.045020 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-9a683868-e038-4112-b657-e78a117baa71 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:14:53.045443 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-9a683868-e038-4112-b657-e78a117baa71 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:14:53.077768 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-9a683868-e038-4112-b657-e78a117baa71 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/a8c74b2c-bf36-4b49-8855-9eb732003e66/ips" status: 200 len: 152 microversion: 2.20 time: 0.129819 Oct 20 06:14:53.077768 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 599/1178] 10.222.0.20 () {60 vars in 1289 bytes} [Thu Oct 20 06:14:52 2022] GET /compute/v2.1/servers/a8c74b2c-bf36-4b49-8855-9eb732003e66/ips => generated 152 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 20 06:14:53.102029 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-fa31e090-0c11-41b9-8ad3-3de3897c04fd tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:14:53.104338 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-fa31e090-0c11-41b9-8ad3-3de3897c04fd tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:14:53.111260 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-fa31e090-0c11-41b9-8ad3-3de3897c04fd tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:14:53.111889 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-fa31e090-0c11-41b9-8ad3-3de3897c04fd tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:14:53.112430 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-fa31e090-0c11-41b9-8ad3-3de3897c04fd tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:14:53.113269 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-fa31e090-0c11-41b9-8ad3-3de3897c04fd tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:14:53.113935 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-fa31e090-0c11-41b9-8ad3-3de3897c04fd tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:14:53.114544 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-fa31e090-0c11-41b9-8ad3-3de3897c04fd tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:14:53.146384 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-fa31e090-0c11-41b9-8ad3-3de3897c04fd tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049502 Oct 20 06:14:53.146989 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 580/1179] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:14:53 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:14:54.158756 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-2e4f4ebe-5c08-462f-9fe1-e4bf309bc37a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:14:54.161515 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-2e4f4ebe-5c08-462f-9fe1-e4bf309bc37a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:14:54.168000 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-2e4f4ebe-5c08-462f-9fe1-e4bf309bc37a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:14:54.168528 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-2e4f4ebe-5c08-462f-9fe1-e4bf309bc37a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:14:54.168932 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-2e4f4ebe-5c08-462f-9fe1-e4bf309bc37a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:14:54.169616 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-2e4f4ebe-5c08-462f-9fe1-e4bf309bc37a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:14:54.170060 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-2e4f4ebe-5c08-462f-9fe1-e4bf309bc37a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:14:54.170477 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-2e4f4ebe-5c08-462f-9fe1-e4bf309bc37a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:14:54.202293 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-2e4f4ebe-5c08-462f-9fe1-e4bf309bc37a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047444 Oct 20 06:14:54.202868 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 600/1180] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:14:54 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:14:55.215204 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-cbcd4a13-d33a-4423-9efe-49f5c382917e tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:14:55.217339 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-cbcd4a13-d33a-4423-9efe-49f5c382917e tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:14:55.224323 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-cbcd4a13-d33a-4423-9efe-49f5c382917e tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:14:55.224738 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-cbcd4a13-d33a-4423-9efe-49f5c382917e tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:14:55.225195 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-cbcd4a13-d33a-4423-9efe-49f5c382917e tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:14:55.225912 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-cbcd4a13-d33a-4423-9efe-49f5c382917e tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:14:55.226408 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-cbcd4a13-d33a-4423-9efe-49f5c382917e tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:14:55.226839 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-cbcd4a13-d33a-4423-9efe-49f5c382917e tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:14:55.256974 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-cbcd4a13-d33a-4423-9efe-49f5c382917e tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045671 Oct 20 06:14:55.257533 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 581/1181] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:14:55 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:14:56.269621 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-a7a059dd-a0c0-40cb-9c07-32f552d6b1ab tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:14:56.272422 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-a7a059dd-a0c0-40cb-9c07-32f552d6b1ab tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:14:56.279382 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a7a059dd-a0c0-40cb-9c07-32f552d6b1ab tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:14:56.279859 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a7a059dd-a0c0-40cb-9c07-32f552d6b1ab tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:14:56.280290 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a7a059dd-a0c0-40cb-9c07-32f552d6b1ab tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:14:56.281030 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a7a059dd-a0c0-40cb-9c07-32f552d6b1ab tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:14:56.281460 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a7a059dd-a0c0-40cb-9c07-32f552d6b1ab tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:14:56.281877 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a7a059dd-a0c0-40cb-9c07-32f552d6b1ab tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:14:56.315118 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-a7a059dd-a0c0-40cb-9c07-32f552d6b1ab tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049555 Oct 20 06:14:56.315681 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 601/1182] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:14:56 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:14:57.328566 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-b86ffcd6-e0a2-4b7b-af74-d56b62b10dcb tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:14:57.330741 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-b86ffcd6-e0a2-4b7b-af74-d56b62b10dcb tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:14:57.337839 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b86ffcd6-e0a2-4b7b-af74-d56b62b10dcb tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:14:57.338256 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b86ffcd6-e0a2-4b7b-af74-d56b62b10dcb tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:14:57.338695 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b86ffcd6-e0a2-4b7b-af74-d56b62b10dcb tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:14:57.339396 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b86ffcd6-e0a2-4b7b-af74-d56b62b10dcb tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:14:57.339852 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b86ffcd6-e0a2-4b7b-af74-d56b62b10dcb tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:14:57.340281 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b86ffcd6-e0a2-4b7b-af74-d56b62b10dcb tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:14:57.369709 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-b86ffcd6-e0a2-4b7b-af74-d56b62b10dcb tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045227 Oct 20 06:14:57.370274 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 582/1183] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:14:57 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:14:58.382865 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-c636b274-aa92-4399-af00-9a192b84e4a0 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:14:58.385208 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-c636b274-aa92-4399-af00-9a192b84e4a0 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:14:58.391346 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c636b274-aa92-4399-af00-9a192b84e4a0 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:14:58.391831 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c636b274-aa92-4399-af00-9a192b84e4a0 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:14:58.392273 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c636b274-aa92-4399-af00-9a192b84e4a0 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:14:58.392994 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c636b274-aa92-4399-af00-9a192b84e4a0 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:14:58.393451 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c636b274-aa92-4399-af00-9a192b84e4a0 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:14:58.394003 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c636b274-aa92-4399-af00-9a192b84e4a0 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:14:58.398274 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG dbcounter [-] [118861] Writing DB stats nova_cell1:SELECT=69 {{(pid=118861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:14:58.424269 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-c636b274-aa92-4399-af00-9a192b84e4a0 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046011 Oct 20 06:14:58.429009 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 602/1184] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:14:58 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:14:59.436346 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-65943921-767b-437e-a6d9-5aaa8e9a663e tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:14:59.438604 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-65943921-767b-437e-a6d9-5aaa8e9a663e tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:14:59.445608 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-65943921-767b-437e-a6d9-5aaa8e9a663e tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:14:59.446025 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-65943921-767b-437e-a6d9-5aaa8e9a663e tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:14:59.446465 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-65943921-767b-437e-a6d9-5aaa8e9a663e tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:14:59.447175 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-65943921-767b-437e-a6d9-5aaa8e9a663e tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:14:59.447629 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-65943921-767b-437e-a6d9-5aaa8e9a663e tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:14:59.448059 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-65943921-767b-437e-a6d9-5aaa8e9a663e tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:14:59.479692 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-65943921-767b-437e-a6d9-5aaa8e9a663e tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047277 Oct 20 06:14:59.480256 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 583/1185] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:14:59 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:15:00.492001 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-cc12391c-5d97-4c0c-9f0d-7f96fb79baac tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:15:00.494279 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-cc12391c-5d97-4c0c-9f0d-7f96fb79baac tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:15:00.501394 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-cc12391c-5d97-4c0c-9f0d-7f96fb79baac tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:15:00.501882 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-cc12391c-5d97-4c0c-9f0d-7f96fb79baac tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:15:00.502311 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-cc12391c-5d97-4c0c-9f0d-7f96fb79baac tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:15:00.503015 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-cc12391c-5d97-4c0c-9f0d-7f96fb79baac tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:15:00.503461 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-cc12391c-5d97-4c0c-9f0d-7f96fb79baac tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:15:00.503882 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-cc12391c-5d97-4c0c-9f0d-7f96fb79baac tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:15:00.537949 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-cc12391c-5d97-4c0c-9f0d-7f96fb79baac tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050153 Oct 20 06:15:00.538608 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 603/1186] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:15:00 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:15:01.550934 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-3b22f259-579d-488b-a0dd-b0727998d060 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:15:01.553418 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-3b22f259-579d-488b-a0dd-b0727998d060 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:15:01.559923 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3b22f259-579d-488b-a0dd-b0727998d060 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:15:01.560333 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3b22f259-579d-488b-a0dd-b0727998d060 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:15:01.560785 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3b22f259-579d-488b-a0dd-b0727998d060 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:15:01.561479 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3b22f259-579d-488b-a0dd-b0727998d060 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:15:01.561955 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3b22f259-579d-488b-a0dd-b0727998d060 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:15:01.562514 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3b22f259-579d-488b-a0dd-b0727998d060 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:15:01.600515 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-3b22f259-579d-488b-a0dd-b0727998d060 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053639 Oct 20 06:15:01.601118 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 584/1187] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:15:01 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:15:02.614566 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-6c344dfa-28be-46cf-839b-ce4632bc885a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:15:02.616782 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-6c344dfa-28be-46cf-839b-ce4632bc885a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:15:02.623820 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-6c344dfa-28be-46cf-839b-ce4632bc885a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:15:02.624301 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-6c344dfa-28be-46cf-839b-ce4632bc885a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:15:02.624760 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-6c344dfa-28be-46cf-839b-ce4632bc885a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:15:02.625718 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-6c344dfa-28be-46cf-839b-ce4632bc885a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:15:02.626172 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-6c344dfa-28be-46cf-839b-ce4632bc885a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:15:02.626588 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-6c344dfa-28be-46cf-839b-ce4632bc885a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:15:02.658074 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-6c344dfa-28be-46cf-839b-ce4632bc885a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048828 Oct 20 06:15:02.658658 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 604/1188] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:15:02 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:15:03.671551 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-df085921-ff57-4044-b12a-8ee7b1526a47 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:15:03.673746 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-df085921-ff57-4044-b12a-8ee7b1526a47 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:15:03.681680 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-df085921-ff57-4044-b12a-8ee7b1526a47 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:15:03.682093 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-df085921-ff57-4044-b12a-8ee7b1526a47 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:15:03.682533 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-df085921-ff57-4044-b12a-8ee7b1526a47 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:15:03.683277 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-df085921-ff57-4044-b12a-8ee7b1526a47 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:15:03.683732 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-df085921-ff57-4044-b12a-8ee7b1526a47 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:15:03.684196 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-df085921-ff57-4044-b12a-8ee7b1526a47 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:15:03.715986 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-df085921-ff57-4044-b12a-8ee7b1526a47 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048451 Oct 20 06:15:03.716565 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 585/1189] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:15:03 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:15:04.728000 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-c989a3ee-de2e-4369-a131-b233d95c0b8d tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:15:04.730227 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-c989a3ee-de2e-4369-a131-b233d95c0b8d tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:15:04.736842 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c989a3ee-de2e-4369-a131-b233d95c0b8d tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:15:04.737314 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c989a3ee-de2e-4369-a131-b233d95c0b8d tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:15:04.737754 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c989a3ee-de2e-4369-a131-b233d95c0b8d tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:15:04.738927 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c989a3ee-de2e-4369-a131-b233d95c0b8d tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:15:04.739369 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c989a3ee-de2e-4369-a131-b233d95c0b8d tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:15:04.739786 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c989a3ee-de2e-4369-a131-b233d95c0b8d tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:15:04.769696 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-c989a3ee-de2e-4369-a131-b233d95c0b8d tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045593 Oct 20 06:15:04.770495 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 605/1190] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:15:04 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:15:05.782577 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-9585f202-90aa-44cc-a798-a16f2f40b013 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:15:05.784769 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-9585f202-90aa-44cc-a798-a16f2f40b013 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:15:05.792370 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-9585f202-90aa-44cc-a798-a16f2f40b013 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:15:05.792825 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-9585f202-90aa-44cc-a798-a16f2f40b013 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:15:05.793264 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-9585f202-90aa-44cc-a798-a16f2f40b013 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:15:05.793957 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-9585f202-90aa-44cc-a798-a16f2f40b013 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:15:05.794411 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-9585f202-90aa-44cc-a798-a16f2f40b013 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:15:05.794834 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-9585f202-90aa-44cc-a798-a16f2f40b013 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:15:05.824891 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-9585f202-90aa-44cc-a798-a16f2f40b013 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046257 Oct 20 06:15:05.825660 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 586/1191] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:15:05 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:15:06.837505 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-864e6ff8-bf0f-43a5-a96b-c8bdf2f6b981 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:15:06.839661 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-864e6ff8-bf0f-43a5-a96b-c8bdf2f6b981 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:15:06.846191 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-864e6ff8-bf0f-43a5-a96b-c8bdf2f6b981 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:15:06.846612 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-864e6ff8-bf0f-43a5-a96b-c8bdf2f6b981 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:15:06.847053 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-864e6ff8-bf0f-43a5-a96b-c8bdf2f6b981 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:15:06.847805 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-864e6ff8-bf0f-43a5-a96b-c8bdf2f6b981 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:15:06.848252 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-864e6ff8-bf0f-43a5-a96b-c8bdf2f6b981 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:15:06.848679 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-864e6ff8-bf0f-43a5-a96b-c8bdf2f6b981 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:15:06.879730 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-864e6ff8-bf0f-43a5-a96b-c8bdf2f6b981 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045550 Oct 20 06:15:06.880314 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 606/1192] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:15:06 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:15:07.892342 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-ffc7607e-d6fe-4391-a32e-cfc448435fa7 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:15:07.894522 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-ffc7607e-d6fe-4391-a32e-cfc448435fa7 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:15:07.900918 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-ffc7607e-d6fe-4391-a32e-cfc448435fa7 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:15:07.901444 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-ffc7607e-d6fe-4391-a32e-cfc448435fa7 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:15:07.901827 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-ffc7607e-d6fe-4391-a32e-cfc448435fa7 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:15:07.902510 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-ffc7607e-d6fe-4391-a32e-cfc448435fa7 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:15:07.902958 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-ffc7607e-d6fe-4391-a32e-cfc448435fa7 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:15:07.903375 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-ffc7607e-d6fe-4391-a32e-cfc448435fa7 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:15:07.933137 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-ffc7607e-d6fe-4391-a32e-cfc448435fa7 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044715 Oct 20 06:15:07.933697 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 587/1193] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:15:07 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:15:08.946035 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-81ead045-9227-4c9f-a86d-796aa6ff9b37 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:15:08.948184 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-81ead045-9227-4c9f-a86d-796aa6ff9b37 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:15:08.954557 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-81ead045-9227-4c9f-a86d-796aa6ff9b37 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:15:08.955034 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-81ead045-9227-4c9f-a86d-796aa6ff9b37 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:15:08.955658 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-81ead045-9227-4c9f-a86d-796aa6ff9b37 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:15:08.956357 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-81ead045-9227-4c9f-a86d-796aa6ff9b37 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:15:08.957442 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-81ead045-9227-4c9f-a86d-796aa6ff9b37 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:15:08.957865 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-81ead045-9227-4c9f-a86d-796aa6ff9b37 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:15:08.987367 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-81ead045-9227-4c9f-a86d-796aa6ff9b37 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045206 Oct 20 06:15:08.987846 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 607/1194] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:15:08 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:15:09.999595 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-6b92e011-9f89-42c5-92e5-f22e71f1dd0e tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:15:10.002061 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-6b92e011-9f89-42c5-92e5-f22e71f1dd0e tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:15:10.009177 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-6b92e011-9f89-42c5-92e5-f22e71f1dd0e tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:15:10.009665 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-6b92e011-9f89-42c5-92e5-f22e71f1dd0e tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:15:10.010111 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-6b92e011-9f89-42c5-92e5-f22e71f1dd0e tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:15:10.010810 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-6b92e011-9f89-42c5-92e5-f22e71f1dd0e tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:15:10.011266 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-6b92e011-9f89-42c5-92e5-f22e71f1dd0e tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:15:10.011695 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-6b92e011-9f89-42c5-92e5-f22e71f1dd0e tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:15:10.041962 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-6b92e011-9f89-42c5-92e5-f22e71f1dd0e tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046291 Oct 20 06:15:10.042554 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 588/1195] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:15:09 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:15:11.054842 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-7412b77c-eecf-4563-b3f4-84bd35607688 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:15:11.057031 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-7412b77c-eecf-4563-b3f4-84bd35607688 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:15:11.059317 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG dbcounter [-] [118861] Writing DB stats nova_api:SELECT=30 {{(pid=118861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:15:11.064940 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7412b77c-eecf-4563-b3f4-84bd35607688 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:15:11.065347 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7412b77c-eecf-4563-b3f4-84bd35607688 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:15:11.065801 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7412b77c-eecf-4563-b3f4-84bd35607688 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:15:11.066621 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7412b77c-eecf-4563-b3f4-84bd35607688 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:15:11.067117 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7412b77c-eecf-4563-b3f4-84bd35607688 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:15:11.067582 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7412b77c-eecf-4563-b3f4-84bd35607688 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:15:11.101319 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-7412b77c-eecf-4563-b3f4-84bd35607688 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051215 Oct 20 06:15:11.101904 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 608/1196] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:15:11 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:15:12.112945 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-b125c441-bad7-44f5-b957-ad62332504b3 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:15:12.115178 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-b125c441-bad7-44f5-b957-ad62332504b3 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:15:12.117490 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG dbcounter [-] [118860] Writing DB stats nova_api:SELECT=30 {{(pid=118860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:15:12.122630 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b125c441-bad7-44f5-b957-ad62332504b3 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:15:12.123110 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b125c441-bad7-44f5-b957-ad62332504b3 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:15:12.123543 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b125c441-bad7-44f5-b957-ad62332504b3 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:15:12.124235 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b125c441-bad7-44f5-b957-ad62332504b3 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:15:12.125106 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b125c441-bad7-44f5-b957-ad62332504b3 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:15:12.125533 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b125c441-bad7-44f5-b957-ad62332504b3 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:15:12.155091 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-b125c441-bad7-44f5-b957-ad62332504b3 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046141 Oct 20 06:15:12.155652 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 589/1197] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:15:12 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:15:13.168283 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-5f23eab4-e906-47bf-98dd-305dc005371b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:15:13.170417 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-5f23eab4-e906-47bf-98dd-305dc005371b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:15:13.177759 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5f23eab4-e906-47bf-98dd-305dc005371b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:15:13.178237 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5f23eab4-e906-47bf-98dd-305dc005371b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:15:13.178672 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5f23eab4-e906-47bf-98dd-305dc005371b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:15:13.179362 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5f23eab4-e906-47bf-98dd-305dc005371b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:15:13.179807 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5f23eab4-e906-47bf-98dd-305dc005371b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:15:13.180224 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5f23eab4-e906-47bf-98dd-305dc005371b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:15:13.210253 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-5f23eab4-e906-47bf-98dd-305dc005371b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045935 Oct 20 06:15:13.210826 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 609/1198] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:15:13 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:15:14.222859 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-12f3464e-2f76-4e04-8b28-b07c3bb04ee7 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:15:14.225082 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-12f3464e-2f76-4e04-8b28-b07c3bb04ee7 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:15:14.231525 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-12f3464e-2f76-4e04-8b28-b07c3bb04ee7 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:15:14.232003 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-12f3464e-2f76-4e04-8b28-b07c3bb04ee7 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:15:14.232433 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-12f3464e-2f76-4e04-8b28-b07c3bb04ee7 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:15:14.233144 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-12f3464e-2f76-4e04-8b28-b07c3bb04ee7 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:15:14.233591 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-12f3464e-2f76-4e04-8b28-b07c3bb04ee7 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:15:14.234018 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-12f3464e-2f76-4e04-8b28-b07c3bb04ee7 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:15:14.236335 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG dbcounter [-] [118860] Writing DB stats nova_cell1:SELECT=90 {{(pid=118860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:15:14.265327 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-12f3464e-2f76-4e04-8b28-b07c3bb04ee7 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046462 Oct 20 06:15:14.265891 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 590/1199] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:15:14 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:15:15.278412 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-ece4c520-7ff4-41a2-8176-6ea81f58eb57 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:15:15.280562 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-ece4c520-7ff4-41a2-8176-6ea81f58eb57 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:15:15.287269 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ece4c520-7ff4-41a2-8176-6ea81f58eb57 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:15:15.287743 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ece4c520-7ff4-41a2-8176-6ea81f58eb57 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:15:15.288176 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ece4c520-7ff4-41a2-8176-6ea81f58eb57 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:15:15.288894 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ece4c520-7ff4-41a2-8176-6ea81f58eb57 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:15:15.289343 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ece4c520-7ff4-41a2-8176-6ea81f58eb57 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:15:15.289763 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ece4c520-7ff4-41a2-8176-6ea81f58eb57 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:15:15.320995 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-ece4c520-7ff4-41a2-8176-6ea81f58eb57 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046440 Oct 20 06:15:15.321779 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 610/1200] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:15:15 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:15:16.334486 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-0acc8d4b-e4cb-4afb-b676-d18b8238a481 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:15:16.336751 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-0acc8d4b-e4cb-4afb-b676-d18b8238a481 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:15:16.343077 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0acc8d4b-e4cb-4afb-b676-d18b8238a481 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:15:16.343566 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0acc8d4b-e4cb-4afb-b676-d18b8238a481 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:15:16.344007 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0acc8d4b-e4cb-4afb-b676-d18b8238a481 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:15:16.344725 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0acc8d4b-e4cb-4afb-b676-d18b8238a481 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:15:16.345178 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0acc8d4b-e4cb-4afb-b676-d18b8238a481 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:15:16.345606 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0acc8d4b-e4cb-4afb-b676-d18b8238a481 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:15:16.376806 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-0acc8d4b-e4cb-4afb-b676-d18b8238a481 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047246 Oct 20 06:15:16.377365 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 591/1201] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:15:16 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:15:17.390393 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-6b4ab23e-b1b8-450e-8e9d-74cb90748853 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:15:17.392554 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-6b4ab23e-b1b8-450e-8e9d-74cb90748853 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:15:17.399337 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-6b4ab23e-b1b8-450e-8e9d-74cb90748853 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:15:17.399824 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-6b4ab23e-b1b8-450e-8e9d-74cb90748853 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:15:17.400257 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-6b4ab23e-b1b8-450e-8e9d-74cb90748853 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:15:17.400962 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-6b4ab23e-b1b8-450e-8e9d-74cb90748853 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:15:17.401408 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-6b4ab23e-b1b8-450e-8e9d-74cb90748853 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:15:17.401823 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-6b4ab23e-b1b8-450e-8e9d-74cb90748853 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:15:17.431852 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-6b4ab23e-b1b8-450e-8e9d-74cb90748853 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045877 Oct 20 06:15:17.432407 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 611/1202] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:15:17 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 20 06:15:18.445115 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-f7dc5311-be63-43cc-b427-0c4bd6f128d1 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:15:18.447189 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-f7dc5311-be63-43cc-b427-0c4bd6f128d1 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:15:18.453687 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f7dc5311-be63-43cc-b427-0c4bd6f128d1 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:15:18.454172 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f7dc5311-be63-43cc-b427-0c4bd6f128d1 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:15:18.454614 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f7dc5311-be63-43cc-b427-0c4bd6f128d1 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:15:18.455307 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f7dc5311-be63-43cc-b427-0c4bd6f128d1 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:15:18.455765 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f7dc5311-be63-43cc-b427-0c4bd6f128d1 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:15:18.456963 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f7dc5311-be63-43cc-b427-0c4bd6f128d1 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:15:18.486228 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-f7dc5311-be63-43cc-b427-0c4bd6f128d1 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045724 Oct 20 06:15:18.486785 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 592/1203] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:15:18 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:15:19.498801 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-0ae3c885-58c3-40b6-970d-a12da84ddbb1 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:15:19.501228 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-0ae3c885-58c3-40b6-970d-a12da84ddbb1 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:15:19.508251 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-0ae3c885-58c3-40b6-970d-a12da84ddbb1 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:15:19.508761 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-0ae3c885-58c3-40b6-970d-a12da84ddbb1 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:15:19.509207 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-0ae3c885-58c3-40b6-970d-a12da84ddbb1 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:15:19.509908 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-0ae3c885-58c3-40b6-970d-a12da84ddbb1 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:15:19.510361 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-0ae3c885-58c3-40b6-970d-a12da84ddbb1 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:15:19.510789 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-0ae3c885-58c3-40b6-970d-a12da84ddbb1 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:15:19.540556 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-0ae3c885-58c3-40b6-970d-a12da84ddbb1 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045702 Oct 20 06:15:19.541138 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 612/1204] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:15:19 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:15:20.552733 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-1bb786f9-4d7f-428e-ba85-f858cbdcfeab tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:15:20.554987 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-1bb786f9-4d7f-428e-ba85-f858cbdcfeab tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:15:20.561725 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1bb786f9-4d7f-428e-ba85-f858cbdcfeab tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:15:20.562206 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1bb786f9-4d7f-428e-ba85-f858cbdcfeab tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:15:20.562847 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1bb786f9-4d7f-428e-ba85-f858cbdcfeab tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:15:20.563548 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1bb786f9-4d7f-428e-ba85-f858cbdcfeab tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:15:20.564003 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1bb786f9-4d7f-428e-ba85-f858cbdcfeab tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:15:20.564422 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1bb786f9-4d7f-428e-ba85-f858cbdcfeab tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:15:20.597873 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-1bb786f9-4d7f-428e-ba85-f858cbdcfeab tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048627 Oct 20 06:15:20.598454 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 593/1205] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:15:20 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:15:21.610459 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-dcfba62e-ce8f-42b6-8250-37926632d593 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:15:21.612787 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-dcfba62e-ce8f-42b6-8250-37926632d593 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:15:21.619122 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-dcfba62e-ce8f-42b6-8250-37926632d593 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:15:21.619594 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-dcfba62e-ce8f-42b6-8250-37926632d593 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:15:21.620024 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-dcfba62e-ce8f-42b6-8250-37926632d593 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:15:21.620723 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-dcfba62e-ce8f-42b6-8250-37926632d593 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:15:21.621173 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-dcfba62e-ce8f-42b6-8250-37926632d593 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:15:21.621591 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-dcfba62e-ce8f-42b6-8250-37926632d593 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:15:21.652538 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-dcfba62e-ce8f-42b6-8250-37926632d593 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045869 Oct 20 06:15:21.653067 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 613/1206] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:15:21 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:15:22.664149 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-a826ab79-160f-4fcc-89fe-b8411e0dd9a9 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:15:22.666350 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-a826ab79-160f-4fcc-89fe-b8411e0dd9a9 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:15:22.672194 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a826ab79-160f-4fcc-89fe-b8411e0dd9a9 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:15:22.672674 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a826ab79-160f-4fcc-89fe-b8411e0dd9a9 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:15:22.673129 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a826ab79-160f-4fcc-89fe-b8411e0dd9a9 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:15:22.673815 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a826ab79-160f-4fcc-89fe-b8411e0dd9a9 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:15:22.674259 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a826ab79-160f-4fcc-89fe-b8411e0dd9a9 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:15:22.675357 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a826ab79-160f-4fcc-89fe-b8411e0dd9a9 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:15:22.705524 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-a826ab79-160f-4fcc-89fe-b8411e0dd9a9 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045221 Oct 20 06:15:22.710462 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 594/1207] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:15:22 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 20 06:15:23.717499 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-dae81016-679a-4ca4-9086-dd277f668a33 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:15:23.719719 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-dae81016-679a-4ca4-9086-dd277f668a33 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:15:23.726499 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-dae81016-679a-4ca4-9086-dd277f668a33 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:15:23.726978 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-dae81016-679a-4ca4-9086-dd277f668a33 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:15:23.727414 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-dae81016-679a-4ca4-9086-dd277f668a33 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:15:23.728108 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-dae81016-679a-4ca4-9086-dd277f668a33 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:15:23.728555 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-dae81016-679a-4ca4-9086-dd277f668a33 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:15:23.728997 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-dae81016-679a-4ca4-9086-dd277f668a33 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:15:23.759273 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-dae81016-679a-4ca4-9086-dd277f668a33 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045695 Oct 20 06:15:23.760047 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 614/1208] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:15:23 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:15:24.771913 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-3325d5d9-7620-4ffa-97d5-74b806552c99 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:15:24.774074 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-3325d5d9-7620-4ffa-97d5-74b806552c99 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:15:24.780648 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3325d5d9-7620-4ffa-97d5-74b806552c99 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:15:24.781296 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3325d5d9-7620-4ffa-97d5-74b806552c99 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:15:24.781734 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3325d5d9-7620-4ffa-97d5-74b806552c99 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:15:24.782427 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3325d5d9-7620-4ffa-97d5-74b806552c99 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:15:24.782878 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3325d5d9-7620-4ffa-97d5-74b806552c99 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:15:24.783301 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3325d5d9-7620-4ffa-97d5-74b806552c99 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:15:24.812870 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-3325d5d9-7620-4ffa-97d5-74b806552c99 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044938 Oct 20 06:15:24.813334 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 595/1209] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:15:24 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:15:25.826221 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-9c5e5e64-af48-4ac2-acd6-7c6b8f910ac7 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:15:25.828306 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-9c5e5e64-af48-4ac2-acd6-7c6b8f910ac7 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:15:25.835296 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-9c5e5e64-af48-4ac2-acd6-7c6b8f910ac7 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:15:25.835784 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-9c5e5e64-af48-4ac2-acd6-7c6b8f910ac7 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:15:25.836224 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-9c5e5e64-af48-4ac2-acd6-7c6b8f910ac7 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:15:25.836950 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-9c5e5e64-af48-4ac2-acd6-7c6b8f910ac7 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:15:25.837407 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-9c5e5e64-af48-4ac2-acd6-7c6b8f910ac7 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:15:25.837835 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-9c5e5e64-af48-4ac2-acd6-7c6b8f910ac7 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:15:25.867610 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-9c5e5e64-af48-4ac2-acd6-7c6b8f910ac7 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045450 Oct 20 06:15:25.868168 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 615/1210] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:15:25 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:15:26.881661 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-e92c1b65-8ff0-40eb-9143-40b536700064 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:15:26.883958 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-e92c1b65-8ff0-40eb-9143-40b536700064 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:15:26.889790 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e92c1b65-8ff0-40eb-9143-40b536700064 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:15:26.890312 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e92c1b65-8ff0-40eb-9143-40b536700064 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:15:26.891201 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e92c1b65-8ff0-40eb-9143-40b536700064 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:15:26.891893 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e92c1b65-8ff0-40eb-9143-40b536700064 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:15:26.892344 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e92c1b65-8ff0-40eb-9143-40b536700064 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:15:26.892789 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e92c1b65-8ff0-40eb-9143-40b536700064 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:15:26.921998 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-e92c1b65-8ff0-40eb-9143-40b536700064 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045427 Oct 20 06:15:26.922541 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 596/1211] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:15:26 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:15:27.934366 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-4a36d76e-da31-4cb5-bc13-59c807a8052c tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:15:27.936515 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-4a36d76e-da31-4cb5-bc13-59c807a8052c tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:15:27.943177 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4a36d76e-da31-4cb5-bc13-59c807a8052c tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:15:27.943655 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4a36d76e-da31-4cb5-bc13-59c807a8052c tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:15:27.944094 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4a36d76e-da31-4cb5-bc13-59c807a8052c tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:15:27.944802 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4a36d76e-da31-4cb5-bc13-59c807a8052c tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:15:27.945251 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4a36d76e-da31-4cb5-bc13-59c807a8052c tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:15:27.945677 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4a36d76e-da31-4cb5-bc13-59c807a8052c tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:15:27.974239 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-4a36d76e-da31-4cb5-bc13-59c807a8052c tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043955 Oct 20 06:15:27.974795 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 616/1212] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:15:27 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:15:28.986695 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-f4303da6-008c-4727-b7b5-77df4a74a120 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:15:28.989584 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-f4303da6-008c-4727-b7b5-77df4a74a120 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:15:28.995922 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f4303da6-008c-4727-b7b5-77df4a74a120 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:15:28.996398 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f4303da6-008c-4727-b7b5-77df4a74a120 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:15:28.996872 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f4303da6-008c-4727-b7b5-77df4a74a120 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:15:28.997561 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f4303da6-008c-4727-b7b5-77df4a74a120 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:15:28.998012 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f4303da6-008c-4727-b7b5-77df4a74a120 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:15:28.998443 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f4303da6-008c-4727-b7b5-77df4a74a120 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:15:29.027667 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-f4303da6-008c-4727-b7b5-77df4a74a120 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044949 Oct 20 06:15:29.028217 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 597/1213] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:15:28 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:15:30.039901 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-03d189b0-b6c2-443d-8e41-52454da5dc02 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:15:30.042096 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-03d189b0-b6c2-443d-8e41-52454da5dc02 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:15:30.048464 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-03d189b0-b6c2-443d-8e41-52454da5dc02 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:15:30.048976 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-03d189b0-b6c2-443d-8e41-52454da5dc02 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:15:30.049932 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-03d189b0-b6c2-443d-8e41-52454da5dc02 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:15:30.050635 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-03d189b0-b6c2-443d-8e41-52454da5dc02 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:15:30.051082 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-03d189b0-b6c2-443d-8e41-52454da5dc02 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:15:30.051507 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-03d189b0-b6c2-443d-8e41-52454da5dc02 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:15:30.055084 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG dbcounter [-] [118861] Writing DB stats nova_cell1:SELECT=90 {{(pid=118861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:15:30.081835 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-03d189b0-b6c2-443d-8e41-52454da5dc02 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045922 Oct 20 06:15:30.082392 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 617/1214] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:15:30 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:15:31.094309 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-c6c1cdd3-7b4a-4275-93bc-326f6a509c43 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:15:31.097115 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-c6c1cdd3-7b4a-4275-93bc-326f6a509c43 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:15:31.103914 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c6c1cdd3-7b4a-4275-93bc-326f6a509c43 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:15:31.104401 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c6c1cdd3-7b4a-4275-93bc-326f6a509c43 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:15:31.104871 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c6c1cdd3-7b4a-4275-93bc-326f6a509c43 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:15:31.105606 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c6c1cdd3-7b4a-4275-93bc-326f6a509c43 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:15:31.106056 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c6c1cdd3-7b4a-4275-93bc-326f6a509c43 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:15:31.106480 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c6c1cdd3-7b4a-4275-93bc-326f6a509c43 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:15:31.137796 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-c6c1cdd3-7b4a-4275-93bc-326f6a509c43 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047546 Oct 20 06:15:31.138350 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 598/1215] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:15:31 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:15:32.150267 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-98b180e3-5f86-42f4-b0ac-1065f71a7ce3 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:15:32.152517 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-98b180e3-5f86-42f4-b0ac-1065f71a7ce3 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:15:32.159590 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-98b180e3-5f86-42f4-b0ac-1065f71a7ce3 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:15:32.160123 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-98b180e3-5f86-42f4-b0ac-1065f71a7ce3 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:15:32.160555 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-98b180e3-5f86-42f4-b0ac-1065f71a7ce3 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:15:32.161308 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-98b180e3-5f86-42f4-b0ac-1065f71a7ce3 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:15:32.161753 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-98b180e3-5f86-42f4-b0ac-1065f71a7ce3 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:15:32.162175 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-98b180e3-5f86-42f4-b0ac-1065f71a7ce3 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:15:32.191525 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-98b180e3-5f86-42f4-b0ac-1065f71a7ce3 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045196 Oct 20 06:15:32.192072 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 618/1216] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:15:32 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:15:33.203777 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-8f9b1d8b-8116-4959-8b2a-cb495f5496c1 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:15:33.206489 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-8f9b1d8b-8116-4959-8b2a-cb495f5496c1 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:15:33.212950 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-8f9b1d8b-8116-4959-8b2a-cb495f5496c1 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:15:33.213432 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-8f9b1d8b-8116-4959-8b2a-cb495f5496c1 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:15:33.213867 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-8f9b1d8b-8116-4959-8b2a-cb495f5496c1 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:15:33.214833 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-8f9b1d8b-8116-4959-8b2a-cb495f5496c1 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:15:33.215289 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-8f9b1d8b-8116-4959-8b2a-cb495f5496c1 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:15:33.215714 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-8f9b1d8b-8116-4959-8b2a-cb495f5496c1 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:15:33.245070 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-8f9b1d8b-8116-4959-8b2a-cb495f5496c1 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045242 Oct 20 06:15:33.245616 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 599/1217] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:15:33 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:15:34.258406 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-b3e50d37-c217-48cc-bec6-67b5ba94f9b3 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:15:34.260479 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-b3e50d37-c217-48cc-bec6-67b5ba94f9b3 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:15:34.267045 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b3e50d37-c217-48cc-bec6-67b5ba94f9b3 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:15:34.267521 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b3e50d37-c217-48cc-bec6-67b5ba94f9b3 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:15:34.268607 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b3e50d37-c217-48cc-bec6-67b5ba94f9b3 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:15:34.269323 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b3e50d37-c217-48cc-bec6-67b5ba94f9b3 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:15:34.269776 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b3e50d37-c217-48cc-bec6-67b5ba94f9b3 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:15:34.270194 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b3e50d37-c217-48cc-bec6-67b5ba94f9b3 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:15:34.305315 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-b3e50d37-c217-48cc-bec6-67b5ba94f9b3 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050910 Oct 20 06:15:34.306129 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 619/1218] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:15:34 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:15:35.319463 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-190f3d55-78e6-411f-b532-058287795c46 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:15:35.322475 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-190f3d55-78e6-411f-b532-058287795c46 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:15:35.329161 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-190f3d55-78e6-411f-b532-058287795c46 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:15:35.329648 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-190f3d55-78e6-411f-b532-058287795c46 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:15:35.330135 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-190f3d55-78e6-411f-b532-058287795c46 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:15:35.330833 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-190f3d55-78e6-411f-b532-058287795c46 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:15:35.331282 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-190f3d55-78e6-411f-b532-058287795c46 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:15:35.331707 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-190f3d55-78e6-411f-b532-058287795c46 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:15:35.360959 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-190f3d55-78e6-411f-b532-058287795c46 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047055 Oct 20 06:15:35.362244 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 600/1219] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:15:35 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:15:36.373958 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-adf617bb-5b1c-4580-9d51-6ec8d19a7d55 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:15:36.376462 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-adf617bb-5b1c-4580-9d51-6ec8d19a7d55 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:15:36.383110 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-adf617bb-5b1c-4580-9d51-6ec8d19a7d55 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:15:36.383591 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-adf617bb-5b1c-4580-9d51-6ec8d19a7d55 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:15:36.384028 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-adf617bb-5b1c-4580-9d51-6ec8d19a7d55 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:15:36.384739 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-adf617bb-5b1c-4580-9d51-6ec8d19a7d55 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:15:36.385194 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-adf617bb-5b1c-4580-9d51-6ec8d19a7d55 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:15:36.385617 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-adf617bb-5b1c-4580-9d51-6ec8d19a7d55 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:15:36.415015 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-adf617bb-5b1c-4580-9d51-6ec8d19a7d55 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045010 Oct 20 06:15:36.415830 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 620/1220] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:15:36 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:15:37.430484 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-de7f9548-2b31-425a-bfee-90c83beb851c tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:15:37.432662 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-de7f9548-2b31-425a-bfee-90c83beb851c tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:15:37.439195 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-de7f9548-2b31-425a-bfee-90c83beb851c tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:15:37.439670 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-de7f9548-2b31-425a-bfee-90c83beb851c tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:15:37.440107 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-de7f9548-2b31-425a-bfee-90c83beb851c tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:15:37.440825 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-de7f9548-2b31-425a-bfee-90c83beb851c tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:15:37.441277 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-de7f9548-2b31-425a-bfee-90c83beb851c tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:15:37.441700 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-de7f9548-2b31-425a-bfee-90c83beb851c tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:15:37.470418 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-de7f9548-2b31-425a-bfee-90c83beb851c tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046889 Oct 20 06:15:37.471924 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 601/1221] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:15:37 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:15:38.483569 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-40aa365f-e8cc-424f-8d8b-67210a1bfe6d tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:15:38.485661 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-40aa365f-e8cc-424f-8d8b-67210a1bfe6d tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:15:38.492563 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-40aa365f-e8cc-424f-8d8b-67210a1bfe6d tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:15:38.493139 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-40aa365f-e8cc-424f-8d8b-67210a1bfe6d tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:15:38.493579 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-40aa365f-e8cc-424f-8d8b-67210a1bfe6d tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:15:38.494267 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-40aa365f-e8cc-424f-8d8b-67210a1bfe6d tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:15:38.494718 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-40aa365f-e8cc-424f-8d8b-67210a1bfe6d tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:15:38.495142 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-40aa365f-e8cc-424f-8d8b-67210a1bfe6d tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:15:38.524931 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-40aa365f-e8cc-424f-8d8b-67210a1bfe6d tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045386 Oct 20 06:15:38.525755 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 621/1222] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:15:38 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:15:39.538078 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-053bc810-b0db-418c-8d36-39424b80dec9 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:15:39.540161 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-053bc810-b0db-418c-8d36-39424b80dec9 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:15:39.546746 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-053bc810-b0db-418c-8d36-39424b80dec9 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:15:39.547230 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-053bc810-b0db-418c-8d36-39424b80dec9 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:15:39.547674 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-053bc810-b0db-418c-8d36-39424b80dec9 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:15:39.548377 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-053bc810-b0db-418c-8d36-39424b80dec9 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:15:39.549591 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-053bc810-b0db-418c-8d36-39424b80dec9 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:15:39.550081 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-053bc810-b0db-418c-8d36-39424b80dec9 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:15:39.581511 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-053bc810-b0db-418c-8d36-39424b80dec9 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048021 Oct 20 06:15:39.582197 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 602/1223] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:15:39 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:15:40.594191 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-d3a6e9ac-f378-4b1e-92cf-d26ca11ae18c tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:15:40.596341 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-d3a6e9ac-f378-4b1e-92cf-d26ca11ae18c tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:15:40.603126 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d3a6e9ac-f378-4b1e-92cf-d26ca11ae18c tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:15:40.603615 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d3a6e9ac-f378-4b1e-92cf-d26ca11ae18c tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:15:40.604061 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d3a6e9ac-f378-4b1e-92cf-d26ca11ae18c tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:15:40.604820 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d3a6e9ac-f378-4b1e-92cf-d26ca11ae18c tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:15:40.605314 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d3a6e9ac-f378-4b1e-92cf-d26ca11ae18c tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:15:40.605746 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d3a6e9ac-f378-4b1e-92cf-d26ca11ae18c tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:15:40.638175 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-d3a6e9ac-f378-4b1e-92cf-d26ca11ae18c tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048051 Oct 20 06:15:40.638736 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 622/1224] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:15:40 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 20 06:15:41.650819 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-af3374c1-a255-4902-b5cf-571b3335fbaf tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:15:41.652997 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-af3374c1-a255-4902-b5cf-571b3335fbaf tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:15:41.659891 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-af3374c1-a255-4902-b5cf-571b3335fbaf tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:15:41.660384 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-af3374c1-a255-4902-b5cf-571b3335fbaf tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:15:41.660851 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-af3374c1-a255-4902-b5cf-571b3335fbaf tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:15:41.661553 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-af3374c1-a255-4902-b5cf-571b3335fbaf tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:15:41.662000 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-af3374c1-a255-4902-b5cf-571b3335fbaf tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:15:41.662420 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-af3374c1-a255-4902-b5cf-571b3335fbaf tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:15:41.693505 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-af3374c1-a255-4902-b5cf-571b3335fbaf tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046566 Oct 20 06:15:41.694076 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 603/1225] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:15:41 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 20 06:15:42.706705 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-1c42e5b3-7090-48eb-8705-e3efd31cf970 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:15:42.709090 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-1c42e5b3-7090-48eb-8705-e3efd31cf970 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:15:42.711643 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG dbcounter [-] [118861] Writing DB stats nova_api:SELECT=30 {{(pid=118861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:15:42.717007 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1c42e5b3-7090-48eb-8705-e3efd31cf970 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:15:42.717493 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1c42e5b3-7090-48eb-8705-e3efd31cf970 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:15:42.717925 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1c42e5b3-7090-48eb-8705-e3efd31cf970 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:15:42.718623 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1c42e5b3-7090-48eb-8705-e3efd31cf970 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:15:42.719099 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1c42e5b3-7090-48eb-8705-e3efd31cf970 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:15:42.719517 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1c42e5b3-7090-48eb-8705-e3efd31cf970 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:15:42.750101 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-1c42e5b3-7090-48eb-8705-e3efd31cf970 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047985 Oct 20 06:15:42.750901 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 623/1226] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:15:42 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:15:43.763528 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-c613adc2-6854-434e-9c79-081e4faa57a6 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:15:43.766288 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-c613adc2-6854-434e-9c79-081e4faa57a6 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:15:43.769569 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG dbcounter [-] [118860] Writing DB stats nova_api:SELECT=30 {{(pid=118860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:15:43.775090 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c613adc2-6854-434e-9c79-081e4faa57a6 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:15:43.775570 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c613adc2-6854-434e-9c79-081e4faa57a6 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:15:43.776007 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c613adc2-6854-434e-9c79-081e4faa57a6 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:15:43.776721 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c613adc2-6854-434e-9c79-081e4faa57a6 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:15:43.777244 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c613adc2-6854-434e-9c79-081e4faa57a6 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:15:43.777658 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c613adc2-6854-434e-9c79-081e4faa57a6 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:15:43.809700 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-c613adc2-6854-434e-9c79-081e4faa57a6 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050561 Oct 20 06:15:43.810267 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 604/1227] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:15:43 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:15:44.823820 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-9ed4acf7-ccce-4878-8862-4f1fd1e5cbad tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:15:44.826184 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-9ed4acf7-ccce-4878-8862-4f1fd1e5cbad tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:15:44.833290 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-9ed4acf7-ccce-4878-8862-4f1fd1e5cbad tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:15:44.833855 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-9ed4acf7-ccce-4878-8862-4f1fd1e5cbad tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:15:44.834357 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-9ed4acf7-ccce-4878-8862-4f1fd1e5cbad tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:15:44.835157 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-9ed4acf7-ccce-4878-8862-4f1fd1e5cbad tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:15:44.835697 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-9ed4acf7-ccce-4878-8862-4f1fd1e5cbad tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:15:44.836194 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-9ed4acf7-ccce-4878-8862-4f1fd1e5cbad tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:15:44.869859 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-9ed4acf7-ccce-4878-8862-4f1fd1e5cbad tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049788 Oct 20 06:15:44.876118 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 624/1228] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:15:44 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:15:45.882816 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-db4f21bf-da16-4a4d-9144-bd98358f8bab tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:15:45.884977 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-db4f21bf-da16-4a4d-9144-bd98358f8bab tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:15:45.891673 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-db4f21bf-da16-4a4d-9144-bd98358f8bab tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:15:45.892375 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-db4f21bf-da16-4a4d-9144-bd98358f8bab tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:15:45.892840 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-db4f21bf-da16-4a4d-9144-bd98358f8bab tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:15:45.893547 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-db4f21bf-da16-4a4d-9144-bd98358f8bab tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:15:45.894003 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-db4f21bf-da16-4a4d-9144-bd98358f8bab tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:15:45.894428 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-db4f21bf-da16-4a4d-9144-bd98358f8bab tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:15:45.898184 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG dbcounter [-] [118860] Writing DB stats nova_cell1:SELECT=90 {{(pid=118860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:15:45.941458 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-db4f21bf-da16-4a4d-9144-bd98358f8bab tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062483 Oct 20 06:15:45.946160 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 605/1229] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:15:45 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:15:46.954078 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-aeccca6a-b5ab-4062-a27a-2848e45b934a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:15:46.956237 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-aeccca6a-b5ab-4062-a27a-2848e45b934a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:15:46.972296 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-aeccca6a-b5ab-4062-a27a-2848e45b934a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:15:46.973035 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-aeccca6a-b5ab-4062-a27a-2848e45b934a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:15:46.973758 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-aeccca6a-b5ab-4062-a27a-2848e45b934a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:15:46.974661 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-aeccca6a-b5ab-4062-a27a-2848e45b934a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:15:46.975279 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-aeccca6a-b5ab-4062-a27a-2848e45b934a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:15:46.975883 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-aeccca6a-b5ab-4062-a27a-2848e45b934a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:15:47.008887 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-aeccca6a-b5ab-4062-a27a-2848e45b934a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058961 Oct 20 06:15:47.009456 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 625/1230] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:15:46 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:15:48.036276 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-d6f97cf9-a16c-42e0-975c-ca8afa313096 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:15:48.038661 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-d6f97cf9-a16c-42e0-975c-ca8afa313096 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:15:48.045785 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-d6f97cf9-a16c-42e0-975c-ca8afa313096 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:15:48.046285 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-d6f97cf9-a16c-42e0-975c-ca8afa313096 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:15:48.046728 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-d6f97cf9-a16c-42e0-975c-ca8afa313096 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:15:48.047454 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-d6f97cf9-a16c-42e0-975c-ca8afa313096 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:15:48.048519 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-d6f97cf9-a16c-42e0-975c-ca8afa313096 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:15:48.053351 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-d6f97cf9-a16c-42e0-975c-ca8afa313096 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:15:48.086814 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-d6f97cf9-a16c-42e0-975c-ca8afa313096 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.068769 Oct 20 06:15:48.091391 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 606/1231] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:15:48 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:15:49.101268 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-909e0651-9261-49b5-ab8d-dea24bb2b940 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:15:49.104176 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-909e0651-9261-49b5-ab8d-dea24bb2b940 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:15:49.112876 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-909e0651-9261-49b5-ab8d-dea24bb2b940 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:15:49.113441 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-909e0651-9261-49b5-ab8d-dea24bb2b940 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:15:49.113944 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-909e0651-9261-49b5-ab8d-dea24bb2b940 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:15:49.114803 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-909e0651-9261-49b5-ab8d-dea24bb2b940 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:15:49.115262 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-909e0651-9261-49b5-ab8d-dea24bb2b940 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:15:49.115800 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-909e0651-9261-49b5-ab8d-dea24bb2b940 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:15:49.154106 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-909e0651-9261-49b5-ab8d-dea24bb2b940 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057650 Oct 20 06:15:49.154688 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 626/1232] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:15:49 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:15:50.167873 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-3f3dd850-1f4b-4296-ad04-f3942b820575 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:15:50.170137 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-3f3dd850-1f4b-4296-ad04-f3942b820575 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:15:50.176874 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3f3dd850-1f4b-4296-ad04-f3942b820575 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:15:50.182720 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3f3dd850-1f4b-4296-ad04-f3942b820575 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:15:50.183182 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3f3dd850-1f4b-4296-ad04-f3942b820575 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:15:50.183899 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3f3dd850-1f4b-4296-ad04-f3942b820575 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:15:50.184359 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3f3dd850-1f4b-4296-ad04-f3942b820575 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:15:50.184807 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3f3dd850-1f4b-4296-ad04-f3942b820575 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:15:50.217038 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-3f3dd850-1f4b-4296-ad04-f3942b820575 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053874 Oct 20 06:15:50.221823 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 607/1233] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:15:50 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:15:51.235859 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-22def406-5347-4164-8bc8-02d93637ffd0 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:15:51.237974 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-22def406-5347-4164-8bc8-02d93637ffd0 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:15:51.243980 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-22def406-5347-4164-8bc8-02d93637ffd0 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:15:51.244467 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-22def406-5347-4164-8bc8-02d93637ffd0 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:15:51.244950 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-22def406-5347-4164-8bc8-02d93637ffd0 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:15:51.245674 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-22def406-5347-4164-8bc8-02d93637ffd0 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:15:51.246118 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-22def406-5347-4164-8bc8-02d93637ffd0 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:15:51.246538 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-22def406-5347-4164-8bc8-02d93637ffd0 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:15:51.277058 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-22def406-5347-4164-8bc8-02d93637ffd0 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051556 Oct 20 06:15:51.277720 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 627/1234] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:15:51 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:15:52.290515 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-2297ebbd-2c89-408b-9b3b-8773a3bfd897 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:15:52.299187 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-2297ebbd-2c89-408b-9b3b-8773a3bfd897 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:15:52.309333 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2297ebbd-2c89-408b-9b3b-8773a3bfd897 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:15:52.309913 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2297ebbd-2c89-408b-9b3b-8773a3bfd897 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:15:52.310410 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2297ebbd-2c89-408b-9b3b-8773a3bfd897 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:15:52.311180 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2297ebbd-2c89-408b-9b3b-8773a3bfd897 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:15:52.311817 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2297ebbd-2c89-408b-9b3b-8773a3bfd897 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:15:52.312322 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2297ebbd-2c89-408b-9b3b-8773a3bfd897 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:15:52.341868 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-2297ebbd-2c89-408b-9b3b-8773a3bfd897 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056012 Oct 20 06:15:52.342490 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 608/1235] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:15:52 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:15:53.355936 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-5bdbfbfb-2b89-4296-8baf-44687e1bd0e0 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:15:53.358204 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-5bdbfbfb-2b89-4296-8baf-44687e1bd0e0 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:15:53.373318 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5bdbfbfb-2b89-4296-8baf-44687e1bd0e0 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:15:53.373318 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5bdbfbfb-2b89-4296-8baf-44687e1bd0e0 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:15:53.373318 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5bdbfbfb-2b89-4296-8baf-44687e1bd0e0 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:15:53.373318 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5bdbfbfb-2b89-4296-8baf-44687e1bd0e0 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:15:53.373669 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5bdbfbfb-2b89-4296-8baf-44687e1bd0e0 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:15:53.373669 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5bdbfbfb-2b89-4296-8baf-44687e1bd0e0 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:15:53.412443 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-5bdbfbfb-2b89-4296-8baf-44687e1bd0e0 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060579 Oct 20 06:15:53.417494 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 628/1236] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:15:53 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:15:54.434082 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-d48c40f7-0250-4b06-a0df-6bd0c100825b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:15:54.437105 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-d48c40f7-0250-4b06-a0df-6bd0c100825b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:15:54.445072 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-d48c40f7-0250-4b06-a0df-6bd0c100825b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:15:54.445742 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-d48c40f7-0250-4b06-a0df-6bd0c100825b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:15:54.446183 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-d48c40f7-0250-4b06-a0df-6bd0c100825b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:15:54.446886 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-d48c40f7-0250-4b06-a0df-6bd0c100825b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:15:54.447340 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-d48c40f7-0250-4b06-a0df-6bd0c100825b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:15:54.447768 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-d48c40f7-0250-4b06-a0df-6bd0c100825b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:15:54.492755 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-d48c40f7-0250-4b06-a0df-6bd0c100825b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062550 Oct 20 06:15:54.493568 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 609/1237] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:15:54 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:15:55.505502 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-88e52b37-c6a3-4eec-91bd-3554a1a63c8e tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:15:55.508526 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-88e52b37-c6a3-4eec-91bd-3554a1a63c8e tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:15:55.514967 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-88e52b37-c6a3-4eec-91bd-3554a1a63c8e tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:15:55.515448 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-88e52b37-c6a3-4eec-91bd-3554a1a63c8e tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:15:55.515880 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-88e52b37-c6a3-4eec-91bd-3554a1a63c8e tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:15:55.517295 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-88e52b37-c6a3-4eec-91bd-3554a1a63c8e tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:15:55.517744 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-88e52b37-c6a3-4eec-91bd-3554a1a63c8e tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:15:55.518372 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-88e52b37-c6a3-4eec-91bd-3554a1a63c8e tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:15:55.562220 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-88e52b37-c6a3-4eec-91bd-3554a1a63c8e tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061247 Oct 20 06:15:55.562777 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 629/1238] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:15:55 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:15:56.575037 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-162c1894-f9a5-458c-b6f6-9c3df92e9d0c tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:15:56.577959 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-162c1894-f9a5-458c-b6f6-9c3df92e9d0c tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:15:56.584848 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-162c1894-f9a5-458c-b6f6-9c3df92e9d0c tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:15:56.599461 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-162c1894-f9a5-458c-b6f6-9c3df92e9d0c tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:15:56.599970 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-162c1894-f9a5-458c-b6f6-9c3df92e9d0c tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:15:56.600737 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-162c1894-f9a5-458c-b6f6-9c3df92e9d0c tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:15:56.601219 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-162c1894-f9a5-458c-b6f6-9c3df92e9d0c tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:15:56.601652 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-162c1894-f9a5-458c-b6f6-9c3df92e9d0c tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:15:56.633557 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-162c1894-f9a5-458c-b6f6-9c3df92e9d0c tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062520 Oct 20 06:15:56.634438 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 610/1239] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:15:56 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:15:57.647613 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-b3c2f66e-c5f5-4076-a216-c00702c25c0d tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:15:57.649975 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-b3c2f66e-c5f5-4076-a216-c00702c25c0d tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:15:57.655894 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b3c2f66e-c5f5-4076-a216-c00702c25c0d tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:15:57.656374 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b3c2f66e-c5f5-4076-a216-c00702c25c0d tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:15:57.656843 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b3c2f66e-c5f5-4076-a216-c00702c25c0d tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:15:57.669047 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b3c2f66e-c5f5-4076-a216-c00702c25c0d tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:15:57.669047 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b3c2f66e-c5f5-4076-a216-c00702c25c0d tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:15:57.669047 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b3c2f66e-c5f5-4076-a216-c00702c25c0d tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:15:57.698021 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-b3c2f66e-c5f5-4076-a216-c00702c25c0d tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055479 Oct 20 06:15:57.702927 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 630/1240] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:15:57 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:15:58.709669 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-6441e337-7dd9-4e32-984b-0f398b10f505 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:15:58.711831 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-6441e337-7dd9-4e32-984b-0f398b10f505 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:15:58.719590 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-6441e337-7dd9-4e32-984b-0f398b10f505 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:15:58.720377 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-6441e337-7dd9-4e32-984b-0f398b10f505 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:15:58.720974 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-6441e337-7dd9-4e32-984b-0f398b10f505 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:15:58.721557 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-6441e337-7dd9-4e32-984b-0f398b10f505 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:15:58.722252 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-6441e337-7dd9-4e32-984b-0f398b10f505 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:15:58.723146 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-6441e337-7dd9-4e32-984b-0f398b10f505 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:15:58.755602 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-6441e337-7dd9-4e32-984b-0f398b10f505 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049764 Oct 20 06:15:58.756247 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 611/1241] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:15:58 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:15:59.768233 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-5a2ca9fb-650c-4bb5-ab89-b3ac41065b60 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:15:59.770727 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-5a2ca9fb-650c-4bb5-ab89-b3ac41065b60 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:15:59.785117 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5a2ca9fb-650c-4bb5-ab89-b3ac41065b60 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:15:59.785117 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5a2ca9fb-650c-4bb5-ab89-b3ac41065b60 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:15:59.785117 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5a2ca9fb-650c-4bb5-ab89-b3ac41065b60 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:15:59.785117 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5a2ca9fb-650c-4bb5-ab89-b3ac41065b60 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:15:59.785507 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5a2ca9fb-650c-4bb5-ab89-b3ac41065b60 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:15:59.785507 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5a2ca9fb-650c-4bb5-ab89-b3ac41065b60 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:15:59.811097 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-5a2ca9fb-650c-4bb5-ab89-b3ac41065b60 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047414 Oct 20 06:15:59.812017 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 631/1242] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:15:59 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:16:00.826122 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-6a0e39e1-c815-4c98-a316-c7865d4d3de2 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:16:00.828333 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-6a0e39e1-c815-4c98-a316-c7865d4d3de2 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:16:00.835377 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-6a0e39e1-c815-4c98-a316-c7865d4d3de2 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:16:00.836163 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-6a0e39e1-c815-4c98-a316-c7865d4d3de2 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:16:00.836535 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-6a0e39e1-c815-4c98-a316-c7865d4d3de2 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:16:00.849797 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-6a0e39e1-c815-4c98-a316-c7865d4d3de2 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:16:00.850321 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-6a0e39e1-c815-4c98-a316-c7865d4d3de2 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:16:00.850699 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-6a0e39e1-c815-4c98-a316-c7865d4d3de2 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:16:00.882691 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-6a0e39e1-c815-4c98-a316-c7865d4d3de2 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060263 Oct 20 06:16:00.883317 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 612/1243] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:16:00 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:16:01.894379 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-4fb05e60-38be-4e08-9b0a-fed26cd802a9 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:16:01.896539 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-4fb05e60-38be-4e08-9b0a-fed26cd802a9 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:16:01.903197 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4fb05e60-38be-4e08-9b0a-fed26cd802a9 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:16:01.903197 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4fb05e60-38be-4e08-9b0a-fed26cd802a9 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:16:01.903197 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4fb05e60-38be-4e08-9b0a-fed26cd802a9 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:16:01.903197 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4fb05e60-38be-4e08-9b0a-fed26cd802a9 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:16:01.913290 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4fb05e60-38be-4e08-9b0a-fed26cd802a9 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:16:01.913290 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4fb05e60-38be-4e08-9b0a-fed26cd802a9 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:16:01.913290 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG dbcounter [-] [118861] Writing DB stats nova_cell1:SELECT=90 {{(pid=118861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:16:01.937608 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-4fb05e60-38be-4e08-9b0a-fed26cd802a9 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047349 Oct 20 06:16:01.942935 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 632/1244] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:16:01 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:16:02.950307 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-34f6e561-aecc-44ac-bfef-f64b9390c2d0 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:16:02.952444 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-34f6e561-aecc-44ac-bfef-f64b9390c2d0 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:16:02.959425 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-34f6e561-aecc-44ac-bfef-f64b9390c2d0 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:16:02.959908 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-34f6e561-aecc-44ac-bfef-f64b9390c2d0 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:16:02.960998 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-34f6e561-aecc-44ac-bfef-f64b9390c2d0 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:16:02.961710 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-34f6e561-aecc-44ac-bfef-f64b9390c2d0 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:16:02.977203 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-34f6e561-aecc-44ac-bfef-f64b9390c2d0 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:16:02.977681 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-34f6e561-aecc-44ac-bfef-f64b9390c2d0 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:16:03.008899 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-34f6e561-aecc-44ac-bfef-f64b9390c2d0 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062403 Oct 20 06:16:03.009670 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 613/1245] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:16:02 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:16:04.022338 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-69545675-0d13-4fcf-b97f-fd38acb91cb5 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:16:04.024875 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-69545675-0d13-4fcf-b97f-fd38acb91cb5 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:16:04.032907 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-69545675-0d13-4fcf-b97f-fd38acb91cb5 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:16:04.033911 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-69545675-0d13-4fcf-b97f-fd38acb91cb5 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:16:04.034612 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-69545675-0d13-4fcf-b97f-fd38acb91cb5 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:16:04.035551 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-69545675-0d13-4fcf-b97f-fd38acb91cb5 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:16:04.036463 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-69545675-0d13-4fcf-b97f-fd38acb91cb5 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:16:04.037583 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-69545675-0d13-4fcf-b97f-fd38acb91cb5 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:16:04.069382 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-69545675-0d13-4fcf-b97f-fd38acb91cb5 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051450 Oct 20 06:16:04.070070 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 633/1246] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:16:04 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:16:05.082643 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-a2422f3a-6c53-439e-b6c0-48f91c6cafc4 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:16:05.084920 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-a2422f3a-6c53-439e-b6c0-48f91c6cafc4 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:16:05.091207 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a2422f3a-6c53-439e-b6c0-48f91c6cafc4 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:16:05.091795 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a2422f3a-6c53-439e-b6c0-48f91c6cafc4 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:16:05.092499 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a2422f3a-6c53-439e-b6c0-48f91c6cafc4 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:16:05.093760 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a2422f3a-6c53-439e-b6c0-48f91c6cafc4 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:16:05.094779 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a2422f3a-6c53-439e-b6c0-48f91c6cafc4 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:16:05.095470 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a2422f3a-6c53-439e-b6c0-48f91c6cafc4 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:16:05.127137 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-a2422f3a-6c53-439e-b6c0-48f91c6cafc4 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048515 Oct 20 06:16:05.127918 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 614/1247] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:16:05 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:16:06.139567 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-a40fe3ab-3504-499b-a0e4-fbb9bcdc8f81 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:16:06.142558 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-a40fe3ab-3504-499b-a0e4-fbb9bcdc8f81 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:16:06.148814 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a40fe3ab-3504-499b-a0e4-fbb9bcdc8f81 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:16:06.149302 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a40fe3ab-3504-499b-a0e4-fbb9bcdc8f81 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:16:06.149744 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a40fe3ab-3504-499b-a0e4-fbb9bcdc8f81 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:16:06.150479 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a40fe3ab-3504-499b-a0e4-fbb9bcdc8f81 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:16:06.150934 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a40fe3ab-3504-499b-a0e4-fbb9bcdc8f81 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:16:06.151362 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a40fe3ab-3504-499b-a0e4-fbb9bcdc8f81 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:16:06.182548 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-a40fe3ab-3504-499b-a0e4-fbb9bcdc8f81 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046909 Oct 20 06:16:06.186544 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 634/1248] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:16:06 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:16:07.195380 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-c907533c-069c-4adc-b40a-c1d6dde1db46 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:16:07.197571 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-c907533c-069c-4adc-b40a-c1d6dde1db46 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:16:07.204793 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c907533c-069c-4adc-b40a-c1d6dde1db46 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:16:07.205391 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c907533c-069c-4adc-b40a-c1d6dde1db46 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:16:07.205903 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c907533c-069c-4adc-b40a-c1d6dde1db46 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:16:07.206665 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c907533c-069c-4adc-b40a-c1d6dde1db46 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:16:07.207127 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c907533c-069c-4adc-b40a-c1d6dde1db46 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:16:07.207654 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c907533c-069c-4adc-b40a-c1d6dde1db46 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:16:07.239099 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-c907533c-069c-4adc-b40a-c1d6dde1db46 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047709 Oct 20 06:16:07.239841 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 615/1249] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:16:07 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:16:08.253877 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-858842dd-722a-4da8-b33e-d755a6958dcb tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:16:08.256075 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-858842dd-722a-4da8-b33e-d755a6958dcb tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:16:08.263235 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-858842dd-722a-4da8-b33e-d755a6958dcb tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:16:08.263940 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-858842dd-722a-4da8-b33e-d755a6958dcb tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:16:08.264556 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-858842dd-722a-4da8-b33e-d755a6958dcb tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:16:08.265429 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-858842dd-722a-4da8-b33e-d755a6958dcb tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:16:08.266092 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-858842dd-722a-4da8-b33e-d755a6958dcb tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:16:08.267428 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-858842dd-722a-4da8-b33e-d755a6958dcb tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:16:08.304689 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-858842dd-722a-4da8-b33e-d755a6958dcb tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052928 Oct 20 06:16:08.310156 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 635/1250] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:16:08 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:16:09.317574 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-f18e936f-95d3-4668-97d7-dc0afabf2448 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:16:09.319919 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-f18e936f-95d3-4668-97d7-dc0afabf2448 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:16:09.326094 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f18e936f-95d3-4668-97d7-dc0afabf2448 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:16:09.326578 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f18e936f-95d3-4668-97d7-dc0afabf2448 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:16:09.327012 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f18e936f-95d3-4668-97d7-dc0afabf2448 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:16:09.327706 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f18e936f-95d3-4668-97d7-dc0afabf2448 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:16:09.328183 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f18e936f-95d3-4668-97d7-dc0afabf2448 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:16:09.329163 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f18e936f-95d3-4668-97d7-dc0afabf2448 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:16:09.361544 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-f18e936f-95d3-4668-97d7-dc0afabf2448 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050039 Oct 20 06:16:09.366634 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 616/1251] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:16:09 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:16:10.374826 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-49519544-a583-4238-91da-6776d854dae3 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:16:10.378736 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-49519544-a583-4238-91da-6776d854dae3 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:16:10.387469 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-49519544-a583-4238-91da-6776d854dae3 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:16:10.388190 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-49519544-a583-4238-91da-6776d854dae3 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:16:10.389197 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-49519544-a583-4238-91da-6776d854dae3 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:16:10.390227 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-49519544-a583-4238-91da-6776d854dae3 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:16:10.390737 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-49519544-a583-4238-91da-6776d854dae3 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:16:10.391552 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-49519544-a583-4238-91da-6776d854dae3 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:16:10.427041 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-49519544-a583-4238-91da-6776d854dae3 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057121 Oct 20 06:16:10.427615 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 636/1252] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:16:10 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:16:11.439930 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-4858dec4-98a8-4710-8d01-a5f8c7a66aae tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:16:11.442236 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-4858dec4-98a8-4710-8d01-a5f8c7a66aae tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:16:11.448754 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-4858dec4-98a8-4710-8d01-a5f8c7a66aae tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:16:11.449306 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-4858dec4-98a8-4710-8d01-a5f8c7a66aae tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:16:11.449814 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-4858dec4-98a8-4710-8d01-a5f8c7a66aae tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:16:11.450572 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-4858dec4-98a8-4710-8d01-a5f8c7a66aae tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:16:11.451177 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-4858dec4-98a8-4710-8d01-a5f8c7a66aae tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:16:11.451669 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-4858dec4-98a8-4710-8d01-a5f8c7a66aae tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:16:11.482445 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-4858dec4-98a8-4710-8d01-a5f8c7a66aae tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047050 Oct 20 06:16:11.483101 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 617/1253] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:16:11 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:16:12.495751 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-1cb6db6f-99a0-4539-95e6-9026363ec5c7 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:16:12.498041 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-1cb6db6f-99a0-4539-95e6-9026363ec5c7 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:16:12.505306 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1cb6db6f-99a0-4539-95e6-9026363ec5c7 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:16:12.505830 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1cb6db6f-99a0-4539-95e6-9026363ec5c7 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:16:12.506266 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1cb6db6f-99a0-4539-95e6-9026363ec5c7 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:16:12.507004 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1cb6db6f-99a0-4539-95e6-9026363ec5c7 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:16:12.507458 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1cb6db6f-99a0-4539-95e6-9026363ec5c7 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:16:12.507886 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1cb6db6f-99a0-4539-95e6-9026363ec5c7 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:16:12.551494 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-1cb6db6f-99a0-4539-95e6-9026363ec5c7 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059915 Oct 20 06:16:12.552073 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 637/1254] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:16:12 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:16:13.566133 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-048c538f-3f4f-4437-a22f-6510982010be tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:16:13.569031 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-048c538f-3f4f-4437-a22f-6510982010be tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:16:13.577078 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-048c538f-3f4f-4437-a22f-6510982010be tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:16:13.579353 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-048c538f-3f4f-4437-a22f-6510982010be tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:16:13.580167 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-048c538f-3f4f-4437-a22f-6510982010be tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:16:13.581130 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-048c538f-3f4f-4437-a22f-6510982010be tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:16:13.581641 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-048c538f-3f4f-4437-a22f-6510982010be tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:16:13.582178 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-048c538f-3f4f-4437-a22f-6510982010be tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:16:13.619213 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-048c538f-3f4f-4437-a22f-6510982010be tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058857 Oct 20 06:16:13.619949 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 618/1255] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:16:13 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:16:14.633658 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-3e7096ca-4c12-4411-81b1-3af0133f37cb tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:16:14.635967 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-3e7096ca-4c12-4411-81b1-3af0133f37cb tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:16:14.638395 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG dbcounter [-] [118861] Writing DB stats nova_api:SELECT=30 {{(pid=118861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:16:14.643923 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-3e7096ca-4c12-4411-81b1-3af0133f37cb tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:16:14.644414 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-3e7096ca-4c12-4411-81b1-3af0133f37cb tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:16:14.645132 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-3e7096ca-4c12-4411-81b1-3af0133f37cb tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:16:14.645846 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-3e7096ca-4c12-4411-81b1-3af0133f37cb tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:16:14.646302 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-3e7096ca-4c12-4411-81b1-3af0133f37cb tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:16:14.646732 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-3e7096ca-4c12-4411-81b1-3af0133f37cb tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:16:14.676947 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-3e7096ca-4c12-4411-81b1-3af0133f37cb tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047718 Oct 20 06:16:14.677522 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 638/1256] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:16:14 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:16:15.690008 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-693ec371-246c-49b7-a3bd-37529e48feb9 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:16:15.692779 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-693ec371-246c-49b7-a3bd-37529e48feb9 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:16:15.694817 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG dbcounter [-] [118860] Writing DB stats nova_api:SELECT=30 {{(pid=118860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:16:15.701484 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-693ec371-246c-49b7-a3bd-37529e48feb9 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:16:15.701980 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-693ec371-246c-49b7-a3bd-37529e48feb9 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:16:15.702620 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-693ec371-246c-49b7-a3bd-37529e48feb9 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:16:15.703330 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-693ec371-246c-49b7-a3bd-37529e48feb9 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:16:15.703974 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-693ec371-246c-49b7-a3bd-37529e48feb9 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:16:15.704741 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-693ec371-246c-49b7-a3bd-37529e48feb9 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:16:15.739202 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-693ec371-246c-49b7-a3bd-37529e48feb9 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054231 Oct 20 06:16:15.739770 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 619/1257] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:16:15 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:16:16.752432 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-f60b4c86-1c69-4172-87d4-fc91302f7478 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:16:16.754867 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-f60b4c86-1c69-4172-87d4-fc91302f7478 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:16:16.761532 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f60b4c86-1c69-4172-87d4-fc91302f7478 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:16:16.762017 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f60b4c86-1c69-4172-87d4-fc91302f7478 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:16:16.762452 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f60b4c86-1c69-4172-87d4-fc91302f7478 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:16:16.763184 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f60b4c86-1c69-4172-87d4-fc91302f7478 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:16:16.763640 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f60b4c86-1c69-4172-87d4-fc91302f7478 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:16:16.764059 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f60b4c86-1c69-4172-87d4-fc91302f7478 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:16:16.795852 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-f60b4c86-1c69-4172-87d4-fc91302f7478 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048192 Oct 20 06:16:16.796657 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 639/1258] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:16:16 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:16:17.810214 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-54b3286e-8102-46ab-917d-f7e3a81f6380 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:16:17.813914 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-54b3286e-8102-46ab-917d-f7e3a81f6380 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:16:17.820673 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-54b3286e-8102-46ab-917d-f7e3a81f6380 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:16:17.821390 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-54b3286e-8102-46ab-917d-f7e3a81f6380 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:16:17.822144 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-54b3286e-8102-46ab-917d-f7e3a81f6380 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:16:17.823142 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-54b3286e-8102-46ab-917d-f7e3a81f6380 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:16:17.823875 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-54b3286e-8102-46ab-917d-f7e3a81f6380 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:16:17.824467 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-54b3286e-8102-46ab-917d-f7e3a81f6380 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:16:17.827636 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG dbcounter [-] [118860] Writing DB stats nova_cell1:SELECT=90 {{(pid=118860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:16:17.872801 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-54b3286e-8102-46ab-917d-f7e3a81f6380 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.067395 Oct 20 06:16:17.873437 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 620/1259] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:16:17 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:16:18.887517 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-fc9e7b9f-9a9f-4d93-b25a-6085eb3251e0 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:16:18.889945 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-fc9e7b9f-9a9f-4d93-b25a-6085eb3251e0 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:16:18.898721 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-fc9e7b9f-9a9f-4d93-b25a-6085eb3251e0 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:16:18.899288 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-fc9e7b9f-9a9f-4d93-b25a-6085eb3251e0 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:16:18.899795 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-fc9e7b9f-9a9f-4d93-b25a-6085eb3251e0 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:16:18.900726 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-fc9e7b9f-9a9f-4d93-b25a-6085eb3251e0 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:16:18.901193 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-fc9e7b9f-9a9f-4d93-b25a-6085eb3251e0 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:16:18.901605 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-fc9e7b9f-9a9f-4d93-b25a-6085eb3251e0 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:16:18.946802 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-fc9e7b9f-9a9f-4d93-b25a-6085eb3251e0 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063564 Oct 20 06:16:18.947555 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 640/1260] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:16:18 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:16:19.959496 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-f7ae808c-b7b2-450f-97f7-dbd464300adc tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:16:19.961652 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-f7ae808c-b7b2-450f-97f7-dbd464300adc tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:16:19.968157 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f7ae808c-b7b2-450f-97f7-dbd464300adc tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:16:19.968642 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f7ae808c-b7b2-450f-97f7-dbd464300adc tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:16:19.969120 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f7ae808c-b7b2-450f-97f7-dbd464300adc tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:16:19.969815 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f7ae808c-b7b2-450f-97f7-dbd464300adc tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:16:19.970267 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f7ae808c-b7b2-450f-97f7-dbd464300adc tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:16:19.970723 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f7ae808c-b7b2-450f-97f7-dbd464300adc tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:16:19.999943 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-f7ae808c-b7b2-450f-97f7-dbd464300adc tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044767 Oct 20 06:16:20.000508 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 621/1261] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:16:19 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:16:21.013019 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-3e555794-b8a6-4bb2-b985-6fd255490e38 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:16:21.015849 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-3e555794-b8a6-4bb2-b985-6fd255490e38 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:16:21.023261 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-3e555794-b8a6-4bb2-b985-6fd255490e38 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:16:21.023822 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-3e555794-b8a6-4bb2-b985-6fd255490e38 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:16:21.024337 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-3e555794-b8a6-4bb2-b985-6fd255490e38 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:16:21.025191 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-3e555794-b8a6-4bb2-b985-6fd255490e38 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:16:21.025733 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-3e555794-b8a6-4bb2-b985-6fd255490e38 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:16:21.026218 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-3e555794-b8a6-4bb2-b985-6fd255490e38 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:16:21.063167 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-3e555794-b8a6-4bb2-b985-6fd255490e38 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054213 Oct 20 06:16:21.063739 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 641/1262] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:16:21 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:16:22.075689 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-438eaac6-123a-4503-8805-b7e7ee2b667f tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:16:22.078773 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-438eaac6-123a-4503-8805-b7e7ee2b667f tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:16:22.086037 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-438eaac6-123a-4503-8805-b7e7ee2b667f tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:16:22.086555 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-438eaac6-123a-4503-8805-b7e7ee2b667f tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:16:22.087031 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-438eaac6-123a-4503-8805-b7e7ee2b667f tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:16:22.087775 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-438eaac6-123a-4503-8805-b7e7ee2b667f tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:16:22.088235 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-438eaac6-123a-4503-8805-b7e7ee2b667f tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:16:22.088661 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-438eaac6-123a-4503-8805-b7e7ee2b667f tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:16:22.121560 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-438eaac6-123a-4503-8805-b7e7ee2b667f tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049896 Oct 20 06:16:22.122220 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 622/1263] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:16:22 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:16:23.135605 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-3a3f9381-9454-42c9-a5b7-7210c993d84f tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:16:23.137967 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-3a3f9381-9454-42c9-a5b7-7210c993d84f tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:16:23.145472 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-3a3f9381-9454-42c9-a5b7-7210c993d84f tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:16:23.145988 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-3a3f9381-9454-42c9-a5b7-7210c993d84f tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:16:23.146448 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-3a3f9381-9454-42c9-a5b7-7210c993d84f tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:16:23.147180 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-3a3f9381-9454-42c9-a5b7-7210c993d84f tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:16:23.147662 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-3a3f9381-9454-42c9-a5b7-7210c993d84f tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:16:23.148107 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-3a3f9381-9454-42c9-a5b7-7210c993d84f tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:16:23.178954 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-3a3f9381-9454-42c9-a5b7-7210c993d84f tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047511 Oct 20 06:16:23.179529 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 642/1264] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:16:23 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:16:24.191480 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-ab87f0ce-5c0f-40eb-8661-15079db871d9 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:16:24.194281 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-ab87f0ce-5c0f-40eb-8661-15079db871d9 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:16:24.200580 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-ab87f0ce-5c0f-40eb-8661-15079db871d9 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:16:24.201087 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-ab87f0ce-5c0f-40eb-8661-15079db871d9 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:16:24.201517 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-ab87f0ce-5c0f-40eb-8661-15079db871d9 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:16:24.202203 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-ab87f0ce-5c0f-40eb-8661-15079db871d9 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:16:24.202652 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-ab87f0ce-5c0f-40eb-8661-15079db871d9 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:16:24.203088 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-ab87f0ce-5c0f-40eb-8661-15079db871d9 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:16:24.233150 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-ab87f0ce-5c0f-40eb-8661-15079db871d9 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045599 Oct 20 06:16:24.233737 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 623/1265] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:16:24 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:16:25.245676 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-561cc45e-cd21-479f-9b39-7b4ceac26a8f tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:16:25.247887 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-561cc45e-cd21-479f-9b39-7b4ceac26a8f tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:16:25.250555 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 20 06:16:25.250702 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: Thu Oct 20 06:16:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments (ip 10.222.0.20) !!! Oct 20 06:16:25.259255 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-561cc45e-cd21-479f-9b39-7b4ceac26a8f tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:16:25.259710 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-561cc45e-cd21-479f-9b39-7b4ceac26a8f tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:16:25.260146 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-561cc45e-cd21-479f-9b39-7b4ceac26a8f tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:16:25.260894 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-561cc45e-cd21-479f-9b39-7b4ceac26a8f tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:16:25.261344 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-561cc45e-cd21-479f-9b39-7b4ceac26a8f tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:16:25.261805 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-561cc45e-cd21-479f-9b39-7b4ceac26a8f tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:16:25.295001 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-561cc45e-cd21-479f-9b39-7b4ceac26a8f tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053243 Oct 20 06:16:25.295955 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 643/1266] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:16:25 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:16:26.308248 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-2956ead1-20c8-4365-9bf7-cf75b74f7ddd tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:16:26.310432 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-2956ead1-20c8-4365-9bf7-cf75b74f7ddd tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:16:26.317234 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2956ead1-20c8-4365-9bf7-cf75b74f7ddd tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:16:26.317713 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2956ead1-20c8-4365-9bf7-cf75b74f7ddd tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:16:26.318921 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2956ead1-20c8-4365-9bf7-cf75b74f7ddd tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:16:26.319672 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2956ead1-20c8-4365-9bf7-cf75b74f7ddd tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:16:26.320077 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2956ead1-20c8-4365-9bf7-cf75b74f7ddd tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:16:26.320504 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2956ead1-20c8-4365-9bf7-cf75b74f7ddd tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:16:26.349937 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-2956ead1-20c8-4365-9bf7-cf75b74f7ddd tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045610 Oct 20 06:16:26.350588 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 624/1267] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:16:26 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:16:27.362109 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-89921705-1fa3-40a5-9916-30d0c732f681 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:16:27.364326 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-89921705-1fa3-40a5-9916-30d0c732f681 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:16:27.371521 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-89921705-1fa3-40a5-9916-30d0c732f681 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:16:27.372015 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-89921705-1fa3-40a5-9916-30d0c732f681 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:16:27.372455 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-89921705-1fa3-40a5-9916-30d0c732f681 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:16:27.373185 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-89921705-1fa3-40a5-9916-30d0c732f681 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:16:27.373638 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-89921705-1fa3-40a5-9916-30d0c732f681 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:16:27.374064 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-89921705-1fa3-40a5-9916-30d0c732f681 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:16:27.407547 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-89921705-1fa3-40a5-9916-30d0c732f681 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049355 Oct 20 06:16:27.408317 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 644/1268] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:16:27 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:16:28.420660 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-dbaac6b3-7b82-4dd5-89dd-4946eb6993b2 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:16:28.422839 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-dbaac6b3-7b82-4dd5-89dd-4946eb6993b2 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:16:28.429871 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-dbaac6b3-7b82-4dd5-89dd-4946eb6993b2 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:16:28.430363 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-dbaac6b3-7b82-4dd5-89dd-4946eb6993b2 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:16:28.430785 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-dbaac6b3-7b82-4dd5-89dd-4946eb6993b2 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:16:28.431472 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-dbaac6b3-7b82-4dd5-89dd-4946eb6993b2 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:16:28.431920 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-dbaac6b3-7b82-4dd5-89dd-4946eb6993b2 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:16:28.432339 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-dbaac6b3-7b82-4dd5-89dd-4946eb6993b2 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:16:28.463539 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-dbaac6b3-7b82-4dd5-89dd-4946eb6993b2 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046739 Oct 20 06:16:28.464100 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 625/1269] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:16:28 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:16:29.478064 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-0624c101-ff68-4fcf-8436-b2ff898235f6 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:16:29.480732 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-0624c101-ff68-4fcf-8436-b2ff898235f6 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:16:29.488090 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-0624c101-ff68-4fcf-8436-b2ff898235f6 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:16:29.488833 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-0624c101-ff68-4fcf-8436-b2ff898235f6 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:16:29.489397 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-0624c101-ff68-4fcf-8436-b2ff898235f6 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:16:29.490714 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-0624c101-ff68-4fcf-8436-b2ff898235f6 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:16:29.491357 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-0624c101-ff68-4fcf-8436-b2ff898235f6 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:16:29.491893 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-0624c101-ff68-4fcf-8436-b2ff898235f6 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:16:29.531148 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-0624c101-ff68-4fcf-8436-b2ff898235f6 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058104 Oct 20 06:16:29.532028 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 645/1270] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:16:29 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:16:30.546331 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-67f8ec37-4104-4cd3-aae5-4b940d422c83 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:16:30.556175 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-67f8ec37-4104-4cd3-aae5-4b940d422c83 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:16:30.564174 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-67f8ec37-4104-4cd3-aae5-4b940d422c83 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:16:30.565074 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-67f8ec37-4104-4cd3-aae5-4b940d422c83 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:16:30.566009 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-67f8ec37-4104-4cd3-aae5-4b940d422c83 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:16:30.566894 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-67f8ec37-4104-4cd3-aae5-4b940d422c83 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:16:30.567690 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-67f8ec37-4104-4cd3-aae5-4b940d422c83 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:16:30.568460 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-67f8ec37-4104-4cd3-aae5-4b940d422c83 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:16:30.616502 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-67f8ec37-4104-4cd3-aae5-4b940d422c83 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064464 Oct 20 06:16:30.616502 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 626/1271] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:16:30 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:16:31.624183 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-0bebd968-d4ac-4b47-98d2-13e6f30dff9d tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:16:31.627779 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-0bebd968-d4ac-4b47-98d2-13e6f30dff9d tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:16:31.636048 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-0bebd968-d4ac-4b47-98d2-13e6f30dff9d tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:16:31.636824 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-0bebd968-d4ac-4b47-98d2-13e6f30dff9d tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:16:31.637503 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-0bebd968-d4ac-4b47-98d2-13e6f30dff9d tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:16:31.638430 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-0bebd968-d4ac-4b47-98d2-13e6f30dff9d tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:16:31.639109 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-0bebd968-d4ac-4b47-98d2-13e6f30dff9d tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:16:31.639746 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-0bebd968-d4ac-4b47-98d2-13e6f30dff9d tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:16:31.672768 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-0bebd968-d4ac-4b47-98d2-13e6f30dff9d tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056410 Oct 20 06:16:31.673571 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 646/1272] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:16:31 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:16:32.688103 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-ab9acddd-5749-4047-917b-1cd5822beda4 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:16:32.691501 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-ab9acddd-5749-4047-917b-1cd5822beda4 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:16:32.701549 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-ab9acddd-5749-4047-917b-1cd5822beda4 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:16:32.702396 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-ab9acddd-5749-4047-917b-1cd5822beda4 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:16:32.703127 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-ab9acddd-5749-4047-917b-1cd5822beda4 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:16:32.704289 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-ab9acddd-5749-4047-917b-1cd5822beda4 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:16:32.705148 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-ab9acddd-5749-4047-917b-1cd5822beda4 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:16:32.705936 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-ab9acddd-5749-4047-917b-1cd5822beda4 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:16:32.758690 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-ab9acddd-5749-4047-917b-1cd5822beda4 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.076132 Oct 20 06:16:32.763921 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 627/1273] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:16:32 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:16:33.772947 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-b48eff18-cf8b-486b-89ba-88b5acf31d73 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:16:33.775959 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-b48eff18-cf8b-486b-89ba-88b5acf31d73 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:16:33.783743 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b48eff18-cf8b-486b-89ba-88b5acf31d73 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:16:33.784324 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b48eff18-cf8b-486b-89ba-88b5acf31d73 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:16:33.784891 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b48eff18-cf8b-486b-89ba-88b5acf31d73 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:16:33.785742 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b48eff18-cf8b-486b-89ba-88b5acf31d73 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:16:33.786242 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b48eff18-cf8b-486b-89ba-88b5acf31d73 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:16:33.786764 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b48eff18-cf8b-486b-89ba-88b5acf31d73 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:16:33.789773 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG dbcounter [-] [118861] Writing DB stats nova_cell1:SELECT=90 {{(pid=118861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:16:33.826160 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-b48eff18-cf8b-486b-89ba-88b5acf31d73 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058018 Oct 20 06:16:33.826745 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 647/1274] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:16:33 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:16:34.840101 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-2d2badeb-f98a-4b0d-9813-def9c7fb0c18 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:16:34.842965 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-2d2badeb-f98a-4b0d-9813-def9c7fb0c18 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:16:34.850979 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2d2badeb-f98a-4b0d-9813-def9c7fb0c18 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:16:34.851469 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2d2badeb-f98a-4b0d-9813-def9c7fb0c18 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:16:34.852098 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2d2badeb-f98a-4b0d-9813-def9c7fb0c18 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:16:34.852839 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2d2badeb-f98a-4b0d-9813-def9c7fb0c18 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:16:34.853297 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2d2badeb-f98a-4b0d-9813-def9c7fb0c18 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:16:34.853723 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2d2badeb-f98a-4b0d-9813-def9c7fb0c18 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:16:34.885107 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-2d2badeb-f98a-4b0d-9813-def9c7fb0c18 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049491 Oct 20 06:16:34.885670 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 628/1275] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:16:34 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:16:35.898873 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-bf266031-939e-4bca-8dd6-f7f412ec440d tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:16:35.901962 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-bf266031-939e-4bca-8dd6-f7f412ec440d tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:16:35.911024 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-bf266031-939e-4bca-8dd6-f7f412ec440d tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:16:35.911871 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-bf266031-939e-4bca-8dd6-f7f412ec440d tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:16:35.912767 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-bf266031-939e-4bca-8dd6-f7f412ec440d tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:16:35.913769 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-bf266031-939e-4bca-8dd6-f7f412ec440d tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:16:35.914725 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-bf266031-939e-4bca-8dd6-f7f412ec440d tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:16:35.915402 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-bf266031-939e-4bca-8dd6-f7f412ec440d tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:16:35.957688 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-bf266031-939e-4bca-8dd6-f7f412ec440d tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063993 Oct 20 06:16:35.958434 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 648/1276] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:16:35 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:16:36.970393 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-e546c985-c6b2-44f6-ad7b-129d505a65df tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:16:36.973129 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-e546c985-c6b2-44f6-ad7b-129d505a65df tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:16:36.980800 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e546c985-c6b2-44f6-ad7b-129d505a65df tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:16:36.981403 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e546c985-c6b2-44f6-ad7b-129d505a65df tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:16:36.981889 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e546c985-c6b2-44f6-ad7b-129d505a65df tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:16:36.982933 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e546c985-c6b2-44f6-ad7b-129d505a65df tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:16:36.983412 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e546c985-c6b2-44f6-ad7b-129d505a65df tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:16:36.983982 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e546c985-c6b2-44f6-ad7b-129d505a65df tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:16:37.019904 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-e546c985-c6b2-44f6-ad7b-129d505a65df tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053461 Oct 20 06:16:37.020581 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 629/1277] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:16:36 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:16:38.033823 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-aefd9302-16b3-42b9-a577-948f66eeafc6 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:16:38.036706 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-aefd9302-16b3-42b9-a577-948f66eeafc6 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:16:38.043577 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-aefd9302-16b3-42b9-a577-948f66eeafc6 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:16:38.044064 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-aefd9302-16b3-42b9-a577-948f66eeafc6 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:16:38.044506 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-aefd9302-16b3-42b9-a577-948f66eeafc6 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:16:38.045257 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-aefd9302-16b3-42b9-a577-948f66eeafc6 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:16:38.045708 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-aefd9302-16b3-42b9-a577-948f66eeafc6 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:16:38.046136 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-aefd9302-16b3-42b9-a577-948f66eeafc6 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:16:38.080569 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-aefd9302-16b3-42b9-a577-948f66eeafc6 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050316 Oct 20 06:16:38.081307 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 649/1278] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:16:38 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:16:39.092720 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-da0ad41f-f387-4178-9dae-5e2420198016 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:16:39.095051 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-da0ad41f-f387-4178-9dae-5e2420198016 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:16:39.102639 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-da0ad41f-f387-4178-9dae-5e2420198016 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:16:39.103130 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-da0ad41f-f387-4178-9dae-5e2420198016 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:16:39.104178 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-da0ad41f-f387-4178-9dae-5e2420198016 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:16:39.105276 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-da0ad41f-f387-4178-9dae-5e2420198016 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:16:39.105899 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-da0ad41f-f387-4178-9dae-5e2420198016 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:16:39.106507 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-da0ad41f-f387-4178-9dae-5e2420198016 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:16:39.145315 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-da0ad41f-f387-4178-9dae-5e2420198016 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056562 Oct 20 06:16:39.146501 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 630/1279] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:16:39 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:16:40.158651 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-64bb31f2-bb10-408c-bb76-66246ba043ad tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:16:40.160996 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-64bb31f2-bb10-408c-bb76-66246ba043ad tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:16:40.167827 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-64bb31f2-bb10-408c-bb76-66246ba043ad tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:16:40.168407 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-64bb31f2-bb10-408c-bb76-66246ba043ad tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:16:40.168755 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-64bb31f2-bb10-408c-bb76-66246ba043ad tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:16:40.169445 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-64bb31f2-bb10-408c-bb76-66246ba043ad tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:16:40.169969 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-64bb31f2-bb10-408c-bb76-66246ba043ad tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:16:40.170391 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-64bb31f2-bb10-408c-bb76-66246ba043ad tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:16:40.203299 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-64bb31f2-bb10-408c-bb76-66246ba043ad tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048765 Oct 20 06:16:40.203868 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 650/1280] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:16:40 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:16:41.217015 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-1c992170-6c67-4bd9-b39e-f2a58dd5a3b2 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:16:41.219493 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-1c992170-6c67-4bd9-b39e-f2a58dd5a3b2 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:16:41.229049 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1c992170-6c67-4bd9-b39e-f2a58dd5a3b2 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:16:41.229049 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1c992170-6c67-4bd9-b39e-f2a58dd5a3b2 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:16:41.229049 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1c992170-6c67-4bd9-b39e-f2a58dd5a3b2 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:16:41.229049 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1c992170-6c67-4bd9-b39e-f2a58dd5a3b2 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:16:41.229600 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1c992170-6c67-4bd9-b39e-f2a58dd5a3b2 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:16:41.229600 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1c992170-6c67-4bd9-b39e-f2a58dd5a3b2 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:16:41.262715 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-1c992170-6c67-4bd9-b39e-f2a58dd5a3b2 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050021 Oct 20 06:16:41.263389 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 631/1281] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:16:41 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:16:42.275999 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-f813b6d0-0cdb-492b-8906-58c1fd4ee87b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:16:42.278762 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-f813b6d0-0cdb-492b-8906-58c1fd4ee87b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:16:42.285823 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f813b6d0-0cdb-492b-8906-58c1fd4ee87b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:16:42.286321 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f813b6d0-0cdb-492b-8906-58c1fd4ee87b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:16:42.286761 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f813b6d0-0cdb-492b-8906-58c1fd4ee87b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:16:42.287514 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f813b6d0-0cdb-492b-8906-58c1fd4ee87b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:16:42.287964 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f813b6d0-0cdb-492b-8906-58c1fd4ee87b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:16:42.288387 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f813b6d0-0cdb-492b-8906-58c1fd4ee87b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:16:42.336755 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-f813b6d0-0cdb-492b-8906-58c1fd4ee87b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064861 Oct 20 06:16:42.338061 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 651/1282] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:16:42 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:16:43.355926 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-58417373-a509-4fbe-9721-9eae45d8f550 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:16:43.358173 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-58417373-a509-4fbe-9721-9eae45d8f550 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:16:43.365738 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-58417373-a509-4fbe-9721-9eae45d8f550 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:16:43.366350 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-58417373-a509-4fbe-9721-9eae45d8f550 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:16:43.366851 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-58417373-a509-4fbe-9721-9eae45d8f550 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:16:43.367611 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-58417373-a509-4fbe-9721-9eae45d8f550 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:16:43.368129 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-58417373-a509-4fbe-9721-9eae45d8f550 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:16:43.368635 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-58417373-a509-4fbe-9721-9eae45d8f550 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:16:43.402982 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-58417373-a509-4fbe-9721-9eae45d8f550 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057229 Oct 20 06:16:43.403545 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 632/1283] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:16:43 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:16:44.416388 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-197b0dd2-6bc0-4de2-8677-ca2e4d05803f tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:16:44.418770 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-197b0dd2-6bc0-4de2-8677-ca2e4d05803f tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:16:44.424833 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-197b0dd2-6bc0-4de2-8677-ca2e4d05803f tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:16:44.425390 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-197b0dd2-6bc0-4de2-8677-ca2e4d05803f tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:16:44.425904 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-197b0dd2-6bc0-4de2-8677-ca2e4d05803f tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:16:44.429096 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-197b0dd2-6bc0-4de2-8677-ca2e4d05803f tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:16:44.429581 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-197b0dd2-6bc0-4de2-8677-ca2e4d05803f tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:16:44.430205 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-197b0dd2-6bc0-4de2-8677-ca2e4d05803f tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:16:44.465711 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-197b0dd2-6bc0-4de2-8677-ca2e4d05803f tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054295 Oct 20 06:16:44.466541 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 652/1284] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:16:44 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:16:45.479635 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-3d3d5ae8-87a2-4f2c-9c2a-e3de60e3ebfd tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:16:45.481807 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-3d3d5ae8-87a2-4f2c-9c2a-e3de60e3ebfd tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:16:45.488426 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3d3d5ae8-87a2-4f2c-9c2a-e3de60e3ebfd tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:16:45.490023 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3d3d5ae8-87a2-4f2c-9c2a-e3de60e3ebfd tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:16:45.491137 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3d3d5ae8-87a2-4f2c-9c2a-e3de60e3ebfd tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:16:45.491799 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3d3d5ae8-87a2-4f2c-9c2a-e3de60e3ebfd tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:16:45.492249 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3d3d5ae8-87a2-4f2c-9c2a-e3de60e3ebfd tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:16:45.492795 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3d3d5ae8-87a2-4f2c-9c2a-e3de60e3ebfd tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:16:45.523844 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-3d3d5ae8-87a2-4f2c-9c2a-e3de60e3ebfd tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048149 Oct 20 06:16:45.524411 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 633/1285] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:16:45 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:16:46.536010 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-ba5c7ec8-5f75-4dc7-8107-45879f9182b5 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:16:46.539137 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-ba5c7ec8-5f75-4dc7-8107-45879f9182b5 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:16:46.541119 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 20 06:16:46.541273 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: Thu Oct 20 06:16:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments (ip 10.222.0.20) !!! Oct 20 06:16:46.544121 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG dbcounter [-] [118861] Writing DB stats nova_api:SELECT=30 {{(pid=118861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:16:46.551330 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ba5c7ec8-5f75-4dc7-8107-45879f9182b5 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:16:46.551817 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ba5c7ec8-5f75-4dc7-8107-45879f9182b5 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:16:46.552349 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ba5c7ec8-5f75-4dc7-8107-45879f9182b5 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:16:46.553150 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ba5c7ec8-5f75-4dc7-8107-45879f9182b5 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:16:46.553598 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ba5c7ec8-5f75-4dc7-8107-45879f9182b5 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:16:46.554184 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ba5c7ec8-5f75-4dc7-8107-45879f9182b5 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:16:46.588635 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-ba5c7ec8-5f75-4dc7-8107-45879f9182b5 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056630 Oct 20 06:16:46.589234 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 653/1286] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:16:46 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:16:47.605572 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-3e35c0ab-ad67-4d5c-ba9f-e78eddb70888 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:16:47.608138 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-3e35c0ab-ad67-4d5c-ba9f-e78eddb70888 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:16:47.610408 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 20 06:16:47.610551 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: Thu Oct 20 06:16:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments (ip 10.222.0.20) !!! Oct 20 06:16:47.612606 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG dbcounter [-] [118860] Writing DB stats nova_api:SELECT=30 {{(pid=118860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:16:47.622353 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3e35c0ab-ad67-4d5c-ba9f-e78eddb70888 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:16:47.622846 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3e35c0ab-ad67-4d5c-ba9f-e78eddb70888 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:16:47.623330 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3e35c0ab-ad67-4d5c-ba9f-e78eddb70888 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:16:47.623972 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3e35c0ab-ad67-4d5c-ba9f-e78eddb70888 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:16:47.624440 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3e35c0ab-ad67-4d5c-ba9f-e78eddb70888 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:16:47.624908 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3e35c0ab-ad67-4d5c-ba9f-e78eddb70888 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:16:47.660922 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-3e35c0ab-ad67-4d5c-ba9f-e78eddb70888 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063285 Oct 20 06:16:47.661502 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 634/1287] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:16:47 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:16:48.673321 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-54fb23bc-ff88-469c-be22-aba9d3fe96b8 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:16:48.675529 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-54fb23bc-ff88-469c-be22-aba9d3fe96b8 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:16:48.683106 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-54fb23bc-ff88-469c-be22-aba9d3fe96b8 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:16:48.683620 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-54fb23bc-ff88-469c-be22-aba9d3fe96b8 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:16:48.684346 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-54fb23bc-ff88-469c-be22-aba9d3fe96b8 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:16:48.685099 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-54fb23bc-ff88-469c-be22-aba9d3fe96b8 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:16:48.685548 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-54fb23bc-ff88-469c-be22-aba9d3fe96b8 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:16:48.686212 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-54fb23bc-ff88-469c-be22-aba9d3fe96b8 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:16:48.717804 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-54fb23bc-ff88-469c-be22-aba9d3fe96b8 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048479 Oct 20 06:16:48.718893 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 654/1288] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:16:48 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:16:49.730914 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-0098052a-8372-4762-b4b1-055e6f958ecd tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:16:49.733114 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-0098052a-8372-4762-b4b1-055e6f958ecd tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:16:49.741222 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0098052a-8372-4762-b4b1-055e6f958ecd tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:16:49.741905 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0098052a-8372-4762-b4b1-055e6f958ecd tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:16:49.742343 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0098052a-8372-4762-b4b1-055e6f958ecd tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:16:49.743045 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0098052a-8372-4762-b4b1-055e6f958ecd tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:16:49.743501 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0098052a-8372-4762-b4b1-055e6f958ecd tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:16:49.743929 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0098052a-8372-4762-b4b1-055e6f958ecd tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:16:49.747684 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG dbcounter [-] [118860] Writing DB stats nova_cell1:SELECT=90 {{(pid=118860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:16:49.778055 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-0098052a-8372-4762-b4b1-055e6f958ecd tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051045 Oct 20 06:16:49.783342 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 635/1289] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:16:49 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:16:50.791022 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-9b4146b2-3a80-4e7c-8362-d11144ead71f tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:16:50.793400 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-9b4146b2-3a80-4e7c-8362-d11144ead71f tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:16:50.799823 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-9b4146b2-3a80-4e7c-8362-d11144ead71f tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:16:50.800303 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-9b4146b2-3a80-4e7c-8362-d11144ead71f tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:16:50.800788 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-9b4146b2-3a80-4e7c-8362-d11144ead71f tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:16:50.801724 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-9b4146b2-3a80-4e7c-8362-d11144ead71f tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:16:50.802338 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-9b4146b2-3a80-4e7c-8362-d11144ead71f tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:16:50.803837 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-9b4146b2-3a80-4e7c-8362-d11144ead71f tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:16:50.837504 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-9b4146b2-3a80-4e7c-8362-d11144ead71f tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051219 Oct 20 06:16:50.841075 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 655/1290] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:16:50 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:16:51.854174 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-01291093-ff04-4e9b-8e4c-6725494d5981 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:16:51.856394 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-01291093-ff04-4e9b-8e4c-6725494d5981 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:16:51.862602 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-01291093-ff04-4e9b-8e4c-6725494d5981 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:16:51.863096 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-01291093-ff04-4e9b-8e4c-6725494d5981 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:16:51.863539 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-01291093-ff04-4e9b-8e4c-6725494d5981 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:16:51.864239 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-01291093-ff04-4e9b-8e4c-6725494d5981 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:16:51.864715 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-01291093-ff04-4e9b-8e4c-6725494d5981 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:16:51.865700 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-01291093-ff04-4e9b-8e4c-6725494d5981 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:16:51.900518 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-01291093-ff04-4e9b-8e4c-6725494d5981 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050115 Oct 20 06:16:51.901294 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 636/1291] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:16:51 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:16:52.915743 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-77d47b42-080b-45a1-84f3-4555e3a0835c tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:16:52.919974 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-77d47b42-080b-45a1-84f3-4555e3a0835c tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:16:52.926084 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-77d47b42-080b-45a1-84f3-4555e3a0835c tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:16:52.926616 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-77d47b42-080b-45a1-84f3-4555e3a0835c tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:16:52.927047 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-77d47b42-080b-45a1-84f3-4555e3a0835c tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:16:52.927740 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-77d47b42-080b-45a1-84f3-4555e3a0835c tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:16:52.928186 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-77d47b42-080b-45a1-84f3-4555e3a0835c tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:16:52.928907 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-77d47b42-080b-45a1-84f3-4555e3a0835c tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:16:52.961368 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-77d47b42-080b-45a1-84f3-4555e3a0835c tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050470 Oct 20 06:16:52.966147 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 656/1292] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:16:52 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:16:53.973442 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-ab190cdd-d6b8-4778-9a5d-e8c02e1d6de9 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:16:53.976190 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-ab190cdd-d6b8-4778-9a5d-e8c02e1d6de9 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:16:53.984535 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-ab190cdd-d6b8-4778-9a5d-e8c02e1d6de9 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:16:53.984535 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-ab190cdd-d6b8-4778-9a5d-e8c02e1d6de9 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:16:53.984535 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-ab190cdd-d6b8-4778-9a5d-e8c02e1d6de9 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:16:53.984535 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-ab190cdd-d6b8-4778-9a5d-e8c02e1d6de9 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:16:53.984961 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-ab190cdd-d6b8-4778-9a5d-e8c02e1d6de9 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:16:53.985498 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-ab190cdd-d6b8-4778-9a5d-e8c02e1d6de9 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:16:54.017544 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-ab190cdd-d6b8-4778-9a5d-e8c02e1d6de9 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047971 Oct 20 06:16:54.023025 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 637/1293] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:16:53 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:16:55.032139 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-83c58438-767a-431d-ac51-721378d01f4f tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:16:55.034571 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-83c58438-767a-431d-ac51-721378d01f4f tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:16:55.042217 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-83c58438-767a-431d-ac51-721378d01f4f tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:16:55.042701 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-83c58438-767a-431d-ac51-721378d01f4f tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:16:55.043384 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-83c58438-767a-431d-ac51-721378d01f4f tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:16:55.044184 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-83c58438-767a-431d-ac51-721378d01f4f tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:16:55.044633 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-83c58438-767a-431d-ac51-721378d01f4f tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:16:55.044979 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-83c58438-767a-431d-ac51-721378d01f4f tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:16:55.080127 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-83c58438-767a-431d-ac51-721378d01f4f tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052675 Oct 20 06:16:55.085805 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 657/1294] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:16:55 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:16:56.093260 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-41278336-1e46-43b2-9e2c-121464010bd4 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:16:56.095153 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-41278336-1e46-43b2-9e2c-121464010bd4 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:16:56.103621 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-41278336-1e46-43b2-9e2c-121464010bd4 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:16:56.104484 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-41278336-1e46-43b2-9e2c-121464010bd4 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:16:56.105303 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-41278336-1e46-43b2-9e2c-121464010bd4 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:16:56.106039 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-41278336-1e46-43b2-9e2c-121464010bd4 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:16:56.106499 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-41278336-1e46-43b2-9e2c-121464010bd4 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:16:56.106924 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-41278336-1e46-43b2-9e2c-121464010bd4 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:16:56.138865 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-41278336-1e46-43b2-9e2c-121464010bd4 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049849 Oct 20 06:16:56.139501 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 638/1295] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:16:56 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:16:57.153724 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-30c8287b-7d3d-428a-90bf-06b19c614be0 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:16:57.161506 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-30c8287b-7d3d-428a-90bf-06b19c614be0 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:16:57.170118 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-30c8287b-7d3d-428a-90bf-06b19c614be0 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:16:57.171101 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-30c8287b-7d3d-428a-90bf-06b19c614be0 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:16:57.171845 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-30c8287b-7d3d-428a-90bf-06b19c614be0 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:16:57.172549 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-30c8287b-7d3d-428a-90bf-06b19c614be0 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:16:57.173039 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-30c8287b-7d3d-428a-90bf-06b19c614be0 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:16:57.173457 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-30c8287b-7d3d-428a-90bf-06b19c614be0 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:16:57.206711 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-30c8287b-7d3d-428a-90bf-06b19c614be0 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057990 Oct 20 06:16:57.212325 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 658/1296] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:16:57 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:16:58.227124 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-d2cd61f0-cfdc-4bfd-bb4f-f0444c3b4dca tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:16:58.229297 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-d2cd61f0-cfdc-4bfd-bb4f-f0444c3b4dca tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:16:58.237268 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-d2cd61f0-cfdc-4bfd-bb4f-f0444c3b4dca tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:16:58.238296 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-d2cd61f0-cfdc-4bfd-bb4f-f0444c3b4dca tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:16:58.239023 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-d2cd61f0-cfdc-4bfd-bb4f-f0444c3b4dca tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:16:58.241022 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-d2cd61f0-cfdc-4bfd-bb4f-f0444c3b4dca tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:16:58.241984 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-d2cd61f0-cfdc-4bfd-bb4f-f0444c3b4dca tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:16:58.242724 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-d2cd61f0-cfdc-4bfd-bb4f-f0444c3b4dca tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:16:58.278850 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-d2cd61f0-cfdc-4bfd-bb4f-f0444c3b4dca tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057992 Oct 20 06:16:58.279419 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 639/1297] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:16:58 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:16:59.291741 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-370033ca-f7ec-46b2-a51a-cd2a44c18c9a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:16:59.297004 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-370033ca-f7ec-46b2-a51a-cd2a44c18c9a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:16:59.304587 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-370033ca-f7ec-46b2-a51a-cd2a44c18c9a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:16:59.305139 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-370033ca-f7ec-46b2-a51a-cd2a44c18c9a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:16:59.305630 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-370033ca-f7ec-46b2-a51a-cd2a44c18c9a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:16:59.306332 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-370033ca-f7ec-46b2-a51a-cd2a44c18c9a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:16:59.307414 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-370033ca-f7ec-46b2-a51a-cd2a44c18c9a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:16:59.308646 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-370033ca-f7ec-46b2-a51a-cd2a44c18c9a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:16:59.343717 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-370033ca-f7ec-46b2-a51a-cd2a44c18c9a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056029 Oct 20 06:16:59.344314 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 659/1298] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:16:59 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:17:00.371176 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-179971ec-7adc-4de6-a656-e1433cc964d0 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:17:00.374961 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-179971ec-7adc-4de6-a656-e1433cc964d0 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:17:00.385400 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-179971ec-7adc-4de6-a656-e1433cc964d0 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:17:00.386094 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-179971ec-7adc-4de6-a656-e1433cc964d0 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:17:00.386565 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-179971ec-7adc-4de6-a656-e1433cc964d0 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:17:00.387365 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-179971ec-7adc-4de6-a656-e1433cc964d0 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:17:00.388077 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-179971ec-7adc-4de6-a656-e1433cc964d0 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:17:00.388855 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-179971ec-7adc-4de6-a656-e1433cc964d0 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:17:00.427098 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-179971ec-7adc-4de6-a656-e1433cc964d0 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059979 Oct 20 06:17:00.428019 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 640/1299] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:17:00 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:17:01.440603 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-97d8339b-219a-4ba2-b609-c01c64842771 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:17:01.442843 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-97d8339b-219a-4ba2-b609-c01c64842771 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:17:01.450058 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-97d8339b-219a-4ba2-b609-c01c64842771 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:17:01.450556 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-97d8339b-219a-4ba2-b609-c01c64842771 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:17:01.450993 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-97d8339b-219a-4ba2-b609-c01c64842771 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:17:01.451702 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-97d8339b-219a-4ba2-b609-c01c64842771 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:17:01.452155 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-97d8339b-219a-4ba2-b609-c01c64842771 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:17:01.452579 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-97d8339b-219a-4ba2-b609-c01c64842771 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:17:01.485425 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-97d8339b-219a-4ba2-b609-c01c64842771 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049714 Oct 20 06:17:01.486315 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 660/1300] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:17:01 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 20 06:17:02.498232 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-2fd750df-fd22-4c97-bca0-e571ef367410 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:17:02.501502 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-2fd750df-fd22-4c97-bca0-e571ef367410 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:17:02.509445 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2fd750df-fd22-4c97-bca0-e571ef367410 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:17:02.510007 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2fd750df-fd22-4c97-bca0-e571ef367410 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:17:02.510515 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2fd750df-fd22-4c97-bca0-e571ef367410 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:17:02.511285 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2fd750df-fd22-4c97-bca0-e571ef367410 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:17:02.511868 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2fd750df-fd22-4c97-bca0-e571ef367410 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:17:02.512364 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2fd750df-fd22-4c97-bca0-e571ef367410 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:17:02.543377 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-2fd750df-fd22-4c97-bca0-e571ef367410 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049108 Oct 20 06:17:02.548089 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 641/1301] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:17:02 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:17:03.555800 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-3f3fa236-e045-4d83-93cc-7f53622a6c11 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:17:03.558248 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-3f3fa236-e045-4d83-93cc-7f53622a6c11 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:17:03.565179 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-3f3fa236-e045-4d83-93cc-7f53622a6c11 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:17:03.565784 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-3f3fa236-e045-4d83-93cc-7f53622a6c11 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:17:03.566325 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-3f3fa236-e045-4d83-93cc-7f53622a6c11 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:17:03.571223 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-3f3fa236-e045-4d83-93cc-7f53622a6c11 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:17:03.571223 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-3f3fa236-e045-4d83-93cc-7f53622a6c11 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:17:03.571223 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-3f3fa236-e045-4d83-93cc-7f53622a6c11 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:17:03.600809 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-3f3fa236-e045-4d83-93cc-7f53622a6c11 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049154 Oct 20 06:17:03.601469 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 661/1302] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:17:03 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:17:04.619616 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-2b6cb536-e12a-4bcd-b16d-4f88a8ff7ecf tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:17:04.623100 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-2b6cb536-e12a-4bcd-b16d-4f88a8ff7ecf tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:17:04.632813 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2b6cb536-e12a-4bcd-b16d-4f88a8ff7ecf tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:17:04.633315 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2b6cb536-e12a-4bcd-b16d-4f88a8ff7ecf tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:17:04.633754 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2b6cb536-e12a-4bcd-b16d-4f88a8ff7ecf tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:17:04.634657 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2b6cb536-e12a-4bcd-b16d-4f88a8ff7ecf tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:17:04.635239 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2b6cb536-e12a-4bcd-b16d-4f88a8ff7ecf tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:17:04.635752 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2b6cb536-e12a-4bcd-b16d-4f88a8ff7ecf tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:17:04.682063 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-2b6cb536-e12a-4bcd-b16d-4f88a8ff7ecf tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.071957 Oct 20 06:17:04.683102 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 642/1303] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:17:04 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:17:05.696042 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-d265de30-f01e-4442-acf3-2967d71cb3b1 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:17:05.698394 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-d265de30-f01e-4442-acf3-2967d71cb3b1 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:17:05.708091 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d265de30-f01e-4442-acf3-2967d71cb3b1 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:17:05.709941 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d265de30-f01e-4442-acf3-2967d71cb3b1 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:17:05.710682 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d265de30-f01e-4442-acf3-2967d71cb3b1 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:17:05.711660 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d265de30-f01e-4442-acf3-2967d71cb3b1 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:17:05.712455 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d265de30-f01e-4442-acf3-2967d71cb3b1 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:17:05.713071 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d265de30-f01e-4442-acf3-2967d71cb3b1 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:17:05.716319 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG dbcounter [-] [118861] Writing DB stats nova_cell1:SELECT=90 {{(pid=118861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:17:05.758270 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-d265de30-f01e-4442-acf3-2967d71cb3b1 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.067042 Oct 20 06:17:05.758853 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 662/1304] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:17:05 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:17:06.770869 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-c2598a14-74e9-4118-a785-ed3b260a2348 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:17:06.773187 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-c2598a14-74e9-4118-a785-ed3b260a2348 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:17:06.779557 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c2598a14-74e9-4118-a785-ed3b260a2348 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:17:06.780048 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c2598a14-74e9-4118-a785-ed3b260a2348 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:17:06.780488 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c2598a14-74e9-4118-a785-ed3b260a2348 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:17:06.781219 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c2598a14-74e9-4118-a785-ed3b260a2348 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:17:06.781875 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c2598a14-74e9-4118-a785-ed3b260a2348 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:17:06.782462 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c2598a14-74e9-4118-a785-ed3b260a2348 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:17:06.818250 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-c2598a14-74e9-4118-a785-ed3b260a2348 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051520 Oct 20 06:17:06.820285 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 643/1305] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:17:06 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:17:07.832495 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-756c24bc-e46b-40fb-9a10-0513f275c52d tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:17:07.835565 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-756c24bc-e46b-40fb-9a10-0513f275c52d tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:17:07.842294 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-756c24bc-e46b-40fb-9a10-0513f275c52d tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:17:07.843013 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-756c24bc-e46b-40fb-9a10-0513f275c52d tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:17:07.843418 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-756c24bc-e46b-40fb-9a10-0513f275c52d tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:17:07.844307 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-756c24bc-e46b-40fb-9a10-0513f275c52d tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:17:07.845118 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-756c24bc-e46b-40fb-9a10-0513f275c52d tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:17:07.845485 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-756c24bc-e46b-40fb-9a10-0513f275c52d tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:17:07.875967 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-756c24bc-e46b-40fb-9a10-0513f275c52d tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047400 Oct 20 06:17:07.876969 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 663/1306] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:17:07 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:17:08.888675 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-c9a664d0-3782-4b4b-9bd9-022c963b8bae tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:17:08.890873 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-c9a664d0-3782-4b4b-9bd9-022c963b8bae tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:17:08.897499 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c9a664d0-3782-4b4b-9bd9-022c963b8bae tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:17:08.897991 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c9a664d0-3782-4b4b-9bd9-022c963b8bae tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:17:08.898564 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c9a664d0-3782-4b4b-9bd9-022c963b8bae tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:17:08.899520 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c9a664d0-3782-4b4b-9bd9-022c963b8bae tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:17:08.899978 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c9a664d0-3782-4b4b-9bd9-022c963b8bae tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:17:08.900593 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c9a664d0-3782-4b4b-9bd9-022c963b8bae tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:17:08.932183 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-c9a664d0-3782-4b4b-9bd9-022c963b8bae tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047355 Oct 20 06:17:08.933113 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 644/1307] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:17:08 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:17:09.945190 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-eca5baff-f38d-478b-9526-3c3b94bd7390 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:17:09.947339 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-eca5baff-f38d-478b-9526-3c3b94bd7390 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:17:09.954114 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-eca5baff-f38d-478b-9526-3c3b94bd7390 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:17:09.954589 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-eca5baff-f38d-478b-9526-3c3b94bd7390 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:17:09.955200 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-eca5baff-f38d-478b-9526-3c3b94bd7390 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:17:09.955898 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-eca5baff-f38d-478b-9526-3c3b94bd7390 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:17:09.956347 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-eca5baff-f38d-478b-9526-3c3b94bd7390 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:17:09.956792 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-eca5baff-f38d-478b-9526-3c3b94bd7390 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:17:09.987678 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-eca5baff-f38d-478b-9526-3c3b94bd7390 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047050 Oct 20 06:17:09.991942 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 664/1308] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:17:09 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:17:11.002391 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-7efec368-ae14-462a-87b3-9521924ec6c5 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:17:11.003872 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-7efec368-ae14-462a-87b3-9521924ec6c5 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:17:11.011175 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7efec368-ae14-462a-87b3-9521924ec6c5 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:17:11.011804 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7efec368-ae14-462a-87b3-9521924ec6c5 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:17:11.012261 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7efec368-ae14-462a-87b3-9521924ec6c5 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:17:11.013064 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7efec368-ae14-462a-87b3-9521924ec6c5 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:17:11.013595 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7efec368-ae14-462a-87b3-9521924ec6c5 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:17:11.014028 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7efec368-ae14-462a-87b3-9521924ec6c5 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:17:11.050299 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-7efec368-ae14-462a-87b3-9521924ec6c5 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053506 Oct 20 06:17:11.051158 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 645/1309] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:17:10 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:17:12.062912 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-334d3b18-5e75-46b9-868e-2fa1f08a8569 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:17:12.065903 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-334d3b18-5e75-46b9-868e-2fa1f08a8569 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:17:12.074844 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-334d3b18-5e75-46b9-868e-2fa1f08a8569 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:17:12.075337 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-334d3b18-5e75-46b9-868e-2fa1f08a8569 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:17:12.075781 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-334d3b18-5e75-46b9-868e-2fa1f08a8569 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:17:12.076491 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-334d3b18-5e75-46b9-868e-2fa1f08a8569 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:17:12.076971 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-334d3b18-5e75-46b9-868e-2fa1f08a8569 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:17:12.077403 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-334d3b18-5e75-46b9-868e-2fa1f08a8569 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:17:12.110984 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-334d3b18-5e75-46b9-868e-2fa1f08a8569 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051984 Oct 20 06:17:12.111552 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 665/1310] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:17:12 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:17:13.123685 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-0a6721d7-dc20-4c03-aaba-a6a48418de92 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:17:13.127886 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-0a6721d7-dc20-4c03-aaba-a6a48418de92 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:17:13.136496 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0a6721d7-dc20-4c03-aaba-a6a48418de92 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:17:13.137214 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0a6721d7-dc20-4c03-aaba-a6a48418de92 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:17:13.137662 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0a6721d7-dc20-4c03-aaba-a6a48418de92 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:17:13.138377 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0a6721d7-dc20-4c03-aaba-a6a48418de92 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:17:13.138836 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0a6721d7-dc20-4c03-aaba-a6a48418de92 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:17:13.139266 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0a6721d7-dc20-4c03-aaba-a6a48418de92 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:17:13.171513 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-0a6721d7-dc20-4c03-aaba-a6a48418de92 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051879 Oct 20 06:17:13.172805 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 646/1311] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:17:13 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:17:14.183647 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-1523b248-4da5-4349-83b2-7c678fd1ada5 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:17:14.185835 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-1523b248-4da5-4349-83b2-7c678fd1ada5 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:17:14.194375 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1523b248-4da5-4349-83b2-7c678fd1ada5 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:17:14.194865 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1523b248-4da5-4349-83b2-7c678fd1ada5 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:17:14.195356 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1523b248-4da5-4349-83b2-7c678fd1ada5 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:17:14.196010 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1523b248-4da5-4349-83b2-7c678fd1ada5 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:17:14.196468 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1523b248-4da5-4349-83b2-7c678fd1ada5 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:17:14.196926 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1523b248-4da5-4349-83b2-7c678fd1ada5 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:17:14.230380 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-1523b248-4da5-4349-83b2-7c678fd1ada5 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049180 Oct 20 06:17:14.230380 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 666/1312] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:17:14 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:17:15.241728 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-98d21c0d-4038-48b5-aace-c5b206e734b8 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:17:15.243946 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-98d21c0d-4038-48b5-aace-c5b206e734b8 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:17:15.250449 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-98d21c0d-4038-48b5-aace-c5b206e734b8 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:17:15.250940 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-98d21c0d-4038-48b5-aace-c5b206e734b8 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:17:15.251626 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-98d21c0d-4038-48b5-aace-c5b206e734b8 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:17:15.252474 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-98d21c0d-4038-48b5-aace-c5b206e734b8 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:17:15.253140 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-98d21c0d-4038-48b5-aace-c5b206e734b8 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:17:15.253572 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-98d21c0d-4038-48b5-aace-c5b206e734b8 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:17:15.297346 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-98d21c0d-4038-48b5-aace-c5b206e734b8 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049418 Oct 20 06:17:15.297346 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 647/1313] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:17:15 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:17:16.299549 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-d440714d-6c67-4535-835e-a019ec6b1a64 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:17:16.301944 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-d440714d-6c67-4535-835e-a019ec6b1a64 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:17:16.310374 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d440714d-6c67-4535-835e-a019ec6b1a64 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:17:16.310926 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d440714d-6c67-4535-835e-a019ec6b1a64 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:17:16.311453 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d440714d-6c67-4535-835e-a019ec6b1a64 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:17:16.312221 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d440714d-6c67-4535-835e-a019ec6b1a64 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:17:16.312878 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d440714d-6c67-4535-835e-a019ec6b1a64 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:17:16.313363 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d440714d-6c67-4535-835e-a019ec6b1a64 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:17:16.345320 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-d440714d-6c67-4535-835e-a019ec6b1a64 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049791 Oct 20 06:17:16.345889 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 667/1314] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:17:16 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:17:17.359156 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-6c71f6cd-1196-466e-8845-0973947fe4a5 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:17:17.361672 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-6c71f6cd-1196-466e-8845-0973947fe4a5 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:17:17.368724 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-6c71f6cd-1196-466e-8845-0973947fe4a5 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:17:17.369219 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-6c71f6cd-1196-466e-8845-0973947fe4a5 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:17:17.369660 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-6c71f6cd-1196-466e-8845-0973947fe4a5 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:17:17.370368 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-6c71f6cd-1196-466e-8845-0973947fe4a5 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:17:17.370820 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-6c71f6cd-1196-466e-8845-0973947fe4a5 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:17:17.371421 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-6c71f6cd-1196-466e-8845-0973947fe4a5 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:17:17.403629 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-6c71f6cd-1196-466e-8845-0973947fe4a5 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048729 Oct 20 06:17:17.408252 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 648/1315] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:17:17 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:17:18.416162 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-efc33478-0b5f-4622-804b-c6c06cb2bc78 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:17:18.419947 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-efc33478-0b5f-4622-804b-c6c06cb2bc78 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:17:18.422380 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG dbcounter [-] [118861] Writing DB stats nova_api:SELECT=30 {{(pid=118861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:17:18.429219 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-efc33478-0b5f-4622-804b-c6c06cb2bc78 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:17:18.430059 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-efc33478-0b5f-4622-804b-c6c06cb2bc78 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:17:18.430667 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-efc33478-0b5f-4622-804b-c6c06cb2bc78 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:17:18.431397 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-efc33478-0b5f-4622-804b-c6c06cb2bc78 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:17:18.432020 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-efc33478-0b5f-4622-804b-c6c06cb2bc78 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:17:18.432617 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-efc33478-0b5f-4622-804b-c6c06cb2bc78 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:17:18.466145 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-efc33478-0b5f-4622-804b-c6c06cb2bc78 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054534 Oct 20 06:17:18.466703 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 668/1316] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:17:18 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:17:19.483379 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-e78a1cd7-5581-4b0c-af7f-e9b778676ba3 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:17:19.485562 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-e78a1cd7-5581-4b0c-af7f-e9b778676ba3 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:17:19.487858 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG dbcounter [-] [118860] Writing DB stats nova_api:SELECT=30 {{(pid=118860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:17:19.494353 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e78a1cd7-5581-4b0c-af7f-e9b778676ba3 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:17:19.494809 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e78a1cd7-5581-4b0c-af7f-e9b778676ba3 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:17:19.495241 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e78a1cd7-5581-4b0c-af7f-e9b778676ba3 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:17:19.495937 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e78a1cd7-5581-4b0c-af7f-e9b778676ba3 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:17:19.496383 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e78a1cd7-5581-4b0c-af7f-e9b778676ba3 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:17:19.497015 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e78a1cd7-5581-4b0c-af7f-e9b778676ba3 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:17:19.527856 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-e78a1cd7-5581-4b0c-af7f-e9b778676ba3 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049682 Oct 20 06:17:19.528586 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 649/1317] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:17:19 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:17:20.550123 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-0f021156-1720-428e-a695-b7306746cd24 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:17:20.550123 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-0f021156-1720-428e-a695-b7306746cd24 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:17:20.563242 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-0f021156-1720-428e-a695-b7306746cd24 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:17:20.563914 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-0f021156-1720-428e-a695-b7306746cd24 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:17:20.565636 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-0f021156-1720-428e-a695-b7306746cd24 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:17:20.567101 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-0f021156-1720-428e-a695-b7306746cd24 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:17:20.569904 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-0f021156-1720-428e-a695-b7306746cd24 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:17:20.572916 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-0f021156-1720-428e-a695-b7306746cd24 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:17:20.624411 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-0f021156-1720-428e-a695-b7306746cd24 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.088644 Oct 20 06:17:20.625655 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 669/1318] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:17:20 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:17:21.637687 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-167f5123-063d-4d62-9377-9413c11d5722 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:17:21.639865 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-167f5123-063d-4d62-9377-9413c11d5722 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:17:21.645787 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-167f5123-063d-4d62-9377-9413c11d5722 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:17:21.646166 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-167f5123-063d-4d62-9377-9413c11d5722 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:17:21.646780 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-167f5123-063d-4d62-9377-9413c11d5722 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:17:21.647566 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-167f5123-063d-4d62-9377-9413c11d5722 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:17:21.648017 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-167f5123-063d-4d62-9377-9413c11d5722 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:17:21.648441 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-167f5123-063d-4d62-9377-9413c11d5722 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:17:21.652136 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG dbcounter [-] [118860] Writing DB stats nova_cell1:SELECT=90 {{(pid=118860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:17:21.687742 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-167f5123-063d-4d62-9377-9413c11d5722 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053221 Oct 20 06:17:21.688533 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 650/1319] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:17:21 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:17:22.701279 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-9b671372-068b-4322-b229-0596e633f859 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:17:22.708804 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-9b671372-068b-4322-b229-0596e633f859 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:17:22.718205 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-9b671372-068b-4322-b229-0596e633f859 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:17:22.718867 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-9b671372-068b-4322-b229-0596e633f859 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:17:22.724731 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-9b671372-068b-4322-b229-0596e633f859 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:17:22.724731 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-9b671372-068b-4322-b229-0596e633f859 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:17:22.724731 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-9b671372-068b-4322-b229-0596e633f859 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:17:22.724731 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-9b671372-068b-4322-b229-0596e633f859 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:17:22.763359 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-9b671372-068b-4322-b229-0596e633f859 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.066174 Oct 20 06:17:22.764615 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 670/1320] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:17:22 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:17:23.777873 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-f2bac39e-182d-4cc4-86bc-d84486cddd71 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:17:23.780075 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-f2bac39e-182d-4cc4-86bc-d84486cddd71 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:17:23.786320 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f2bac39e-182d-4cc4-86bc-d84486cddd71 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:17:23.786801 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f2bac39e-182d-4cc4-86bc-d84486cddd71 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:17:23.787244 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f2bac39e-182d-4cc4-86bc-d84486cddd71 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:17:23.787949 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f2bac39e-182d-4cc4-86bc-d84486cddd71 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:17:23.788398 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f2bac39e-182d-4cc4-86bc-d84486cddd71 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:17:23.788841 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f2bac39e-182d-4cc4-86bc-d84486cddd71 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:17:23.821054 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-f2bac39e-182d-4cc4-86bc-d84486cddd71 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047019 Oct 20 06:17:23.821783 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 651/1321] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:17:23 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:17:24.833190 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-63dec6c1-e99e-401d-833e-5c33e809513d tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:17:24.835662 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-63dec6c1-e99e-401d-833e-5c33e809513d tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:17:24.842340 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-63dec6c1-e99e-401d-833e-5c33e809513d tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:17:24.842900 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-63dec6c1-e99e-401d-833e-5c33e809513d tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:17:24.843421 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-63dec6c1-e99e-401d-833e-5c33e809513d tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:17:24.844181 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-63dec6c1-e99e-401d-833e-5c33e809513d tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:17:24.844863 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-63dec6c1-e99e-401d-833e-5c33e809513d tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:17:24.845520 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-63dec6c1-e99e-401d-833e-5c33e809513d tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:17:24.878280 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-63dec6c1-e99e-401d-833e-5c33e809513d tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048927 Oct 20 06:17:24.879055 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 671/1322] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:17:24 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:17:25.891272 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-93980652-1920-4a58-8fac-7797f1e88c7a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:17:25.893439 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-93980652-1920-4a58-8fac-7797f1e88c7a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:17:25.900680 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-93980652-1920-4a58-8fac-7797f1e88c7a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:17:25.901220 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-93980652-1920-4a58-8fac-7797f1e88c7a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:17:25.901652 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-93980652-1920-4a58-8fac-7797f1e88c7a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:17:25.902346 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-93980652-1920-4a58-8fac-7797f1e88c7a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:17:25.902983 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-93980652-1920-4a58-8fac-7797f1e88c7a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:17:25.903403 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-93980652-1920-4a58-8fac-7797f1e88c7a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:17:25.933802 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-93980652-1920-4a58-8fac-7797f1e88c7a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046357 Oct 20 06:17:25.934373 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 652/1323] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:17:25 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:17:26.948391 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-09f2910d-81cc-482d-98d5-d9e106bfe078 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:17:26.950861 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-09f2910d-81cc-482d-98d5-d9e106bfe078 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:17:26.957373 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-09f2910d-81cc-482d-98d5-d9e106bfe078 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:17:26.957863 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-09f2910d-81cc-482d-98d5-d9e106bfe078 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:17:26.958306 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-09f2910d-81cc-482d-98d5-d9e106bfe078 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:17:26.959015 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-09f2910d-81cc-482d-98d5-d9e106bfe078 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:17:26.959983 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-09f2910d-81cc-482d-98d5-d9e106bfe078 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:17:26.960478 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-09f2910d-81cc-482d-98d5-d9e106bfe078 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:17:26.992825 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-09f2910d-81cc-482d-98d5-d9e106bfe078 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050140 Oct 20 06:17:26.993596 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 672/1324] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:17:26 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:17:28.009795 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-408b2198-c6b8-4033-a3d1-c38be0df3da1 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:17:28.011636 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-408b2198-c6b8-4033-a3d1-c38be0df3da1 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:17:28.018027 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-408b2198-c6b8-4033-a3d1-c38be0df3da1 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:17:28.018521 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-408b2198-c6b8-4033-a3d1-c38be0df3da1 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:17:28.018964 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-408b2198-c6b8-4033-a3d1-c38be0df3da1 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:17:28.019677 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-408b2198-c6b8-4033-a3d1-c38be0df3da1 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:17:28.020139 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-408b2198-c6b8-4033-a3d1-c38be0df3da1 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:17:28.020568 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-408b2198-c6b8-4033-a3d1-c38be0df3da1 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:17:28.061282 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-408b2198-c6b8-4033-a3d1-c38be0df3da1 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059740 Oct 20 06:17:28.062116 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 653/1325] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:17:28 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:17:29.074792 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-25c85f7e-885e-48a9-9173-8c5deba32a02 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:17:29.077704 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-25c85f7e-885e-48a9-9173-8c5deba32a02 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:17:29.085029 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-25c85f7e-885e-48a9-9173-8c5deba32a02 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:17:29.085831 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-25c85f7e-885e-48a9-9173-8c5deba32a02 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:17:29.086276 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-25c85f7e-885e-48a9-9173-8c5deba32a02 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:17:29.087246 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-25c85f7e-885e-48a9-9173-8c5deba32a02 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:17:29.087710 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-25c85f7e-885e-48a9-9173-8c5deba32a02 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:17:29.088132 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-25c85f7e-885e-48a9-9173-8c5deba32a02 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:17:29.124943 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-25c85f7e-885e-48a9-9173-8c5deba32a02 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053992 Oct 20 06:17:29.125709 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 673/1326] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:17:29 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:17:30.137401 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-76506667-9213-4ac2-a2e8-0262014b8840 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:17:30.139824 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-76506667-9213-4ac2-a2e8-0262014b8840 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:17:30.147277 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-76506667-9213-4ac2-a2e8-0262014b8840 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:17:30.147868 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-76506667-9213-4ac2-a2e8-0262014b8840 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:17:30.148310 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-76506667-9213-4ac2-a2e8-0262014b8840 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:17:30.149042 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-76506667-9213-4ac2-a2e8-0262014b8840 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:17:30.149502 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-76506667-9213-4ac2-a2e8-0262014b8840 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:17:30.150220 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-76506667-9213-4ac2-a2e8-0262014b8840 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:17:30.192947 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-76506667-9213-4ac2-a2e8-0262014b8840 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059384 Oct 20 06:17:30.193548 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 654/1327] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:17:30 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:17:31.205265 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-b47fc615-22f5-40aa-98fe-d04cc9348488 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:17:31.207430 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-b47fc615-22f5-40aa-98fe-d04cc9348488 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:17:31.215215 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b47fc615-22f5-40aa-98fe-d04cc9348488 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:17:31.215704 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b47fc615-22f5-40aa-98fe-d04cc9348488 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:17:31.216142 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b47fc615-22f5-40aa-98fe-d04cc9348488 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:17:31.216874 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b47fc615-22f5-40aa-98fe-d04cc9348488 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:17:31.217329 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b47fc615-22f5-40aa-98fe-d04cc9348488 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:17:31.217757 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b47fc615-22f5-40aa-98fe-d04cc9348488 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:17:31.257345 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-b47fc615-22f5-40aa-98fe-d04cc9348488 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055870 Oct 20 06:17:31.262303 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 674/1328] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:17:31 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:17:32.269873 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-1b79c6b8-8bb8-474f-ab1c-c5ab2d3685aa tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:17:32.272328 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-1b79c6b8-8bb8-474f-ab1c-c5ab2d3685aa tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:17:32.278966 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1b79c6b8-8bb8-474f-ab1c-c5ab2d3685aa tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:17:32.279460 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1b79c6b8-8bb8-474f-ab1c-c5ab2d3685aa tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:17:32.279900 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1b79c6b8-8bb8-474f-ab1c-c5ab2d3685aa tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:17:32.280643 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1b79c6b8-8bb8-474f-ab1c-c5ab2d3685aa tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:17:32.281123 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1b79c6b8-8bb8-474f-ab1c-c5ab2d3685aa tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:17:32.281551 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1b79c6b8-8bb8-474f-ab1c-c5ab2d3685aa tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:17:32.339964 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-1b79c6b8-8bb8-474f-ab1c-c5ab2d3685aa tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.074141 Oct 20 06:17:32.341394 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 655/1329] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:17:32 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:17:33.364822 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-d18f28c2-917a-4915-99cb-6e410839d077 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:17:33.367097 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-d18f28c2-917a-4915-99cb-6e410839d077 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:17:33.373784 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d18f28c2-917a-4915-99cb-6e410839d077 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:17:33.374269 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d18f28c2-917a-4915-99cb-6e410839d077 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:17:33.374705 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d18f28c2-917a-4915-99cb-6e410839d077 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:17:33.375404 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d18f28c2-917a-4915-99cb-6e410839d077 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:17:33.375850 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d18f28c2-917a-4915-99cb-6e410839d077 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:17:33.376269 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d18f28c2-917a-4915-99cb-6e410839d077 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:17:33.409842 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-d18f28c2-917a-4915-99cb-6e410839d077 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050271 Oct 20 06:17:33.410423 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 675/1330] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:17:33 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:17:34.423241 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-9ed8c04b-5260-4b86-8407-298d0a369a4b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:17:34.426012 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-9ed8c04b-5260-4b86-8407-298d0a369a4b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:17:34.435533 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-9ed8c04b-5260-4b86-8407-298d0a369a4b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:17:34.436214 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-9ed8c04b-5260-4b86-8407-298d0a369a4b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:17:34.436718 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-9ed8c04b-5260-4b86-8407-298d0a369a4b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:17:34.437494 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-9ed8c04b-5260-4b86-8407-298d0a369a4b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:17:34.437955 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-9ed8c04b-5260-4b86-8407-298d0a369a4b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:17:34.438379 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-9ed8c04b-5260-4b86-8407-298d0a369a4b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:17:34.472881 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-9ed8c04b-5260-4b86-8407-298d0a369a4b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053834 Oct 20 06:17:34.473472 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 656/1331] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:17:34 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:17:35.485309 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-b90069d6-154f-48cc-abf1-76fd1596af73 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:17:35.487464 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-b90069d6-154f-48cc-abf1-76fd1596af73 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:17:35.494711 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b90069d6-154f-48cc-abf1-76fd1596af73 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:17:35.495185 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b90069d6-154f-48cc-abf1-76fd1596af73 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:17:35.496061 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b90069d6-154f-48cc-abf1-76fd1596af73 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:17:35.496805 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b90069d6-154f-48cc-abf1-76fd1596af73 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:17:35.497287 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b90069d6-154f-48cc-abf1-76fd1596af73 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:17:35.497718 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b90069d6-154f-48cc-abf1-76fd1596af73 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:17:35.529793 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-b90069d6-154f-48cc-abf1-76fd1596af73 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048323 Oct 20 06:17:35.534682 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 676/1332] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:17:35 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:17:36.542710 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-efceacda-69a2-4b79-92e3-c7cfdee14e8d tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:17:36.545154 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-efceacda-69a2-4b79-92e3-c7cfdee14e8d tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:17:36.551598 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-efceacda-69a2-4b79-92e3-c7cfdee14e8d tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:17:36.552175 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-efceacda-69a2-4b79-92e3-c7cfdee14e8d tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:17:36.552674 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-efceacda-69a2-4b79-92e3-c7cfdee14e8d tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:17:36.553477 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-efceacda-69a2-4b79-92e3-c7cfdee14e8d tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:17:36.553993 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-efceacda-69a2-4b79-92e3-c7cfdee14e8d tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:17:36.554481 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-efceacda-69a2-4b79-92e3-c7cfdee14e8d tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:17:36.587287 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-efceacda-69a2-4b79-92e3-c7cfdee14e8d tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048896 Oct 20 06:17:36.588131 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 657/1333] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:17:36 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:17:37.601236 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-a4bd3df1-ae11-4d5c-8648-f179b057060d tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:17:37.602676 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-a4bd3df1-ae11-4d5c-8648-f179b057060d tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:17:37.610288 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a4bd3df1-ae11-4d5c-8648-f179b057060d tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:17:37.611038 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a4bd3df1-ae11-4d5c-8648-f179b057060d tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:17:37.611537 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a4bd3df1-ae11-4d5c-8648-f179b057060d tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:17:37.612436 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a4bd3df1-ae11-4d5c-8648-f179b057060d tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:17:37.613009 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a4bd3df1-ae11-4d5c-8648-f179b057060d tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:17:37.613550 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a4bd3df1-ae11-4d5c-8648-f179b057060d tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:17:37.616685 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG dbcounter [-] [118861] Writing DB stats nova_cell1:SELECT=90 {{(pid=118861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:17:37.654422 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-a4bd3df1-ae11-4d5c-8648-f179b057060d tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058932 Oct 20 06:17:37.655033 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 677/1334] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:17:37 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:17:38.668687 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-57c00f2d-dd4f-4a35-86bb-827ef353e01e tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:17:38.671434 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-57c00f2d-dd4f-4a35-86bb-827ef353e01e tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:17:38.677870 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-57c00f2d-dd4f-4a35-86bb-827ef353e01e tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:17:38.678392 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-57c00f2d-dd4f-4a35-86bb-827ef353e01e tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:17:38.678873 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-57c00f2d-dd4f-4a35-86bb-827ef353e01e tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:17:38.679536 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-57c00f2d-dd4f-4a35-86bb-827ef353e01e tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:17:38.679992 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-57c00f2d-dd4f-4a35-86bb-827ef353e01e tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:17:38.680417 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-57c00f2d-dd4f-4a35-86bb-827ef353e01e tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:17:38.713785 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-57c00f2d-dd4f-4a35-86bb-827ef353e01e tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050897 Oct 20 06:17:38.714353 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 658/1335] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:17:38 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:17:39.726184 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-80c7e85a-7901-4d01-89ed-6030c4b21703 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:17:39.731356 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-80c7e85a-7901-4d01-89ed-6030c4b21703 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:17:39.738422 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-80c7e85a-7901-4d01-89ed-6030c4b21703 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:17:39.738989 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-80c7e85a-7901-4d01-89ed-6030c4b21703 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:17:39.739495 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-80c7e85a-7901-4d01-89ed-6030c4b21703 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:17:39.740789 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-80c7e85a-7901-4d01-89ed-6030c4b21703 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:17:39.741264 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-80c7e85a-7901-4d01-89ed-6030c4b21703 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:17:39.741901 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-80c7e85a-7901-4d01-89ed-6030c4b21703 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:17:39.775850 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-80c7e85a-7901-4d01-89ed-6030c4b21703 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053662 Oct 20 06:17:39.776521 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 678/1336] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:17:39 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:17:40.789987 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-75d3c17b-23bc-425f-8f41-a1325771c5ed tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:17:40.794497 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-75d3c17b-23bc-425f-8f41-a1325771c5ed tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:17:40.802586 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-75d3c17b-23bc-425f-8f41-a1325771c5ed tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:17:40.803743 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-75d3c17b-23bc-425f-8f41-a1325771c5ed tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:17:40.804198 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-75d3c17b-23bc-425f-8f41-a1325771c5ed tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:17:40.805114 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-75d3c17b-23bc-425f-8f41-a1325771c5ed tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:17:40.805573 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-75d3c17b-23bc-425f-8f41-a1325771c5ed tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:17:40.806419 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-75d3c17b-23bc-425f-8f41-a1325771c5ed tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:17:40.856167 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-75d3c17b-23bc-425f-8f41-a1325771c5ed tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.071879 Oct 20 06:17:40.856847 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 659/1337] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:17:40 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:17:41.869815 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-b831489a-704e-4db4-b3ed-421d119fd96e tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:17:41.872356 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-b831489a-704e-4db4-b3ed-421d119fd96e tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:17:41.879193 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b831489a-704e-4db4-b3ed-421d119fd96e tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:17:41.879682 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b831489a-704e-4db4-b3ed-421d119fd96e tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:17:41.880149 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b831489a-704e-4db4-b3ed-421d119fd96e tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:17:41.881223 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b831489a-704e-4db4-b3ed-421d119fd96e tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:17:41.881688 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b831489a-704e-4db4-b3ed-421d119fd96e tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:17:41.882122 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b831489a-704e-4db4-b3ed-421d119fd96e tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:17:41.915245 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-b831489a-704e-4db4-b3ed-421d119fd96e tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050508 Oct 20 06:17:41.915818 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 679/1338] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:17:41 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:17:42.927571 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-62b24736-028c-4681-ae28-1b8237382264 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:17:42.931683 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-62b24736-028c-4681-ae28-1b8237382264 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:17:42.939180 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-62b24736-028c-4681-ae28-1b8237382264 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:17:42.939695 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-62b24736-028c-4681-ae28-1b8237382264 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:17:42.940129 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-62b24736-028c-4681-ae28-1b8237382264 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:17:42.947041 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-62b24736-028c-4681-ae28-1b8237382264 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:17:42.947626 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-62b24736-028c-4681-ae28-1b8237382264 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:17:42.948071 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-62b24736-028c-4681-ae28-1b8237382264 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:17:42.983163 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-62b24736-028c-4681-ae28-1b8237382264 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059590 Oct 20 06:17:42.984156 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 660/1339] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:17:42 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 20 06:17:43.996291 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-b978d1a7-8a1e-4799-b64a-4a6488db8e3a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:17:43.998677 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-b978d1a7-8a1e-4799-b64a-4a6488db8e3a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:17:44.017394 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b978d1a7-8a1e-4799-b64a-4a6488db8e3a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:17:44.017394 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b978d1a7-8a1e-4799-b64a-4a6488db8e3a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:17:44.017394 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b978d1a7-8a1e-4799-b64a-4a6488db8e3a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:17:44.017394 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b978d1a7-8a1e-4799-b64a-4a6488db8e3a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:17:44.017748 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b978d1a7-8a1e-4799-b64a-4a6488db8e3a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:17:44.017748 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b978d1a7-8a1e-4799-b64a-4a6488db8e3a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:17:44.040950 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-b978d1a7-8a1e-4799-b64a-4a6488db8e3a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048432 Oct 20 06:17:44.044046 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 680/1340] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:17:43 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:17:45.053477 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-cd14f513-44f8-45f3-8892-539badf82219 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:17:45.055753 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-cd14f513-44f8-45f3-8892-539badf82219 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:17:45.062580 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-cd14f513-44f8-45f3-8892-539badf82219 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:17:45.063105 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-cd14f513-44f8-45f3-8892-539badf82219 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:17:45.063639 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-cd14f513-44f8-45f3-8892-539badf82219 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:17:45.064374 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-cd14f513-44f8-45f3-8892-539badf82219 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:17:45.064880 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-cd14f513-44f8-45f3-8892-539badf82219 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:17:45.065590 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-cd14f513-44f8-45f3-8892-539badf82219 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:17:45.106544 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-cd14f513-44f8-45f3-8892-539badf82219 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056849 Oct 20 06:17:45.107161 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 661/1341] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:17:45 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:17:46.118718 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-cf9bc5f8-420e-4a4d-84c5-0861e15a04c3 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:17:46.121904 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-cf9bc5f8-420e-4a4d-84c5-0861e15a04c3 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:17:46.130761 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-cf9bc5f8-420e-4a4d-84c5-0861e15a04c3 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:17:46.132168 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-cf9bc5f8-420e-4a4d-84c5-0861e15a04c3 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:17:46.132927 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-cf9bc5f8-420e-4a4d-84c5-0861e15a04c3 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:17:46.134169 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-cf9bc5f8-420e-4a4d-84c5-0861e15a04c3 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:17:46.134883 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-cf9bc5f8-420e-4a4d-84c5-0861e15a04c3 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:17:46.135529 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-cf9bc5f8-420e-4a4d-84c5-0861e15a04c3 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:17:46.172080 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-cf9bc5f8-420e-4a4d-84c5-0861e15a04c3 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057654 Oct 20 06:17:46.173821 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 681/1342] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:17:46 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:17:47.185504 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-e85ba855-e501-4feb-9b4a-b9e83919cace tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:17:47.187699 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-e85ba855-e501-4feb-9b4a-b9e83919cace tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:17:47.194448 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e85ba855-e501-4feb-9b4a-b9e83919cace tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:17:47.195150 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e85ba855-e501-4feb-9b4a-b9e83919cace tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:17:47.195594 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e85ba855-e501-4feb-9b4a-b9e83919cace tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:17:47.196308 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e85ba855-e501-4feb-9b4a-b9e83919cace tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:17:47.196784 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e85ba855-e501-4feb-9b4a-b9e83919cace tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:17:47.197372 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e85ba855-e501-4feb-9b4a-b9e83919cace tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:17:47.229704 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-e85ba855-e501-4feb-9b4a-b9e83919cace tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048070 Oct 20 06:17:47.230436 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 662/1343] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:17:47 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:17:48.246423 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-2604cee4-0770-4b0b-9078-f0dca4fc5ba0 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:17:48.248788 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-2604cee4-0770-4b0b-9078-f0dca4fc5ba0 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:17:48.257947 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-2604cee4-0770-4b0b-9078-f0dca4fc5ba0 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:17:48.260170 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-2604cee4-0770-4b0b-9078-f0dca4fc5ba0 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:17:48.260786 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-2604cee4-0770-4b0b-9078-f0dca4fc5ba0 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:17:48.261648 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-2604cee4-0770-4b0b-9078-f0dca4fc5ba0 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:17:48.262239 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-2604cee4-0770-4b0b-9078-f0dca4fc5ba0 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:17:48.262882 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-2604cee4-0770-4b0b-9078-f0dca4fc5ba0 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:17:48.296740 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-2604cee4-0770-4b0b-9078-f0dca4fc5ba0 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058369 Oct 20 06:17:48.297599 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 682/1344] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:17:48 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:17:49.313384 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-e4b73459-e681-4c9f-926e-cfc282fc6b96 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:17:49.316244 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-e4b73459-e681-4c9f-926e-cfc282fc6b96 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:17:49.322674 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e4b73459-e681-4c9f-926e-cfc282fc6b96 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:17:49.323196 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e4b73459-e681-4c9f-926e-cfc282fc6b96 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:17:49.323633 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e4b73459-e681-4c9f-926e-cfc282fc6b96 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:17:49.324502 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e4b73459-e681-4c9f-926e-cfc282fc6b96 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:17:49.324976 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e4b73459-e681-4c9f-926e-cfc282fc6b96 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:17:49.325405 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e4b73459-e681-4c9f-926e-cfc282fc6b96 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:17:49.356098 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-e4b73459-e681-4c9f-926e-cfc282fc6b96 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049551 Oct 20 06:17:49.357039 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 663/1345] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:17:49 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:17:50.370069 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-5d269def-fbae-4370-9943-b860773f01bf tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:17:50.381819 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-5d269def-fbae-4370-9943-b860773f01bf tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:17:50.381819 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG dbcounter [-] [118861] Writing DB stats nova_api:SELECT=30 {{(pid=118861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:17:50.381819 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5d269def-fbae-4370-9943-b860773f01bf tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:17:50.382260 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5d269def-fbae-4370-9943-b860773f01bf tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:17:50.382352 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5d269def-fbae-4370-9943-b860773f01bf tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:17:50.383142 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5d269def-fbae-4370-9943-b860773f01bf tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:17:50.383593 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5d269def-fbae-4370-9943-b860773f01bf tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:17:50.384009 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5d269def-fbae-4370-9943-b860773f01bf tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:17:50.415546 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-5d269def-fbae-4370-9943-b860773f01bf tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050316 Oct 20 06:17:50.416533 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 683/1346] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:17:50 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 20 06:17:51.428408 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-6cb73ef1-258e-41ae-812b-e2756a485e8b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:17:51.430870 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-6cb73ef1-258e-41ae-812b-e2756a485e8b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:17:51.432940 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG dbcounter [-] [118860] Writing DB stats nova_api:SELECT=30 {{(pid=118860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:17:51.438254 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-6cb73ef1-258e-41ae-812b-e2756a485e8b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:17:51.438746 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-6cb73ef1-258e-41ae-812b-e2756a485e8b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:17:51.439223 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-6cb73ef1-258e-41ae-812b-e2756a485e8b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:17:51.439933 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-6cb73ef1-258e-41ae-812b-e2756a485e8b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:17:51.440422 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-6cb73ef1-258e-41ae-812b-e2756a485e8b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:17:51.440890 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-6cb73ef1-258e-41ae-812b-e2756a485e8b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:17:51.472192 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-6cb73ef1-258e-41ae-812b-e2756a485e8b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048520 Oct 20 06:17:51.473000 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 664/1347] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:17:51 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:17:52.492918 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-dc1780c7-3645-40ab-aeb9-711f32ccffad tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:17:52.492918 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-dc1780c7-3645-40ab-aeb9-711f32ccffad tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:17:52.494126 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-dc1780c7-3645-40ab-aeb9-711f32ccffad tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:17:52.494614 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-dc1780c7-3645-40ab-aeb9-711f32ccffad tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:17:52.495058 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-dc1780c7-3645-40ab-aeb9-711f32ccffad tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:17:52.495765 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-dc1780c7-3645-40ab-aeb9-711f32ccffad tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:17:52.496218 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-dc1780c7-3645-40ab-aeb9-711f32ccffad tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:17:52.496801 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-dc1780c7-3645-40ab-aeb9-711f32ccffad tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:17:52.528976 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-dc1780c7-3645-40ab-aeb9-711f32ccffad tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048110 Oct 20 06:17:52.529545 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 684/1348] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:17:52 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:17:53.541057 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-790bf87a-4d17-476e-8060-11ad2c18b457 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:17:53.543215 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-790bf87a-4d17-476e-8060-11ad2c18b457 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:17:53.549596 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-790bf87a-4d17-476e-8060-11ad2c18b457 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:17:53.550081 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-790bf87a-4d17-476e-8060-11ad2c18b457 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:17:53.550521 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-790bf87a-4d17-476e-8060-11ad2c18b457 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:17:53.551200 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-790bf87a-4d17-476e-8060-11ad2c18b457 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:17:53.551651 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-790bf87a-4d17-476e-8060-11ad2c18b457 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:17:53.552076 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-790bf87a-4d17-476e-8060-11ad2c18b457 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:17:53.554399 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG dbcounter [-] [118860] Writing DB stats nova_cell1:SELECT=90 {{(pid=118860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:17:53.582694 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-790bf87a-4d17-476e-8060-11ad2c18b457 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045742 Oct 20 06:17:53.588080 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 665/1349] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:17:53 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:17:54.595558 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-b500ba2c-cde5-4954-90bf-b7578378e694 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:17:54.598964 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-b500ba2c-cde5-4954-90bf-b7578378e694 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:17:54.606869 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b500ba2c-cde5-4954-90bf-b7578378e694 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:17:54.607347 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b500ba2c-cde5-4954-90bf-b7578378e694 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:17:54.607776 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b500ba2c-cde5-4954-90bf-b7578378e694 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:17:54.608471 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b500ba2c-cde5-4954-90bf-b7578378e694 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:17:54.608943 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b500ba2c-cde5-4954-90bf-b7578378e694 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:17:54.609359 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b500ba2c-cde5-4954-90bf-b7578378e694 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:17:54.639442 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-b500ba2c-cde5-4954-90bf-b7578378e694 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047775 Oct 20 06:17:54.640190 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 685/1350] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:17:54 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:17:55.652265 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-12d0004a-10ff-42d0-8938-c164ab86477d tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:17:55.655312 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-12d0004a-10ff-42d0-8938-c164ab86477d tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:17:55.662871 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-12d0004a-10ff-42d0-8938-c164ab86477d tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:17:55.663533 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-12d0004a-10ff-42d0-8938-c164ab86477d tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:17:55.664037 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-12d0004a-10ff-42d0-8938-c164ab86477d tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:17:55.664890 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-12d0004a-10ff-42d0-8938-c164ab86477d tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:17:55.665418 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-12d0004a-10ff-42d0-8938-c164ab86477d tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:17:55.665911 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-12d0004a-10ff-42d0-8938-c164ab86477d tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:17:55.701068 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-12d0004a-10ff-42d0-8938-c164ab86477d tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052728 Oct 20 06:17:55.701766 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 666/1351] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:17:55 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:17:56.715553 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-a037dc61-3e0d-4183-a8f7-a5e2f1481bf9 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:17:56.717897 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-a037dc61-3e0d-4183-a8f7-a5e2f1481bf9 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:17:56.724890 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a037dc61-3e0d-4183-a8f7-a5e2f1481bf9 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:17:56.725677 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a037dc61-3e0d-4183-a8f7-a5e2f1481bf9 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:17:56.726191 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a037dc61-3e0d-4183-a8f7-a5e2f1481bf9 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:17:56.726987 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a037dc61-3e0d-4183-a8f7-a5e2f1481bf9 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:17:56.727536 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a037dc61-3e0d-4183-a8f7-a5e2f1481bf9 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:17:56.728038 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a037dc61-3e0d-4183-a8f7-a5e2f1481bf9 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:17:56.761589 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-a037dc61-3e0d-4183-a8f7-a5e2f1481bf9 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050856 Oct 20 06:17:56.766628 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 686/1352] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:17:56 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:17:57.774724 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-a147cec8-6662-4402-827e-94f47293bf9a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:17:57.776911 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-a147cec8-6662-4402-827e-94f47293bf9a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:17:57.783263 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a147cec8-6662-4402-827e-94f47293bf9a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:17:57.783745 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a147cec8-6662-4402-827e-94f47293bf9a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:17:57.784183 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a147cec8-6662-4402-827e-94f47293bf9a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:17:57.784911 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a147cec8-6662-4402-827e-94f47293bf9a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:17:57.785364 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a147cec8-6662-4402-827e-94f47293bf9a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:17:57.785791 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a147cec8-6662-4402-827e-94f47293bf9a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:17:57.817169 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-a147cec8-6662-4402-827e-94f47293bf9a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047081 Oct 20 06:17:57.817928 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 667/1353] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:17:57 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:17:58.828948 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-adf95c6c-2347-49e9-80e8-b2f033568ce8 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:17:58.831238 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-adf95c6c-2347-49e9-80e8-b2f033568ce8 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:17:58.837778 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-adf95c6c-2347-49e9-80e8-b2f033568ce8 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:17:58.838338 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-adf95c6c-2347-49e9-80e8-b2f033568ce8 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:17:58.838861 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-adf95c6c-2347-49e9-80e8-b2f033568ce8 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:17:58.839644 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-adf95c6c-2347-49e9-80e8-b2f033568ce8 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:17:58.840178 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-adf95c6c-2347-49e9-80e8-b2f033568ce8 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:17:58.840721 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-adf95c6c-2347-49e9-80e8-b2f033568ce8 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:17:58.872746 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-adf95c6c-2347-49e9-80e8-b2f033568ce8 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047808 Oct 20 06:17:58.873512 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 687/1354] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:17:58 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:17:59.885861 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-872b477c-0f4b-4681-a8aa-a51fc8a7d34f tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:17:59.888191 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-872b477c-0f4b-4681-a8aa-a51fc8a7d34f tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:17:59.895093 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-872b477c-0f4b-4681-a8aa-a51fc8a7d34f tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:17:59.895654 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-872b477c-0f4b-4681-a8aa-a51fc8a7d34f tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:17:59.896096 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-872b477c-0f4b-4681-a8aa-a51fc8a7d34f tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:17:59.896876 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-872b477c-0f4b-4681-a8aa-a51fc8a7d34f tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:17:59.897352 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-872b477c-0f4b-4681-a8aa-a51fc8a7d34f tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:17:59.897948 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-872b477c-0f4b-4681-a8aa-a51fc8a7d34f tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:17:59.930987 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-872b477c-0f4b-4681-a8aa-a51fc8a7d34f tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048945 Oct 20 06:17:59.931652 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 668/1355] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:17:59 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:18:00.946037 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-532a0a7c-2c30-4909-90a1-201f3e0c975d tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:18:00.948852 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-532a0a7c-2c30-4909-90a1-201f3e0c975d tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:18:00.955028 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-532a0a7c-2c30-4909-90a1-201f3e0c975d tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:18:00.955513 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-532a0a7c-2c30-4909-90a1-201f3e0c975d tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:18:00.955980 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-532a0a7c-2c30-4909-90a1-201f3e0c975d tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:18:00.957353 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-532a0a7c-2c30-4909-90a1-201f3e0c975d tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:18:00.958071 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-532a0a7c-2c30-4909-90a1-201f3e0c975d tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:18:00.958504 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-532a0a7c-2c30-4909-90a1-201f3e0c975d tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:18:00.997858 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-532a0a7c-2c30-4909-90a1-201f3e0c975d tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057806 Oct 20 06:18:00.999169 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 688/1356] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:18:00 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:18:02.011221 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-5f792e0e-f29e-4f17-a3d8-237e1ee1bdea tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:18:02.013791 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-5f792e0e-f29e-4f17-a3d8-237e1ee1bdea tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:18:02.020204 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5f792e0e-f29e-4f17-a3d8-237e1ee1bdea tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:18:02.020779 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5f792e0e-f29e-4f17-a3d8-237e1ee1bdea tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:18:02.021282 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5f792e0e-f29e-4f17-a3d8-237e1ee1bdea tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:18:02.022100 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5f792e0e-f29e-4f17-a3d8-237e1ee1bdea tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:18:02.022780 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5f792e0e-f29e-4f17-a3d8-237e1ee1bdea tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:18:02.023646 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5f792e0e-f29e-4f17-a3d8-237e1ee1bdea tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:18:02.055481 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-5f792e0e-f29e-4f17-a3d8-237e1ee1bdea tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048209 Oct 20 06:18:02.056455 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 669/1357] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:18:02 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:18:03.067784 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-8c2591af-0ac8-4f4f-961f-912f8e89cefa tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:18:03.070320 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-8c2591af-0ac8-4f4f-961f-912f8e89cefa tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:18:03.077075 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-8c2591af-0ac8-4f4f-961f-912f8e89cefa tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:18:03.077564 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-8c2591af-0ac8-4f4f-961f-912f8e89cefa tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:18:03.077998 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-8c2591af-0ac8-4f4f-961f-912f8e89cefa tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:18:03.078690 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-8c2591af-0ac8-4f4f-961f-912f8e89cefa tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:18:03.079323 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-8c2591af-0ac8-4f4f-961f-912f8e89cefa tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:18:03.079750 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-8c2591af-0ac8-4f4f-961f-912f8e89cefa tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:18:03.112044 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-8c2591af-0ac8-4f4f-961f-912f8e89cefa tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048455 Oct 20 06:18:03.112621 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 689/1358] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:18:03 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:18:04.123830 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-980c85ad-982d-4e86-abaf-fc67f0122c88 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:18:04.126058 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-980c85ad-982d-4e86-abaf-fc67f0122c88 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:18:04.138158 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-980c85ad-982d-4e86-abaf-fc67f0122c88 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:18:04.138642 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-980c85ad-982d-4e86-abaf-fc67f0122c88 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:18:04.139074 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-980c85ad-982d-4e86-abaf-fc67f0122c88 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:18:04.139776 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-980c85ad-982d-4e86-abaf-fc67f0122c88 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:18:04.140223 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-980c85ad-982d-4e86-abaf-fc67f0122c88 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:18:04.140645 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-980c85ad-982d-4e86-abaf-fc67f0122c88 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:18:04.172716 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-980c85ad-982d-4e86-abaf-fc67f0122c88 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052586 Oct 20 06:18:04.173300 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 670/1359] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:18:04 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:18:05.187519 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-682c270e-a651-4333-a131-cd59120c1f49 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:18:05.190103 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-682c270e-a651-4333-a131-cd59120c1f49 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:18:05.197619 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-682c270e-a651-4333-a131-cd59120c1f49 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:18:05.198214 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-682c270e-a651-4333-a131-cd59120c1f49 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:18:05.198786 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-682c270e-a651-4333-a131-cd59120c1f49 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:18:05.199597 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-682c270e-a651-4333-a131-cd59120c1f49 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:18:05.200158 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-682c270e-a651-4333-a131-cd59120c1f49 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:18:05.200713 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-682c270e-a651-4333-a131-cd59120c1f49 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:18:05.234260 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-682c270e-a651-4333-a131-cd59120c1f49 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052602 Oct 20 06:18:05.235136 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 690/1360] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:18:05 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:18:06.247180 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-1a48f096-e41c-4b7f-af47-a87f724e1a40 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:18:06.250184 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-1a48f096-e41c-4b7f-af47-a87f724e1a40 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:18:06.259151 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1a48f096-e41c-4b7f-af47-a87f724e1a40 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:18:06.259151 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1a48f096-e41c-4b7f-af47-a87f724e1a40 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:18:06.261047 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1a48f096-e41c-4b7f-af47-a87f724e1a40 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:18:06.261047 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1a48f096-e41c-4b7f-af47-a87f724e1a40 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:18:06.261047 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1a48f096-e41c-4b7f-af47-a87f724e1a40 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:18:06.261594 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1a48f096-e41c-4b7f-af47-a87f724e1a40 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:18:06.312105 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-1a48f096-e41c-4b7f-af47-a87f724e1a40 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.068931 Oct 20 06:18:06.313474 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 671/1361] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:18:06 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:18:07.326237 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-3c2aaf30-5392-480d-9b86-b63f2bfc34f7 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:18:07.328655 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-3c2aaf30-5392-480d-9b86-b63f2bfc34f7 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:18:07.331099 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 20 06:18:07.331319 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: Thu Oct 20 06:18:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments (ip 10.222.0.20) !!! Oct 20 06:18:07.339802 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-3c2aaf30-5392-480d-9b86-b63f2bfc34f7 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:18:07.340567 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-3c2aaf30-5392-480d-9b86-b63f2bfc34f7 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:18:07.341037 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-3c2aaf30-5392-480d-9b86-b63f2bfc34f7 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:18:07.341752 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-3c2aaf30-5392-480d-9b86-b63f2bfc34f7 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:18:07.342208 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-3c2aaf30-5392-480d-9b86-b63f2bfc34f7 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:18:07.342642 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-3c2aaf30-5392-480d-9b86-b63f2bfc34f7 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:18:07.385019 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-3c2aaf30-5392-480d-9b86-b63f2bfc34f7 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063365 Oct 20 06:18:07.385792 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 691/1362] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:18:07 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:18:08.397852 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-01f264b4-7144-4f3d-ba96-8d575aa985a6 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:18:08.400125 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-01f264b4-7144-4f3d-ba96-8d575aa985a6 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:18:08.406753 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-01f264b4-7144-4f3d-ba96-8d575aa985a6 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:18:08.407288 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-01f264b4-7144-4f3d-ba96-8d575aa985a6 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:18:08.407648 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-01f264b4-7144-4f3d-ba96-8d575aa985a6 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:18:08.408475 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-01f264b4-7144-4f3d-ba96-8d575aa985a6 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:18:08.408801 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-01f264b4-7144-4f3d-ba96-8d575aa985a6 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:18:08.409220 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-01f264b4-7144-4f3d-ba96-8d575aa985a6 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:18:08.441980 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-01f264b4-7144-4f3d-ba96-8d575aa985a6 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046105 Oct 20 06:18:08.445520 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 672/1363] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:18:08 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:18:09.452798 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-4df878c9-f52f-41d5-9f63-b439062a72c3 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:18:09.455517 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-4df878c9-f52f-41d5-9f63-b439062a72c3 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:18:09.463443 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4df878c9-f52f-41d5-9f63-b439062a72c3 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:18:09.463935 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4df878c9-f52f-41d5-9f63-b439062a72c3 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:18:09.464379 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4df878c9-f52f-41d5-9f63-b439062a72c3 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:18:09.465131 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4df878c9-f52f-41d5-9f63-b439062a72c3 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:18:09.465590 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4df878c9-f52f-41d5-9f63-b439062a72c3 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:18:09.466016 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4df878c9-f52f-41d5-9f63-b439062a72c3 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:18:09.468529 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG dbcounter [-] [118861] Writing DB stats nova_cell1:SELECT=90 {{(pid=118861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:18:09.500276 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-4df878c9-f52f-41d5-9f63-b439062a72c3 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051211 Oct 20 06:18:09.501197 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 692/1364] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:18:09 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:18:10.515467 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-74ee78c6-2517-491f-807b-ccbfcb7c8f13 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:18:10.521225 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-74ee78c6-2517-491f-807b-ccbfcb7c8f13 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:18:10.528021 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-74ee78c6-2517-491f-807b-ccbfcb7c8f13 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:18:10.528512 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-74ee78c6-2517-491f-807b-ccbfcb7c8f13 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:18:10.528977 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-74ee78c6-2517-491f-807b-ccbfcb7c8f13 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:18:10.529823 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-74ee78c6-2517-491f-807b-ccbfcb7c8f13 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:18:10.530333 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-74ee78c6-2517-491f-807b-ccbfcb7c8f13 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:18:10.530693 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-74ee78c6-2517-491f-807b-ccbfcb7c8f13 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:18:10.566050 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-74ee78c6-2517-491f-807b-ccbfcb7c8f13 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056195 Oct 20 06:18:10.566611 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 673/1365] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:18:10 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:18:11.578333 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-1047c72f-3245-4d80-8715-2969f0d65cb6 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:18:11.580638 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-1047c72f-3245-4d80-8715-2969f0d65cb6 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:18:11.587866 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1047c72f-3245-4d80-8715-2969f0d65cb6 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:18:11.588346 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1047c72f-3245-4d80-8715-2969f0d65cb6 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:18:11.588807 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1047c72f-3245-4d80-8715-2969f0d65cb6 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:18:11.589582 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1047c72f-3245-4d80-8715-2969f0d65cb6 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:18:11.590032 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1047c72f-3245-4d80-8715-2969f0d65cb6 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:18:11.590450 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1047c72f-3245-4d80-8715-2969f0d65cb6 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:18:11.623143 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-1047c72f-3245-4d80-8715-2969f0d65cb6 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048570 Oct 20 06:18:11.623888 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 693/1366] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:18:11 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:18:12.635759 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-4610e76e-9c8d-400e-a6a1-68a3c823cfab tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:18:12.638196 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-4610e76e-9c8d-400e-a6a1-68a3c823cfab tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:18:12.644882 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-4610e76e-9c8d-400e-a6a1-68a3c823cfab tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:18:12.645492 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-4610e76e-9c8d-400e-a6a1-68a3c823cfab tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:18:12.646204 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-4610e76e-9c8d-400e-a6a1-68a3c823cfab tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:18:12.647739 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-4610e76e-9c8d-400e-a6a1-68a3c823cfab tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:18:12.648263 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-4610e76e-9c8d-400e-a6a1-68a3c823cfab tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:18:12.648791 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-4610e76e-9c8d-400e-a6a1-68a3c823cfab tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:18:12.680601 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-4610e76e-9c8d-400e-a6a1-68a3c823cfab tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048825 Oct 20 06:18:12.681389 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 674/1367] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:18:12 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 20 06:18:13.692852 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-71c70d36-d50c-4890-9fdf-6ff20f22e422 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:18:13.695559 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-71c70d36-d50c-4890-9fdf-6ff20f22e422 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:18:13.702189 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-71c70d36-d50c-4890-9fdf-6ff20f22e422 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:18:13.702910 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-71c70d36-d50c-4890-9fdf-6ff20f22e422 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:18:13.703343 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-71c70d36-d50c-4890-9fdf-6ff20f22e422 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:18:13.704041 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-71c70d36-d50c-4890-9fdf-6ff20f22e422 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:18:13.704489 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-71c70d36-d50c-4890-9fdf-6ff20f22e422 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:18:13.704931 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-71c70d36-d50c-4890-9fdf-6ff20f22e422 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:18:13.749529 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-71c70d36-d50c-4890-9fdf-6ff20f22e422 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060443 Oct 20 06:18:13.754670 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 694/1368] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:18:13 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:18:14.762392 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-c6a0b667-26d9-4804-a2fd-d2c0e839a89f tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:18:14.764525 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-c6a0b667-26d9-4804-a2fd-d2c0e839a89f tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:18:14.771129 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c6a0b667-26d9-4804-a2fd-d2c0e839a89f tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:18:14.771650 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c6a0b667-26d9-4804-a2fd-d2c0e839a89f tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:18:14.772234 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c6a0b667-26d9-4804-a2fd-d2c0e839a89f tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:18:14.772985 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c6a0b667-26d9-4804-a2fd-d2c0e839a89f tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:18:14.773438 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c6a0b667-26d9-4804-a2fd-d2c0e839a89f tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:18:14.773860 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c6a0b667-26d9-4804-a2fd-d2c0e839a89f tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:18:14.810027 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-c6a0b667-26d9-4804-a2fd-d2c0e839a89f tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051496 Oct 20 06:18:14.810600 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 675/1369] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:18:14 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:18:15.823034 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-06fa1d95-3c93-4d01-8e1a-69d026656153 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:18:15.825431 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-06fa1d95-3c93-4d01-8e1a-69d026656153 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:18:15.831838 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-06fa1d95-3c93-4d01-8e1a-69d026656153 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:18:15.832386 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-06fa1d95-3c93-4d01-8e1a-69d026656153 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:18:15.832923 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-06fa1d95-3c93-4d01-8e1a-69d026656153 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:18:15.834231 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-06fa1d95-3c93-4d01-8e1a-69d026656153 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:18:15.834932 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-06fa1d95-3c93-4d01-8e1a-69d026656153 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:18:15.835463 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-06fa1d95-3c93-4d01-8e1a-69d026656153 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:18:15.876117 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-06fa1d95-3c93-4d01-8e1a-69d026656153 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057598 Oct 20 06:18:15.876806 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 695/1370] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:18:15 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:18:16.889712 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-c2ed15c3-7e57-4c04-96ac-a63b762eed55 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:18:16.893021 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-c2ed15c3-7e57-4c04-96ac-a63b762eed55 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:18:16.902421 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c2ed15c3-7e57-4c04-96ac-a63b762eed55 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:18:16.902926 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c2ed15c3-7e57-4c04-96ac-a63b762eed55 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:18:16.903374 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c2ed15c3-7e57-4c04-96ac-a63b762eed55 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:18:16.904339 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c2ed15c3-7e57-4c04-96ac-a63b762eed55 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:18:16.905407 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c2ed15c3-7e57-4c04-96ac-a63b762eed55 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:18:16.905856 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c2ed15c3-7e57-4c04-96ac-a63b762eed55 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:18:16.943053 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-c2ed15c3-7e57-4c04-96ac-a63b762eed55 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057837 Oct 20 06:18:16.943933 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 676/1371] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:18:16 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:18:17.955767 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-bed288e2-8a1a-496a-bd00-f576cbf4e28a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:18:17.958087 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-bed288e2-8a1a-496a-bd00-f576cbf4e28a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:18:17.965360 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-bed288e2-8a1a-496a-bd00-f576cbf4e28a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:18:17.966052 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-bed288e2-8a1a-496a-bd00-f576cbf4e28a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:18:17.966597 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-bed288e2-8a1a-496a-bd00-f576cbf4e28a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:18:17.967976 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-bed288e2-8a1a-496a-bd00-f576cbf4e28a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:18:17.968546 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-bed288e2-8a1a-496a-bd00-f576cbf4e28a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:18:17.969110 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-bed288e2-8a1a-496a-bd00-f576cbf4e28a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:18:18.006927 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-bed288e2-8a1a-496a-bd00-f576cbf4e28a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054636 Oct 20 06:18:18.012064 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 696/1372] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:18:17 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:18:19.020330 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-a1d36926-113a-43d9-9614-3b67ccc12180 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:18:19.022679 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-a1d36926-113a-43d9-9614-3b67ccc12180 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:18:19.029157 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a1d36926-113a-43d9-9614-3b67ccc12180 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:18:19.029639 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a1d36926-113a-43d9-9614-3b67ccc12180 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:18:19.030074 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a1d36926-113a-43d9-9614-3b67ccc12180 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:18:19.030771 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a1d36926-113a-43d9-9614-3b67ccc12180 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:18:19.031220 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a1d36926-113a-43d9-9614-3b67ccc12180 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:18:19.031702 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a1d36926-113a-43d9-9614-3b67ccc12180 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:18:19.065452 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-a1d36926-113a-43d9-9614-3b67ccc12180 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050031 Oct 20 06:18:19.070601 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 677/1373] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:18:19 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:18:20.078227 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-cb6e19bf-8e67-4fc9-8b92-40634e8d7462 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:18:20.080378 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-cb6e19bf-8e67-4fc9-8b92-40634e8d7462 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:18:20.087321 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-cb6e19bf-8e67-4fc9-8b92-40634e8d7462 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:18:20.087800 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-cb6e19bf-8e67-4fc9-8b92-40634e8d7462 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:18:20.088235 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-cb6e19bf-8e67-4fc9-8b92-40634e8d7462 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:18:20.088959 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-cb6e19bf-8e67-4fc9-8b92-40634e8d7462 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:18:20.089401 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-cb6e19bf-8e67-4fc9-8b92-40634e8d7462 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:18:20.089821 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-cb6e19bf-8e67-4fc9-8b92-40634e8d7462 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:18:20.136478 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-cb6e19bf-8e67-4fc9-8b92-40634e8d7462 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062032 Oct 20 06:18:20.141580 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 697/1374] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:18:20 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:18:21.149686 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-5bdc0711-8fa3-437f-a0dc-fa3056dcb295 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:18:21.151806 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-5bdc0711-8fa3-437f-a0dc-fa3056dcb295 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:18:21.158126 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5bdc0711-8fa3-437f-a0dc-fa3056dcb295 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:18:21.158609 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5bdc0711-8fa3-437f-a0dc-fa3056dcb295 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:18:21.159089 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5bdc0711-8fa3-437f-a0dc-fa3056dcb295 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:18:21.159773 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5bdc0711-8fa3-437f-a0dc-fa3056dcb295 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:18:21.160326 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5bdc0711-8fa3-437f-a0dc-fa3056dcb295 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:18:21.160779 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5bdc0711-8fa3-437f-a0dc-fa3056dcb295 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:18:21.191916 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-5bdc0711-8fa3-437f-a0dc-fa3056dcb295 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046805 Oct 20 06:18:21.192571 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 678/1375] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:18:21 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:18:22.205187 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-f7568edd-0ee2-4111-94fe-20a0dd1a4b52 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:18:22.207335 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-f7568edd-0ee2-4111-94fe-20a0dd1a4b52 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:18:22.212287 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG dbcounter [-] [118861] Writing DB stats nova_api:SELECT=30 {{(pid=118861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:18:22.218144 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f7568edd-0ee2-4111-94fe-20a0dd1a4b52 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:18:22.218628 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f7568edd-0ee2-4111-94fe-20a0dd1a4b52 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:18:22.219063 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f7568edd-0ee2-4111-94fe-20a0dd1a4b52 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:18:22.220077 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f7568edd-0ee2-4111-94fe-20a0dd1a4b52 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:18:22.220685 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f7568edd-0ee2-4111-94fe-20a0dd1a4b52 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:18:22.221273 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f7568edd-0ee2-4111-94fe-20a0dd1a4b52 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:18:22.252415 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-f7568edd-0ee2-4111-94fe-20a0dd1a4b52 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051188 Oct 20 06:18:22.257958 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 698/1376] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:18:22 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:18:23.266412 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-1d50e240-7aea-429b-95b3-644f8b572b69 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:18:23.268860 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-1d50e240-7aea-429b-95b3-644f8b572b69 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:18:23.271311 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG dbcounter [-] [118860] Writing DB stats nova_api:SELECT=30 {{(pid=118860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:18:23.276544 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1d50e240-7aea-429b-95b3-644f8b572b69 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:18:23.277140 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1d50e240-7aea-429b-95b3-644f8b572b69 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:18:23.277801 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1d50e240-7aea-429b-95b3-644f8b572b69 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:18:23.278657 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1d50e240-7aea-429b-95b3-644f8b572b69 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:18:23.279310 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1d50e240-7aea-429b-95b3-644f8b572b69 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:18:23.279767 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1d50e240-7aea-429b-95b3-644f8b572b69 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:18:23.315177 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-1d50e240-7aea-429b-95b3-644f8b572b69 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053323 Oct 20 06:18:23.315839 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 679/1377] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:18:23 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:18:24.328384 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-baabcda3-6117-45a1-b05e-ec5ae998787f tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:18:24.330659 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-baabcda3-6117-45a1-b05e-ec5ae998787f tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:18:24.337772 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-baabcda3-6117-45a1-b05e-ec5ae998787f tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:18:24.338252 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-baabcda3-6117-45a1-b05e-ec5ae998787f tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:18:24.338681 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-baabcda3-6117-45a1-b05e-ec5ae998787f tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:18:24.339369 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-baabcda3-6117-45a1-b05e-ec5ae998787f tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:18:24.339822 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-baabcda3-6117-45a1-b05e-ec5ae998787f tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:18:24.340553 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-baabcda3-6117-45a1-b05e-ec5ae998787f tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:18:24.371692 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-baabcda3-6117-45a1-b05e-ec5ae998787f tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048182 Oct 20 06:18:24.372262 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 699/1378] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:18:24 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:18:25.385777 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-fcd9f764-5b08-4426-bd76-88d4b8ad14fc tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:18:25.388107 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-fcd9f764-5b08-4426-bd76-88d4b8ad14fc tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:18:25.395092 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-fcd9f764-5b08-4426-bd76-88d4b8ad14fc tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:18:25.395686 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-fcd9f764-5b08-4426-bd76-88d4b8ad14fc tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:18:25.396286 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-fcd9f764-5b08-4426-bd76-88d4b8ad14fc tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:18:25.397171 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-fcd9f764-5b08-4426-bd76-88d4b8ad14fc tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:18:25.397722 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-fcd9f764-5b08-4426-bd76-88d4b8ad14fc tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:18:25.398251 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-fcd9f764-5b08-4426-bd76-88d4b8ad14fc tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:18:25.402345 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG dbcounter [-] [118860] Writing DB stats nova_cell1:SELECT=90 {{(pid=118860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:18:25.444117 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-fcd9f764-5b08-4426-bd76-88d4b8ad14fc tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061459 Oct 20 06:18:25.444845 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 680/1379] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:18:25 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:18:26.456662 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-a490f797-7527-42d8-a5c6-67c1d13666d7 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:18:26.458912 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-a490f797-7527-42d8-a5c6-67c1d13666d7 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:18:26.466299 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a490f797-7527-42d8-a5c6-67c1d13666d7 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:18:26.466784 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a490f797-7527-42d8-a5c6-67c1d13666d7 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:18:26.467228 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a490f797-7527-42d8-a5c6-67c1d13666d7 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:18:26.467933 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a490f797-7527-42d8-a5c6-67c1d13666d7 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:18:26.468384 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a490f797-7527-42d8-a5c6-67c1d13666d7 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:18:26.468839 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a490f797-7527-42d8-a5c6-67c1d13666d7 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:18:26.505005 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-a490f797-7527-42d8-a5c6-67c1d13666d7 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051718 Oct 20 06:18:26.508828 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 700/1380] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:18:26 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:18:27.517021 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-9375198c-ca70-44d1-b13c-26e002514393 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:18:27.519722 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-9375198c-ca70-44d1-b13c-26e002514393 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:18:27.530059 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-9375198c-ca70-44d1-b13c-26e002514393 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:18:27.530542 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-9375198c-ca70-44d1-b13c-26e002514393 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:18:27.530990 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-9375198c-ca70-44d1-b13c-26e002514393 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:18:27.531656 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-9375198c-ca70-44d1-b13c-26e002514393 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:18:27.532111 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-9375198c-ca70-44d1-b13c-26e002514393 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:18:27.532529 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-9375198c-ca70-44d1-b13c-26e002514393 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:18:27.573379 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-9375198c-ca70-44d1-b13c-26e002514393 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060104 Oct 20 06:18:27.574364 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 681/1381] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:18:27 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:18:28.597071 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-77f98f08-3dfe-442e-bdb6-382c71214e11 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:18:28.597071 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-77f98f08-3dfe-442e-bdb6-382c71214e11 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:18:28.597071 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-77f98f08-3dfe-442e-bdb6-382c71214e11 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:18:28.597705 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-77f98f08-3dfe-442e-bdb6-382c71214e11 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:18:28.597882 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-77f98f08-3dfe-442e-bdb6-382c71214e11 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:18:28.598813 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-77f98f08-3dfe-442e-bdb6-382c71214e11 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:18:28.599396 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-77f98f08-3dfe-442e-bdb6-382c71214e11 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:18:28.599828 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-77f98f08-3dfe-442e-bdb6-382c71214e11 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:18:28.634243 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-77f98f08-3dfe-442e-bdb6-382c71214e11 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051974 Oct 20 06:18:28.635130 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 701/1382] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:18:28 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 20 06:18:29.646884 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-d34f18dd-4049-4500-a61b-bfb049c76ac8 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:18:29.649636 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-d34f18dd-4049-4500-a61b-bfb049c76ac8 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:18:29.656489 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-d34f18dd-4049-4500-a61b-bfb049c76ac8 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:18:29.657471 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-d34f18dd-4049-4500-a61b-bfb049c76ac8 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:18:29.658369 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-d34f18dd-4049-4500-a61b-bfb049c76ac8 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:18:29.660998 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-d34f18dd-4049-4500-a61b-bfb049c76ac8 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:18:29.662225 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-d34f18dd-4049-4500-a61b-bfb049c76ac8 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:18:29.662917 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-d34f18dd-4049-4500-a61b-bfb049c76ac8 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:18:29.697361 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-d34f18dd-4049-4500-a61b-bfb049c76ac8 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054078 Oct 20 06:18:29.698135 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 682/1383] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:18:29 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:18:30.710739 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-fc0e4daf-5cc0-432b-99d4-ba908561e772 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:18:30.713545 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-fc0e4daf-5cc0-432b-99d4-ba908561e772 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:18:30.729232 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-fc0e4daf-5cc0-432b-99d4-ba908561e772 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:18:30.729232 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-fc0e4daf-5cc0-432b-99d4-ba908561e772 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:18:30.729232 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-fc0e4daf-5cc0-432b-99d4-ba908561e772 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:18:30.729232 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-fc0e4daf-5cc0-432b-99d4-ba908561e772 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:18:30.729569 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-fc0e4daf-5cc0-432b-99d4-ba908561e772 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:18:30.729569 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-fc0e4daf-5cc0-432b-99d4-ba908561e772 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:18:30.759814 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-fc0e4daf-5cc0-432b-99d4-ba908561e772 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053842 Oct 20 06:18:30.760727 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 702/1384] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:18:30 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:18:31.771870 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-e691f19d-e49a-4369-b70a-3dfc7fed4ff2 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:18:31.774210 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-e691f19d-e49a-4369-b70a-3dfc7fed4ff2 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:18:31.795759 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e691f19d-e49a-4369-b70a-3dfc7fed4ff2 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:18:31.796253 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e691f19d-e49a-4369-b70a-3dfc7fed4ff2 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:18:31.796715 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e691f19d-e49a-4369-b70a-3dfc7fed4ff2 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:18:31.797410 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e691f19d-e49a-4369-b70a-3dfc7fed4ff2 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:18:31.797862 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e691f19d-e49a-4369-b70a-3dfc7fed4ff2 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:18:31.798283 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e691f19d-e49a-4369-b70a-3dfc7fed4ff2 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:18:31.829615 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-e691f19d-e49a-4369-b70a-3dfc7fed4ff2 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061930 Oct 20 06:18:31.830370 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 683/1385] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:18:31 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:18:32.842589 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-00f1f9a0-d46d-426b-ad7a-c45add73feb1 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:18:32.844793 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-00f1f9a0-d46d-426b-ad7a-c45add73feb1 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:18:32.855012 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-00f1f9a0-d46d-426b-ad7a-c45add73feb1 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:18:32.855440 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-00f1f9a0-d46d-426b-ad7a-c45add73feb1 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:18:32.855817 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-00f1f9a0-d46d-426b-ad7a-c45add73feb1 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:18:32.856527 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-00f1f9a0-d46d-426b-ad7a-c45add73feb1 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:18:32.857011 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-00f1f9a0-d46d-426b-ad7a-c45add73feb1 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:18:32.857438 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-00f1f9a0-d46d-426b-ad7a-c45add73feb1 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:18:32.889287 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-00f1f9a0-d46d-426b-ad7a-c45add73feb1 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050849 Oct 20 06:18:32.901107 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 703/1386] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:18:32 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:18:33.902639 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-1f5161fe-badd-4362-95c5-6fe75211a923 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:18:33.907751 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-1f5161fe-badd-4362-95c5-6fe75211a923 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:18:33.916277 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1f5161fe-badd-4362-95c5-6fe75211a923 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:18:33.916813 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1f5161fe-badd-4362-95c5-6fe75211a923 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:18:33.917277 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1f5161fe-badd-4362-95c5-6fe75211a923 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:18:33.918191 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1f5161fe-badd-4362-95c5-6fe75211a923 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:18:33.918850 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1f5161fe-badd-4362-95c5-6fe75211a923 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:18:33.919284 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1f5161fe-badd-4362-95c5-6fe75211a923 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:18:33.965333 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-1f5161fe-badd-4362-95c5-6fe75211a923 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055415 Oct 20 06:18:33.965333 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 684/1387] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:18:33 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 20 06:18:34.965761 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-d9eb7fde-3448-47f4-a948-e973dc174594 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:18:34.969413 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-d9eb7fde-3448-47f4-a948-e973dc174594 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:18:34.974915 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d9eb7fde-3448-47f4-a948-e973dc174594 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:18:34.975354 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d9eb7fde-3448-47f4-a948-e973dc174594 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:18:34.975951 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d9eb7fde-3448-47f4-a948-e973dc174594 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:18:34.976655 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d9eb7fde-3448-47f4-a948-e973dc174594 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:18:34.977135 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d9eb7fde-3448-47f4-a948-e973dc174594 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:18:34.977559 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d9eb7fde-3448-47f4-a948-e973dc174594 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:18:35.009005 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-d9eb7fde-3448-47f4-a948-e973dc174594 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047065 Oct 20 06:18:35.013972 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 704/1388] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:18:34 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:18:36.022162 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-03b93bcc-41ec-4ded-b768-26ce4c171098 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:18:36.024931 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-03b93bcc-41ec-4ded-b768-26ce4c171098 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:18:36.032095 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-03b93bcc-41ec-4ded-b768-26ce4c171098 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:18:36.032824 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-03b93bcc-41ec-4ded-b768-26ce4c171098 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:18:36.033354 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-03b93bcc-41ec-4ded-b768-26ce4c171098 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:18:36.034043 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-03b93bcc-41ec-4ded-b768-26ce4c171098 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:18:36.034375 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-03b93bcc-41ec-4ded-b768-26ce4c171098 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:18:36.034796 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-03b93bcc-41ec-4ded-b768-26ce4c171098 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:18:36.066278 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-03b93bcc-41ec-4ded-b768-26ce4c171098 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048387 Oct 20 06:18:36.067013 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 685/1389] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:18:36 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:18:37.079074 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-b6abacc3-6aad-4dc7-a0ec-e7a4876a65e2 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:18:37.081250 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-b6abacc3-6aad-4dc7-a0ec-e7a4876a65e2 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:18:37.088351 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b6abacc3-6aad-4dc7-a0ec-e7a4876a65e2 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:18:37.088862 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b6abacc3-6aad-4dc7-a0ec-e7a4876a65e2 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:18:37.089306 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b6abacc3-6aad-4dc7-a0ec-e7a4876a65e2 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:18:37.090001 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b6abacc3-6aad-4dc7-a0ec-e7a4876a65e2 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:18:37.090642 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b6abacc3-6aad-4dc7-a0ec-e7a4876a65e2 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:18:37.091068 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b6abacc3-6aad-4dc7-a0ec-e7a4876a65e2 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:18:37.138167 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-b6abacc3-6aad-4dc7-a0ec-e7a4876a65e2 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062873 Oct 20 06:18:37.139467 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 705/1390] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:18:37 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:18:38.151131 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-58137726-a7f7-42dc-9545-e0cca5896452 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:18:38.153399 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-58137726-a7f7-42dc-9545-e0cca5896452 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:18:38.171414 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-58137726-a7f7-42dc-9545-e0cca5896452 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:18:38.171414 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-58137726-a7f7-42dc-9545-e0cca5896452 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:18:38.171414 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-58137726-a7f7-42dc-9545-e0cca5896452 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:18:38.171414 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-58137726-a7f7-42dc-9545-e0cca5896452 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:18:38.172595 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-58137726-a7f7-42dc-9545-e0cca5896452 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:18:38.172595 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-58137726-a7f7-42dc-9545-e0cca5896452 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:18:38.204451 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-58137726-a7f7-42dc-9545-e0cca5896452 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057309 Oct 20 06:18:38.210147 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 686/1391] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:18:38 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:18:39.224925 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-68b833fb-8e1c-4909-aaac-4bc517352699 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:18:39.224925 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-68b833fb-8e1c-4909-aaac-4bc517352699 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:18:39.227753 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-68b833fb-8e1c-4909-aaac-4bc517352699 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:18:39.228472 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-68b833fb-8e1c-4909-aaac-4bc517352699 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:18:39.229131 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-68b833fb-8e1c-4909-aaac-4bc517352699 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:18:39.230177 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-68b833fb-8e1c-4909-aaac-4bc517352699 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:18:39.230795 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-68b833fb-8e1c-4909-aaac-4bc517352699 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:18:39.231220 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-68b833fb-8e1c-4909-aaac-4bc517352699 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:18:39.266828 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-68b833fb-8e1c-4909-aaac-4bc517352699 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052587 Oct 20 06:18:39.267414 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 706/1392] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:18:39 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:18:40.279008 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-3dadae50-e2b0-4ece-999a-63d894cd084d tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:18:40.281356 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-3dadae50-e2b0-4ece-999a-63d894cd084d tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:18:40.288567 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3dadae50-e2b0-4ece-999a-63d894cd084d tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:18:40.289088 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3dadae50-e2b0-4ece-999a-63d894cd084d tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:18:40.289518 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3dadae50-e2b0-4ece-999a-63d894cd084d tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:18:40.290403 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3dadae50-e2b0-4ece-999a-63d894cd084d tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:18:40.291020 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3dadae50-e2b0-4ece-999a-63d894cd084d tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:18:40.291450 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3dadae50-e2b0-4ece-999a-63d894cd084d tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:18:40.337173 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-3dadae50-e2b0-4ece-999a-63d894cd084d tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057105 Oct 20 06:18:40.341577 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 687/1393] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:18:40 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:18:41.345569 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-581ac330-6371-441e-9604-33893eaaf36f tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:18:41.347806 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-581ac330-6371-441e-9604-33893eaaf36f tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:18:41.354990 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-581ac330-6371-441e-9604-33893eaaf36f tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:18:41.355599 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-581ac330-6371-441e-9604-33893eaaf36f tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:18:41.356131 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-581ac330-6371-441e-9604-33893eaaf36f tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:18:41.356984 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-581ac330-6371-441e-9604-33893eaaf36f tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:18:41.357560 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-581ac330-6371-441e-9604-33893eaaf36f tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:18:41.358086 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-581ac330-6371-441e-9604-33893eaaf36f tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:18:41.360774 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG dbcounter [-] [118861] Writing DB stats nova_cell1:SELECT=90 {{(pid=118861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:18:41.395396 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-581ac330-6371-441e-9604-33893eaaf36f tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053702 Oct 20 06:18:41.396265 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 707/1394] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:18:41 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:18:42.364470 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-f3b49560-9fc2-4f04-bcf5-bb754876f700 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:18:42.364470 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-f3b49560-9fc2-4f04-bcf5-bb754876f700 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:18:42.364470 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f3b49560-9fc2-4f04-bcf5-bb754876f700 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:18:42.365959 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f3b49560-9fc2-4f04-bcf5-bb754876f700 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:18:42.365959 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f3b49560-9fc2-4f04-bcf5-bb754876f700 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:18:42.366810 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f3b49560-9fc2-4f04-bcf5-bb754876f700 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:18:42.367344 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f3b49560-9fc2-4f04-bcf5-bb754876f700 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:18:42.367839 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f3b49560-9fc2-4f04-bcf5-bb754876f700 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:18:42.394665 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-f3b49560-9fc2-4f04-bcf5-bb754876f700 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Going to try to terminate instance {{(pid=118860) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 20 06:18:42.407423 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-261c044f-e164-49c2-9917-507736a5864a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:18:42.410901 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-261c044f-e164-49c2-9917-507736a5864a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:18:42.421546 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-261c044f-e164-49c2-9917-507736a5864a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:18:42.423714 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-261c044f-e164-49c2-9917-507736a5864a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:18:42.424345 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-261c044f-e164-49c2-9917-507736a5864a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:18:42.426149 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-261c044f-e164-49c2-9917-507736a5864a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:18:42.426780 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-261c044f-e164-49c2-9917-507736a5864a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:18:42.428076 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-261c044f-e164-49c2-9917-507736a5864a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:18:42.478528 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-261c044f-e164-49c2-9917-507736a5864a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.074954 Oct 20 06:18:42.483921 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 708/1395] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:18:42 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:18:42.495136 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-f3b49560-9fc2-4f04-bcf5-bb754876f700 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "DELETE /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 204 len: 0 microversion: 2.1 time: 0.141687 Oct 20 06:18:42.496442 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 688/1396] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 20 06:18:42 2022] DELETE /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 20 06:18:42.507129 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-5d749c12-7cd7-424d-8748-26c06c9ea345 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:18:42.508118 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-5d749c12-7cd7-424d-8748-26c06c9ea345 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:18:42.516133 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5d749c12-7cd7-424d-8748-26c06c9ea345 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:18:42.516633 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5d749c12-7cd7-424d-8748-26c06c9ea345 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:18:42.517338 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5d749c12-7cd7-424d-8748-26c06c9ea345 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:18:42.518184 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5d749c12-7cd7-424d-8748-26c06c9ea345 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:18:42.518643 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5d749c12-7cd7-424d-8748-26c06c9ea345 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:18:42.519228 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5d749c12-7cd7-424d-8748-26c06c9ea345 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:18:42.769969 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-5d749c12-7cd7-424d-8748-26c06c9ea345 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:18:42.779510 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-5d749c12-7cd7-424d-8748-26c06c9ea345 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.278493 Oct 20 06:18:42.780317 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 709/1397] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:18:42 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:18:43.491442 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-3e930c7a-b48f-4d85-828f-8eabd5ca7660 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:18:43.493661 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-3e930c7a-b48f-4d85-828f-8eabd5ca7660 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:18:43.500601 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3e930c7a-b48f-4d85-828f-8eabd5ca7660 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:18:43.501115 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3e930c7a-b48f-4d85-828f-8eabd5ca7660 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:18:43.501551 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3e930c7a-b48f-4d85-828f-8eabd5ca7660 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:18:43.502300 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3e930c7a-b48f-4d85-828f-8eabd5ca7660 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:18:43.502681 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3e930c7a-b48f-4d85-828f-8eabd5ca7660 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:18:43.503102 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3e930c7a-b48f-4d85-828f-8eabd5ca7660 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:18:43.539907 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-3e930c7a-b48f-4d85-828f-8eabd5ca7660 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052635 Oct 20 06:18:43.540522 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 689/1398] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:18:43 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:18:43.804184 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-fc332907-82dd-4d69-bc77-cbed2dcd1d57 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:18:43.805523 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-fc332907-82dd-4d69-bc77-cbed2dcd1d57 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:18:43.813927 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-fc332907-82dd-4d69-bc77-cbed2dcd1d57 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:18:43.814779 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-fc332907-82dd-4d69-bc77-cbed2dcd1d57 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:18:43.815996 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-fc332907-82dd-4d69-bc77-cbed2dcd1d57 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:18:43.817265 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-fc332907-82dd-4d69-bc77-cbed2dcd1d57 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:18:43.818788 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-fc332907-82dd-4d69-bc77-cbed2dcd1d57 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:18:43.819378 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-fc332907-82dd-4d69-bc77-cbed2dcd1d57 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:18:43.975490 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-fc332907-82dd-4d69-bc77-cbed2dcd1d57 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:18:43.984540 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-fc332907-82dd-4d69-bc77-cbed2dcd1d57 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.185065 Oct 20 06:18:43.997209 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 710/1399] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:18:43 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:18:44.551898 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-80637a9b-614a-42ed-9696-c0d41fc48f28 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:18:44.555219 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-80637a9b-614a-42ed-9696-c0d41fc48f28 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:18:44.562328 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-80637a9b-614a-42ed-9696-c0d41fc48f28 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:18:44.563093 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-80637a9b-614a-42ed-9696-c0d41fc48f28 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:18:44.563753 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-80637a9b-614a-42ed-9696-c0d41fc48f28 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:18:44.564616 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-80637a9b-614a-42ed-9696-c0d41fc48f28 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:18:44.565257 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-80637a9b-614a-42ed-9696-c0d41fc48f28 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:18:44.565687 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-80637a9b-614a-42ed-9696-c0d41fc48f28 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:18:44.598369 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-80637a9b-614a-42ed-9696-c0d41fc48f28 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050222 Oct 20 06:18:44.603915 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 690/1400] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:18:44 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:18:45.011865 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-c23e9dc0-4921-45d2-a9f1-7be90792df0e tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:18:45.014210 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-c23e9dc0-4921-45d2-a9f1-7be90792df0e tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:18:45.029369 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c23e9dc0-4921-45d2-a9f1-7be90792df0e tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:18:45.030558 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c23e9dc0-4921-45d2-a9f1-7be90792df0e tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:18:45.032270 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c23e9dc0-4921-45d2-a9f1-7be90792df0e tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:18:45.033521 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c23e9dc0-4921-45d2-a9f1-7be90792df0e tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:18:45.034166 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c23e9dc0-4921-45d2-a9f1-7be90792df0e tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:18:45.034758 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c23e9dc0-4921-45d2-a9f1-7be90792df0e tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:18:45.252992 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-c23e9dc0-4921-45d2-a9f1-7be90792df0e tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:18:45.266406 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-c23e9dc0-4921-45d2-a9f1-7be90792df0e tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.259917 Oct 20 06:18:45.267465 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 711/1401] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:18:45 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:18:45.611328 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-52dbc550-3bfc-4de3-8b02-e7a88e63eb58 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:18:45.616915 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-52dbc550-3bfc-4de3-8b02-e7a88e63eb58 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:18:45.638226 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-52dbc550-3bfc-4de3-8b02-e7a88e63eb58 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:18:45.639304 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-52dbc550-3bfc-4de3-8b02-e7a88e63eb58 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:18:45.639982 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-52dbc550-3bfc-4de3-8b02-e7a88e63eb58 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:18:45.640962 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-52dbc550-3bfc-4de3-8b02-e7a88e63eb58 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:18:45.641638 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-52dbc550-3bfc-4de3-8b02-e7a88e63eb58 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:18:45.642300 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-52dbc550-3bfc-4de3-8b02-e7a88e63eb58 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:18:45.693834 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-52dbc550-3bfc-4de3-8b02-e7a88e63eb58 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.086777 Oct 20 06:18:45.694667 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 691/1402] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:18:45 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:18:46.291631 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-7a747075-7f28-46e8-ae9a-ca766375a5bc tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:18:46.292242 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-7a747075-7f28-46e8-ae9a-ca766375a5bc tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:18:46.309679 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7a747075-7f28-46e8-ae9a-ca766375a5bc tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:18:46.310174 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7a747075-7f28-46e8-ae9a-ca766375a5bc tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:18:46.310604 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7a747075-7f28-46e8-ae9a-ca766375a5bc tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:18:46.311320 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7a747075-7f28-46e8-ae9a-ca766375a5bc tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:18:46.311767 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7a747075-7f28-46e8-ae9a-ca766375a5bc tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:18:46.312187 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7a747075-7f28-46e8-ae9a-ca766375a5bc tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:18:46.537904 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-7a747075-7f28-46e8-ae9a-ca766375a5bc tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:18:46.548034 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-7a747075-7f28-46e8-ae9a-ca766375a5bc tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.260202 Oct 20 06:18:46.548922 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 712/1403] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:18:46 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:18:46.706171 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-043a7a17-1435-4b8a-94e9-2b954b8a254b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:18:46.708305 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-043a7a17-1435-4b8a-94e9-2b954b8a254b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:18:46.715513 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-043a7a17-1435-4b8a-94e9-2b954b8a254b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:18:46.715919 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-043a7a17-1435-4b8a-94e9-2b954b8a254b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:18:46.716721 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-043a7a17-1435-4b8a-94e9-2b954b8a254b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:18:46.721576 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-043a7a17-1435-4b8a-94e9-2b954b8a254b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:18:46.722380 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-043a7a17-1435-4b8a-94e9-2b954b8a254b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:18:46.722970 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-043a7a17-1435-4b8a-94e9-2b954b8a254b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:18:46.774131 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-043a7a17-1435-4b8a-94e9-2b954b8a254b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.071884 Oct 20 06:18:46.779329 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 692/1404] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:18:46 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:18:47.577796 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-fce614fc-6068-4aab-9031-e7972b3c9d91 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:18:47.578412 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-fce614fc-6068-4aab-9031-e7972b3c9d91 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:18:47.600000 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-fce614fc-6068-4aab-9031-e7972b3c9d91 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:18:47.601179 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-fce614fc-6068-4aab-9031-e7972b3c9d91 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:18:47.601869 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-fce614fc-6068-4aab-9031-e7972b3c9d91 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:18:47.602911 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-fce614fc-6068-4aab-9031-e7972b3c9d91 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:18:47.603586 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-fce614fc-6068-4aab-9031-e7972b3c9d91 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:18:47.604212 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-fce614fc-6068-4aab-9031-e7972b3c9d91 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:18:47.786669 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-0008dbe9-5bf4-47e2-ae29-d8b3660ba04f tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:18:47.789523 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-0008dbe9-5bf4-47e2-ae29-d8b3660ba04f tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:18:47.796339 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0008dbe9-5bf4-47e2-ae29-d8b3660ba04f tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:18:47.797066 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0008dbe9-5bf4-47e2-ae29-d8b3660ba04f tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:18:47.797680 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0008dbe9-5bf4-47e2-ae29-d8b3660ba04f tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:18:47.798733 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0008dbe9-5bf4-47e2-ae29-d8b3660ba04f tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:18:47.799339 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0008dbe9-5bf4-47e2-ae29-d8b3660ba04f tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:18:47.799916 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0008dbe9-5bf4-47e2-ae29-d8b3660ba04f tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:18:47.836469 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-0008dbe9-5bf4-47e2-ae29-d8b3660ba04f tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053680 Oct 20 06:18:47.841688 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 693/1405] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:18:47 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:18:47.908072 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-fce614fc-6068-4aab-9031-e7972b3c9d91 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:18:47.930837 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-fce614fc-6068-4aab-9031-e7972b3c9d91 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.351524 Oct 20 06:18:47.953337 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 713/1406] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:18:47 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:18:48.850214 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-26411bae-026f-473d-9fd3-293c76e23838 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:18:48.852341 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-26411bae-026f-473d-9fd3-293c76e23838 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:18:48.870752 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-26411bae-026f-473d-9fd3-293c76e23838 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:18:48.871260 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-26411bae-026f-473d-9fd3-293c76e23838 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:18:48.871698 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-26411bae-026f-473d-9fd3-293c76e23838 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:18:48.872421 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-26411bae-026f-473d-9fd3-293c76e23838 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:18:48.872887 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-26411bae-026f-473d-9fd3-293c76e23838 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:18:48.873489 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-26411bae-026f-473d-9fd3-293c76e23838 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:18:48.912829 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-26411bae-026f-473d-9fd3-293c76e23838 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.067394 Oct 20 06:18:48.917862 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 694/1407] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:18:48 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:18:48.957891 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-e3e654c2-321a-4d28-982c-5eb9364f6e5c tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:18:48.959013 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-e3e654c2-321a-4d28-982c-5eb9364f6e5c tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:18:48.967182 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e3e654c2-321a-4d28-982c-5eb9364f6e5c tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:18:48.967664 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e3e654c2-321a-4d28-982c-5eb9364f6e5c tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:18:48.968097 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e3e654c2-321a-4d28-982c-5eb9364f6e5c tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:18:48.972595 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e3e654c2-321a-4d28-982c-5eb9364f6e5c tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:18:48.973548 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e3e654c2-321a-4d28-982c-5eb9364f6e5c tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:18:48.974684 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e3e654c2-321a-4d28-982c-5eb9364f6e5c tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:18:49.217634 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-e3e654c2-321a-4d28-982c-5eb9364f6e5c tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:18:49.231584 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-e3e654c2-321a-4d28-982c-5eb9364f6e5c tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.277177 Oct 20 06:18:49.232740 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 714/1408] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:18:48 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:18:49.935559 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-a5664d61-ad4c-4a02-82ca-2159eef1797a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:18:49.938984 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-a5664d61-ad4c-4a02-82ca-2159eef1797a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:18:49.953651 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a5664d61-ad4c-4a02-82ca-2159eef1797a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:18:49.954332 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a5664d61-ad4c-4a02-82ca-2159eef1797a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:18:49.955004 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a5664d61-ad4c-4a02-82ca-2159eef1797a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:18:49.956618 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a5664d61-ad4c-4a02-82ca-2159eef1797a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:18:49.957663 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a5664d61-ad4c-4a02-82ca-2159eef1797a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:18:49.958372 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a5664d61-ad4c-4a02-82ca-2159eef1797a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:18:49.965621 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG dbcounter [-] [118860] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:18:50.017656 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-a5664d61-ad4c-4a02-82ca-2159eef1797a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.095315 Oct 20 06:18:50.018824 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 695/1409] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:18:49 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:18:50.259863 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-45ca10db-a1f0-4dfc-b521-683571bbf31b tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:18:50.260484 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-45ca10db-a1f0-4dfc-b521-683571bbf31b tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:18:50.277948 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-45ca10db-a1f0-4dfc-b521-683571bbf31b tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:18:50.278699 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-45ca10db-a1f0-4dfc-b521-683571bbf31b tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:18:50.279581 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-45ca10db-a1f0-4dfc-b521-683571bbf31b tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:18:50.280212 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-45ca10db-a1f0-4dfc-b521-683571bbf31b tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:18:50.280675 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-45ca10db-a1f0-4dfc-b521-683571bbf31b tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:18:50.281132 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-45ca10db-a1f0-4dfc-b521-683571bbf31b tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:18:50.698819 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-45ca10db-a1f0-4dfc-b521-683571bbf31b tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:18:50.713677 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-45ca10db-a1f0-4dfc-b521-683571bbf31b tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.455084 Oct 20 06:18:50.717532 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 715/1410] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:18:50 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:18:51.032217 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-336c6206-d4f5-4ab9-9f30-5da979ba46f6 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:18:51.044954 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-336c6206-d4f5-4ab9-9f30-5da979ba46f6 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:18:51.060071 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-336c6206-d4f5-4ab9-9f30-5da979ba46f6 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:18:51.060957 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-336c6206-d4f5-4ab9-9f30-5da979ba46f6 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:18:51.061503 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-336c6206-d4f5-4ab9-9f30-5da979ba46f6 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:18:51.062122 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-336c6206-d4f5-4ab9-9f30-5da979ba46f6 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:18:51.062580 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-336c6206-d4f5-4ab9-9f30-5da979ba46f6 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:18:51.063205 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-336c6206-d4f5-4ab9-9f30-5da979ba46f6 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:18:51.159568 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-336c6206-d4f5-4ab9-9f30-5da979ba46f6 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.132526 Oct 20 06:18:51.160215 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 696/1411] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:18:51 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:18:51.743243 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-94bb0c71-aa37-4681-8900-75f52c0d5c73 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:18:51.744485 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-94bb0c71-aa37-4681-8900-75f52c0d5c73 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:18:51.755244 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-94bb0c71-aa37-4681-8900-75f52c0d5c73 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:18:51.756543 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-94bb0c71-aa37-4681-8900-75f52c0d5c73 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:18:51.761346 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-94bb0c71-aa37-4681-8900-75f52c0d5c73 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:18:51.762116 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-94bb0c71-aa37-4681-8900-75f52c0d5c73 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:18:51.762582 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-94bb0c71-aa37-4681-8900-75f52c0d5c73 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:18:51.763011 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-94bb0c71-aa37-4681-8900-75f52c0d5c73 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:18:51.957941 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-94bb0c71-aa37-4681-8900-75f52c0d5c73 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:18:51.972839 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-94bb0c71-aa37-4681-8900-75f52c0d5c73 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.233988 Oct 20 06:18:51.974837 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 716/1412] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:18:51 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:18:52.174467 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-573f970f-641b-4bd4-a267-07c42d515226 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:18:52.183360 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-573f970f-641b-4bd4-a267-07c42d515226 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:18:52.200235 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-573f970f-641b-4bd4-a267-07c42d515226 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:18:52.208053 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-573f970f-641b-4bd4-a267-07c42d515226 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:18:52.217571 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-573f970f-641b-4bd4-a267-07c42d515226 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:18:52.221137 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-573f970f-641b-4bd4-a267-07c42d515226 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:18:52.221627 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-573f970f-641b-4bd4-a267-07c42d515226 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:18:52.222071 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-573f970f-641b-4bd4-a267-07c42d515226 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:18:52.347912 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-573f970f-641b-4bd4-a267-07c42d515226 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.177613 Oct 20 06:18:52.354810 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 697/1413] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:18:52 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:18:52.996573 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-de08686d-7c1e-40f8-b6df-bb0b7800c10f tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:18:52.997339 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-de08686d-7c1e-40f8-b6df-bb0b7800c10f tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:18:53.011969 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG dbcounter [-] [118861] Writing DB stats nova_api:SELECT=38 {{(pid=118861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:18:53.013953 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-de08686d-7c1e-40f8-b6df-bb0b7800c10f tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:18:53.014512 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-de08686d-7c1e-40f8-b6df-bb0b7800c10f tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:18:53.014978 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-de08686d-7c1e-40f8-b6df-bb0b7800c10f tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:18:53.015753 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-de08686d-7c1e-40f8-b6df-bb0b7800c10f tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:18:53.016203 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-de08686d-7c1e-40f8-b6df-bb0b7800c10f tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:18:53.016649 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-de08686d-7c1e-40f8-b6df-bb0b7800c10f tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:18:53.325788 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-de08686d-7c1e-40f8-b6df-bb0b7800c10f tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:18:53.337370 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-de08686d-7c1e-40f8-b6df-bb0b7800c10f tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.344689 Oct 20 06:18:53.341593 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 717/1414] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:18:52 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:18:53.367075 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-9e3c0322-4d4e-4b14-8024-5e37422bc573 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:18:53.369331 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-9e3c0322-4d4e-4b14-8024-5e37422bc573 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:18:53.388394 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG dbcounter [-] [118860] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1 {{(pid=118860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:18:53.394703 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-9e3c0322-4d4e-4b14-8024-5e37422bc573 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:18:53.395211 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-9e3c0322-4d4e-4b14-8024-5e37422bc573 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:18:53.395656 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-9e3c0322-4d4e-4b14-8024-5e37422bc573 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:18:53.402862 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-9e3c0322-4d4e-4b14-8024-5e37422bc573 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:18:53.403359 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-9e3c0322-4d4e-4b14-8024-5e37422bc573 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:18:53.403998 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-9e3c0322-4d4e-4b14-8024-5e37422bc573 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:18:53.537190 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-9e3c0322-4d4e-4b14-8024-5e37422bc573 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.178742 Oct 20 06:18:53.542928 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 698/1415] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:18:53 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:18:54.363404 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-f365a260-244d-498f-a415-e80dbac87965 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:18:54.364559 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-f365a260-244d-498f-a415-e80dbac87965 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:18:54.387319 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f365a260-244d-498f-a415-e80dbac87965 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:18:54.388358 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f365a260-244d-498f-a415-e80dbac87965 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:18:54.388977 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f365a260-244d-498f-a415-e80dbac87965 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:18:54.393356 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f365a260-244d-498f-a415-e80dbac87965 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:18:54.398965 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f365a260-244d-498f-a415-e80dbac87965 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:18:54.399624 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f365a260-244d-498f-a415-e80dbac87965 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:18:54.553466 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-ccdfe7e5-1976-44b5-88ca-867adc079c44 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:18:54.556512 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-ccdfe7e5-1976-44b5-88ca-867adc079c44 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:18:54.573614 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-ccdfe7e5-1976-44b5-88ca-867adc079c44 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:18:54.575048 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-ccdfe7e5-1976-44b5-88ca-867adc079c44 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:18:54.575677 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-ccdfe7e5-1976-44b5-88ca-867adc079c44 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:18:54.576593 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-ccdfe7e5-1976-44b5-88ca-867adc079c44 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:18:54.577283 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-ccdfe7e5-1976-44b5-88ca-867adc079c44 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:18:54.577853 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-ccdfe7e5-1976-44b5-88ca-867adc079c44 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:18:54.645319 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-ccdfe7e5-1976-44b5-88ca-867adc079c44 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.098317 Oct 20 06:18:54.647075 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 699/1416] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:18:54 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 20 06:18:54.844738 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-f365a260-244d-498f-a415-e80dbac87965 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:18:54.857530 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-f365a260-244d-498f-a415-e80dbac87965 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.495601 Oct 20 06:18:54.858731 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 718/1417] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:18:54 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:18:55.662122 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-19737b91-8643-41e5-b38a-97bf1dcaa0ce tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:18:55.664911 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-19737b91-8643-41e5-b38a-97bf1dcaa0ce tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:18:55.672216 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-19737b91-8643-41e5-b38a-97bf1dcaa0ce tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:18:55.672978 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-19737b91-8643-41e5-b38a-97bf1dcaa0ce tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:18:55.674004 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-19737b91-8643-41e5-b38a-97bf1dcaa0ce tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:18:55.674908 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-19737b91-8643-41e5-b38a-97bf1dcaa0ce tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:18:55.675669 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-19737b91-8643-41e5-b38a-97bf1dcaa0ce tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:18:55.676848 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-19737b91-8643-41e5-b38a-97bf1dcaa0ce tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:18:55.726668 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-19737b91-8643-41e5-b38a-97bf1dcaa0ce tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.068441 Oct 20 06:18:55.727867 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 700/1418] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:18:55 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:18:55.887317 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-4679c7e0-1c04-4a50-98c4-b8407d2a2874 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:18:55.888511 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-4679c7e0-1c04-4a50-98c4-b8407d2a2874 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:18:55.895466 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4679c7e0-1c04-4a50-98c4-b8407d2a2874 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:18:55.896286 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4679c7e0-1c04-4a50-98c4-b8407d2a2874 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:18:55.896977 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4679c7e0-1c04-4a50-98c4-b8407d2a2874 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:18:55.897925 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4679c7e0-1c04-4a50-98c4-b8407d2a2874 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:18:55.898682 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4679c7e0-1c04-4a50-98c4-b8407d2a2874 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:18:55.899308 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4679c7e0-1c04-4a50-98c4-b8407d2a2874 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:18:56.165990 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-4679c7e0-1c04-4a50-98c4-b8407d2a2874 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:18:56.176909 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-4679c7e0-1c04-4a50-98c4-b8407d2a2874 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.292935 Oct 20 06:18:56.180750 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 719/1419] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:18:55 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:18:56.741572 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-77c32f50-0714-43c4-af64-2384592a36ac tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:18:56.745556 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-77c32f50-0714-43c4-af64-2384592a36ac tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:18:56.758604 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-77c32f50-0714-43c4-af64-2384592a36ac tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:18:56.759237 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-77c32f50-0714-43c4-af64-2384592a36ac tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:18:56.759929 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-77c32f50-0714-43c4-af64-2384592a36ac tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:18:56.760801 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-77c32f50-0714-43c4-af64-2384592a36ac tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:18:56.761671 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-77c32f50-0714-43c4-af64-2384592a36ac tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:18:56.762474 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-77c32f50-0714-43c4-af64-2384592a36ac tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:18:56.827411 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-77c32f50-0714-43c4-af64-2384592a36ac tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.090353 Oct 20 06:18:56.836312 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 720/1420] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:18:56 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:18:56.941942 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-2657a2f1-5daf-4e5f-9293-1e3965a6f0a0 tempest-TestShelveInstance-1797429796 tempest-TestShelveInstance-1797429796-project] Action: 'create', calling method: .version_select at 0x7fbe4ac55430>, body: {"keypair": {"name": "tempest-TestShelveInstance-1313377453", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOpptanUEWdyf8rQBPnbPA9jicegez2uGdFIbjEx2d8DPGhyqLdIYigljtSJyFLQbYFkB2htEMqkDV93IFeSAqzszD3xHHu0LilPeO4qa1xRN2HTMToDWOxB41/bXFZ25Q=="}} {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 06:18:56.959353 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.quota [None req-2657a2f1-5daf-4e5f-9293-1e3965a6f0a0 tempest-TestShelveInstance-1797429796 tempest-TestShelveInstance-1797429796-project] Getting quotas for project 0cfa9834ec244713816c8775c3ba7f18. Resources: {'key_pairs'} {{(pid=118860) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 20 06:18:56.963514 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.quota [None req-2657a2f1-5daf-4e5f-9293-1e3965a6f0a0 tempest-TestShelveInstance-1797429796 tempest-TestShelveInstance-1797429796-project] Getting quotas for user b2a67495335541dcb1cf1405ca9e3245 and project 0cfa9834ec244713816c8775c3ba7f18. Resources: {'key_pairs'} {{(pid=118860) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 20 06:18:56.976894 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR oslo.messaging._drivers.impl_rabbit [None req-2657a2f1-5daf-4e5f-9293-1e3965a6f0a0 tempest-TestShelveInstance-1797429796 tempest-TestShelveInstance-1797429796-project] [319af16a-6c95-4eb2-86db-7112ed08e1b4] AMQP server on 10.222.0.20:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 20 06:18:57.203826 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-30d4240b-e2dc-467b-a1af-4a514d97fa9c tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:18:57.204444 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-30d4240b-e2dc-467b-a1af-4a514d97fa9c tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:18:57.211455 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-30d4240b-e2dc-467b-a1af-4a514d97fa9c tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:18:57.212044 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-30d4240b-e2dc-467b-a1af-4a514d97fa9c tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:18:57.212547 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-30d4240b-e2dc-467b-a1af-4a514d97fa9c tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:18:57.213303 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-30d4240b-e2dc-467b-a1af-4a514d97fa9c tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:18:57.213750 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-30d4240b-e2dc-467b-a1af-4a514d97fa9c tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:18:57.214164 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-30d4240b-e2dc-467b-a1af-4a514d97fa9c tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:18:57.356687 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-30d4240b-e2dc-467b-a1af-4a514d97fa9c tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:18:57.365905 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-30d4240b-e2dc-467b-a1af-4a514d97fa9c tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.165835 Oct 20 06:18:57.366671 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 721/1421] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:18:57 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:18:57.839825 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-17f458d9-068a-405a-bfc5-89d80fd01091 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:18:57.841993 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-17f458d9-068a-405a-bfc5-89d80fd01091 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:18:57.847958 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-17f458d9-068a-405a-bfc5-89d80fd01091 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:18:57.848436 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-17f458d9-068a-405a-bfc5-89d80fd01091 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:18:57.848901 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-17f458d9-068a-405a-bfc5-89d80fd01091 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:18:57.849766 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-17f458d9-068a-405a-bfc5-89d80fd01091 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:18:57.850214 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-17f458d9-068a-405a-bfc5-89d80fd01091 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:18:57.850633 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-17f458d9-068a-405a-bfc5-89d80fd01091 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:18:57.882811 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-17f458d9-068a-405a-bfc5-89d80fd01091 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046943 Oct 20 06:18:57.883694 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 722/1422] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:18:57 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 20 06:18:57.994085 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO oslo.messaging._drivers.impl_rabbit [None req-2657a2f1-5daf-4e5f-9293-1e3965a6f0a0 tempest-TestShelveInstance-1797429796 tempest-TestShelveInstance-1797429796-project] [319af16a-6c95-4eb2-86db-7112ed08e1b4] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 34202. Oct 20 06:18:58.009552 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-2657a2f1-5daf-4e5f-9293-1e3965a6f0a0 tempest-TestShelveInstance-1797429796 tempest-TestShelveInstance-1797429796-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 1.431039 Oct 20 06:18:58.010149 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 701/1423] 10.222.0.20 () {60 vars in 1159 bytes} [Thu Oct 20 06:18:56 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 1434 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:18:58.390189 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-4491b50f-83ef-4d8a-a305-98e6d0634bd6 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:18:58.391687 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-4491b50f-83ef-4d8a-a305-98e6d0634bd6 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:18:58.399426 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4491b50f-83ef-4d8a-a305-98e6d0634bd6 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:18:58.400084 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4491b50f-83ef-4d8a-a305-98e6d0634bd6 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:18:58.400672 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4491b50f-83ef-4d8a-a305-98e6d0634bd6 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:18:58.401995 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4491b50f-83ef-4d8a-a305-98e6d0634bd6 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:18:58.402651 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4491b50f-83ef-4d8a-a305-98e6d0634bd6 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:18:58.403265 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4491b50f-83ef-4d8a-a305-98e6d0634bd6 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:18:58.599007 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-4491b50f-83ef-4d8a-a305-98e6d0634bd6 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:18:58.608553 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG dbcounter [-] [118861] Writing DB stats nova_cell1:SELECT=100 {{(pid=118861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:18:58.612837 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-4491b50f-83ef-4d8a-a305-98e6d0634bd6 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.226432 Oct 20 06:18:58.629744 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 723/1424] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:18:58 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:18:58.896331 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-018cdafc-d593-448f-b3a9-e56797217bb7 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:18:58.899601 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-018cdafc-d593-448f-b3a9-e56797217bb7 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:18:58.906628 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-018cdafc-d593-448f-b3a9-e56797217bb7 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:18:58.907301 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-018cdafc-d593-448f-b3a9-e56797217bb7 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:18:58.907904 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-018cdafc-d593-448f-b3a9-e56797217bb7 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:18:58.908801 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-018cdafc-d593-448f-b3a9-e56797217bb7 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:18:58.909427 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-018cdafc-d593-448f-b3a9-e56797217bb7 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:18:58.910007 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-018cdafc-d593-448f-b3a9-e56797217bb7 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:18:58.946705 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-018cdafc-d593-448f-b3a9-e56797217bb7 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055398 Oct 20 06:18:58.947279 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 702/1425] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:18:58 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:18:59.647653 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-5d52165f-fa3f-490d-b667-013eaa5a1f32 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:18:59.649275 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-5d52165f-fa3f-490d-b667-013eaa5a1f32 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:18:59.658186 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5d52165f-fa3f-490d-b667-013eaa5a1f32 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:18:59.658998 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5d52165f-fa3f-490d-b667-013eaa5a1f32 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:18:59.661122 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5d52165f-fa3f-490d-b667-013eaa5a1f32 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:18:59.662793 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5d52165f-fa3f-490d-b667-013eaa5a1f32 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:18:59.663425 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5d52165f-fa3f-490d-b667-013eaa5a1f32 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:18:59.666435 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5d52165f-fa3f-490d-b667-013eaa5a1f32 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:18:59.948379 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-5d52165f-fa3f-490d-b667-013eaa5a1f32 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:18:59.960150 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-5d52165f-fa3f-490d-b667-013eaa5a1f32 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.325502 Oct 20 06:18:59.960821 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-d897c303-f9a9-48af-b5b6-bcb80565d6d0 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:18:59.963302 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-d897c303-f9a9-48af-b5b6-bcb80565d6d0 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:18:59.966278 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 724/1426] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:18:59 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:18:59.995437 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-d897c303-f9a9-48af-b5b6-bcb80565d6d0 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:18:59.997200 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-d897c303-f9a9-48af-b5b6-bcb80565d6d0 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:18:59.998520 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-d897c303-f9a9-48af-b5b6-bcb80565d6d0 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:18:59.999587 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-d897c303-f9a9-48af-b5b6-bcb80565d6d0 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:19:00.000482 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-d897c303-f9a9-48af-b5b6-bcb80565d6d0 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:19:00.001132 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-d897c303-f9a9-48af-b5b6-bcb80565d6d0 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:19:00.038735 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-d897c303-f9a9-48af-b5b6-bcb80565d6d0 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.082383 Oct 20 06:19:00.039678 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 703/1427] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:18:59 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:19:00.992125 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-c6de92c0-5534-4ae8-88e0-541760947e32 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:19:00.992829 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-c6de92c0-5534-4ae8-88e0-541760947e32 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:19:00.999786 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c6de92c0-5534-4ae8-88e0-541760947e32 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:19:01.000385 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c6de92c0-5534-4ae8-88e0-541760947e32 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:19:01.000792 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c6de92c0-5534-4ae8-88e0-541760947e32 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:19:01.001517 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c6de92c0-5534-4ae8-88e0-541760947e32 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:19:01.002939 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c6de92c0-5534-4ae8-88e0-541760947e32 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:19:01.003398 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c6de92c0-5534-4ae8-88e0-541760947e32 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:19:01.051456 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-160e9372-027a-4da0-bef0-703dc392bcd2 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:19:01.061478 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-160e9372-027a-4da0-bef0-703dc392bcd2 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:19:01.076462 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-160e9372-027a-4da0-bef0-703dc392bcd2 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:19:01.077999 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-160e9372-027a-4da0-bef0-703dc392bcd2 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:19:01.079041 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-160e9372-027a-4da0-bef0-703dc392bcd2 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:19:01.082044 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-160e9372-027a-4da0-bef0-703dc392bcd2 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:19:01.082594 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-160e9372-027a-4da0-bef0-703dc392bcd2 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:19:01.083101 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-160e9372-027a-4da0-bef0-703dc392bcd2 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:19:01.136836 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-160e9372-027a-4da0-bef0-703dc392bcd2 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.082077 Oct 20 06:19:01.136836 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 704/1428] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:19:01 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:19:01.204526 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-c6de92c0-5534-4ae8-88e0-541760947e32 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:19:01.215251 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-c6de92c0-5534-4ae8-88e0-541760947e32 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.227520 Oct 20 06:19:01.216881 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 725/1429] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:19:00 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:19:02.143693 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-75c20642-bad8-4b9b-8953-c90bad7c3510 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:19:02.146142 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-75c20642-bad8-4b9b-8953-c90bad7c3510 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:19:02.156317 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-75c20642-bad8-4b9b-8953-c90bad7c3510 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:19:02.157074 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-75c20642-bad8-4b9b-8953-c90bad7c3510 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:19:02.157586 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-75c20642-bad8-4b9b-8953-c90bad7c3510 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:19:02.158520 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-75c20642-bad8-4b9b-8953-c90bad7c3510 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:19:02.158927 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-75c20642-bad8-4b9b-8953-c90bad7c3510 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:19:02.159427 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-75c20642-bad8-4b9b-8953-c90bad7c3510 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:19:02.201284 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-75c20642-bad8-4b9b-8953-c90bad7c3510 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055341 Oct 20 06:19:02.201284 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 705/1430] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:19:02 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:19:02.239163 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-3a1ca4aa-e58b-4a6d-8356-cb264763be29 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:19:02.240314 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-3a1ca4aa-e58b-4a6d-8356-cb264763be29 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:19:02.248297 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-3a1ca4aa-e58b-4a6d-8356-cb264763be29 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:19:02.249219 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-3a1ca4aa-e58b-4a6d-8356-cb264763be29 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:19:02.249908 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-3a1ca4aa-e58b-4a6d-8356-cb264763be29 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:19:02.250839 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-3a1ca4aa-e58b-4a6d-8356-cb264763be29 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:19:02.251760 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-3a1ca4aa-e58b-4a6d-8356-cb264763be29 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:19:02.253062 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-3a1ca4aa-e58b-4a6d-8356-cb264763be29 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:19:02.407656 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-3a1ca4aa-e58b-4a6d-8356-cb264763be29 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:19:02.418136 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-3a1ca4aa-e58b-4a6d-8356-cb264763be29 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.182687 Oct 20 06:19:02.419438 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 726/1431] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:19:02 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:19:03.207241 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-d3b4b379-4f60-491e-b5f7-ab73e55f9ad3 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:19:03.210085 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-d3b4b379-4f60-491e-b5f7-ab73e55f9ad3 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:19:03.218886 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-d3b4b379-4f60-491e-b5f7-ab73e55f9ad3 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:19:03.219372 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-d3b4b379-4f60-491e-b5f7-ab73e55f9ad3 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:19:03.219807 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-d3b4b379-4f60-491e-b5f7-ab73e55f9ad3 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:19:03.220505 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-d3b4b379-4f60-491e-b5f7-ab73e55f9ad3 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:19:03.220981 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-d3b4b379-4f60-491e-b5f7-ab73e55f9ad3 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:19:03.221403 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-d3b4b379-4f60-491e-b5f7-ab73e55f9ad3 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:19:03.258890 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-d3b4b379-4f60-491e-b5f7-ab73e55f9ad3 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055873 Oct 20 06:19:03.259299 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 706/1432] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:19:03 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:19:03.442325 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-b868f3ef-955f-43cc-a313-c96f233d2180 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:19:03.442941 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-b868f3ef-955f-43cc-a313-c96f233d2180 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:19:03.449998 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b868f3ef-955f-43cc-a313-c96f233d2180 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:19:03.450478 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b868f3ef-955f-43cc-a313-c96f233d2180 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:19:03.450922 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b868f3ef-955f-43cc-a313-c96f233d2180 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:19:03.451624 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b868f3ef-955f-43cc-a313-c96f233d2180 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:19:03.452079 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b868f3ef-955f-43cc-a313-c96f233d2180 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:19:03.452505 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b868f3ef-955f-43cc-a313-c96f233d2180 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:19:03.604024 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-b868f3ef-955f-43cc-a313-c96f233d2180 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:19:03.616498 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-b868f3ef-955f-43cc-a313-c96f233d2180 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.177569 Oct 20 06:19:03.617174 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 727/1433] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:19:03 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 06:19:04.271544 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-b490efff-4940-46f7-a459-85e19aac1a30 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:19:04.276800 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-b490efff-4940-46f7-a459-85e19aac1a30 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:19:04.284052 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b490efff-4940-46f7-a459-85e19aac1a30 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:19:04.284553 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b490efff-4940-46f7-a459-85e19aac1a30 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:19:04.285025 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b490efff-4940-46f7-a459-85e19aac1a30 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:19:04.285756 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b490efff-4940-46f7-a459-85e19aac1a30 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:19:04.286212 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b490efff-4940-46f7-a459-85e19aac1a30 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:19:04.286640 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b490efff-4940-46f7-a459-85e19aac1a30 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:19:04.332912 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-b490efff-4940-46f7-a459-85e19aac1a30 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.065295 Oct 20 06:19:04.337439 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 707/1434] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:19:04 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:19:04.643516 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-4b1abbfa-40b4-4baf-9c27-331a4f8b4424 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:19:04.644199 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-4b1abbfa-40b4-4baf-9c27-331a4f8b4424 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:19:04.651975 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4b1abbfa-40b4-4baf-9c27-331a4f8b4424 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:19:04.652479 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4b1abbfa-40b4-4baf-9c27-331a4f8b4424 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:19:04.652952 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4b1abbfa-40b4-4baf-9c27-331a4f8b4424 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:19:04.653676 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4b1abbfa-40b4-4baf-9c27-331a4f8b4424 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:19:04.654134 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4b1abbfa-40b4-4baf-9c27-331a4f8b4424 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:19:04.654568 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4b1abbfa-40b4-4baf-9c27-331a4f8b4424 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:19:04.791123 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-4b1abbfa-40b4-4baf-9c27-331a4f8b4424 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:19:04.803316 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-4b1abbfa-40b4-4baf-9c27-331a4f8b4424 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.163584 Oct 20 06:19:04.803900 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 728/1435] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:19:04 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:19:05.349482 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-2ed5371e-6412-42ab-a09c-21a4456bdf4f tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:19:05.352688 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-2ed5371e-6412-42ab-a09c-21a4456bdf4f tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:19:05.359891 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2ed5371e-6412-42ab-a09c-21a4456bdf4f tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:19:05.360383 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2ed5371e-6412-42ab-a09c-21a4456bdf4f tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:19:05.360890 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2ed5371e-6412-42ab-a09c-21a4456bdf4f tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:19:05.361715 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2ed5371e-6412-42ab-a09c-21a4456bdf4f tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:19:05.362069 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2ed5371e-6412-42ab-a09c-21a4456bdf4f tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:19:05.362534 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2ed5371e-6412-42ab-a09c-21a4456bdf4f tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:19:05.394476 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-2ed5371e-6412-42ab-a09c-21a4456bdf4f tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049000 Oct 20 06:19:05.395054 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 708/1436] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:19:05 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:19:05.827471 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-46fccf4c-d99b-488d-987d-b17b7fd60cd9 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:19:05.828081 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-46fccf4c-d99b-488d-987d-b17b7fd60cd9 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:19:05.834569 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-46fccf4c-d99b-488d-987d-b17b7fd60cd9 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:19:05.835050 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-46fccf4c-d99b-488d-987d-b17b7fd60cd9 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:19:05.836544 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-46fccf4c-d99b-488d-987d-b17b7fd60cd9 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:19:05.837309 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-46fccf4c-d99b-488d-987d-b17b7fd60cd9 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:19:05.837763 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-46fccf4c-d99b-488d-987d-b17b7fd60cd9 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:19:05.838190 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-46fccf4c-d99b-488d-987d-b17b7fd60cd9 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:19:05.986906 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-46fccf4c-d99b-488d-987d-b17b7fd60cd9 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:19:05.996866 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-46fccf4c-d99b-488d-987d-b17b7fd60cd9 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.173202 Oct 20 06:19:05.997553 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 729/1437] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:19:05 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:19:06.407729 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-4f724bac-cc78-40e3-b057-97d9e4365d9b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:19:06.409879 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-4f724bac-cc78-40e3-b057-97d9e4365d9b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:19:06.417265 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-4f724bac-cc78-40e3-b057-97d9e4365d9b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:19:06.418051 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-4f724bac-cc78-40e3-b057-97d9e4365d9b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:19:06.418444 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-4f724bac-cc78-40e3-b057-97d9e4365d9b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:19:06.419357 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-4f724bac-cc78-40e3-b057-97d9e4365d9b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:19:06.419820 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-4f724bac-cc78-40e3-b057-97d9e4365d9b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:19:06.420427 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-4f724bac-cc78-40e3-b057-97d9e4365d9b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:19:06.458980 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-4f724bac-cc78-40e3-b057-97d9e4365d9b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055306 Oct 20 06:19:06.459818 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 709/1438] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:19:06 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:19:07.020941 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-a771950f-91e1-4d1d-90f0-093e048d65e1 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:19:07.021690 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-a771950f-91e1-4d1d-90f0-093e048d65e1 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:19:07.029057 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a771950f-91e1-4d1d-90f0-093e048d65e1 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:19:07.029548 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a771950f-91e1-4d1d-90f0-093e048d65e1 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:19:07.029987 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a771950f-91e1-4d1d-90f0-093e048d65e1 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:19:07.030869 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a771950f-91e1-4d1d-90f0-093e048d65e1 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:19:07.031321 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a771950f-91e1-4d1d-90f0-093e048d65e1 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:19:07.031750 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a771950f-91e1-4d1d-90f0-093e048d65e1 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:19:07.167494 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-a771950f-91e1-4d1d-90f0-093e048d65e1 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:19:07.175932 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-a771950f-91e1-4d1d-90f0-093e048d65e1 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.158809 Oct 20 06:19:07.176607 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 730/1439] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:19:07 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:19:07.471573 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-52993a8c-ee66-420b-b5a3-a6e94bbf5d23 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:19:07.473667 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-52993a8c-ee66-420b-b5a3-a6e94bbf5d23 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:19:07.475544 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG dbcounter [-] [118860] Writing DB stats nova_cell0:SELECT=4 {{(pid=118860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:19:07.482258 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-52993a8c-ee66-420b-b5a3-a6e94bbf5d23 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:19:07.482793 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-52993a8c-ee66-420b-b5a3-a6e94bbf5d23 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:19:07.483239 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-52993a8c-ee66-420b-b5a3-a6e94bbf5d23 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:19:07.483927 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-52993a8c-ee66-420b-b5a3-a6e94bbf5d23 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:19:07.484382 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-52993a8c-ee66-420b-b5a3-a6e94bbf5d23 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:19:07.484906 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-52993a8c-ee66-420b-b5a3-a6e94bbf5d23 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:19:07.519026 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-52993a8c-ee66-420b-b5a3-a6e94bbf5d23 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051425 Oct 20 06:19:07.519966 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 710/1440] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:19:07 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:19:08.200541 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-9ed2a0ad-1f1d-4e75-b97d-ff9143542d1f tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:19:08.201268 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-9ed2a0ad-1f1d-4e75-b97d-ff9143542d1f tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:19:08.208242 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-9ed2a0ad-1f1d-4e75-b97d-ff9143542d1f tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:19:08.208781 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-9ed2a0ad-1f1d-4e75-b97d-ff9143542d1f tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:19:08.209225 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-9ed2a0ad-1f1d-4e75-b97d-ff9143542d1f tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:19:08.210003 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-9ed2a0ad-1f1d-4e75-b97d-ff9143542d1f tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:19:08.210508 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-9ed2a0ad-1f1d-4e75-b97d-ff9143542d1f tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:19:08.211261 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-9ed2a0ad-1f1d-4e75-b97d-ff9143542d1f tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:19:08.386259 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-9ed2a0ad-1f1d-4e75-b97d-ff9143542d1f tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:19:08.397969 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-9ed2a0ad-1f1d-4e75-b97d-ff9143542d1f tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.201337 Oct 20 06:19:08.400727 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 731/1441] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:19:08 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:19:08.532473 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-024c7e16-4ac4-4020-aa40-dacd8f5b46ad tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:19:08.535790 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-024c7e16-4ac4-4020-aa40-dacd8f5b46ad tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:19:08.545823 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-024c7e16-4ac4-4020-aa40-dacd8f5b46ad tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:19:08.546319 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-024c7e16-4ac4-4020-aa40-dacd8f5b46ad tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:19:08.546765 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-024c7e16-4ac4-4020-aa40-dacd8f5b46ad tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:19:08.547508 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-024c7e16-4ac4-4020-aa40-dacd8f5b46ad tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:19:08.548256 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-024c7e16-4ac4-4020-aa40-dacd8f5b46ad tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:19:08.548590 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-024c7e16-4ac4-4020-aa40-dacd8f5b46ad tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:19:08.588637 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-024c7e16-4ac4-4020-aa40-dacd8f5b46ad tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060559 Oct 20 06:19:08.589261 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 711/1442] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:19:08 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:19:09.428132 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-efb8ddf8-5793-4c76-adad-9f1f36eb99e3 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:19:09.428787 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-efb8ddf8-5793-4c76-adad-9f1f36eb99e3 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:19:09.436965 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-efb8ddf8-5793-4c76-adad-9f1f36eb99e3 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:19:09.437458 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-efb8ddf8-5793-4c76-adad-9f1f36eb99e3 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:19:09.437897 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-efb8ddf8-5793-4c76-adad-9f1f36eb99e3 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:19:09.438620 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-efb8ddf8-5793-4c76-adad-9f1f36eb99e3 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:19:09.440735 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-efb8ddf8-5793-4c76-adad-9f1f36eb99e3 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:19:09.440735 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-efb8ddf8-5793-4c76-adad-9f1f36eb99e3 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:19:09.586232 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-efb8ddf8-5793-4c76-adad-9f1f36eb99e3 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:19:09.595858 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-efb8ddf8-5793-4c76-adad-9f1f36eb99e3 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.171457 Oct 20 06:19:09.598294 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 732/1443] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:19:09 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:19:09.602267 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-43399718-56bc-4348-80fa-2b19b43d2b87 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:19:09.604964 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-43399718-56bc-4348-80fa-2b19b43d2b87 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:19:09.611548 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-43399718-56bc-4348-80fa-2b19b43d2b87 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:19:09.612026 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-43399718-56bc-4348-80fa-2b19b43d2b87 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:19:09.612458 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-43399718-56bc-4348-80fa-2b19b43d2b87 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:19:09.613190 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-43399718-56bc-4348-80fa-2b19b43d2b87 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:19:09.613817 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-43399718-56bc-4348-80fa-2b19b43d2b87 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:19:09.614236 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-43399718-56bc-4348-80fa-2b19b43d2b87 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:19:09.646466 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG dbcounter [-] [118860] Writing DB stats nova_cell1:SELECT=100 {{(pid=118860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:19:09.654298 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-43399718-56bc-4348-80fa-2b19b43d2b87 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057605 Oct 20 06:19:09.655142 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 712/1444] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:19:09 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 20 06:19:10.621803 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-404965dc-a94d-49ac-93cd-44d6610f18e7 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:19:10.622336 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-404965dc-a94d-49ac-93cd-44d6610f18e7 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:19:10.630097 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-404965dc-a94d-49ac-93cd-44d6610f18e7 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:19:10.630580 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-404965dc-a94d-49ac-93cd-44d6610f18e7 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:19:10.631014 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-404965dc-a94d-49ac-93cd-44d6610f18e7 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:19:10.631707 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-404965dc-a94d-49ac-93cd-44d6610f18e7 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:19:10.632729 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-404965dc-a94d-49ac-93cd-44d6610f18e7 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:19:10.633558 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-404965dc-a94d-49ac-93cd-44d6610f18e7 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:19:10.668239 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-c33ea176-19ca-4da6-9246-2c3932a42b7e tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:19:10.671218 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-c33ea176-19ca-4da6-9246-2c3932a42b7e tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:19:10.678520 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c33ea176-19ca-4da6-9246-2c3932a42b7e tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:19:10.679552 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c33ea176-19ca-4da6-9246-2c3932a42b7e tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:19:10.680211 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c33ea176-19ca-4da6-9246-2c3932a42b7e tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:19:10.680964 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c33ea176-19ca-4da6-9246-2c3932a42b7e tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:19:10.681443 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c33ea176-19ca-4da6-9246-2c3932a42b7e tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:19:10.682005 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c33ea176-19ca-4da6-9246-2c3932a42b7e tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:19:10.718580 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-c33ea176-19ca-4da6-9246-2c3932a42b7e tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055519 Oct 20 06:19:10.720242 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 713/1445] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:19:10 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 20 06:19:10.792105 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-404965dc-a94d-49ac-93cd-44d6610f18e7 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:19:10.800769 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-404965dc-a94d-49ac-93cd-44d6610f18e7 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.183198 Oct 20 06:19:10.801304 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 733/1446] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:19:10 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:19:11.731488 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-bb7d3838-c396-42e1-a691-906580f8e748 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:19:11.733640 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-bb7d3838-c396-42e1-a691-906580f8e748 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:19:11.740064 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-bb7d3838-c396-42e1-a691-906580f8e748 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:19:11.740547 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-bb7d3838-c396-42e1-a691-906580f8e748 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:19:11.741016 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-bb7d3838-c396-42e1-a691-906580f8e748 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:19:11.741717 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-bb7d3838-c396-42e1-a691-906580f8e748 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:19:11.742170 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-bb7d3838-c396-42e1-a691-906580f8e748 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:19:11.742596 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-bb7d3838-c396-42e1-a691-906580f8e748 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:19:11.773602 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-bb7d3838-c396-42e1-a691-906580f8e748 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045347 Oct 20 06:19:11.774407 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 714/1447] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:19:11 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:19:11.824530 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-60525740-ad42-44a6-8003-428d98c79774 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:19:11.825220 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-60525740-ad42-44a6-8003-428d98c79774 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:19:11.832727 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-60525740-ad42-44a6-8003-428d98c79774 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:19:11.833471 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-60525740-ad42-44a6-8003-428d98c79774 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:19:11.834077 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-60525740-ad42-44a6-8003-428d98c79774 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:19:11.834789 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-60525740-ad42-44a6-8003-428d98c79774 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:19:11.835766 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-60525740-ad42-44a6-8003-428d98c79774 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:19:11.836404 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-60525740-ad42-44a6-8003-428d98c79774 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:19:11.973719 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-60525740-ad42-44a6-8003-428d98c79774 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:19:11.982827 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-60525740-ad42-44a6-8003-428d98c79774 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.162164 Oct 20 06:19:11.983587 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 734/1448] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:19:11 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:19:12.786340 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-7b188a38-ffbe-4329-97cf-bfe8d9840367 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:19:12.789281 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-7b188a38-ffbe-4329-97cf-bfe8d9840367 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:19:12.795811 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7b188a38-ffbe-4329-97cf-bfe8d9840367 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:19:12.796375 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7b188a38-ffbe-4329-97cf-bfe8d9840367 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:19:12.796929 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7b188a38-ffbe-4329-97cf-bfe8d9840367 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:19:12.797697 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7b188a38-ffbe-4329-97cf-bfe8d9840367 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:19:12.798161 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7b188a38-ffbe-4329-97cf-bfe8d9840367 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:19:12.798585 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7b188a38-ffbe-4329-97cf-bfe8d9840367 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:19:12.828349 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-7b188a38-ffbe-4329-97cf-bfe8d9840367 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045879 Oct 20 06:19:12.829119 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 715/1449] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:19:12 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:19:13.006526 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-320105dc-5951-473a-af6e-d12e1b05f914 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:19:13.008322 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-320105dc-5951-473a-af6e-d12e1b05f914 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:19:13.014983 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-320105dc-5951-473a-af6e-d12e1b05f914 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:19:13.015716 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-320105dc-5951-473a-af6e-d12e1b05f914 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:19:13.016423 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-320105dc-5951-473a-af6e-d12e1b05f914 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:19:13.017247 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-320105dc-5951-473a-af6e-d12e1b05f914 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:19:13.017794 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-320105dc-5951-473a-af6e-d12e1b05f914 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:19:13.018439 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-320105dc-5951-473a-af6e-d12e1b05f914 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:19:13.148204 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-320105dc-5951-473a-af6e-d12e1b05f914 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:19:13.156575 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-320105dc-5951-473a-af6e-d12e1b05f914 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.154217 Oct 20 06:19:13.157392 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 735/1450] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:19:13 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:19:13.842116 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-013a68d7-4cbe-4a23-a947-e6b8f4eaee4e tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:19:13.844262 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-013a68d7-4cbe-4a23-a947-e6b8f4eaee4e tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:19:13.850141 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-013a68d7-4cbe-4a23-a947-e6b8f4eaee4e tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:19:13.850626 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-013a68d7-4cbe-4a23-a947-e6b8f4eaee4e tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:19:13.851095 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-013a68d7-4cbe-4a23-a947-e6b8f4eaee4e tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:19:13.851781 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-013a68d7-4cbe-4a23-a947-e6b8f4eaee4e tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:19:13.852225 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-013a68d7-4cbe-4a23-a947-e6b8f4eaee4e tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:19:13.852648 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-013a68d7-4cbe-4a23-a947-e6b8f4eaee4e tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:19:13.881702 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-013a68d7-4cbe-4a23-a947-e6b8f4eaee4e tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044102 Oct 20 06:19:13.883300 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 716/1451] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:19:13 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:19:14.180425 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-8119e3d4-3e95-445c-b274-032eb0833ba6 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:19:14.181084 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-8119e3d4-3e95-445c-b274-032eb0833ba6 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:19:14.187493 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-8119e3d4-3e95-445c-b274-032eb0833ba6 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:19:14.187965 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-8119e3d4-3e95-445c-b274-032eb0833ba6 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:19:14.188392 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-8119e3d4-3e95-445c-b274-032eb0833ba6 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:19:14.189101 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-8119e3d4-3e95-445c-b274-032eb0833ba6 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:19:14.189542 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-8119e3d4-3e95-445c-b274-032eb0833ba6 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:19:14.189961 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-8119e3d4-3e95-445c-b274-032eb0833ba6 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:19:14.325555 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-8119e3d4-3e95-445c-b274-032eb0833ba6 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:19:14.333823 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-8119e3d4-3e95-445c-b274-032eb0833ba6 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.157492 Oct 20 06:19:14.334474 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 736/1452] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:19:14 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:19:14.897387 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-182aa3e7-1b59-4f45-ae9f-52f140ceffe1 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:19:14.897387 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-182aa3e7-1b59-4f45-ae9f-52f140ceffe1 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:19:14.903604 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-182aa3e7-1b59-4f45-ae9f-52f140ceffe1 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:19:14.904080 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-182aa3e7-1b59-4f45-ae9f-52f140ceffe1 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:19:14.904510 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-182aa3e7-1b59-4f45-ae9f-52f140ceffe1 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:19:14.905219 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-182aa3e7-1b59-4f45-ae9f-52f140ceffe1 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:19:14.905665 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-182aa3e7-1b59-4f45-ae9f-52f140ceffe1 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:19:14.906084 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-182aa3e7-1b59-4f45-ae9f-52f140ceffe1 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:19:14.935397 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-182aa3e7-1b59-4f45-ae9f-52f140ceffe1 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044571 Oct 20 06:19:14.940107 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 717/1453] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:19:14 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:19:15.357994 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-06e7f56e-ceba-4d15-8f2a-99a86b44b788 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:19:15.358596 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-06e7f56e-ceba-4d15-8f2a-99a86b44b788 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:19:15.365033 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-06e7f56e-ceba-4d15-8f2a-99a86b44b788 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:19:15.365503 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-06e7f56e-ceba-4d15-8f2a-99a86b44b788 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:19:15.365927 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-06e7f56e-ceba-4d15-8f2a-99a86b44b788 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:19:15.367240 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-06e7f56e-ceba-4d15-8f2a-99a86b44b788 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:19:15.367689 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-06e7f56e-ceba-4d15-8f2a-99a86b44b788 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:19:15.368102 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-06e7f56e-ceba-4d15-8f2a-99a86b44b788 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:19:15.497272 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-06e7f56e-ceba-4d15-8f2a-99a86b44b788 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:19:15.505682 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-06e7f56e-ceba-4d15-8f2a-99a86b44b788 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.151607 Oct 20 06:19:15.506245 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 737/1454] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:19:15 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:19:15.952929 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-27978588-1da7-4037-84ff-27701a6a4770 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:19:15.952929 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-27978588-1da7-4037-84ff-27701a6a4770 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:19:15.957036 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-27978588-1da7-4037-84ff-27701a6a4770 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:19:15.957894 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-27978588-1da7-4037-84ff-27701a6a4770 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:19:15.958384 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-27978588-1da7-4037-84ff-27701a6a4770 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:19:15.959179 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-27978588-1da7-4037-84ff-27701a6a4770 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:19:15.959703 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-27978588-1da7-4037-84ff-27701a6a4770 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:19:15.960347 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-27978588-1da7-4037-84ff-27701a6a4770 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:19:15.990466 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-27978588-1da7-4037-84ff-27701a6a4770 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046875 Oct 20 06:19:15.991192 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 718/1455] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:19:15 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:19:16.542651 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-f58e614f-a4f9-4621-8a2a-c8683f82b457 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:19:16.543199 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-f58e614f-a4f9-4621-8a2a-c8683f82b457 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:19:16.549855 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f58e614f-a4f9-4621-8a2a-c8683f82b457 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:19:16.550340 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f58e614f-a4f9-4621-8a2a-c8683f82b457 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:19:16.550780 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f58e614f-a4f9-4621-8a2a-c8683f82b457 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:19:16.551485 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f58e614f-a4f9-4621-8a2a-c8683f82b457 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:19:16.551941 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f58e614f-a4f9-4621-8a2a-c8683f82b457 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:19:16.552401 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f58e614f-a4f9-4621-8a2a-c8683f82b457 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:19:16.679979 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-f58e614f-a4f9-4621-8a2a-c8683f82b457 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:19:16.688171 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-f58e614f-a4f9-4621-8a2a-c8683f82b457 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.162609 Oct 20 06:19:16.688768 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 738/1456] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:19:16 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:19:17.004361 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-753ccb35-8d9f-4788-a987-ea066de058d7 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:19:17.007946 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-753ccb35-8d9f-4788-a987-ea066de058d7 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:19:17.014621 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-753ccb35-8d9f-4788-a987-ea066de058d7 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:19:17.015109 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-753ccb35-8d9f-4788-a987-ea066de058d7 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:19:17.015547 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-753ccb35-8d9f-4788-a987-ea066de058d7 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:19:17.016250 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-753ccb35-8d9f-4788-a987-ea066de058d7 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:19:17.016742 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-753ccb35-8d9f-4788-a987-ea066de058d7 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:19:17.017173 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-753ccb35-8d9f-4788-a987-ea066de058d7 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:19:17.047963 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-753ccb35-8d9f-4788-a987-ea066de058d7 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047812 Oct 20 06:19:17.048917 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 719/1457] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:19:16 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:19:17.713427 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-1fd32afc-ef06-4412-ac13-6a4d82bcd71a tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:19:17.714042 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-1fd32afc-ef06-4412-ac13-6a4d82bcd71a tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:19:17.720550 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1fd32afc-ef06-4412-ac13-6a4d82bcd71a tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:19:17.721060 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1fd32afc-ef06-4412-ac13-6a4d82bcd71a tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:19:17.721500 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1fd32afc-ef06-4412-ac13-6a4d82bcd71a tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:19:17.722192 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1fd32afc-ef06-4412-ac13-6a4d82bcd71a tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:19:17.722642 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1fd32afc-ef06-4412-ac13-6a4d82bcd71a tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:19:17.723070 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1fd32afc-ef06-4412-ac13-6a4d82bcd71a tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:19:17.877180 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-1fd32afc-ef06-4412-ac13-6a4d82bcd71a tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:19:17.880689 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-1fd32afc-ef06-4412-ac13-6a4d82bcd71a tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.171835 Oct 20 06:19:17.881461 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 739/1458] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:19:17 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:19:18.060164 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-bf2ef269-549d-497e-8545-ae2fb9ad0ef9 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:19:18.073439 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-bf2ef269-549d-497e-8545-ae2fb9ad0ef9 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:19:18.073439 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-bf2ef269-549d-497e-8545-ae2fb9ad0ef9 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:19:18.073439 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-bf2ef269-549d-497e-8545-ae2fb9ad0ef9 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:19:18.073439 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-bf2ef269-549d-497e-8545-ae2fb9ad0ef9 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:19:18.073832 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-bf2ef269-549d-497e-8545-ae2fb9ad0ef9 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:19:18.073832 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-bf2ef269-549d-497e-8545-ae2fb9ad0ef9 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:19:18.073832 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-bf2ef269-549d-497e-8545-ae2fb9ad0ef9 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:19:18.104389 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-bf2ef269-549d-497e-8545-ae2fb9ad0ef9 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048069 Oct 20 06:19:18.105165 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 720/1459] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:19:18 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:19:18.904111 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-aa5ee036-7fd0-4c58-945a-616826276b33 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:19:18.904891 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-aa5ee036-7fd0-4c58-945a-616826276b33 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:19:18.911448 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-aa5ee036-7fd0-4c58-945a-616826276b33 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:19:18.912161 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-aa5ee036-7fd0-4c58-945a-616826276b33 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:19:18.912598 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-aa5ee036-7fd0-4c58-945a-616826276b33 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:19:18.914011 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-aa5ee036-7fd0-4c58-945a-616826276b33 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:19:18.914572 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-aa5ee036-7fd0-4c58-945a-616826276b33 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:19:18.914998 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-aa5ee036-7fd0-4c58-945a-616826276b33 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:19:18.930793 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG dbcounter [-] [118861] Writing DB stats nova_cell1:SELECT=100 {{(pid=118861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:19:19.051107 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-aa5ee036-7fd0-4c58-945a-616826276b33 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:19:19.059392 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-aa5ee036-7fd0-4c58-945a-616826276b33 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.159187 Oct 20 06:19:19.059955 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 740/1460] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:19:18 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:19:19.116239 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-0d7a5017-d127-4a18-92e5-29a2c1b41d8d tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:19:19.118824 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-0d7a5017-d127-4a18-92e5-29a2c1b41d8d tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:19:19.126588 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0d7a5017-d127-4a18-92e5-29a2c1b41d8d tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:19:19.127179 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0d7a5017-d127-4a18-92e5-29a2c1b41d8d tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:19:19.127721 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0d7a5017-d127-4a18-92e5-29a2c1b41d8d tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:19:19.128525 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0d7a5017-d127-4a18-92e5-29a2c1b41d8d tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:19:19.129130 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0d7a5017-d127-4a18-92e5-29a2c1b41d8d tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:19:19.129647 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0d7a5017-d127-4a18-92e5-29a2c1b41d8d tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:19:19.164088 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-0d7a5017-d127-4a18-92e5-29a2c1b41d8d tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051543 Oct 20 06:19:19.164851 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 721/1461] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:19:19 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:19:20.084003 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-ba87be2e-bfc6-4a4a-8a28-c55ba32bdc67 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:19:20.084599 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-ba87be2e-bfc6-4a4a-8a28-c55ba32bdc67 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:19:20.091330 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ba87be2e-bfc6-4a4a-8a28-c55ba32bdc67 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:19:20.091812 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ba87be2e-bfc6-4a4a-8a28-c55ba32bdc67 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:19:20.092244 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ba87be2e-bfc6-4a4a-8a28-c55ba32bdc67 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:19:20.092981 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ba87be2e-bfc6-4a4a-8a28-c55ba32bdc67 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:19:20.093427 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ba87be2e-bfc6-4a4a-8a28-c55ba32bdc67 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:19:20.093844 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ba87be2e-bfc6-4a4a-8a28-c55ba32bdc67 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:19:20.176543 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-4424281a-bd9b-43f9-902e-a2afed97efc9 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:19:20.178679 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-4424281a-bd9b-43f9-902e-a2afed97efc9 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:19:20.200062 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-4424281a-bd9b-43f9-902e-a2afed97efc9 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:19:20.200559 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-4424281a-bd9b-43f9-902e-a2afed97efc9 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:19:20.201023 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-4424281a-bd9b-43f9-902e-a2afed97efc9 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:19:20.201724 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-4424281a-bd9b-43f9-902e-a2afed97efc9 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:19:20.202182 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-4424281a-bd9b-43f9-902e-a2afed97efc9 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:19:20.202605 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-4424281a-bd9b-43f9-902e-a2afed97efc9 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:19:20.252203 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-4424281a-bd9b-43f9-902e-a2afed97efc9 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.079462 Oct 20 06:19:20.253113 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 722/1462] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:19:20 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 20 06:19:20.267772 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-ba87be2e-bfc6-4a4a-8a28-c55ba32bdc67 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:19:20.276180 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-ba87be2e-bfc6-4a4a-8a28-c55ba32bdc67 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.196193 Oct 20 06:19:20.276806 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 741/1463] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:19:20 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:19:21.265709 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-38a7d1a4-862f-4565-bb19-38b4c016426c tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:19:21.267865 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-38a7d1a4-862f-4565-bb19-38b4c016426c tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:19:21.274710 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-38a7d1a4-862f-4565-bb19-38b4c016426c tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:19:21.275198 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-38a7d1a4-862f-4565-bb19-38b4c016426c tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:19:21.275642 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-38a7d1a4-862f-4565-bb19-38b4c016426c tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:19:21.276381 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-38a7d1a4-862f-4565-bb19-38b4c016426c tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:19:21.276829 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-38a7d1a4-862f-4565-bb19-38b4c016426c tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:19:21.277257 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-38a7d1a4-862f-4565-bb19-38b4c016426c tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:19:21.301018 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-ca280b06-bf58-4440-870c-5635a2d02307 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:19:21.301693 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-ca280b06-bf58-4440-870c-5635a2d02307 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:19:21.309998 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-38a7d1a4-862f-4565-bb19-38b4c016426c tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048102 Oct 20 06:19:21.311082 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 723/1464] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:19:21 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:19:21.315913 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ca280b06-bf58-4440-870c-5635a2d02307 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:19:21.316404 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ca280b06-bf58-4440-870c-5635a2d02307 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:19:21.316878 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ca280b06-bf58-4440-870c-5635a2d02307 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:19:21.317583 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ca280b06-bf58-4440-870c-5635a2d02307 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:19:21.318202 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ca280b06-bf58-4440-870c-5635a2d02307 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:19:21.318938 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ca280b06-bf58-4440-870c-5635a2d02307 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:19:21.457897 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-ca280b06-bf58-4440-870c-5635a2d02307 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:19:21.467501 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-ca280b06-bf58-4440-870c-5635a2d02307 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.171242 Oct 20 06:19:21.468088 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 742/1465] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:19:21 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 06:19:22.323344 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-d983ac88-c4af-4594-9d1b-03d5bd192525 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:19:22.326176 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-d983ac88-c4af-4594-9d1b-03d5bd192525 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:19:22.332758 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-d983ac88-c4af-4594-9d1b-03d5bd192525 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:19:22.333370 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-d983ac88-c4af-4594-9d1b-03d5bd192525 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:19:22.333870 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-d983ac88-c4af-4594-9d1b-03d5bd192525 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:19:22.334635 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-d983ac88-c4af-4594-9d1b-03d5bd192525 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:19:22.335335 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-d983ac88-c4af-4594-9d1b-03d5bd192525 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:19:22.335979 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-d983ac88-c4af-4594-9d1b-03d5bd192525 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:19:22.366825 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-d983ac88-c4af-4594-9d1b-03d5bd192525 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047680 Oct 20 06:19:22.367621 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 724/1466] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:19:22 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:19:22.490722 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-ac752fef-ed93-4bcf-8e14-1267155289b0 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:19:22.491532 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-ac752fef-ed93-4bcf-8e14-1267155289b0 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:19:22.498029 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ac752fef-ed93-4bcf-8e14-1267155289b0 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:19:22.498508 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ac752fef-ed93-4bcf-8e14-1267155289b0 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:19:22.499149 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ac752fef-ed93-4bcf-8e14-1267155289b0 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:19:22.499848 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ac752fef-ed93-4bcf-8e14-1267155289b0 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:19:22.500297 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ac752fef-ed93-4bcf-8e14-1267155289b0 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:19:22.500745 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ac752fef-ed93-4bcf-8e14-1267155289b0 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:19:22.630413 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-ac752fef-ed93-4bcf-8e14-1267155289b0 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:19:22.638803 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-ac752fef-ed93-4bcf-8e14-1267155289b0 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.151968 Oct 20 06:19:22.639378 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 743/1467] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:19:22 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:19:23.379189 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-700f3e5a-b2b9-41b0-aeba-df45bec29101 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:19:23.382852 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-700f3e5a-b2b9-41b0-aeba-df45bec29101 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:19:23.389200 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-700f3e5a-b2b9-41b0-aeba-df45bec29101 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:19:23.389795 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-700f3e5a-b2b9-41b0-aeba-df45bec29101 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:19:23.390339 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-700f3e5a-b2b9-41b0-aeba-df45bec29101 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:19:23.391189 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-700f3e5a-b2b9-41b0-aeba-df45bec29101 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:19:23.391775 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-700f3e5a-b2b9-41b0-aeba-df45bec29101 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:19:23.392307 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-700f3e5a-b2b9-41b0-aeba-df45bec29101 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:19:23.424666 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-700f3e5a-b2b9-41b0-aeba-df45bec29101 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049494 Oct 20 06:19:23.425557 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 725/1468] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:19:23 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:19:23.662332 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-eee6b88b-acd0-4a6f-a9bf-1e00a882bdcf tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:19:23.663070 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-eee6b88b-acd0-4a6f-a9bf-1e00a882bdcf tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:19:23.665542 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG dbcounter [-] [118861] Writing DB stats nova_api:SELECT=54 {{(pid=118861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:19:23.670809 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-eee6b88b-acd0-4a6f-a9bf-1e00a882bdcf tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:19:23.671370 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-eee6b88b-acd0-4a6f-a9bf-1e00a882bdcf tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:19:23.671801 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-eee6b88b-acd0-4a6f-a9bf-1e00a882bdcf tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:19:23.672493 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-eee6b88b-acd0-4a6f-a9bf-1e00a882bdcf tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:19:23.672962 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-eee6b88b-acd0-4a6f-a9bf-1e00a882bdcf tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:19:23.673403 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-eee6b88b-acd0-4a6f-a9bf-1e00a882bdcf tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:19:23.808773 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-eee6b88b-acd0-4a6f-a9bf-1e00a882bdcf tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:19:23.816998 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-eee6b88b-acd0-4a6f-a9bf-1e00a882bdcf tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.158515 Oct 20 06:19:23.817556 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 744/1469] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:19:23 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:19:24.437595 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-0bdd88b8-67a8-46f9-a4da-ad080be64277 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:19:24.439761 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-0bdd88b8-67a8-46f9-a4da-ad080be64277 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:19:24.442120 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG dbcounter [-] [118860] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=1 {{(pid=118860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:19:24.448131 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0bdd88b8-67a8-46f9-a4da-ad080be64277 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:19:24.448626 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0bdd88b8-67a8-46f9-a4da-ad080be64277 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:19:24.449096 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0bdd88b8-67a8-46f9-a4da-ad080be64277 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:19:24.449802 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0bdd88b8-67a8-46f9-a4da-ad080be64277 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:19:24.450263 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0bdd88b8-67a8-46f9-a4da-ad080be64277 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:19:24.450693 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0bdd88b8-67a8-46f9-a4da-ad080be64277 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:19:24.482892 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-0bdd88b8-67a8-46f9-a4da-ad080be64277 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049162 Oct 20 06:19:24.483669 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 726/1470] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:19:24 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:19:24.839647 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-5071b9de-e154-4785-98a4-ef9e945945d5 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:19:24.840194 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-5071b9de-e154-4785-98a4-ef9e945945d5 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:19:24.846521 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5071b9de-e154-4785-98a4-ef9e945945d5 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:19:24.846991 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5071b9de-e154-4785-98a4-ef9e945945d5 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:19:24.847420 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5071b9de-e154-4785-98a4-ef9e945945d5 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:19:24.848109 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5071b9de-e154-4785-98a4-ef9e945945d5 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:19:24.848553 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5071b9de-e154-4785-98a4-ef9e945945d5 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:19:24.848994 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5071b9de-e154-4785-98a4-ef9e945945d5 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:19:24.979994 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-5071b9de-e154-4785-98a4-ef9e945945d5 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:19:24.988264 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-5071b9de-e154-4785-98a4-ef9e945945d5 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.152643 Oct 20 06:19:24.988880 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 745/1471] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:19:24 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:19:25.495497 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-57d1b958-288e-4583-9da4-29661455b5b9 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:19:25.497966 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-57d1b958-288e-4583-9da4-29661455b5b9 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:19:25.504588 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-57d1b958-288e-4583-9da4-29661455b5b9 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:19:25.505371 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-57d1b958-288e-4583-9da4-29661455b5b9 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:19:25.505817 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-57d1b958-288e-4583-9da4-29661455b5b9 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:19:25.506653 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-57d1b958-288e-4583-9da4-29661455b5b9 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:19:25.507218 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-57d1b958-288e-4583-9da4-29661455b5b9 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:19:25.507736 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-57d1b958-288e-4583-9da4-29661455b5b9 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:19:25.539601 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-57d1b958-288e-4583-9da4-29661455b5b9 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048306 Oct 20 06:19:25.540448 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 727/1472] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:19:25 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 20 06:19:26.012758 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-5f39d685-fbe7-4a77-ad34-482b855bf4de tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:19:26.013367 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-5f39d685-fbe7-4a77-ad34-482b855bf4de tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:19:26.019657 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5f39d685-fbe7-4a77-ad34-482b855bf4de tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:19:26.020199 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5f39d685-fbe7-4a77-ad34-482b855bf4de tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:19:26.020636 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5f39d685-fbe7-4a77-ad34-482b855bf4de tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:19:26.021351 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5f39d685-fbe7-4a77-ad34-482b855bf4de tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:19:26.021793 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5f39d685-fbe7-4a77-ad34-482b855bf4de tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:19:26.022212 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5f39d685-fbe7-4a77-ad34-482b855bf4de tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:19:26.153539 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-5f39d685-fbe7-4a77-ad34-482b855bf4de tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:19:26.161728 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-5f39d685-fbe7-4a77-ad34-482b855bf4de tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.152879 Oct 20 06:19:26.162293 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 746/1473] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:19:26 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:19:26.551397 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-b05e182d-8702-47b7-bd7e-513815d19e9b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:19:26.553678 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-b05e182d-8702-47b7-bd7e-513815d19e9b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:19:26.559728 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b05e182d-8702-47b7-bd7e-513815d19e9b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:19:26.560211 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b05e182d-8702-47b7-bd7e-513815d19e9b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:19:26.560647 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b05e182d-8702-47b7-bd7e-513815d19e9b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:19:26.561393 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b05e182d-8702-47b7-bd7e-513815d19e9b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:19:26.561866 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b05e182d-8702-47b7-bd7e-513815d19e9b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:19:26.562378 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b05e182d-8702-47b7-bd7e-513815d19e9b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:19:26.595168 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-b05e182d-8702-47b7-bd7e-513815d19e9b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047714 Oct 20 06:19:26.596277 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 728/1474] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:19:26 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:19:27.186321 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-9d3abfad-9922-4840-8bad-000f2a86358f tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:19:27.186961 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-9d3abfad-9922-4840-8bad-000f2a86358f tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:19:27.193029 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-9d3abfad-9922-4840-8bad-000f2a86358f tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:19:27.193518 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-9d3abfad-9922-4840-8bad-000f2a86358f tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:19:27.193950 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-9d3abfad-9922-4840-8bad-000f2a86358f tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:19:27.195150 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-9d3abfad-9922-4840-8bad-000f2a86358f tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:19:27.195599 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-9d3abfad-9922-4840-8bad-000f2a86358f tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:19:27.196027 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-9d3abfad-9922-4840-8bad-000f2a86358f tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:19:27.349070 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-9d3abfad-9922-4840-8bad-000f2a86358f tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:19:27.359417 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-9d3abfad-9922-4840-8bad-000f2a86358f tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.176940 Oct 20 06:19:27.376107 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 747/1475] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:19:27 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:19:27.608905 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-308364e2-795d-4907-a3a2-5af4117d03c6 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:19:27.610166 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-308364e2-795d-4907-a3a2-5af4117d03c6 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:19:27.616860 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-308364e2-795d-4907-a3a2-5af4117d03c6 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:19:27.617348 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-308364e2-795d-4907-a3a2-5af4117d03c6 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:19:27.617783 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-308364e2-795d-4907-a3a2-5af4117d03c6 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:19:27.618490 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-308364e2-795d-4907-a3a2-5af4117d03c6 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:19:27.618935 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-308364e2-795d-4907-a3a2-5af4117d03c6 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:19:27.619574 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-308364e2-795d-4907-a3a2-5af4117d03c6 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:19:27.636781 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG dbcounter [-] [118860] Writing DB stats nova_cell1:SELECT=100 {{(pid=118860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:19:27.661327 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-308364e2-795d-4907-a3a2-5af4117d03c6 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051066 Oct 20 06:19:27.661327 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 729/1476] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:19:27 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:19:28.384268 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-a374d1ce-641a-45db-b008-9970bdfe7f18 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:19:28.384922 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-a374d1ce-641a-45db-b008-9970bdfe7f18 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:19:28.391709 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a374d1ce-641a-45db-b008-9970bdfe7f18 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:19:28.392020 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a374d1ce-641a-45db-b008-9970bdfe7f18 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:19:28.392435 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a374d1ce-641a-45db-b008-9970bdfe7f18 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:19:28.393143 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a374d1ce-641a-45db-b008-9970bdfe7f18 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:19:28.393598 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a374d1ce-641a-45db-b008-9970bdfe7f18 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:19:28.394023 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a374d1ce-641a-45db-b008-9970bdfe7f18 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:19:28.533795 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-a374d1ce-641a-45db-b008-9970bdfe7f18 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:19:28.542438 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-a374d1ce-641a-45db-b008-9970bdfe7f18 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.163013 Oct 20 06:19:28.543322 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 748/1477] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:19:28 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:19:28.668715 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-6cfb5f8f-0e95-45e2-832a-b2a37fe7a5b7 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:19:28.670869 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-6cfb5f8f-0e95-45e2-832a-b2a37fe7a5b7 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:19:28.677515 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-6cfb5f8f-0e95-45e2-832a-b2a37fe7a5b7 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:19:28.678002 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-6cfb5f8f-0e95-45e2-832a-b2a37fe7a5b7 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:19:28.678439 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-6cfb5f8f-0e95-45e2-832a-b2a37fe7a5b7 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:19:28.679175 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-6cfb5f8f-0e95-45e2-832a-b2a37fe7a5b7 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:19:28.679778 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-6cfb5f8f-0e95-45e2-832a-b2a37fe7a5b7 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:19:28.680208 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-6cfb5f8f-0e95-45e2-832a-b2a37fe7a5b7 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:19:28.721338 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-6cfb5f8f-0e95-45e2-832a-b2a37fe7a5b7 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048850 Oct 20 06:19:28.721338 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 730/1478] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:19:28 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:19:29.566468 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-7a5a9148-3f6a-4075-b8b0-2bac54f83518 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:19:29.567083 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-7a5a9148-3f6a-4075-b8b0-2bac54f83518 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:19:29.573652 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7a5a9148-3f6a-4075-b8b0-2bac54f83518 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:19:29.574137 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7a5a9148-3f6a-4075-b8b0-2bac54f83518 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:19:29.574577 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7a5a9148-3f6a-4075-b8b0-2bac54f83518 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:19:29.575276 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7a5a9148-3f6a-4075-b8b0-2bac54f83518 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:19:29.575730 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7a5a9148-3f6a-4075-b8b0-2bac54f83518 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:19:29.576159 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7a5a9148-3f6a-4075-b8b0-2bac54f83518 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:19:29.709913 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-7a5a9148-3f6a-4075-b8b0-2bac54f83518 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:19:29.718428 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-7a5a9148-3f6a-4075-b8b0-2bac54f83518 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.155887 Oct 20 06:19:29.719179 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 749/1479] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:19:29 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:19:29.725988 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-f768e37f-1c12-4c93-9724-9614d41ba235 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:19:29.728688 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-f768e37f-1c12-4c93-9724-9614d41ba235 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:19:29.737435 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f768e37f-1c12-4c93-9724-9614d41ba235 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:19:29.737912 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f768e37f-1c12-4c93-9724-9614d41ba235 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:19:29.738348 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f768e37f-1c12-4c93-9724-9614d41ba235 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:19:29.739005 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f768e37f-1c12-4c93-9724-9614d41ba235 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:19:29.739461 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f768e37f-1c12-4c93-9724-9614d41ba235 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:19:29.739888 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f768e37f-1c12-4c93-9724-9614d41ba235 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:19:29.773019 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-f768e37f-1c12-4c93-9724-9614d41ba235 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051534 Oct 20 06:19:29.773586 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 731/1480] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:19:29 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:19:30.742865 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-3cefb3dc-74f0-49da-bc2b-35f4e737d073 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:19:30.743415 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-3cefb3dc-74f0-49da-bc2b-35f4e737d073 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:19:30.750003 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-3cefb3dc-74f0-49da-bc2b-35f4e737d073 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:19:30.750488 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-3cefb3dc-74f0-49da-bc2b-35f4e737d073 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:19:30.750927 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-3cefb3dc-74f0-49da-bc2b-35f4e737d073 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:19:30.751633 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-3cefb3dc-74f0-49da-bc2b-35f4e737d073 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:19:30.752088 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-3cefb3dc-74f0-49da-bc2b-35f4e737d073 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:19:30.752514 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-3cefb3dc-74f0-49da-bc2b-35f4e737d073 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:19:30.785410 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-0c56ad67-cd86-4a68-a1ad-b658ac5df524 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:19:30.787620 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-0c56ad67-cd86-4a68-a1ad-b658ac5df524 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:19:30.800130 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0c56ad67-cd86-4a68-a1ad-b658ac5df524 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:19:30.800876 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0c56ad67-cd86-4a68-a1ad-b658ac5df524 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:19:30.801784 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0c56ad67-cd86-4a68-a1ad-b658ac5df524 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:19:30.802765 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0c56ad67-cd86-4a68-a1ad-b658ac5df524 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:19:30.803375 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0c56ad67-cd86-4a68-a1ad-b658ac5df524 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:19:30.803995 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0c56ad67-cd86-4a68-a1ad-b658ac5df524 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:19:30.836531 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-0c56ad67-cd86-4a68-a1ad-b658ac5df524 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054954 Oct 20 06:19:30.837685 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 732/1481] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:19:30 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 20 06:19:30.923457 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-3cefb3dc-74f0-49da-bc2b-35f4e737d073 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:19:30.933030 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-3cefb3dc-74f0-49da-bc2b-35f4e737d073 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.194492 Oct 20 06:19:30.933599 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 750/1482] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:19:30 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:19:31.849330 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-dc2a6e72-d89b-4c34-bf85-bac84ecfa24a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:19:31.851394 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-dc2a6e72-d89b-4c34-bf85-bac84ecfa24a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:19:31.857819 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-dc2a6e72-d89b-4c34-bf85-bac84ecfa24a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:19:31.858306 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-dc2a6e72-d89b-4c34-bf85-bac84ecfa24a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:19:31.858751 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-dc2a6e72-d89b-4c34-bf85-bac84ecfa24a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:19:31.859452 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-dc2a6e72-d89b-4c34-bf85-bac84ecfa24a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:19:31.859908 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-dc2a6e72-d89b-4c34-bf85-bac84ecfa24a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:19:31.860340 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-dc2a6e72-d89b-4c34-bf85-bac84ecfa24a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:19:31.895189 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-dc2a6e72-d89b-4c34-bf85-bac84ecfa24a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049902 Oct 20 06:19:31.900737 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 733/1483] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:19:31 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:19:31.958060 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-78354036-42f5-4e8c-9c54-d1fbb45b94e7 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:19:31.959425 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-78354036-42f5-4e8c-9c54-d1fbb45b94e7 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:19:31.966831 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-78354036-42f5-4e8c-9c54-d1fbb45b94e7 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:19:31.967309 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-78354036-42f5-4e8c-9c54-d1fbb45b94e7 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:19:31.967737 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-78354036-42f5-4e8c-9c54-d1fbb45b94e7 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:19:31.968438 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-78354036-42f5-4e8c-9c54-d1fbb45b94e7 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:19:31.968936 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-78354036-42f5-4e8c-9c54-d1fbb45b94e7 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:19:31.969338 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-78354036-42f5-4e8c-9c54-d1fbb45b94e7 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:19:32.103773 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-78354036-42f5-4e8c-9c54-d1fbb45b94e7 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:19:32.112096 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-78354036-42f5-4e8c-9c54-d1fbb45b94e7 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.158469 Oct 20 06:19:32.112674 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 751/1484] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:19:31 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:19:32.908468 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-2df076c0-92e1-463a-ad1f-73e00cc70e3f tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:19:32.910645 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-2df076c0-92e1-463a-ad1f-73e00cc70e3f tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:19:32.918061 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2df076c0-92e1-463a-ad1f-73e00cc70e3f tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:19:32.918677 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2df076c0-92e1-463a-ad1f-73e00cc70e3f tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:19:32.919111 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2df076c0-92e1-463a-ad1f-73e00cc70e3f tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:19:32.919809 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2df076c0-92e1-463a-ad1f-73e00cc70e3f tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:19:32.920261 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2df076c0-92e1-463a-ad1f-73e00cc70e3f tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:19:32.920707 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2df076c0-92e1-463a-ad1f-73e00cc70e3f tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:19:32.950636 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-2df076c0-92e1-463a-ad1f-73e00cc70e3f tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046122 Oct 20 06:19:32.951199 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 734/1485] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:19:32 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:19:33.135485 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-eb2f1447-f154-419f-9198-35fc3876d235 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:19:33.136166 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-eb2f1447-f154-419f-9198-35fc3876d235 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:19:33.142538 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-eb2f1447-f154-419f-9198-35fc3876d235 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:19:33.143015 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-eb2f1447-f154-419f-9198-35fc3876d235 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:19:33.143444 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-eb2f1447-f154-419f-9198-35fc3876d235 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:19:33.144131 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-eb2f1447-f154-419f-9198-35fc3876d235 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:19:33.144576 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-eb2f1447-f154-419f-9198-35fc3876d235 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:19:33.145024 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-eb2f1447-f154-419f-9198-35fc3876d235 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:19:33.275091 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-eb2f1447-f154-419f-9198-35fc3876d235 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:19:33.283489 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-eb2f1447-f154-419f-9198-35fc3876d235 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.151814 Oct 20 06:19:33.284066 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 752/1486] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:19:33 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 06:19:33.964077 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-178d6378-1f00-4bf3-9bd6-e8b431a6ffa2 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:19:33.966247 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-178d6378-1f00-4bf3-9bd6-e8b431a6ffa2 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:19:33.972595 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-178d6378-1f00-4bf3-9bd6-e8b431a6ffa2 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:19:33.973139 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-178d6378-1f00-4bf3-9bd6-e8b431a6ffa2 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:19:33.973574 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-178d6378-1f00-4bf3-9bd6-e8b431a6ffa2 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:19:33.974260 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-178d6378-1f00-4bf3-9bd6-e8b431a6ffa2 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:19:33.975005 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-178d6378-1f00-4bf3-9bd6-e8b431a6ffa2 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:19:33.975434 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-178d6378-1f00-4bf3-9bd6-e8b431a6ffa2 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:19:34.005688 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-178d6378-1f00-4bf3-9bd6-e8b431a6ffa2 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046068 Oct 20 06:19:34.007225 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 735/1487] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:19:33 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:19:34.308299 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-0d9551e2-ce10-474f-a563-27d4c3836932 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:19:34.309269 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-0d9551e2-ce10-474f-a563-27d4c3836932 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:19:34.315944 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-0d9551e2-ce10-474f-a563-27d4c3836932 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:19:34.316430 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-0d9551e2-ce10-474f-a563-27d4c3836932 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:19:34.316900 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-0d9551e2-ce10-474f-a563-27d4c3836932 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:19:34.317686 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-0d9551e2-ce10-474f-a563-27d4c3836932 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:19:34.318144 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-0d9551e2-ce10-474f-a563-27d4c3836932 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:19:34.318569 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-0d9551e2-ce10-474f-a563-27d4c3836932 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:19:34.450735 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-0d9551e2-ce10-474f-a563-27d4c3836932 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:19:34.458885 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-0d9551e2-ce10-474f-a563-27d4c3836932 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.155657 Oct 20 06:19:34.459453 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 753/1488] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:19:34 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:19:35.019121 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-f1553d49-c05b-4058-8114-20d8677b2a59 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:19:35.021189 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-f1553d49-c05b-4058-8114-20d8677b2a59 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:19:35.028340 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f1553d49-c05b-4058-8114-20d8677b2a59 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:19:35.028857 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f1553d49-c05b-4058-8114-20d8677b2a59 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:19:35.029321 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f1553d49-c05b-4058-8114-20d8677b2a59 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:19:35.030013 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f1553d49-c05b-4058-8114-20d8677b2a59 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:19:35.030467 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f1553d49-c05b-4058-8114-20d8677b2a59 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:19:35.030891 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f1553d49-c05b-4058-8114-20d8677b2a59 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:19:35.062148 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-f1553d49-c05b-4058-8114-20d8677b2a59 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047002 Oct 20 06:19:35.062711 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 736/1489] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:19:35 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:19:35.483380 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-e4ee7bf3-c6b3-4879-91a0-3e0ea28049ba tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:19:35.484387 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-e4ee7bf3-c6b3-4879-91a0-3e0ea28049ba tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:19:35.490789 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e4ee7bf3-c6b3-4879-91a0-3e0ea28049ba tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:19:35.492251 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e4ee7bf3-c6b3-4879-91a0-3e0ea28049ba tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:19:35.492548 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e4ee7bf3-c6b3-4879-91a0-3e0ea28049ba tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:19:35.493266 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e4ee7bf3-c6b3-4879-91a0-3e0ea28049ba tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:19:35.493717 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e4ee7bf3-c6b3-4879-91a0-3e0ea28049ba tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:19:35.494170 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e4ee7bf3-c6b3-4879-91a0-3e0ea28049ba tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:19:35.627604 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-e4ee7bf3-c6b3-4879-91a0-3e0ea28049ba tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:19:35.636173 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-e4ee7bf3-c6b3-4879-91a0-3e0ea28049ba tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.156611 Oct 20 06:19:35.636754 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 754/1490] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:19:35 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:19:36.074803 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-565c09ab-8b7e-4c21-8ecc-71a6b4a48c55 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:19:36.076985 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-565c09ab-8b7e-4c21-8ecc-71a6b4a48c55 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:19:36.083383 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-565c09ab-8b7e-4c21-8ecc-71a6b4a48c55 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:19:36.083860 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-565c09ab-8b7e-4c21-8ecc-71a6b4a48c55 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:19:36.084293 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-565c09ab-8b7e-4c21-8ecc-71a6b4a48c55 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:19:36.085624 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-565c09ab-8b7e-4c21-8ecc-71a6b4a48c55 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:19:36.086137 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-565c09ab-8b7e-4c21-8ecc-71a6b4a48c55 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:19:36.086388 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-565c09ab-8b7e-4c21-8ecc-71a6b4a48c55 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:19:36.116912 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-565c09ab-8b7e-4c21-8ecc-71a6b4a48c55 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045507 Oct 20 06:19:36.117468 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 737/1491] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:19:36 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 20 06:19:36.659388 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-1667ea93-8dbb-4267-bd0e-ef98551e0a14 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:19:36.660034 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-1667ea93-8dbb-4267-bd0e-ef98551e0a14 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:19:36.667464 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1667ea93-8dbb-4267-bd0e-ef98551e0a14 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:19:36.667945 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1667ea93-8dbb-4267-bd0e-ef98551e0a14 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:19:36.668377 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1667ea93-8dbb-4267-bd0e-ef98551e0a14 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:19:36.669094 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1667ea93-8dbb-4267-bd0e-ef98551e0a14 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:19:36.669543 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1667ea93-8dbb-4267-bd0e-ef98551e0a14 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:19:36.669965 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1667ea93-8dbb-4267-bd0e-ef98551e0a14 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:19:36.803380 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-1667ea93-8dbb-4267-bd0e-ef98551e0a14 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:19:36.815079 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-1667ea93-8dbb-4267-bd0e-ef98551e0a14 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.159525 Oct 20 06:19:36.815827 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 755/1492] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:19:36 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:19:37.129448 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-293172e9-de88-4162-8f10-d441455ba526 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:19:37.131949 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-293172e9-de88-4162-8f10-d441455ba526 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:19:37.138398 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-293172e9-de88-4162-8f10-d441455ba526 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:19:37.138881 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-293172e9-de88-4162-8f10-d441455ba526 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:19:37.139319 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-293172e9-de88-4162-8f10-d441455ba526 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:19:37.140018 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-293172e9-de88-4162-8f10-d441455ba526 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:19:37.140472 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-293172e9-de88-4162-8f10-d441455ba526 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:19:37.140923 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-293172e9-de88-4162-8f10-d441455ba526 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:19:37.170976 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-293172e9-de88-4162-8f10-d441455ba526 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045525 Oct 20 06:19:37.171599 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 738/1493] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:19:37 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:19:37.838965 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-763f8268-2b8f-4d91-9a0e-fc318252b591 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:19:37.839585 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-763f8268-2b8f-4d91-9a0e-fc318252b591 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:19:37.846202 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-763f8268-2b8f-4d91-9a0e-fc318252b591 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:19:37.846683 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-763f8268-2b8f-4d91-9a0e-fc318252b591 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:19:37.847122 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-763f8268-2b8f-4d91-9a0e-fc318252b591 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:19:37.847827 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-763f8268-2b8f-4d91-9a0e-fc318252b591 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:19:37.848275 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-763f8268-2b8f-4d91-9a0e-fc318252b591 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:19:37.848705 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-763f8268-2b8f-4d91-9a0e-fc318252b591 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:19:37.998539 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-763f8268-2b8f-4d91-9a0e-fc318252b591 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:19:38.007650 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-763f8268-2b8f-4d91-9a0e-fc318252b591 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.172708 Oct 20 06:19:38.008328 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 756/1494] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:19:37 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:19:38.184787 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-a530bac3-c79a-4d3c-b384-68912f1c5153 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:19:38.187045 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-a530bac3-c79a-4d3c-b384-68912f1c5153 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:19:38.193876 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a530bac3-c79a-4d3c-b384-68912f1c5153 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:19:38.194994 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a530bac3-c79a-4d3c-b384-68912f1c5153 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:19:38.195442 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a530bac3-c79a-4d3c-b384-68912f1c5153 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:19:38.196166 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a530bac3-c79a-4d3c-b384-68912f1c5153 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:19:38.196627 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a530bac3-c79a-4d3c-b384-68912f1c5153 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:19:38.197082 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a530bac3-c79a-4d3c-b384-68912f1c5153 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:19:38.228168 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-a530bac3-c79a-4d3c-b384-68912f1c5153 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047664 Oct 20 06:19:38.228964 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 739/1495] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:19:38 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 20 06:19:39.031475 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-ee17d660-ecbc-4fac-9fbc-7da102fda9da tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:19:39.032155 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-ee17d660-ecbc-4fac-9fbc-7da102fda9da tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:19:39.039501 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ee17d660-ecbc-4fac-9fbc-7da102fda9da tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:19:39.040043 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ee17d660-ecbc-4fac-9fbc-7da102fda9da tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:19:39.040479 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ee17d660-ecbc-4fac-9fbc-7da102fda9da tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:19:39.041207 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ee17d660-ecbc-4fac-9fbc-7da102fda9da tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:19:39.041656 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ee17d660-ecbc-4fac-9fbc-7da102fda9da tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:19:39.042117 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ee17d660-ecbc-4fac-9fbc-7da102fda9da tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:19:39.044757 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG dbcounter [-] [118861] Writing DB stats nova_cell1:SELECT=100 {{(pid=118861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:19:39.171880 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-ee17d660-ecbc-4fac-9fbc-7da102fda9da tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:19:39.180154 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-ee17d660-ecbc-4fac-9fbc-7da102fda9da tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.152628 Oct 20 06:19:39.180814 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 757/1496] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:19:39 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:19:39.241685 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-1c929cf6-48bd-4b67-ac81-0574daff2a63 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:19:39.243879 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-1c929cf6-48bd-4b67-ac81-0574daff2a63 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:19:39.250883 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1c929cf6-48bd-4b67-ac81-0574daff2a63 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:19:39.251383 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1c929cf6-48bd-4b67-ac81-0574daff2a63 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:19:39.251828 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1c929cf6-48bd-4b67-ac81-0574daff2a63 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:19:39.252549 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1c929cf6-48bd-4b67-ac81-0574daff2a63 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:19:39.253046 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1c929cf6-48bd-4b67-ac81-0574daff2a63 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:19:39.253483 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1c929cf6-48bd-4b67-ac81-0574daff2a63 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:19:39.287340 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-1c929cf6-48bd-4b67-ac81-0574daff2a63 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050121 Oct 20 06:19:39.287923 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 740/1497] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:19:39 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:19:40.203773 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-9cf39d5d-da4d-4749-bae8-c45b1f74d12b tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:19:40.211844 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-9cf39d5d-da4d-4749-bae8-c45b1f74d12b tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:19:40.218454 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-9cf39d5d-da4d-4749-bae8-c45b1f74d12b tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:19:40.218950 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-9cf39d5d-da4d-4749-bae8-c45b1f74d12b tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:19:40.219365 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-9cf39d5d-da4d-4749-bae8-c45b1f74d12b tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:19:40.220060 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-9cf39d5d-da4d-4749-bae8-c45b1f74d12b tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:19:40.220506 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-9cf39d5d-da4d-4749-bae8-c45b1f74d12b tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:19:40.220962 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-9cf39d5d-da4d-4749-bae8-c45b1f74d12b tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:19:40.301787 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-aaa7e76f-e0a3-442b-9bd6-94c4ffe91b43 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:19:40.304454 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-aaa7e76f-e0a3-442b-9bd6-94c4ffe91b43 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:19:40.314374 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-aaa7e76f-e0a3-442b-9bd6-94c4ffe91b43 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:19:40.314878 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-aaa7e76f-e0a3-442b-9bd6-94c4ffe91b43 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:19:40.315320 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-aaa7e76f-e0a3-442b-9bd6-94c4ffe91b43 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:19:40.316083 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-aaa7e76f-e0a3-442b-9bd6-94c4ffe91b43 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:19:40.316545 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-aaa7e76f-e0a3-442b-9bd6-94c4ffe91b43 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:19:40.317006 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-aaa7e76f-e0a3-442b-9bd6-94c4ffe91b43 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:19:40.351772 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-aaa7e76f-e0a3-442b-9bd6-94c4ffe91b43 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055915 Oct 20 06:19:40.352352 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 741/1498] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:19:40 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 20 06:19:40.367660 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-9cf39d5d-da4d-4749-bae8-c45b1f74d12b tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:19:40.376051 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-9cf39d5d-da4d-4749-bae8-c45b1f74d12b tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.176106 Oct 20 06:19:40.376629 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 758/1499] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:19:40 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:19:41.364350 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-f9b3289c-9bc2-431d-8672-619c91c71152 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:19:41.367194 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-f9b3289c-9bc2-431d-8672-619c91c71152 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:19:41.375005 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f9b3289c-9bc2-431d-8672-619c91c71152 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:19:41.375487 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f9b3289c-9bc2-431d-8672-619c91c71152 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:19:41.375917 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f9b3289c-9bc2-431d-8672-619c91c71152 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:19:41.376615 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f9b3289c-9bc2-431d-8672-619c91c71152 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:19:41.377084 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f9b3289c-9bc2-431d-8672-619c91c71152 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:19:41.377505 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f9b3289c-9bc2-431d-8672-619c91c71152 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:19:41.399357 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-db66dfb1-6ac8-44e0-a55c-89663878df61 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:19:41.400040 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-db66dfb1-6ac8-44e0-a55c-89663878df61 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:19:41.406756 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-db66dfb1-6ac8-44e0-a55c-89663878df61 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:19:41.407309 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-db66dfb1-6ac8-44e0-a55c-89663878df61 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:19:41.408000 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-db66dfb1-6ac8-44e0-a55c-89663878df61 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:19:41.408260 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-f9b3289c-9bc2-431d-8672-619c91c71152 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047926 Oct 20 06:19:41.408823 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-db66dfb1-6ac8-44e0-a55c-89663878df61 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:19:41.408958 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 742/1500] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:19:41 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:19:41.409555 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-db66dfb1-6ac8-44e0-a55c-89663878df61 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:19:41.409983 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-db66dfb1-6ac8-44e0-a55c-89663878df61 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:19:41.540522 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-db66dfb1-6ac8-44e0-a55c-89663878df61 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:19:41.549125 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-db66dfb1-6ac8-44e0-a55c-89663878df61 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.153579 Oct 20 06:19:41.549703 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 759/1501] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:19:41 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 06:19:42.421064 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-413ec664-894a-4c57-81b2-b342a6f5a498 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:19:42.423242 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-413ec664-894a-4c57-81b2-b342a6f5a498 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:19:42.429905 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-413ec664-894a-4c57-81b2-b342a6f5a498 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:19:42.430379 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-413ec664-894a-4c57-81b2-b342a6f5a498 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:19:42.430823 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-413ec664-894a-4c57-81b2-b342a6f5a498 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:19:42.431523 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-413ec664-894a-4c57-81b2-b342a6f5a498 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:19:42.431982 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-413ec664-894a-4c57-81b2-b342a6f5a498 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:19:42.432407 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-413ec664-894a-4c57-81b2-b342a6f5a498 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:19:42.462609 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-413ec664-894a-4c57-81b2-b342a6f5a498 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045550 Oct 20 06:19:42.463188 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 743/1502] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:19:42 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:19:42.572074 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-70337d7d-63e8-4cbc-a3f0-c0a5253a9cce tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:19:42.572866 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-70337d7d-63e8-4cbc-a3f0-c0a5253a9cce tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:19:42.579345 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-70337d7d-63e8-4cbc-a3f0-c0a5253a9cce tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:19:42.579829 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-70337d7d-63e8-4cbc-a3f0-c0a5253a9cce tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:19:42.580271 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-70337d7d-63e8-4cbc-a3f0-c0a5253a9cce tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:19:42.581010 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-70337d7d-63e8-4cbc-a3f0-c0a5253a9cce tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:19:42.581464 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-70337d7d-63e8-4cbc-a3f0-c0a5253a9cce tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:19:42.581892 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-70337d7d-63e8-4cbc-a3f0-c0a5253a9cce tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:19:42.730128 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-70337d7d-63e8-4cbc-a3f0-c0a5253a9cce tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:19:42.746337 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-70337d7d-63e8-4cbc-a3f0-c0a5253a9cce tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.178725 Oct 20 06:19:42.746911 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 760/1503] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:19:42 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:19:43.474594 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-cc04370f-6d9a-4464-bce5-ebd77d371da3 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:19:43.477368 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-cc04370f-6d9a-4464-bce5-ebd77d371da3 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:19:43.483803 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-cc04370f-6d9a-4464-bce5-ebd77d371da3 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:19:43.484281 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-cc04370f-6d9a-4464-bce5-ebd77d371da3 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:19:43.484735 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-cc04370f-6d9a-4464-bce5-ebd77d371da3 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:19:43.485438 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-cc04370f-6d9a-4464-bce5-ebd77d371da3 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:19:43.485891 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-cc04370f-6d9a-4464-bce5-ebd77d371da3 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:19:43.486320 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-cc04370f-6d9a-4464-bce5-ebd77d371da3 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:19:43.516625 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-cc04370f-6d9a-4464-bce5-ebd77d371da3 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046092 Oct 20 06:19:43.517315 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 744/1504] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:19:43 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:19:43.770655 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-03f7663e-5038-4a66-80d8-052f66cf3841 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:19:43.771282 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-03f7663e-5038-4a66-80d8-052f66cf3841 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:19:43.778574 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-03f7663e-5038-4a66-80d8-052f66cf3841 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:19:43.779251 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-03f7663e-5038-4a66-80d8-052f66cf3841 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:19:43.779693 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-03f7663e-5038-4a66-80d8-052f66cf3841 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:19:43.780395 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-03f7663e-5038-4a66-80d8-052f66cf3841 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:19:43.781044 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-03f7663e-5038-4a66-80d8-052f66cf3841 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:19:43.781476 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-03f7663e-5038-4a66-80d8-052f66cf3841 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:19:43.914626 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-03f7663e-5038-4a66-80d8-052f66cf3841 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:19:43.923201 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-03f7663e-5038-4a66-80d8-052f66cf3841 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.156434 Oct 20 06:19:43.923776 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 761/1505] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:19:43 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:19:44.529562 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-3c8d4b80-7418-456f-b67c-57853ec7c461 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:19:44.532440 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-3c8d4b80-7418-456f-b67c-57853ec7c461 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:19:44.541036 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3c8d4b80-7418-456f-b67c-57853ec7c461 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:19:44.541531 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3c8d4b80-7418-456f-b67c-57853ec7c461 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:19:44.541973 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3c8d4b80-7418-456f-b67c-57853ec7c461 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:19:44.542678 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3c8d4b80-7418-456f-b67c-57853ec7c461 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:19:44.543134 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3c8d4b80-7418-456f-b67c-57853ec7c461 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:19:44.543560 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3c8d4b80-7418-456f-b67c-57853ec7c461 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:19:44.580067 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-3c8d4b80-7418-456f-b67c-57853ec7c461 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054439 Oct 20 06:19:44.585056 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 745/1506] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:19:44 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:19:44.946664 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-dc7b4e8d-00ac-4e30-9e2e-c4ba5277084c tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:19:44.947397 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-dc7b4e8d-00ac-4e30-9e2e-c4ba5277084c tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:19:44.954107 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-dc7b4e8d-00ac-4e30-9e2e-c4ba5277084c tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:19:44.954583 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-dc7b4e8d-00ac-4e30-9e2e-c4ba5277084c tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:19:44.955018 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-dc7b4e8d-00ac-4e30-9e2e-c4ba5277084c tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:19:44.955715 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-dc7b4e8d-00ac-4e30-9e2e-c4ba5277084c tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:19:44.956182 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-dc7b4e8d-00ac-4e30-9e2e-c4ba5277084c tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:19:44.956590 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-dc7b4e8d-00ac-4e30-9e2e-c4ba5277084c tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:19:45.105923 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-dc7b4e8d-00ac-4e30-9e2e-c4ba5277084c tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:19:45.114333 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-dc7b4e8d-00ac-4e30-9e2e-c4ba5277084c tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.171900 Oct 20 06:19:45.114894 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 762/1507] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:19:44 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:19:45.592534 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-fc7082fd-1c31-4402-9666-e8f969fabc7c tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:19:45.594871 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-fc7082fd-1c31-4402-9666-e8f969fabc7c tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:19:45.602703 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-fc7082fd-1c31-4402-9666-e8f969fabc7c tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:19:45.603327 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-fc7082fd-1c31-4402-9666-e8f969fabc7c tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:19:45.603859 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-fc7082fd-1c31-4402-9666-e8f969fabc7c tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:19:45.604829 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-fc7082fd-1c31-4402-9666-e8f969fabc7c tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:19:45.605348 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-fc7082fd-1c31-4402-9666-e8f969fabc7c tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:19:45.605871 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-fc7082fd-1c31-4402-9666-e8f969fabc7c tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:19:45.608485 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG dbcounter [-] [118860] Writing DB stats nova_cell1:SELECT=100 {{(pid=118860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:19:45.638065 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-fc7082fd-1c31-4402-9666-e8f969fabc7c tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049684 Oct 20 06:19:45.642782 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 746/1508] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:19:45 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:19:46.138644 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-11ed4d51-d83a-41cd-a8bb-cc7547dd3813 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:19:46.139357 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-11ed4d51-d83a-41cd-a8bb-cc7547dd3813 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:19:46.145617 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-11ed4d51-d83a-41cd-a8bb-cc7547dd3813 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:19:46.146099 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-11ed4d51-d83a-41cd-a8bb-cc7547dd3813 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:19:46.146907 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-11ed4d51-d83a-41cd-a8bb-cc7547dd3813 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:19:46.147233 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-11ed4d51-d83a-41cd-a8bb-cc7547dd3813 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:19:46.148784 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-11ed4d51-d83a-41cd-a8bb-cc7547dd3813 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:19:46.149291 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-11ed4d51-d83a-41cd-a8bb-cc7547dd3813 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:19:46.287608 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-11ed4d51-d83a-41cd-a8bb-cc7547dd3813 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:19:46.306942 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-11ed4d51-d83a-41cd-a8bb-cc7547dd3813 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.172038 Oct 20 06:19:46.308220 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 763/1509] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:19:46 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:19:46.759339 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-95c2070c-f6ab-4d4b-a437-a90cb6aabeb6 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:19:46.761838 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-95c2070c-f6ab-4d4b-a437-a90cb6aabeb6 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:19:46.767888 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-95c2070c-f6ab-4d4b-a437-a90cb6aabeb6 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:19:46.768372 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-95c2070c-f6ab-4d4b-a437-a90cb6aabeb6 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:19:46.768859 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-95c2070c-f6ab-4d4b-a437-a90cb6aabeb6 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:19:46.769559 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-95c2070c-f6ab-4d4b-a437-a90cb6aabeb6 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:19:46.770038 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-95c2070c-f6ab-4d4b-a437-a90cb6aabeb6 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:19:46.770548 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-95c2070c-f6ab-4d4b-a437-a90cb6aabeb6 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:19:46.802325 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-95c2070c-f6ab-4d4b-a437-a90cb6aabeb6 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.155747 Oct 20 06:19:46.802886 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 747/1510] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:19:46 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:19:47.330020 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-09004f85-983f-49fd-ae38-a970a9f133fc tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:19:47.330642 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-09004f85-983f-49fd-ae38-a970a9f133fc tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:19:47.336928 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 20 06:19:47.337158 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: Thu Oct 20 06:19:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f (ip 10.222.0.20) !!! Oct 20 06:19:47.347277 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-09004f85-983f-49fd-ae38-a970a9f133fc tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:19:47.347764 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-09004f85-983f-49fd-ae38-a970a9f133fc tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:19:47.348205 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-09004f85-983f-49fd-ae38-a970a9f133fc tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:19:47.348949 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-09004f85-983f-49fd-ae38-a970a9f133fc tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:19:47.349411 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-09004f85-983f-49fd-ae38-a970a9f133fc tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:19:47.349842 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-09004f85-983f-49fd-ae38-a970a9f133fc tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:19:47.489157 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-09004f85-983f-49fd-ae38-a970a9f133fc tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:19:47.498119 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-09004f85-983f-49fd-ae38-a970a9f133fc tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.172016 Oct 20 06:19:47.499073 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 764/1511] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:19:47 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:19:47.815009 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-56b44297-c503-40ae-88cd-3667ec212e69 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:19:47.817258 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-56b44297-c503-40ae-88cd-3667ec212e69 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:19:47.824814 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-56b44297-c503-40ae-88cd-3667ec212e69 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:19:47.825306 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-56b44297-c503-40ae-88cd-3667ec212e69 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:19:47.825757 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-56b44297-c503-40ae-88cd-3667ec212e69 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:19:47.826470 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-56b44297-c503-40ae-88cd-3667ec212e69 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:19:47.826927 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-56b44297-c503-40ae-88cd-3667ec212e69 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:19:47.827360 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-56b44297-c503-40ae-88cd-3667ec212e69 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:19:47.856906 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-56b44297-c503-40ae-88cd-3667ec212e69 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045849 Oct 20 06:19:47.857486 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 748/1512] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:19:47 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:19:48.523685 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-678ad851-4426-4d93-9772-3d73f6ab6ed5 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:19:48.524439 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-678ad851-4426-4d93-9772-3d73f6ab6ed5 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:19:48.531250 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-678ad851-4426-4d93-9772-3d73f6ab6ed5 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:19:48.531828 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-678ad851-4426-4d93-9772-3d73f6ab6ed5 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:19:48.532325 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-678ad851-4426-4d93-9772-3d73f6ab6ed5 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:19:48.533133 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-678ad851-4426-4d93-9772-3d73f6ab6ed5 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:19:48.533588 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-678ad851-4426-4d93-9772-3d73f6ab6ed5 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:19:48.534011 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-678ad851-4426-4d93-9772-3d73f6ab6ed5 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:19:48.667491 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-678ad851-4426-4d93-9772-3d73f6ab6ed5 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:19:48.676032 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-678ad851-4426-4d93-9772-3d73f6ab6ed5 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.156936 Oct 20 06:19:48.676619 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 765/1513] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:19:48 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:19:48.869588 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-3ae7e969-a6b7-49a9-b9bc-aa35fe1a35ad tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:19:48.871712 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-3ae7e969-a6b7-49a9-b9bc-aa35fe1a35ad tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:19:48.873760 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 20 06:19:48.873907 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: Thu Oct 20 06:19:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments (ip 10.222.0.20) !!! Oct 20 06:19:48.884209 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3ae7e969-a6b7-49a9-b9bc-aa35fe1a35ad tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:19:48.884725 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3ae7e969-a6b7-49a9-b9bc-aa35fe1a35ad tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:19:48.885167 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3ae7e969-a6b7-49a9-b9bc-aa35fe1a35ad tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:19:48.885889 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3ae7e969-a6b7-49a9-b9bc-aa35fe1a35ad tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:19:48.886340 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3ae7e969-a6b7-49a9-b9bc-aa35fe1a35ad tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:19:48.886769 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3ae7e969-a6b7-49a9-b9bc-aa35fe1a35ad tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:19:48.918260 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-3ae7e969-a6b7-49a9-b9bc-aa35fe1a35ad tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053321 Oct 20 06:19:48.918784 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 749/1514] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:19:48 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:19:49.700443 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-3b3c41a0-4f77-4f6b-8981-5fd0c57f2794 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:19:49.701038 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-3b3c41a0-4f77-4f6b-8981-5fd0c57f2794 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:19:49.707653 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-3b3c41a0-4f77-4f6b-8981-5fd0c57f2794 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:19:49.708145 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-3b3c41a0-4f77-4f6b-8981-5fd0c57f2794 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:19:49.708687 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-3b3c41a0-4f77-4f6b-8981-5fd0c57f2794 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:19:49.709417 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-3b3c41a0-4f77-4f6b-8981-5fd0c57f2794 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:19:49.710450 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-3b3c41a0-4f77-4f6b-8981-5fd0c57f2794 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:19:49.710922 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-3b3c41a0-4f77-4f6b-8981-5fd0c57f2794 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:19:49.841841 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-3b3c41a0-4f77-4f6b-8981-5fd0c57f2794 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:19:49.850005 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-3b3c41a0-4f77-4f6b-8981-5fd0c57f2794 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.153634 Oct 20 06:19:49.850653 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 766/1515] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:19:49 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:19:49.929650 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-dfe2f137-f2b5-47f5-8aba-d42dbb1782ec tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:19:49.931796 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-dfe2f137-f2b5-47f5-8aba-d42dbb1782ec tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:19:49.938294 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-dfe2f137-f2b5-47f5-8aba-d42dbb1782ec tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:19:49.938784 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-dfe2f137-f2b5-47f5-8aba-d42dbb1782ec tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:19:49.939226 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-dfe2f137-f2b5-47f5-8aba-d42dbb1782ec tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:19:49.939932 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-dfe2f137-f2b5-47f5-8aba-d42dbb1782ec tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:19:49.940392 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-dfe2f137-f2b5-47f5-8aba-d42dbb1782ec tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:19:49.940850 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-dfe2f137-f2b5-47f5-8aba-d42dbb1782ec tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:19:49.971988 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-dfe2f137-f2b5-47f5-8aba-d42dbb1782ec tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046122 Oct 20 06:19:49.972675 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 750/1516] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:19:49 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:19:50.873600 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-2b0f28f3-5815-4fbe-aa96-96d0f96573c0 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:19:50.874138 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-2b0f28f3-5815-4fbe-aa96-96d0f96573c0 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:19:50.880883 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-2b0f28f3-5815-4fbe-aa96-96d0f96573c0 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:19:50.881373 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-2b0f28f3-5815-4fbe-aa96-96d0f96573c0 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:19:50.881812 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-2b0f28f3-5815-4fbe-aa96-96d0f96573c0 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:19:50.882508 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-2b0f28f3-5815-4fbe-aa96-96d0f96573c0 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:19:50.882958 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-2b0f28f3-5815-4fbe-aa96-96d0f96573c0 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:19:50.883386 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-2b0f28f3-5815-4fbe-aa96-96d0f96573c0 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:19:50.986773 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-2a126abf-6758-48bc-b7e9-45eefe42bc11 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:19:50.988940 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-2a126abf-6758-48bc-b7e9-45eefe42bc11 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:19:50.994872 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2a126abf-6758-48bc-b7e9-45eefe42bc11 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:19:50.995355 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2a126abf-6758-48bc-b7e9-45eefe42bc11 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:19:50.995816 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2a126abf-6758-48bc-b7e9-45eefe42bc11 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:19:50.996506 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2a126abf-6758-48bc-b7e9-45eefe42bc11 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:19:50.996989 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2a126abf-6758-48bc-b7e9-45eefe42bc11 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:19:50.997500 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2a126abf-6758-48bc-b7e9-45eefe42bc11 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:19:51.019134 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-2b0f28f3-5815-4fbe-aa96-96d0f96573c0 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:19:51.027356 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-2a126abf-6758-48bc-b7e9-45eefe42bc11 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044865 Oct 20 06:19:51.028044 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 751/1517] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:19:50 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 20 06:19:51.028514 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-2b0f28f3-5815-4fbe-aa96-96d0f96573c0 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.158822 Oct 20 06:19:51.040927 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 767/1518] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:19:50 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:19:52.039848 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-5aa4710e-d7ee-4c09-a578-b96ef026dd28 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:19:52.041966 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-5aa4710e-d7ee-4c09-a578-b96ef026dd28 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:19:52.048367 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5aa4710e-d7ee-4c09-a578-b96ef026dd28 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:19:52.048882 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5aa4710e-d7ee-4c09-a578-b96ef026dd28 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:19:52.049361 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5aa4710e-d7ee-4c09-a578-b96ef026dd28 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:19:52.050007 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5aa4710e-d7ee-4c09-a578-b96ef026dd28 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:19:52.050461 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5aa4710e-d7ee-4c09-a578-b96ef026dd28 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:19:52.050882 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5aa4710e-d7ee-4c09-a578-b96ef026dd28 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:19:52.053158 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-b4aff8c5-1554-4b87-b79a-063ba20927f7 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:19:52.054520 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-b4aff8c5-1554-4b87-b79a-063ba20927f7 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:19:52.060968 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b4aff8c5-1554-4b87-b79a-063ba20927f7 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:19:52.061456 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b4aff8c5-1554-4b87-b79a-063ba20927f7 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:19:52.061896 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b4aff8c5-1554-4b87-b79a-063ba20927f7 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:19:52.062592 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b4aff8c5-1554-4b87-b79a-063ba20927f7 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:19:52.063045 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b4aff8c5-1554-4b87-b79a-063ba20927f7 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:19:52.063467 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b4aff8c5-1554-4b87-b79a-063ba20927f7 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:19:52.082040 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-5aa4710e-d7ee-4c09-a578-b96ef026dd28 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046248 Oct 20 06:19:52.083041 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 752/1519] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:19:52 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:19:52.204978 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-b4aff8c5-1554-4b87-b79a-063ba20927f7 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:19:52.214181 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-b4aff8c5-1554-4b87-b79a-063ba20927f7 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.165198 Oct 20 06:19:52.215512 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 768/1520] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:19:52 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:19:53.095677 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-463761f0-39e2-478d-a4f5-52e9f8767508 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:19:53.097875 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-463761f0-39e2-478d-a4f5-52e9f8767508 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:19:53.104973 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-463761f0-39e2-478d-a4f5-52e9f8767508 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:19:53.105460 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-463761f0-39e2-478d-a4f5-52e9f8767508 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:19:53.105900 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-463761f0-39e2-478d-a4f5-52e9f8767508 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:19:53.106596 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-463761f0-39e2-478d-a4f5-52e9f8767508 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:19:53.107052 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-463761f0-39e2-478d-a4f5-52e9f8767508 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:19:53.107477 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-463761f0-39e2-478d-a4f5-52e9f8767508 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:19:53.136844 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-463761f0-39e2-478d-a4f5-52e9f8767508 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045136 Oct 20 06:19:53.137412 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 753/1521] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:19:53 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:19:53.238482 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-bc5d305d-c312-475f-ae4c-e241c9023b01 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:19:53.239133 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-bc5d305d-c312-475f-ae4c-e241c9023b01 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:19:53.245806 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-bc5d305d-c312-475f-ae4c-e241c9023b01 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:19:53.246294 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-bc5d305d-c312-475f-ae4c-e241c9023b01 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:19:53.246736 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-bc5d305d-c312-475f-ae4c-e241c9023b01 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:19:53.247441 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-bc5d305d-c312-475f-ae4c-e241c9023b01 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:19:53.247892 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-bc5d305d-c312-475f-ae4c-e241c9023b01 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:19:53.248317 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-bc5d305d-c312-475f-ae4c-e241c9023b01 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:19:53.398751 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-bc5d305d-c312-475f-ae4c-e241c9023b01 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:19:53.407168 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-bc5d305d-c312-475f-ae4c-e241c9023b01 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.172568 Oct 20 06:19:53.407745 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 769/1522] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:19:53 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:19:54.149635 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-e4b712af-46c1-4f63-898c-3c1da664187b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:19:54.151794 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-e4b712af-46c1-4f63-898c-3c1da664187b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:19:54.157997 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e4b712af-46c1-4f63-898c-3c1da664187b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:19:54.158489 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e4b712af-46c1-4f63-898c-3c1da664187b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:19:54.158932 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e4b712af-46c1-4f63-898c-3c1da664187b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:19:54.159638 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e4b712af-46c1-4f63-898c-3c1da664187b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:19:54.160213 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e4b712af-46c1-4f63-898c-3c1da664187b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:19:54.160654 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e4b712af-46c1-4f63-898c-3c1da664187b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:19:54.191355 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-e4b712af-46c1-4f63-898c-3c1da664187b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045889 Oct 20 06:19:54.191928 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 754/1523] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:19:54 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:19:54.431100 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-2f608fda-3ef6-48f3-9df1-85f9fe2c2ca1 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:19:54.431718 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-2f608fda-3ef6-48f3-9df1-85f9fe2c2ca1 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:19:54.434155 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG dbcounter [-] [118861] Writing DB stats nova_api:SELECT=52 {{(pid=118861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:19:54.439738 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-2f608fda-3ef6-48f3-9df1-85f9fe2c2ca1 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:19:54.440218 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-2f608fda-3ef6-48f3-9df1-85f9fe2c2ca1 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:19:54.440653 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-2f608fda-3ef6-48f3-9df1-85f9fe2c2ca1 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:19:54.441376 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-2f608fda-3ef6-48f3-9df1-85f9fe2c2ca1 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:19:54.441826 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-2f608fda-3ef6-48f3-9df1-85f9fe2c2ca1 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:19:54.442253 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-2f608fda-3ef6-48f3-9df1-85f9fe2c2ca1 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:19:54.785487 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-2f608fda-3ef6-48f3-9df1-85f9fe2c2ca1 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:19:54.793929 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-2f608fda-3ef6-48f3-9df1-85f9fe2c2ca1 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.367382 Oct 20 06:19:54.794507 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 770/1524] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:19:54 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:19:55.204150 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-fd5aecbc-1c87-4892-bcd1-898da9dd4672 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:19:55.206479 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-fd5aecbc-1c87-4892-bcd1-898da9dd4672 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:19:55.212534 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG dbcounter [-] [118860] Writing DB stats nova_api:SELECT=58 {{(pid=118860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:19:55.214498 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-fd5aecbc-1c87-4892-bcd1-898da9dd4672 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:19:55.215059 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-fd5aecbc-1c87-4892-bcd1-898da9dd4672 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:19:55.215684 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-fd5aecbc-1c87-4892-bcd1-898da9dd4672 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:19:55.216555 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-fd5aecbc-1c87-4892-bcd1-898da9dd4672 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:19:55.217166 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-fd5aecbc-1c87-4892-bcd1-898da9dd4672 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:19:55.217600 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-fd5aecbc-1c87-4892-bcd1-898da9dd4672 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:19:55.248304 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-fd5aecbc-1c87-4892-bcd1-898da9dd4672 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048124 Oct 20 06:19:55.248906 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 755/1525] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:19:55 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:19:55.818133 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-9fd68951-437e-4532-bcab-43261cf917fe tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:19:55.818678 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-9fd68951-437e-4532-bcab-43261cf917fe tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:19:55.825440 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-9fd68951-437e-4532-bcab-43261cf917fe tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:19:55.825930 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-9fd68951-437e-4532-bcab-43261cf917fe tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:19:55.826371 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-9fd68951-437e-4532-bcab-43261cf917fe tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:19:55.827076 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-9fd68951-437e-4532-bcab-43261cf917fe tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:19:55.827531 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-9fd68951-437e-4532-bcab-43261cf917fe tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:19:55.827958 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-9fd68951-437e-4532-bcab-43261cf917fe tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:19:55.967213 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-9fd68951-437e-4532-bcab-43261cf917fe tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:19:55.980138 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-9fd68951-437e-4532-bcab-43261cf917fe tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.165910 Oct 20 06:19:55.980751 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 771/1526] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:19:55 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:19:56.261211 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-cf3f6b41-1036-4c5f-b5f6-ca0b324b0272 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:19:56.263349 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-cf3f6b41-1036-4c5f-b5f6-ca0b324b0272 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:19:56.269863 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-cf3f6b41-1036-4c5f-b5f6-ca0b324b0272 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:19:56.270349 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-cf3f6b41-1036-4c5f-b5f6-ca0b324b0272 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:19:56.270785 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-cf3f6b41-1036-4c5f-b5f6-ca0b324b0272 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:19:56.271487 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-cf3f6b41-1036-4c5f-b5f6-ca0b324b0272 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:19:56.271939 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-cf3f6b41-1036-4c5f-b5f6-ca0b324b0272 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:19:56.272438 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-cf3f6b41-1036-4c5f-b5f6-ca0b324b0272 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:19:56.310539 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-cf3f6b41-1036-4c5f-b5f6-ca0b324b0272 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053942 Oct 20 06:19:56.311376 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 756/1527] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:19:56 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:19:57.003506 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-62574477-d3c7-4b1d-91c8-e128a2bb1930 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:19:57.004124 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-62574477-d3c7-4b1d-91c8-e128a2bb1930 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:19:57.010506 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-62574477-d3c7-4b1d-91c8-e128a2bb1930 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:19:57.010994 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-62574477-d3c7-4b1d-91c8-e128a2bb1930 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:19:57.011437 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-62574477-d3c7-4b1d-91c8-e128a2bb1930 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:19:57.012206 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-62574477-d3c7-4b1d-91c8-e128a2bb1930 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:19:57.012667 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-62574477-d3c7-4b1d-91c8-e128a2bb1930 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:19:57.013117 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-62574477-d3c7-4b1d-91c8-e128a2bb1930 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:19:57.144953 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-62574477-d3c7-4b1d-91c8-e128a2bb1930 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:19:57.153776 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-62574477-d3c7-4b1d-91c8-e128a2bb1930 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.154316 Oct 20 06:19:57.154338 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 772/1528] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:19:56 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:19:57.323552 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-4e7c501e-3bc3-42fe-a1b6-1aad6d51ac9f tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:19:57.325711 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-4e7c501e-3bc3-42fe-a1b6-1aad6d51ac9f tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:19:57.332070 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-4e7c501e-3bc3-42fe-a1b6-1aad6d51ac9f tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:19:57.332556 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-4e7c501e-3bc3-42fe-a1b6-1aad6d51ac9f tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:19:57.333033 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-4e7c501e-3bc3-42fe-a1b6-1aad6d51ac9f tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:19:57.333740 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-4e7c501e-3bc3-42fe-a1b6-1aad6d51ac9f tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:19:57.334199 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-4e7c501e-3bc3-42fe-a1b6-1aad6d51ac9f tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:19:57.334632 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-4e7c501e-3bc3-42fe-a1b6-1aad6d51ac9f tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:19:57.365399 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-4e7c501e-3bc3-42fe-a1b6-1aad6d51ac9f tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046316 Oct 20 06:19:57.365961 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 757/1529] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:19:57 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:19:58.177748 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-fa21e0ea-28fb-4888-9486-3ebf28ae7434 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:19:58.178671 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-fa21e0ea-28fb-4888-9486-3ebf28ae7434 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:19:58.185119 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-fa21e0ea-28fb-4888-9486-3ebf28ae7434 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:19:58.185605 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-fa21e0ea-28fb-4888-9486-3ebf28ae7434 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:19:58.186042 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-fa21e0ea-28fb-4888-9486-3ebf28ae7434 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:19:58.186744 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-fa21e0ea-28fb-4888-9486-3ebf28ae7434 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:19:58.187197 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-fa21e0ea-28fb-4888-9486-3ebf28ae7434 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:19:58.187627 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-fa21e0ea-28fb-4888-9486-3ebf28ae7434 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:19:58.325786 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-fa21e0ea-28fb-4888-9486-3ebf28ae7434 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:19:58.328194 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG dbcounter [-] [118861] Writing DB stats nova_cell1:SELECT=100 {{(pid=118861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:19:58.335816 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-fa21e0ea-28fb-4888-9486-3ebf28ae7434 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.161938 Oct 20 06:19:58.336481 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 773/1530] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:19:58 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:19:58.378101 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-243b9311-f0a7-45d3-92c3-91d952357040 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:19:58.380269 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-243b9311-f0a7-45d3-92c3-91d952357040 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:19:58.391089 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-243b9311-f0a7-45d3-92c3-91d952357040 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:19:58.391576 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-243b9311-f0a7-45d3-92c3-91d952357040 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:19:58.392007 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-243b9311-f0a7-45d3-92c3-91d952357040 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:19:58.392913 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-243b9311-f0a7-45d3-92c3-91d952357040 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:19:58.393364 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-243b9311-f0a7-45d3-92c3-91d952357040 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:19:58.394028 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-243b9311-f0a7-45d3-92c3-91d952357040 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:19:58.424449 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-243b9311-f0a7-45d3-92c3-91d952357040 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050277 Oct 20 06:19:58.425032 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 758/1531] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:19:58 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:19:59.359034 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-d6c09f13-c090-408e-a106-f297914470fc tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:19:59.359671 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-d6c09f13-c090-408e-a106-f297914470fc tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:19:59.366180 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d6c09f13-c090-408e-a106-f297914470fc tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:19:59.366657 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d6c09f13-c090-408e-a106-f297914470fc tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:19:59.367090 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d6c09f13-c090-408e-a106-f297914470fc tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:19:59.367782 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d6c09f13-c090-408e-a106-f297914470fc tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:19:59.368225 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d6c09f13-c090-408e-a106-f297914470fc tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:19:59.368641 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d6c09f13-c090-408e-a106-f297914470fc tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:19:59.437456 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-1d835810-7e3e-4cce-831e-bdb8d3968e59 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:19:59.439731 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-1d835810-7e3e-4cce-831e-bdb8d3968e59 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:19:59.446888 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1d835810-7e3e-4cce-831e-bdb8d3968e59 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:19:59.447380 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1d835810-7e3e-4cce-831e-bdb8d3968e59 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:19:59.447823 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1d835810-7e3e-4cce-831e-bdb8d3968e59 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:19:59.448532 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1d835810-7e3e-4cce-831e-bdb8d3968e59 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:19:59.449582 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1d835810-7e3e-4cce-831e-bdb8d3968e59 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:19:59.449582 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1d835810-7e3e-4cce-831e-bdb8d3968e59 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:19:59.480785 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-1d835810-7e3e-4cce-831e-bdb8d3968e59 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047194 Oct 20 06:19:59.481735 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 759/1532] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:19:59 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 20 06:19:59.501888 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-d6c09f13-c090-408e-a106-f297914470fc tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:19:59.510876 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-d6c09f13-c090-408e-a106-f297914470fc tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.155707 Oct 20 06:19:59.511438 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 774/1533] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:19:59 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:20:00.493808 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-576b1335-fd66-44da-9670-58cd37935b75 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:20:00.495967 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-576b1335-fd66-44da-9670-58cd37935b75 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:20:00.502560 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-576b1335-fd66-44da-9670-58cd37935b75 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:20:00.503053 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-576b1335-fd66-44da-9670-58cd37935b75 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:20:00.503494 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-576b1335-fd66-44da-9670-58cd37935b75 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:20:00.504206 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-576b1335-fd66-44da-9670-58cd37935b75 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:20:00.504688 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-576b1335-fd66-44da-9670-58cd37935b75 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:20:00.505165 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-576b1335-fd66-44da-9670-58cd37935b75 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:20:00.534371 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-ff3e8603-9be7-4d76-bc69-8d69a05a52b1 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:20:00.534981 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-ff3e8603-9be7-4d76-bc69-8d69a05a52b1 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:20:00.536132 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-576b1335-fd66-44da-9670-58cd37935b75 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046845 Oct 20 06:20:00.536905 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 760/1534] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:20:00 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:20:00.545380 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ff3e8603-9be7-4d76-bc69-8d69a05a52b1 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:20:00.545865 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ff3e8603-9be7-4d76-bc69-8d69a05a52b1 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:20:00.546305 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ff3e8603-9be7-4d76-bc69-8d69a05a52b1 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:20:00.547009 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ff3e8603-9be7-4d76-bc69-8d69a05a52b1 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:20:00.547463 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ff3e8603-9be7-4d76-bc69-8d69a05a52b1 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:20:00.547887 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ff3e8603-9be7-4d76-bc69-8d69a05a52b1 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:20:00.682255 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-ff3e8603-9be7-4d76-bc69-8d69a05a52b1 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:20:00.690497 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-ff3e8603-9be7-4d76-bc69-8d69a05a52b1 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.160093 Oct 20 06:20:00.691075 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 775/1535] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:20:00 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 06:20:01.550343 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-c6137c6e-bd0d-4e78-bd1f-16b2f347470e tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:20:01.553257 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-c6137c6e-bd0d-4e78-bd1f-16b2f347470e tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:20:01.559836 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c6137c6e-bd0d-4e78-bd1f-16b2f347470e tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:20:01.560332 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c6137c6e-bd0d-4e78-bd1f-16b2f347470e tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:20:01.560805 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c6137c6e-bd0d-4e78-bd1f-16b2f347470e tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:20:01.561522 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c6137c6e-bd0d-4e78-bd1f-16b2f347470e tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:20:01.561979 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c6137c6e-bd0d-4e78-bd1f-16b2f347470e tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:20:01.562604 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c6137c6e-bd0d-4e78-bd1f-16b2f347470e tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:20:01.593142 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-c6137c6e-bd0d-4e78-bd1f-16b2f347470e tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047455 Oct 20 06:20:01.593965 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 761/1536] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:20:01 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:20:01.715731 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-66f98ee3-bee6-43a4-982a-34104c710bdc tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:20:01.717283 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-66f98ee3-bee6-43a4-982a-34104c710bdc tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:20:01.723785 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-66f98ee3-bee6-43a4-982a-34104c710bdc tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:20:01.724633 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-66f98ee3-bee6-43a4-982a-34104c710bdc tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:20:01.725887 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-66f98ee3-bee6-43a4-982a-34104c710bdc tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:20:01.726934 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-66f98ee3-bee6-43a4-982a-34104c710bdc tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:20:01.727701 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-66f98ee3-bee6-43a4-982a-34104c710bdc tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:20:01.728320 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-66f98ee3-bee6-43a4-982a-34104c710bdc tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:20:01.867189 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-66f98ee3-bee6-43a4-982a-34104c710bdc tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:20:01.875437 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-66f98ee3-bee6-43a4-982a-34104c710bdc tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.164339 Oct 20 06:20:01.876002 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 776/1537] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:20:01 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:20:02.606357 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-a6155001-11da-4380-bc3a-a71fda618557 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:20:02.608395 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-a6155001-11da-4380-bc3a-a71fda618557 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:20:02.614875 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a6155001-11da-4380-bc3a-a71fda618557 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:20:02.615355 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a6155001-11da-4380-bc3a-a71fda618557 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:20:02.615787 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a6155001-11da-4380-bc3a-a71fda618557 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:20:02.617262 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a6155001-11da-4380-bc3a-a71fda618557 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:20:02.617717 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a6155001-11da-4380-bc3a-a71fda618557 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:20:02.618139 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a6155001-11da-4380-bc3a-a71fda618557 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:20:02.645326 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG dbcounter [-] [118860] Writing DB stats nova_cell1:SELECT=100 {{(pid=118860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:20:02.648095 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-a6155001-11da-4380-bc3a-a71fda618557 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045720 Oct 20 06:20:02.648654 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 762/1538] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:20:02 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:20:02.901169 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-24bf9ff8-a7f4-47a7-a1f5-6de35d93076d tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:20:02.901837 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-24bf9ff8-a7f4-47a7-a1f5-6de35d93076d tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:20:02.908812 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-24bf9ff8-a7f4-47a7-a1f5-6de35d93076d tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:20:02.909301 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-24bf9ff8-a7f4-47a7-a1f5-6de35d93076d tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:20:02.909744 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-24bf9ff8-a7f4-47a7-a1f5-6de35d93076d tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:20:02.910604 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-24bf9ff8-a7f4-47a7-a1f5-6de35d93076d tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:20:02.911127 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-24bf9ff8-a7f4-47a7-a1f5-6de35d93076d tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:20:02.911482 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-24bf9ff8-a7f4-47a7-a1f5-6de35d93076d tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:20:03.054104 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-24bf9ff8-a7f4-47a7-a1f5-6de35d93076d tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:20:03.064203 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-24bf9ff8-a7f4-47a7-a1f5-6de35d93076d tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.168062 Oct 20 06:20:03.064851 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 777/1539] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:20:02 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:20:03.661049 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-e4c5fc1c-e097-449e-b717-41d0172d43a2 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:20:03.663899 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-e4c5fc1c-e097-449e-b717-41d0172d43a2 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:20:03.670387 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e4c5fc1c-e097-449e-b717-41d0172d43a2 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:20:03.670883 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e4c5fc1c-e097-449e-b717-41d0172d43a2 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:20:03.671321 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e4c5fc1c-e097-449e-b717-41d0172d43a2 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:20:03.672019 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e4c5fc1c-e097-449e-b717-41d0172d43a2 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:20:03.672476 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e4c5fc1c-e097-449e-b717-41d0172d43a2 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:20:03.672934 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e4c5fc1c-e097-449e-b717-41d0172d43a2 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:20:03.702573 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-e4c5fc1c-e097-449e-b717-41d0172d43a2 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045832 Oct 20 06:20:03.703132 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 763/1540] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:20:03 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:20:04.089697 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-63ce7af9-6b69-4f74-bbdf-64361333e1ac tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:20:04.090317 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-63ce7af9-6b69-4f74-bbdf-64361333e1ac tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:20:04.097065 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-63ce7af9-6b69-4f74-bbdf-64361333e1ac tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:20:04.097549 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-63ce7af9-6b69-4f74-bbdf-64361333e1ac tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:20:04.097988 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-63ce7af9-6b69-4f74-bbdf-64361333e1ac tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:20:04.098692 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-63ce7af9-6b69-4f74-bbdf-64361333e1ac tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:20:04.099142 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-63ce7af9-6b69-4f74-bbdf-64361333e1ac tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:20:04.099589 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-63ce7af9-6b69-4f74-bbdf-64361333e1ac tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:20:04.234097 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-63ce7af9-6b69-4f74-bbdf-64361333e1ac tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:20:04.244577 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-63ce7af9-6b69-4f74-bbdf-64361333e1ac tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.159525 Oct 20 06:20:04.245278 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 778/1541] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:20:04 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:20:04.715251 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-53ba426b-f2cf-4c9d-88b9-4505b11ef754 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:20:04.717437 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-53ba426b-f2cf-4c9d-88b9-4505b11ef754 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:20:04.723775 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-53ba426b-f2cf-4c9d-88b9-4505b11ef754 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:20:04.724257 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-53ba426b-f2cf-4c9d-88b9-4505b11ef754 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:20:04.724688 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-53ba426b-f2cf-4c9d-88b9-4505b11ef754 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:20:04.725990 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-53ba426b-f2cf-4c9d-88b9-4505b11ef754 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:20:04.726438 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-53ba426b-f2cf-4c9d-88b9-4505b11ef754 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:20:04.726858 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-53ba426b-f2cf-4c9d-88b9-4505b11ef754 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:20:04.757407 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-53ba426b-f2cf-4c9d-88b9-4505b11ef754 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046062 Oct 20 06:20:04.757972 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 764/1542] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:20:04 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:20:05.267524 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-ea1bc2f5-be5a-4273-ab19-69f30b46be8d tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:20:05.268164 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-ea1bc2f5-be5a-4273-ab19-69f30b46be8d tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:20:05.275559 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ea1bc2f5-be5a-4273-ab19-69f30b46be8d tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:20:05.276041 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ea1bc2f5-be5a-4273-ab19-69f30b46be8d tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:20:05.276477 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ea1bc2f5-be5a-4273-ab19-69f30b46be8d tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:20:05.277211 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ea1bc2f5-be5a-4273-ab19-69f30b46be8d tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:20:05.277673 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ea1bc2f5-be5a-4273-ab19-69f30b46be8d tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:20:05.278098 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ea1bc2f5-be5a-4273-ab19-69f30b46be8d tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:20:05.412183 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-ea1bc2f5-be5a-4273-ab19-69f30b46be8d tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:20:05.422626 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-ea1bc2f5-be5a-4273-ab19-69f30b46be8d tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.158605 Oct 20 06:20:05.423446 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 779/1543] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:20:05 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:20:05.770091 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-7e0bff56-1c72-4af2-b55c-f44ea58ea62c tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:20:05.772782 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-7e0bff56-1c72-4af2-b55c-f44ea58ea62c tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:20:05.779219 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7e0bff56-1c72-4af2-b55c-f44ea58ea62c tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:20:05.779708 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7e0bff56-1c72-4af2-b55c-f44ea58ea62c tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:20:05.780145 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7e0bff56-1c72-4af2-b55c-f44ea58ea62c tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:20:05.780882 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7e0bff56-1c72-4af2-b55c-f44ea58ea62c tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:20:05.781334 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7e0bff56-1c72-4af2-b55c-f44ea58ea62c tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:20:05.781760 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7e0bff56-1c72-4af2-b55c-f44ea58ea62c tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:20:05.813514 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-7e0bff56-1c72-4af2-b55c-f44ea58ea62c tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047386 Oct 20 06:20:05.814067 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 765/1544] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:20:05 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:20:06.446957 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-cb29ce6e-be25-4c95-b85b-e5db0ede6e50 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:20:06.447573 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-cb29ce6e-be25-4c95-b85b-e5db0ede6e50 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:20:06.453942 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-cb29ce6e-be25-4c95-b85b-e5db0ede6e50 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:20:06.454451 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-cb29ce6e-be25-4c95-b85b-e5db0ede6e50 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:20:06.454880 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-cb29ce6e-be25-4c95-b85b-e5db0ede6e50 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:20:06.455580 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-cb29ce6e-be25-4c95-b85b-e5db0ede6e50 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:20:06.456034 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-cb29ce6e-be25-4c95-b85b-e5db0ede6e50 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:20:06.456461 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-cb29ce6e-be25-4c95-b85b-e5db0ede6e50 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:20:06.601810 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-cb29ce6e-be25-4c95-b85b-e5db0ede6e50 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:20:06.610356 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-cb29ce6e-be25-4c95-b85b-e5db0ede6e50 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.167972 Oct 20 06:20:06.610932 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 780/1545] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:20:06 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:20:06.826517 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-a26f4351-77c6-451b-886a-49e6f4907bbd tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:20:06.828559 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-a26f4351-77c6-451b-886a-49e6f4907bbd tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:20:06.835960 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a26f4351-77c6-451b-886a-49e6f4907bbd tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:20:06.836437 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a26f4351-77c6-451b-886a-49e6f4907bbd tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:20:06.836973 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a26f4351-77c6-451b-886a-49e6f4907bbd tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:20:06.837699 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a26f4351-77c6-451b-886a-49e6f4907bbd tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:20:06.838208 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a26f4351-77c6-451b-886a-49e6f4907bbd tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:20:06.838629 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a26f4351-77c6-451b-886a-49e6f4907bbd tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:20:06.868745 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-a26f4351-77c6-451b-886a-49e6f4907bbd tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046377 Oct 20 06:20:06.869543 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 766/1546] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:20:06 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:20:07.634942 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-f9bed002-61ec-4396-95f9-155711ad6020 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:20:07.635565 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-f9bed002-61ec-4396-95f9-155711ad6020 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:20:07.642039 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f9bed002-61ec-4396-95f9-155711ad6020 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:20:07.642525 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f9bed002-61ec-4396-95f9-155711ad6020 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:20:07.642967 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f9bed002-61ec-4396-95f9-155711ad6020 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:20:07.643665 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f9bed002-61ec-4396-95f9-155711ad6020 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:20:07.644122 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f9bed002-61ec-4396-95f9-155711ad6020 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:20:07.644547 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f9bed002-61ec-4396-95f9-155711ad6020 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:20:07.773830 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-f9bed002-61ec-4396-95f9-155711ad6020 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:20:07.782296 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-f9bed002-61ec-4396-95f9-155711ad6020 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.152107 Oct 20 06:20:07.782961 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 781/1547] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:20:07 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:20:07.881995 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-23b7ab3e-f67b-4704-a5e9-d8969d45b911 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:20:07.884141 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-23b7ab3e-f67b-4704-a5e9-d8969d45b911 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:20:07.890634 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-23b7ab3e-f67b-4704-a5e9-d8969d45b911 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:20:07.891119 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-23b7ab3e-f67b-4704-a5e9-d8969d45b911 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:20:07.891565 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-23b7ab3e-f67b-4704-a5e9-d8969d45b911 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:20:07.892266 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-23b7ab3e-f67b-4704-a5e9-d8969d45b911 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:20:07.892746 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-23b7ab3e-f67b-4704-a5e9-d8969d45b911 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:20:07.893175 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-23b7ab3e-f67b-4704-a5e9-d8969d45b911 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:20:07.924132 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-23b7ab3e-f67b-4704-a5e9-d8969d45b911 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046911 Oct 20 06:20:07.924709 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 767/1548] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:20:07 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:20:08.806689 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-3f8e747a-7571-4815-9fad-1aabd05eea20 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:20:08.807280 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-3f8e747a-7571-4815-9fad-1aabd05eea20 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:20:08.809353 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 20 06:20:08.809502 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: Thu Oct 20 06:20:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f (ip 10.222.0.20) !!! Oct 20 06:20:08.816993 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-3f8e747a-7571-4815-9fad-1aabd05eea20 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:20:08.817476 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-3f8e747a-7571-4815-9fad-1aabd05eea20 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:20:08.817914 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-3f8e747a-7571-4815-9fad-1aabd05eea20 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:20:08.818668 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-3f8e747a-7571-4815-9fad-1aabd05eea20 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:20:08.819720 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-3f8e747a-7571-4815-9fad-1aabd05eea20 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:20:08.820110 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-3f8e747a-7571-4815-9fad-1aabd05eea20 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:20:08.936753 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-3ccec188-b593-4946-9ec2-ade944cf1e9a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:20:08.938906 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-3ccec188-b593-4946-9ec2-ade944cf1e9a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:20:08.945898 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3ccec188-b593-4946-9ec2-ade944cf1e9a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:20:08.946388 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3ccec188-b593-4946-9ec2-ade944cf1e9a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:20:08.946826 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3ccec188-b593-4946-9ec2-ade944cf1e9a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:20:08.947518 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3ccec188-b593-4946-9ec2-ade944cf1e9a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:20:08.948047 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3ccec188-b593-4946-9ec2-ade944cf1e9a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:20:08.948621 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3ccec188-b593-4946-9ec2-ade944cf1e9a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:20:08.955281 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-3f8e747a-7571-4815-9fad-1aabd05eea20 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:20:08.963454 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-3f8e747a-7571-4815-9fad-1aabd05eea20 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.161242 Oct 20 06:20:08.964037 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 782/1549] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:20:08 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:20:08.982465 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-3ccec188-b593-4946-9ec2-ade944cf1e9a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049647 Oct 20 06:20:08.983068 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 768/1550] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:20:08 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 20 06:20:09.986383 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-e5092999-4158-44a4-843d-317f0024c841 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:20:09.987002 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-e5092999-4158-44a4-843d-317f0024c841 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:20:09.994798 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e5092999-4158-44a4-843d-317f0024c841 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:20:09.995291 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e5092999-4158-44a4-843d-317f0024c841 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:20:09.995731 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e5092999-4158-44a4-843d-317f0024c841 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:20:09.996445 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e5092999-4158-44a4-843d-317f0024c841 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:20:09.996576 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-a12fa3de-927e-431c-ac41-70ea03cc2874 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:20:09.997051 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e5092999-4158-44a4-843d-317f0024c841 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:20:09.997336 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e5092999-4158-44a4-843d-317f0024c841 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:20:09.998998 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-a12fa3de-927e-431c-ac41-70ea03cc2874 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:20:10.004949 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a12fa3de-927e-431c-ac41-70ea03cc2874 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:20:10.005652 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a12fa3de-927e-431c-ac41-70ea03cc2874 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:20:10.006445 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a12fa3de-927e-431c-ac41-70ea03cc2874 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:20:10.007450 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a12fa3de-927e-431c-ac41-70ea03cc2874 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:20:10.007904 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a12fa3de-927e-431c-ac41-70ea03cc2874 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:20:10.008343 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a12fa3de-927e-431c-ac41-70ea03cc2874 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:20:10.041831 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-a12fa3de-927e-431c-ac41-70ea03cc2874 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050847 Oct 20 06:20:10.042423 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 769/1551] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:20:09 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:20:10.129338 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-e5092999-4158-44a4-843d-317f0024c841 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:20:10.138146 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-e5092999-4158-44a4-843d-317f0024c841 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.155698 Oct 20 06:20:10.138721 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 783/1552] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:20:09 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:20:11.055697 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-e99ac0d5-acdb-4a63-898f-7aa4894538a7 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:20:11.057759 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-e99ac0d5-acdb-4a63-898f-7aa4894538a7 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:20:11.064721 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e99ac0d5-acdb-4a63-898f-7aa4894538a7 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:20:11.066734 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e99ac0d5-acdb-4a63-898f-7aa4894538a7 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:20:11.066734 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e99ac0d5-acdb-4a63-898f-7aa4894538a7 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:20:11.067434 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e99ac0d5-acdb-4a63-898f-7aa4894538a7 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:20:11.067873 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e99ac0d5-acdb-4a63-898f-7aa4894538a7 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:20:11.068300 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e99ac0d5-acdb-4a63-898f-7aa4894538a7 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:20:11.103245 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-e99ac0d5-acdb-4a63-898f-7aa4894538a7 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052311 Oct 20 06:20:11.103983 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 770/1553] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:20:11 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:20:11.161830 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-ba592035-8f1f-4786-baef-4fabeb93b585 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:20:11.165069 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-ba592035-8f1f-4786-baef-4fabeb93b585 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:20:11.172929 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ba592035-8f1f-4786-baef-4fabeb93b585 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:20:11.173418 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ba592035-8f1f-4786-baef-4fabeb93b585 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:20:11.173901 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ba592035-8f1f-4786-baef-4fabeb93b585 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:20:11.174617 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ba592035-8f1f-4786-baef-4fabeb93b585 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:20:11.175096 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ba592035-8f1f-4786-baef-4fabeb93b585 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:20:11.175518 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ba592035-8f1f-4786-baef-4fabeb93b585 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:20:11.344239 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-ba592035-8f1f-4786-baef-4fabeb93b585 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:20:11.357415 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-ba592035-8f1f-4786-baef-4fabeb93b585 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.199378 Oct 20 06:20:11.363538 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 784/1554] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:20:11 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:20:12.116440 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-04c2ea44-765e-43a7-83a6-8409a7e03245 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:20:12.118715 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-04c2ea44-765e-43a7-83a6-8409a7e03245 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:20:12.125287 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-04c2ea44-765e-43a7-83a6-8409a7e03245 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:20:12.125784 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-04c2ea44-765e-43a7-83a6-8409a7e03245 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:20:12.126229 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-04c2ea44-765e-43a7-83a6-8409a7e03245 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:20:12.126941 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-04c2ea44-765e-43a7-83a6-8409a7e03245 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:20:12.127399 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-04c2ea44-765e-43a7-83a6-8409a7e03245 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:20:12.127832 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-04c2ea44-765e-43a7-83a6-8409a7e03245 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:20:12.159456 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-04c2ea44-765e-43a7-83a6-8409a7e03245 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047562 Oct 20 06:20:12.160042 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 771/1555] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:20:12 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:20:12.389990 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-403c25f6-b07b-46bf-aded-3f46f87d6058 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:20:12.390754 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-403c25f6-b07b-46bf-aded-3f46f87d6058 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:20:12.397742 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-403c25f6-b07b-46bf-aded-3f46f87d6058 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:20:12.398341 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-403c25f6-b07b-46bf-aded-3f46f87d6058 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:20:12.398881 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-403c25f6-b07b-46bf-aded-3f46f87d6058 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:20:12.399669 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-403c25f6-b07b-46bf-aded-3f46f87d6058 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:20:12.400200 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-403c25f6-b07b-46bf-aded-3f46f87d6058 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:20:12.400710 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-403c25f6-b07b-46bf-aded-3f46f87d6058 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:20:12.550152 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-403c25f6-b07b-46bf-aded-3f46f87d6058 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:20:12.559055 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-403c25f6-b07b-46bf-aded-3f46f87d6058 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.175563 Oct 20 06:20:12.560685 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 785/1556] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:20:12 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 06:20:13.172522 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-b1ed7469-5f46-468f-bbbf-2632ddecce53 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:20:13.174753 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-b1ed7469-5f46-468f-bbbf-2632ddecce53 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:20:13.181985 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b1ed7469-5f46-468f-bbbf-2632ddecce53 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:20:13.182469 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b1ed7469-5f46-468f-bbbf-2632ddecce53 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:20:13.182909 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b1ed7469-5f46-468f-bbbf-2632ddecce53 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:20:13.183603 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b1ed7469-5f46-468f-bbbf-2632ddecce53 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:20:13.184065 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b1ed7469-5f46-468f-bbbf-2632ddecce53 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:20:13.184492 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b1ed7469-5f46-468f-bbbf-2632ddecce53 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:20:13.214885 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-b1ed7469-5f46-468f-bbbf-2632ddecce53 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046273 Oct 20 06:20:13.215472 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 772/1557] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:20:13 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:20:13.586547 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-acfff5b2-1e35-4474-8fa8-b9c956b46071 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:20:13.587174 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-acfff5b2-1e35-4474-8fa8-b9c956b46071 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:20:13.593690 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-acfff5b2-1e35-4474-8fa8-b9c956b46071 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:20:13.594168 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-acfff5b2-1e35-4474-8fa8-b9c956b46071 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:20:13.594607 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-acfff5b2-1e35-4474-8fa8-b9c956b46071 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:20:13.595299 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-acfff5b2-1e35-4474-8fa8-b9c956b46071 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:20:13.595746 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-acfff5b2-1e35-4474-8fa8-b9c956b46071 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:20:13.596175 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-acfff5b2-1e35-4474-8fa8-b9c956b46071 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:20:13.726286 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-acfff5b2-1e35-4474-8fa8-b9c956b46071 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:20:13.734847 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-acfff5b2-1e35-4474-8fa8-b9c956b46071 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.152895 Oct 20 06:20:13.748723 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 786/1558] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:20:13 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:20:14.228437 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-936653e1-488d-4717-8660-a704bf6dc7b2 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:20:14.230745 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-936653e1-488d-4717-8660-a704bf6dc7b2 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:20:14.237663 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-936653e1-488d-4717-8660-a704bf6dc7b2 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:20:14.238074 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-936653e1-488d-4717-8660-a704bf6dc7b2 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:20:14.238512 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-936653e1-488d-4717-8660-a704bf6dc7b2 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:20:14.239211 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-936653e1-488d-4717-8660-a704bf6dc7b2 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:20:14.239659 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-936653e1-488d-4717-8660-a704bf6dc7b2 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:20:14.240083 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-936653e1-488d-4717-8660-a704bf6dc7b2 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:20:14.270951 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-936653e1-488d-4717-8660-a704bf6dc7b2 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047204 Oct 20 06:20:14.271549 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 773/1559] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:20:14 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:20:14.763041 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-5a66ee3b-0e68-4a5b-aeed-d3e37c77d775 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:20:14.763562 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-5a66ee3b-0e68-4a5b-aeed-d3e37c77d775 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:20:14.770041 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5a66ee3b-0e68-4a5b-aeed-d3e37c77d775 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:20:14.770471 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5a66ee3b-0e68-4a5b-aeed-d3e37c77d775 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:20:14.770903 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5a66ee3b-0e68-4a5b-aeed-d3e37c77d775 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:20:14.771593 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5a66ee3b-0e68-4a5b-aeed-d3e37c77d775 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:20:14.772090 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5a66ee3b-0e68-4a5b-aeed-d3e37c77d775 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:20:14.772615 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5a66ee3b-0e68-4a5b-aeed-d3e37c77d775 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:20:14.912664 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-5a66ee3b-0e68-4a5b-aeed-d3e37c77d775 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:20:14.921136 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-5a66ee3b-0e68-4a5b-aeed-d3e37c77d775 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.162075 Oct 20 06:20:14.925995 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 787/1560] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:20:14 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:20:15.284212 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-67cc9f4d-ecbd-42a9-8ff5-18a905d19979 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:20:15.286492 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-67cc9f4d-ecbd-42a9-8ff5-18a905d19979 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:20:15.293510 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-67cc9f4d-ecbd-42a9-8ff5-18a905d19979 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:20:15.293996 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-67cc9f4d-ecbd-42a9-8ff5-18a905d19979 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:20:15.294430 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-67cc9f4d-ecbd-42a9-8ff5-18a905d19979 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:20:15.295144 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-67cc9f4d-ecbd-42a9-8ff5-18a905d19979 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:20:15.295678 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-67cc9f4d-ecbd-42a9-8ff5-18a905d19979 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:20:15.296032 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-67cc9f4d-ecbd-42a9-8ff5-18a905d19979 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:20:15.329072 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-67cc9f4d-ecbd-42a9-8ff5-18a905d19979 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048709 Oct 20 06:20:15.329659 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 774/1561] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:20:15 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:20:15.945697 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-ae1f911d-8e1b-4124-8266-d0d2faa44038 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:20:15.946305 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-ae1f911d-8e1b-4124-8266-d0d2faa44038 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:20:15.952671 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ae1f911d-8e1b-4124-8266-d0d2faa44038 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:20:15.953223 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ae1f911d-8e1b-4124-8266-d0d2faa44038 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:20:15.953641 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ae1f911d-8e1b-4124-8266-d0d2faa44038 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:20:15.954338 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ae1f911d-8e1b-4124-8266-d0d2faa44038 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:20:15.954783 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ae1f911d-8e1b-4124-8266-d0d2faa44038 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:20:15.955198 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ae1f911d-8e1b-4124-8266-d0d2faa44038 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:20:16.093081 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-ae1f911d-8e1b-4124-8266-d0d2faa44038 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:20:16.102114 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-ae1f911d-8e1b-4124-8266-d0d2faa44038 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.160991 Oct 20 06:20:16.102703 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 788/1562] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:20:15 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:20:16.341907 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-de0670a3-eb09-49ce-9e34-4c320ffad986 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:20:16.344095 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-de0670a3-eb09-49ce-9e34-4c320ffad986 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:20:16.350926 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-de0670a3-eb09-49ce-9e34-4c320ffad986 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:20:16.351419 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-de0670a3-eb09-49ce-9e34-4c320ffad986 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:20:16.351862 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-de0670a3-eb09-49ce-9e34-4c320ffad986 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:20:16.352571 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-de0670a3-eb09-49ce-9e34-4c320ffad986 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:20:16.353052 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-de0670a3-eb09-49ce-9e34-4c320ffad986 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:20:16.353482 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-de0670a3-eb09-49ce-9e34-4c320ffad986 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:20:16.385840 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-de0670a3-eb09-49ce-9e34-4c320ffad986 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047812 Oct 20 06:20:16.386647 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 775/1563] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:20:16 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:20:17.125220 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-a081c52d-a9a7-4dc8-84a5-cbc62623a14d tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:20:17.126002 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-a081c52d-a9a7-4dc8-84a5-cbc62623a14d tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:20:17.137419 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a081c52d-a9a7-4dc8-84a5-cbc62623a14d tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:20:17.137915 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a081c52d-a9a7-4dc8-84a5-cbc62623a14d tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:20:17.138358 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a081c52d-a9a7-4dc8-84a5-cbc62623a14d tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:20:17.139063 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a081c52d-a9a7-4dc8-84a5-cbc62623a14d tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:20:17.139523 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a081c52d-a9a7-4dc8-84a5-cbc62623a14d tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:20:17.139935 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a081c52d-a9a7-4dc8-84a5-cbc62623a14d tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:20:17.274427 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-a081c52d-a9a7-4dc8-84a5-cbc62623a14d tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:20:17.282928 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-a081c52d-a9a7-4dc8-84a5-cbc62623a14d tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.161453 Oct 20 06:20:17.283515 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 789/1564] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:20:17 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:20:17.399911 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-9ee25273-d734-48d9-a653-7ef994455a37 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:20:17.402093 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-9ee25273-d734-48d9-a653-7ef994455a37 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:20:17.408537 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-9ee25273-d734-48d9-a653-7ef994455a37 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:20:17.409060 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-9ee25273-d734-48d9-a653-7ef994455a37 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:20:17.409511 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-9ee25273-d734-48d9-a653-7ef994455a37 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:20:17.410214 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-9ee25273-d734-48d9-a653-7ef994455a37 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:20:17.410674 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-9ee25273-d734-48d9-a653-7ef994455a37 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:20:17.411105 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-9ee25273-d734-48d9-a653-7ef994455a37 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:20:17.440632 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-9ee25273-d734-48d9-a653-7ef994455a37 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045326 Oct 20 06:20:17.441300 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 776/1565] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:20:17 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:20:18.308003 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-e898b61b-a173-47c0-879c-86ef3b2c0c8d tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:20:18.309284 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-e898b61b-a173-47c0-879c-86ef3b2c0c8d tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:20:18.315634 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e898b61b-a173-47c0-879c-86ef3b2c0c8d tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:20:18.316122 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e898b61b-a173-47c0-879c-86ef3b2c0c8d tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:20:18.316561 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e898b61b-a173-47c0-879c-86ef3b2c0c8d tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:20:18.317296 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e898b61b-a173-47c0-879c-86ef3b2c0c8d tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:20:18.317781 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e898b61b-a173-47c0-879c-86ef3b2c0c8d tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:20:18.318206 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e898b61b-a173-47c0-879c-86ef3b2c0c8d tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:20:18.333200 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG dbcounter [-] [118861] Writing DB stats nova_cell1:SELECT=100 {{(pid=118861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:20:18.447761 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-e898b61b-a173-47c0-879c-86ef3b2c0c8d tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:20:18.453186 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-f9529af3-d6f5-4207-a0d7-8e717925758e tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:20:18.455400 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-f9529af3-d6f5-4207-a0d7-8e717925758e tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:20:18.456971 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-e898b61b-a173-47c0-879c-86ef3b2c0c8d tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.153489 Oct 20 06:20:18.457559 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 790/1566] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:20:18 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 06:20:18.462711 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f9529af3-d6f5-4207-a0d7-8e717925758e tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:20:18.463193 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f9529af3-d6f5-4207-a0d7-8e717925758e tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:20:18.463629 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f9529af3-d6f5-4207-a0d7-8e717925758e tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:20:18.464331 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f9529af3-d6f5-4207-a0d7-8e717925758e tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:20:18.464805 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f9529af3-d6f5-4207-a0d7-8e717925758e tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:20:18.465229 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f9529af3-d6f5-4207-a0d7-8e717925758e tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:20:18.495824 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-f9529af3-d6f5-4207-a0d7-8e717925758e tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046458 Oct 20 06:20:18.496377 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 777/1567] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:20:18 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 20 06:20:19.481274 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-459f24a1-1464-4ce5-a82c-63823c9fe9ad tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:20:19.481891 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-459f24a1-1464-4ce5-a82c-63823c9fe9ad tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:20:19.488449 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-459f24a1-1464-4ce5-a82c-63823c9fe9ad tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:20:19.488968 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-459f24a1-1464-4ce5-a82c-63823c9fe9ad tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:20:19.489409 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-459f24a1-1464-4ce5-a82c-63823c9fe9ad tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:20:19.490098 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-459f24a1-1464-4ce5-a82c-63823c9fe9ad tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:20:19.491210 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-459f24a1-1464-4ce5-a82c-63823c9fe9ad tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:20:19.491735 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-459f24a1-1464-4ce5-a82c-63823c9fe9ad tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:20:19.508408 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-c550ad02-83e3-418a-8933-bca486eb640a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:20:19.511340 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-c550ad02-83e3-418a-8933-bca486eb640a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:20:19.517650 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c550ad02-83e3-418a-8933-bca486eb640a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:20:19.518138 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c550ad02-83e3-418a-8933-bca486eb640a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:20:19.518572 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c550ad02-83e3-418a-8933-bca486eb640a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:20:19.519300 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c550ad02-83e3-418a-8933-bca486eb640a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:20:19.519750 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c550ad02-83e3-418a-8933-bca486eb640a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:20:19.520178 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c550ad02-83e3-418a-8933-bca486eb640a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:20:19.551164 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-c550ad02-83e3-418a-8933-bca486eb640a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047598 Oct 20 06:20:19.551729 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 778/1568] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:20:19 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 20 06:20:19.626181 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-459f24a1-1464-4ce5-a82c-63823c9fe9ad tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:20:19.635342 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-459f24a1-1464-4ce5-a82c-63823c9fe9ad tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.157923 Oct 20 06:20:19.635919 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 791/1569] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:20:19 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:20:20.563693 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-cfcad133-05c0-4e1b-a8f4-df19ae86a5f9 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:20:20.566101 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-cfcad133-05c0-4e1b-a8f4-df19ae86a5f9 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:20:20.573550 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-cfcad133-05c0-4e1b-a8f4-df19ae86a5f9 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:20:20.574169 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-cfcad133-05c0-4e1b-a8f4-df19ae86a5f9 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:20:20.574705 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-cfcad133-05c0-4e1b-a8f4-df19ae86a5f9 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:20:20.575646 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-cfcad133-05c0-4e1b-a8f4-df19ae86a5f9 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:20:20.576204 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-cfcad133-05c0-4e1b-a8f4-df19ae86a5f9 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:20:20.576706 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-cfcad133-05c0-4e1b-a8f4-df19ae86a5f9 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:20:20.591403 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG dbcounter [-] [118860] Writing DB stats nova_cell1:SELECT=100 {{(pid=118860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:20:20.608216 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-cfcad133-05c0-4e1b-a8f4-df19ae86a5f9 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048611 Oct 20 06:20:20.608980 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 779/1570] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:20:20 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:20:20.658545 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-16e861d8-a29b-4958-9ebe-309fe3be21d2 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:20:20.659286 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-16e861d8-a29b-4958-9ebe-309fe3be21d2 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:20:20.666285 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-16e861d8-a29b-4958-9ebe-309fe3be21d2 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:20:20.666757 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-16e861d8-a29b-4958-9ebe-309fe3be21d2 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:20:20.667188 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-16e861d8-a29b-4958-9ebe-309fe3be21d2 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:20:20.667872 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-16e861d8-a29b-4958-9ebe-309fe3be21d2 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:20:20.668316 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-16e861d8-a29b-4958-9ebe-309fe3be21d2 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:20:20.669035 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-16e861d8-a29b-4958-9ebe-309fe3be21d2 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:20:20.799072 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-16e861d8-a29b-4958-9ebe-309fe3be21d2 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:20:20.808149 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-16e861d8-a29b-4958-9ebe-309fe3be21d2 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.153474 Oct 20 06:20:20.808748 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 792/1571] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:20:20 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:20:21.621107 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-1bcf7117-4682-48cf-b107-b7b8bb4aa69b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:20:21.623182 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-1bcf7117-4682-48cf-b107-b7b8bb4aa69b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:20:21.629479 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1bcf7117-4682-48cf-b107-b7b8bb4aa69b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:20:21.629966 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1bcf7117-4682-48cf-b107-b7b8bb4aa69b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:20:21.630451 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1bcf7117-4682-48cf-b107-b7b8bb4aa69b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:20:21.631155 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1bcf7117-4682-48cf-b107-b7b8bb4aa69b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:20:21.631866 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1bcf7117-4682-48cf-b107-b7b8bb4aa69b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:20:21.632376 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1bcf7117-4682-48cf-b107-b7b8bb4aa69b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:20:21.664166 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-1bcf7117-4682-48cf-b107-b7b8bb4aa69b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047350 Oct 20 06:20:21.664763 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 780/1572] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:20:21 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:20:21.831335 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-da0b033b-01a3-4787-aff5-600fd5c3d3f7 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:20:21.831944 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-da0b033b-01a3-4787-aff5-600fd5c3d3f7 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:20:21.838594 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-da0b033b-01a3-4787-aff5-600fd5c3d3f7 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:20:21.839076 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-da0b033b-01a3-4787-aff5-600fd5c3d3f7 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:20:21.839511 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-da0b033b-01a3-4787-aff5-600fd5c3d3f7 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:20:21.840212 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-da0b033b-01a3-4787-aff5-600fd5c3d3f7 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:20:21.840660 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-da0b033b-01a3-4787-aff5-600fd5c3d3f7 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:20:21.841107 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-da0b033b-01a3-4787-aff5-600fd5c3d3f7 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:20:21.985809 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-da0b033b-01a3-4787-aff5-600fd5c3d3f7 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:20:21.994884 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-da0b033b-01a3-4787-aff5-600fd5c3d3f7 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.167406 Oct 20 06:20:21.995457 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 793/1573] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:20:21 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:20:22.675553 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-647a5e78-c62d-4ab8-af58-34f5ddde0d5e tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:20:22.677689 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-647a5e78-c62d-4ab8-af58-34f5ddde0d5e tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:20:22.684677 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-647a5e78-c62d-4ab8-af58-34f5ddde0d5e tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:20:22.685193 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-647a5e78-c62d-4ab8-af58-34f5ddde0d5e tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:20:22.685630 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-647a5e78-c62d-4ab8-af58-34f5ddde0d5e tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:20:22.686336 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-647a5e78-c62d-4ab8-af58-34f5ddde0d5e tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:20:22.686777 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-647a5e78-c62d-4ab8-af58-34f5ddde0d5e tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:20:22.687198 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-647a5e78-c62d-4ab8-af58-34f5ddde0d5e tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:20:22.717239 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-647a5e78-c62d-4ab8-af58-34f5ddde0d5e tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045553 Oct 20 06:20:22.717786 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 781/1574] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:20:22 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:20:23.027408 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-e7c2dfd0-8b42-4512-b996-96cb8e3505b0 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:20:23.028037 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-e7c2dfd0-8b42-4512-b996-96cb8e3505b0 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:20:23.034879 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e7c2dfd0-8b42-4512-b996-96cb8e3505b0 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:20:23.035365 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e7c2dfd0-8b42-4512-b996-96cb8e3505b0 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:20:23.035804 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e7c2dfd0-8b42-4512-b996-96cb8e3505b0 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:20:23.036492 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e7c2dfd0-8b42-4512-b996-96cb8e3505b0 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:20:23.036964 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e7c2dfd0-8b42-4512-b996-96cb8e3505b0 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:20:23.037950 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e7c2dfd0-8b42-4512-b996-96cb8e3505b0 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:20:23.175237 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-e7c2dfd0-8b42-4512-b996-96cb8e3505b0 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:20:23.183545 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-e7c2dfd0-8b42-4512-b996-96cb8e3505b0 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.159978 Oct 20 06:20:23.184118 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 794/1575] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:20:23 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:20:23.729991 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-dd88107e-ea47-4ae2-bf13-e2354f9f862a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:20:23.732303 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-dd88107e-ea47-4ae2-bf13-e2354f9f862a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:20:23.739879 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-dd88107e-ea47-4ae2-bf13-e2354f9f862a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:20:23.740359 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-dd88107e-ea47-4ae2-bf13-e2354f9f862a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:20:23.740921 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-dd88107e-ea47-4ae2-bf13-e2354f9f862a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:20:23.741779 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-dd88107e-ea47-4ae2-bf13-e2354f9f862a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:20:23.742308 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-dd88107e-ea47-4ae2-bf13-e2354f9f862a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:20:23.742894 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-dd88107e-ea47-4ae2-bf13-e2354f9f862a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:20:23.775098 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-dd88107e-ea47-4ae2-bf13-e2354f9f862a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049129 Oct 20 06:20:23.775673 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 782/1576] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:20:23 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:20:24.207015 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-a61cf728-eaf4-44f0-b2b8-4ea2aabe019c tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:20:24.207624 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-a61cf728-eaf4-44f0-b2b8-4ea2aabe019c tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:20:24.215354 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a61cf728-eaf4-44f0-b2b8-4ea2aabe019c tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:20:24.215831 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a61cf728-eaf4-44f0-b2b8-4ea2aabe019c tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:20:24.216257 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a61cf728-eaf4-44f0-b2b8-4ea2aabe019c tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:20:24.216976 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a61cf728-eaf4-44f0-b2b8-4ea2aabe019c tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:20:24.217419 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a61cf728-eaf4-44f0-b2b8-4ea2aabe019c tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:20:24.217836 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a61cf728-eaf4-44f0-b2b8-4ea2aabe019c tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:20:24.346959 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-a61cf728-eaf4-44f0-b2b8-4ea2aabe019c tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:20:24.355399 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-a61cf728-eaf4-44f0-b2b8-4ea2aabe019c tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.152390 Oct 20 06:20:24.355970 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 795/1577] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:20:24 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:20:24.788535 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-4ad8594c-d7be-45e4-9daa-5cb1d533da3c tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:20:24.790720 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-4ad8594c-d7be-45e4-9daa-5cb1d533da3c tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:20:24.797171 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-4ad8594c-d7be-45e4-9daa-5cb1d533da3c tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:20:24.797654 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-4ad8594c-d7be-45e4-9daa-5cb1d533da3c tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:20:24.798097 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-4ad8594c-d7be-45e4-9daa-5cb1d533da3c tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:20:24.798788 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-4ad8594c-d7be-45e4-9daa-5cb1d533da3c tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:20:24.799245 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-4ad8594c-d7be-45e4-9daa-5cb1d533da3c tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:20:24.799671 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-4ad8594c-d7be-45e4-9daa-5cb1d533da3c tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:20:24.829073 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-4ad8594c-d7be-45e4-9daa-5cb1d533da3c tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045208 Oct 20 06:20:24.829644 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 783/1578] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:20:24 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:20:25.379472 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-519a9211-6194-4ac7-a6d1-a8fa693e4bd2 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:20:25.380015 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-519a9211-6194-4ac7-a6d1-a8fa693e4bd2 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:20:25.382754 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG dbcounter [-] [118861] Writing DB stats nova_api:SELECT=52 {{(pid=118861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:20:25.388177 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-519a9211-6194-4ac7-a6d1-a8fa693e4bd2 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:20:25.388660 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-519a9211-6194-4ac7-a6d1-a8fa693e4bd2 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:20:25.389136 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-519a9211-6194-4ac7-a6d1-a8fa693e4bd2 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:20:25.389837 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-519a9211-6194-4ac7-a6d1-a8fa693e4bd2 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:20:25.390289 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-519a9211-6194-4ac7-a6d1-a8fa693e4bd2 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:20:25.390733 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-519a9211-6194-4ac7-a6d1-a8fa693e4bd2 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:20:25.530271 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-519a9211-6194-4ac7-a6d1-a8fa693e4bd2 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:20:25.539713 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-519a9211-6194-4ac7-a6d1-a8fa693e4bd2 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.164154 Oct 20 06:20:25.540316 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 796/1579] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:20:25 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:20:25.841470 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-f041dece-1905-4032-85f6-8e6f3bddb19a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:20:25.843585 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-f041dece-1905-4032-85f6-8e6f3bddb19a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:20:25.845877 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG dbcounter [-] [118860] Writing DB stats nova_api:SELECT=58 {{(pid=118860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:20:25.851977 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f041dece-1905-4032-85f6-8e6f3bddb19a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:20:25.852459 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f041dece-1905-4032-85f6-8e6f3bddb19a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:20:25.852928 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f041dece-1905-4032-85f6-8e6f3bddb19a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:20:25.853618 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f041dece-1905-4032-85f6-8e6f3bddb19a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:20:25.854067 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f041dece-1905-4032-85f6-8e6f3bddb19a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:20:25.854481 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f041dece-1905-4032-85f6-8e6f3bddb19a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:20:25.885241 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-f041dece-1905-4032-85f6-8e6f3bddb19a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047645 Oct 20 06:20:25.885818 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 784/1580] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:20:25 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:20:26.567590 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-9649eff6-1b40-48e2-bad6-ed45512fcc6d tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:20:26.568171 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-9649eff6-1b40-48e2-bad6-ed45512fcc6d tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:20:26.575460 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-9649eff6-1b40-48e2-bad6-ed45512fcc6d tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:20:26.575955 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-9649eff6-1b40-48e2-bad6-ed45512fcc6d tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:20:26.576401 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-9649eff6-1b40-48e2-bad6-ed45512fcc6d tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:20:26.577186 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-9649eff6-1b40-48e2-bad6-ed45512fcc6d tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:20:26.577643 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-9649eff6-1b40-48e2-bad6-ed45512fcc6d tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:20:26.578071 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-9649eff6-1b40-48e2-bad6-ed45512fcc6d tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:20:26.716502 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-9649eff6-1b40-48e2-bad6-ed45512fcc6d tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:20:26.725048 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-9649eff6-1b40-48e2-bad6-ed45512fcc6d tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.161338 Oct 20 06:20:26.725627 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 797/1581] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:20:26 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:20:26.898518 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-bfd4522f-474a-4b6d-b63a-7fc316910cdb tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:20:26.900738 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-bfd4522f-474a-4b6d-b63a-7fc316910cdb tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:20:26.907324 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-bfd4522f-474a-4b6d-b63a-7fc316910cdb tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:20:26.907826 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-bfd4522f-474a-4b6d-b63a-7fc316910cdb tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:20:26.908270 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-bfd4522f-474a-4b6d-b63a-7fc316910cdb tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:20:26.909007 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-bfd4522f-474a-4b6d-b63a-7fc316910cdb tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:20:26.909469 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-bfd4522f-474a-4b6d-b63a-7fc316910cdb tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:20:26.909898 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-bfd4522f-474a-4b6d-b63a-7fc316910cdb tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:20:26.940226 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-bfd4522f-474a-4b6d-b63a-7fc316910cdb tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046241 Oct 20 06:20:26.941139 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 785/1582] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:20:26 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:20:27.748222 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-5a30aa97-d515-4249-8dd8-8ca49388293b tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:20:27.748862 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-5a30aa97-d515-4249-8dd8-8ca49388293b tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:20:27.754950 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5a30aa97-d515-4249-8dd8-8ca49388293b tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:20:27.755427 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5a30aa97-d515-4249-8dd8-8ca49388293b tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:20:27.755864 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5a30aa97-d515-4249-8dd8-8ca49388293b tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:20:27.757768 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5a30aa97-d515-4249-8dd8-8ca49388293b tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:20:27.758224 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5a30aa97-d515-4249-8dd8-8ca49388293b tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:20:27.758651 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5a30aa97-d515-4249-8dd8-8ca49388293b tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:20:27.888599 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-5a30aa97-d515-4249-8dd8-8ca49388293b tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:20:27.897218 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-5a30aa97-d515-4249-8dd8-8ca49388293b tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.152450 Oct 20 06:20:27.897554 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 798/1583] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:20:27 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:20:27.953154 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-2a86f89c-ce20-41e2-945d-7a45d5f6a017 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:20:27.955274 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-2a86f89c-ce20-41e2-945d-7a45d5f6a017 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:20:27.961747 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2a86f89c-ce20-41e2-945d-7a45d5f6a017 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:20:27.962229 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2a86f89c-ce20-41e2-945d-7a45d5f6a017 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:20:27.962665 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2a86f89c-ce20-41e2-945d-7a45d5f6a017 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:20:27.963384 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2a86f89c-ce20-41e2-945d-7a45d5f6a017 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:20:27.963833 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2a86f89c-ce20-41e2-945d-7a45d5f6a017 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:20:27.964255 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2a86f89c-ce20-41e2-945d-7a45d5f6a017 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:20:27.994200 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-2a86f89c-ce20-41e2-945d-7a45d5f6a017 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045296 Oct 20 06:20:27.995161 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 786/1584] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:20:27 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:20:28.919733 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-23a42703-22cb-4ded-913e-65e83f41f77b tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:20:28.920444 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-23a42703-22cb-4ded-913e-65e83f41f77b tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:20:28.926807 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-23a42703-22cb-4ded-913e-65e83f41f77b tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:20:28.927292 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-23a42703-22cb-4ded-913e-65e83f41f77b tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:20:28.927728 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-23a42703-22cb-4ded-913e-65e83f41f77b tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:20:28.928426 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-23a42703-22cb-4ded-913e-65e83f41f77b tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:20:28.928904 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-23a42703-22cb-4ded-913e-65e83f41f77b tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:20:28.929394 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-23a42703-22cb-4ded-913e-65e83f41f77b tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:20:29.008184 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-ffd77d73-9be4-4620-9ea3-a140c8a53662 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:20:29.010847 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-ffd77d73-9be4-4620-9ea3-a140c8a53662 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:20:29.016799 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-ffd77d73-9be4-4620-9ea3-a140c8a53662 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:20:29.017289 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-ffd77d73-9be4-4620-9ea3-a140c8a53662 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:20:29.017722 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-ffd77d73-9be4-4620-9ea3-a140c8a53662 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:20:29.018688 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-ffd77d73-9be4-4620-9ea3-a140c8a53662 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:20:29.019138 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-ffd77d73-9be4-4620-9ea3-a140c8a53662 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:20:29.019610 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-ffd77d73-9be4-4620-9ea3-a140c8a53662 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:20:29.051286 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-ffd77d73-9be4-4620-9ea3-a140c8a53662 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048019 Oct 20 06:20:29.056455 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 787/1585] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:20:29 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 20 06:20:29.065594 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-23a42703-22cb-4ded-913e-65e83f41f77b tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:20:29.074820 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-23a42703-22cb-4ded-913e-65e83f41f77b tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.159020 Oct 20 06:20:29.075387 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 799/1586] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:20:28 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:20:30.063695 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-a2cb9aac-f290-4b49-8b0e-972174f9d9cb tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:20:30.065785 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-a2cb9aac-f290-4b49-8b0e-972174f9d9cb tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:20:30.072174 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a2cb9aac-f290-4b49-8b0e-972174f9d9cb tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:20:30.072652 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a2cb9aac-f290-4b49-8b0e-972174f9d9cb tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:20:30.073146 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a2cb9aac-f290-4b49-8b0e-972174f9d9cb tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:20:30.073832 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a2cb9aac-f290-4b49-8b0e-972174f9d9cb tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:20:30.074279 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a2cb9aac-f290-4b49-8b0e-972174f9d9cb tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:20:30.074704 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a2cb9aac-f290-4b49-8b0e-972174f9d9cb tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:20:30.097723 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-2471bf77-8016-42e2-8e97-1d5f983acd81 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:20:30.098462 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-2471bf77-8016-42e2-8e97-1d5f983acd81 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:20:30.105216 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-a2cb9aac-f290-4b49-8b0e-972174f9d9cb tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045581 Oct 20 06:20:30.105974 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 788/1587] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:20:30 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:20:30.106131 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-2471bf77-8016-42e2-8e97-1d5f983acd81 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:20:30.106583 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-2471bf77-8016-42e2-8e97-1d5f983acd81 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:20:30.107021 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-2471bf77-8016-42e2-8e97-1d5f983acd81 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:20:30.107730 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-2471bf77-8016-42e2-8e97-1d5f983acd81 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:20:30.108253 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-2471bf77-8016-42e2-8e97-1d5f983acd81 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:20:30.108702 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-2471bf77-8016-42e2-8e97-1d5f983acd81 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:20:30.243379 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-2471bf77-8016-42e2-8e97-1d5f983acd81 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:20:30.251789 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-2471bf77-8016-42e2-8e97-1d5f983acd81 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.157898 Oct 20 06:20:30.252383 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 800/1588] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:20:30 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:20:31.118040 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-bcafc1a0-85a0-4f06-9193-e964cc1bb278 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:20:31.120167 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-bcafc1a0-85a0-4f06-9193-e964cc1bb278 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:20:31.126595 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-bcafc1a0-85a0-4f06-9193-e964cc1bb278 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:20:31.127083 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-bcafc1a0-85a0-4f06-9193-e964cc1bb278 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:20:31.127526 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-bcafc1a0-85a0-4f06-9193-e964cc1bb278 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:20:31.128224 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-bcafc1a0-85a0-4f06-9193-e964cc1bb278 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:20:31.128677 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-bcafc1a0-85a0-4f06-9193-e964cc1bb278 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:20:31.129130 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-bcafc1a0-85a0-4f06-9193-e964cc1bb278 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:20:31.160418 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-bcafc1a0-85a0-4f06-9193-e964cc1bb278 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046525 Oct 20 06:20:31.161016 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 789/1589] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:20:31 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:20:31.277289 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-b4600032-4980-446e-a874-4deb41eef822 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:20:31.277904 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-b4600032-4980-446e-a874-4deb41eef822 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:20:31.284554 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b4600032-4980-446e-a874-4deb41eef822 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:20:31.285074 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b4600032-4980-446e-a874-4deb41eef822 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:20:31.285510 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b4600032-4980-446e-a874-4deb41eef822 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:20:31.286216 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b4600032-4980-446e-a874-4deb41eef822 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:20:31.286664 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b4600032-4980-446e-a874-4deb41eef822 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:20:31.287094 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b4600032-4980-446e-a874-4deb41eef822 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:20:31.582601 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-b4600032-4980-446e-a874-4deb41eef822 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:20:31.591969 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-b4600032-4980-446e-a874-4deb41eef822 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.319351 Oct 20 06:20:31.592543 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 801/1590] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:20:31 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:20:32.172400 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-59d6b5e5-f389-4b41-a310-bce7f853f485 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:20:32.174579 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-59d6b5e5-f389-4b41-a310-bce7f853f485 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:20:32.181364 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-59d6b5e5-f389-4b41-a310-bce7f853f485 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:20:32.181851 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-59d6b5e5-f389-4b41-a310-bce7f853f485 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:20:32.182293 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-59d6b5e5-f389-4b41-a310-bce7f853f485 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:20:32.183000 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-59d6b5e5-f389-4b41-a310-bce7f853f485 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:20:32.183458 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-59d6b5e5-f389-4b41-a310-bce7f853f485 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:20:32.183888 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-59d6b5e5-f389-4b41-a310-bce7f853f485 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:20:32.213670 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-59d6b5e5-f389-4b41-a310-bce7f853f485 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045321 Oct 20 06:20:32.214231 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 790/1591] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:20:32 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:20:32.616039 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-c81b186c-0b99-4e81-93a5-f22ad0625e56 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:20:32.616769 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-c81b186c-0b99-4e81-93a5-f22ad0625e56 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:20:32.624771 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c81b186c-0b99-4e81-93a5-f22ad0625e56 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:20:32.625483 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c81b186c-0b99-4e81-93a5-f22ad0625e56 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:20:32.626033 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c81b186c-0b99-4e81-93a5-f22ad0625e56 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:20:32.626844 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c81b186c-0b99-4e81-93a5-f22ad0625e56 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:20:32.627476 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c81b186c-0b99-4e81-93a5-f22ad0625e56 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:20:32.628069 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c81b186c-0b99-4e81-93a5-f22ad0625e56 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:20:32.757588 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-c81b186c-0b99-4e81-93a5-f22ad0625e56 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:20:32.766001 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-c81b186c-0b99-4e81-93a5-f22ad0625e56 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.154427 Oct 20 06:20:32.766564 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 802/1592] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:20:32 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:20:33.226048 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-adf7ef1a-98a4-4c24-83e2-1870030f4c05 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:20:33.228462 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-adf7ef1a-98a4-4c24-83e2-1870030f4c05 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:20:33.235010 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-adf7ef1a-98a4-4c24-83e2-1870030f4c05 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:20:33.235492 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-adf7ef1a-98a4-4c24-83e2-1870030f4c05 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:20:33.235933 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-adf7ef1a-98a4-4c24-83e2-1870030f4c05 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:20:33.236624 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-adf7ef1a-98a4-4c24-83e2-1870030f4c05 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:20:33.237108 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-adf7ef1a-98a4-4c24-83e2-1870030f4c05 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:20:33.237537 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-adf7ef1a-98a4-4c24-83e2-1870030f4c05 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:20:33.269221 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-adf7ef1a-98a4-4c24-83e2-1870030f4c05 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047032 Oct 20 06:20:33.269790 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 791/1593] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:20:33 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:20:33.626399 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-bf586638-bdfb-4452-8291-4010f9d0d9e1 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:20:33.626933 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-bf586638-bdfb-4452-8291-4010f9d0d9e1 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:20:33.633902 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-bf586638-bdfb-4452-8291-4010f9d0d9e1 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:20:33.634381 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-bf586638-bdfb-4452-8291-4010f9d0d9e1 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:20:33.634809 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-bf586638-bdfb-4452-8291-4010f9d0d9e1 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:20:33.635513 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-bf586638-bdfb-4452-8291-4010f9d0d9e1 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:20:33.635961 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-bf586638-bdfb-4452-8291-4010f9d0d9e1 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:20:33.636386 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-bf586638-bdfb-4452-8291-4010f9d0d9e1 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:20:33.664181 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-bf586638-bdfb-4452-8291-4010f9d0d9e1 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Going to try to terminate instance {{(pid=118861) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 20 06:20:33.762195 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-bf586638-bdfb-4452-8291-4010f9d0d9e1 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "DELETE /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 204 len: 0 microversion: 2.1 time: 0.139296 Oct 20 06:20:33.763155 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 803/1594] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 20 06:20:33 2022] DELETE /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 20 06:20:33.771420 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-e5da2896-a58c-4684-a928-a0f0ec2d4e5e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:20:33.772030 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-e5da2896-a58c-4684-a928-a0f0ec2d4e5e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:20:33.778703 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e5da2896-a58c-4684-a928-a0f0ec2d4e5e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:20:33.779189 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e5da2896-a58c-4684-a928-a0f0ec2d4e5e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:20:33.779625 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e5da2896-a58c-4684-a928-a0f0ec2d4e5e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:20:33.780349 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e5da2896-a58c-4684-a928-a0f0ec2d4e5e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:20:33.780824 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e5da2896-a58c-4684-a928-a0f0ec2d4e5e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:20:33.781248 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e5da2896-a58c-4684-a928-a0f0ec2d4e5e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:20:33.790732 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-b55341dd-9a58-42ab-85b5-a43e2ca3ddee tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:20:33.791747 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-b55341dd-9a58-42ab-85b5-a43e2ca3ddee tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:20:33.797922 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b55341dd-9a58-42ab-85b5-a43e2ca3ddee tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:20:33.798658 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b55341dd-9a58-42ab-85b5-a43e2ca3ddee tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:20:33.799146 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b55341dd-9a58-42ab-85b5-a43e2ca3ddee tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:20:33.799853 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b55341dd-9a58-42ab-85b5-a43e2ca3ddee tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:20:33.800308 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b55341dd-9a58-42ab-85b5-a43e2ca3ddee tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:20:33.800758 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b55341dd-9a58-42ab-85b5-a43e2ca3ddee tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:20:33.946624 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-b55341dd-9a58-42ab-85b5-a43e2ca3ddee tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:20:33.958328 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-b55341dd-9a58-42ab-85b5-a43e2ca3ddee tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.171935 Oct 20 06:20:33.973510 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 804/1595] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:20:33 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 06:20:34.029079 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-e5da2896-a58c-4684-a928-a0f0ec2d4e5e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:20:34.037806 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-e5da2896-a58c-4684-a928-a0f0ec2d4e5e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1727 microversion: 2.1 time: 0.270246 Oct 20 06:20:34.038715 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 792/1596] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:20:33 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1727 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:20:34.282382 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-d4d05c52-f3d2-4d70-8cb0-c255441f16b8 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:20:34.284486 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-d4d05c52-f3d2-4d70-8cb0-c255441f16b8 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:20:34.290956 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d4d05c52-f3d2-4d70-8cb0-c255441f16b8 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:20:34.291435 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d4d05c52-f3d2-4d70-8cb0-c255441f16b8 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:20:34.291858 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d4d05c52-f3d2-4d70-8cb0-c255441f16b8 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:20:34.292540 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d4d05c52-f3d2-4d70-8cb0-c255441f16b8 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:20:34.293011 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d4d05c52-f3d2-4d70-8cb0-c255441f16b8 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:20:34.293428 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d4d05c52-f3d2-4d70-8cb0-c255441f16b8 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:20:34.307602 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG dbcounter [-] [118861] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:20:34.327962 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-d4d05c52-f3d2-4d70-8cb0-c255441f16b8 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049551 Oct 20 06:20:34.328523 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 805/1597] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:20:34 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:20:34.983414 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-bb952691-2e6c-4142-af00-5199af1484aa tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:20:34.984201 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-bb952691-2e6c-4142-af00-5199af1484aa tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:20:34.991233 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-bb952691-2e6c-4142-af00-5199af1484aa tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:20:34.991748 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-bb952691-2e6c-4142-af00-5199af1484aa tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:20:34.992810 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-bb952691-2e6c-4142-af00-5199af1484aa tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:20:34.993510 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-bb952691-2e6c-4142-af00-5199af1484aa tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:20:34.994302 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-bb952691-2e6c-4142-af00-5199af1484aa tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:20:34.994728 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-bb952691-2e6c-4142-af00-5199af1484aa tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:20:35.062824 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-90669d6b-eb57-40eb-868b-ecf2ff6c8be1 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:20:35.084587 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-90669d6b-eb57-40eb-868b-ecf2ff6c8be1 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:20:35.100249 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-90669d6b-eb57-40eb-868b-ecf2ff6c8be1 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:20:35.103927 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-90669d6b-eb57-40eb-868b-ecf2ff6c8be1 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:20:35.104495 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-90669d6b-eb57-40eb-868b-ecf2ff6c8be1 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:20:35.105282 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-90669d6b-eb57-40eb-868b-ecf2ff6c8be1 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:20:35.105751 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-90669d6b-eb57-40eb-868b-ecf2ff6c8be1 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:20:35.106202 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-90669d6b-eb57-40eb-868b-ecf2ff6c8be1 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:20:35.188824 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-90669d6b-eb57-40eb-868b-ecf2ff6c8be1 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:20:35.197870 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-90669d6b-eb57-40eb-868b-ecf2ff6c8be1 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1660 microversion: 2.1 time: 0.139709 Oct 20 06:20:35.198627 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 806/1598] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:20:35 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1660 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 06:20:35.273774 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-bb952691-2e6c-4142-af00-5199af1484aa tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:20:35.282645 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-bb952691-2e6c-4142-af00-5199af1484aa tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.303110 Oct 20 06:20:35.283372 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 793/1599] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:20:34 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:20:35.341604 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-f2c766f4-e45f-47cc-9be6-a3e3ef46789a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:20:35.343917 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-f2c766f4-e45f-47cc-9be6-a3e3ef46789a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:20:35.350336 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f2c766f4-e45f-47cc-9be6-a3e3ef46789a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:20:35.351031 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f2c766f4-e45f-47cc-9be6-a3e3ef46789a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:20:35.352187 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f2c766f4-e45f-47cc-9be6-a3e3ef46789a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:20:35.353191 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f2c766f4-e45f-47cc-9be6-a3e3ef46789a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:20:35.353753 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f2c766f4-e45f-47cc-9be6-a3e3ef46789a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:20:35.354283 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f2c766f4-e45f-47cc-9be6-a3e3ef46789a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:20:35.404619 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-f2c766f4-e45f-47cc-9be6-a3e3ef46789a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.068310 Oct 20 06:20:35.405323 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 807/1600] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:20:35 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:20:35.519039 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [req-7b7369a9-ecfe-48f2-a684-e3c2269de34e req-726682ef-3af8-4e60-bc65-9df21d97808d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4ba366c-2f51-44e0-b5da-c838e4672533", "name": "network-vif-deleted", "tag": "943f88da-f813-40be-a9ed-2fe73f75124f"}]} {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 06:20:35.530977 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [req-7b7369a9-ecfe-48f2-a684-e3c2269de34e req-726682ef-3af8-4e60-bc65-9df21d97808d service nova] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:20:35.531669 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [req-7b7369a9-ecfe-48f2-a684-e3c2269de34e req-726682ef-3af8-4e60-bc65-9df21d97808d service nova] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:20:35.532269 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [req-7b7369a9-ecfe-48f2-a684-e3c2269de34e req-726682ef-3af8-4e60-bc65-9df21d97808d service nova] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:20:35.550218 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.compute.server_external_events [req-7b7369a9-ecfe-48f2-a684-e3c2269de34e req-726682ef-3af8-4e60-bc65-9df21d97808d service nova] Creating event network-vif-deleted:943f88da-f813-40be-a9ed-2fe73f75124f for instance d4ba366c-2f51-44e0-b5da-c838e4672533 on hv-cinder-86156 Oct 20 06:20:35.555334 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [req-7b7369a9-ecfe-48f2-a684-e3c2269de34e req-726682ef-3af8-4e60-bc65-9df21d97808d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111957 Oct 20 06:20:35.556230 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 794/1601] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 20 06:20:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:20:36.221531 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-a8ae7728-5e41-4cb6-9227-d51240a38e60 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:20:36.222138 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-a8ae7728-5e41-4cb6-9227-d51240a38e60 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:20:36.229141 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a8ae7728-5e41-4cb6-9227-d51240a38e60 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:20:36.229736 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a8ae7728-5e41-4cb6-9227-d51240a38e60 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:20:36.230057 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a8ae7728-5e41-4cb6-9227-d51240a38e60 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:20:36.230810 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a8ae7728-5e41-4cb6-9227-d51240a38e60 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:20:36.231236 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a8ae7728-5e41-4cb6-9227-d51240a38e60 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:20:36.231655 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a8ae7728-5e41-4cb6-9227-d51240a38e60 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:20:36.300605 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-a8ae7728-5e41-4cb6-9227-d51240a38e60 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:20:36.307903 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-52a70951-731a-4e16-9534-3b94f233f92d tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:20:36.308756 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-52a70951-731a-4e16-9534-3b94f233f92d tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:20:36.309588 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-a8ae7728-5e41-4cb6-9227-d51240a38e60 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.091910 Oct 20 06:20:36.310804 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 808/1602] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:20:36 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:20:36.318507 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-52a70951-731a-4e16-9534-3b94f233f92d tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:20:36.319081 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-52a70951-731a-4e16-9534-3b94f233f92d tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:20:36.319613 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-52a70951-731a-4e16-9534-3b94f233f92d tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:20:36.321198 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-52a70951-731a-4e16-9534-3b94f233f92d tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:20:36.321864 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-52a70951-731a-4e16-9534-3b94f233f92d tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:20:36.326724 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-52a70951-731a-4e16-9534-3b94f233f92d tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:20:36.417047 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-086b9e92-477c-4c49-bcb1-f1d8d7cf7fbe tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:20:36.420265 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-086b9e92-477c-4c49-bcb1-f1d8d7cf7fbe tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:20:36.426430 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-086b9e92-477c-4c49-bcb1-f1d8d7cf7fbe tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:20:36.427150 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-086b9e92-477c-4c49-bcb1-f1d8d7cf7fbe tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:20:36.427768 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-086b9e92-477c-4c49-bcb1-f1d8d7cf7fbe tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:20:36.429056 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-086b9e92-477c-4c49-bcb1-f1d8d7cf7fbe tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:20:36.429793 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-086b9e92-477c-4c49-bcb1-f1d8d7cf7fbe tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:20:36.430380 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-086b9e92-477c-4c49-bcb1-f1d8d7cf7fbe tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:20:36.465984 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-086b9e92-477c-4c49-bcb1-f1d8d7cf7fbe tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052935 Oct 20 06:20:36.466917 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 809/1603] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:20:36 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 20 06:20:36.479851 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-52a70951-731a-4e16-9534-3b94f233f92d tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:20:36.489306 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-52a70951-731a-4e16-9534-3b94f233f92d tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.186148 Oct 20 06:20:36.490397 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 795/1604] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:20:36 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:20:37.332781 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-ad0ad4f7-ea99-4f45-a1e2-6402b52ced1d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:20:37.333541 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-ad0ad4f7-ea99-4f45-a1e2-6402b52ced1d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:20:37.340649 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ad0ad4f7-ea99-4f45-a1e2-6402b52ced1d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:20:37.341162 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ad0ad4f7-ea99-4f45-a1e2-6402b52ced1d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:20:37.341608 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ad0ad4f7-ea99-4f45-a1e2-6402b52ced1d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:20:37.342331 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ad0ad4f7-ea99-4f45-a1e2-6402b52ced1d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:20:37.342820 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ad0ad4f7-ea99-4f45-a1e2-6402b52ced1d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:20:37.343275 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ad0ad4f7-ea99-4f45-a1e2-6402b52ced1d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:20:37.405734 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-ad0ad4f7-ea99-4f45-a1e2-6402b52ced1d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:20:37.413997 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-ad0ad4f7-ea99-4f45-a1e2-6402b52ced1d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.085219 Oct 20 06:20:37.415171 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 810/1605] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:20:37 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:20:37.479114 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-b144847a-8c11-4246-a40a-8ef88189a24b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:20:37.481463 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-b144847a-8c11-4246-a40a-8ef88189a24b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:20:37.487907 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b144847a-8c11-4246-a40a-8ef88189a24b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:20:37.488395 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b144847a-8c11-4246-a40a-8ef88189a24b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:20:37.488885 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b144847a-8c11-4246-a40a-8ef88189a24b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:20:37.489652 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b144847a-8c11-4246-a40a-8ef88189a24b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:20:37.490108 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b144847a-8c11-4246-a40a-8ef88189a24b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:20:37.490538 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b144847a-8c11-4246-a40a-8ef88189a24b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:20:37.520607 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG dbcounter [-] [118860] Writing DB stats nova_cell1:SELECT=100 {{(pid=118860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:20:37.528565 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-b144847a-8c11-4246-a40a-8ef88189a24b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054054 Oct 20 06:20:37.529069 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 796/1606] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:20:37 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 20 06:20:37.632944 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-a87c4b4a-8825-4a61-a0c0-a8749a1358ca tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:20:37.633629 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-a87c4b4a-8825-4a61-a0c0-a8749a1358ca tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:20:37.639601 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a87c4b4a-8825-4a61-a0c0-a8749a1358ca tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:20:37.640085 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a87c4b4a-8825-4a61-a0c0-a8749a1358ca tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:20:37.640520 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a87c4b4a-8825-4a61-a0c0-a8749a1358ca tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:20:37.641240 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a87c4b4a-8825-4a61-a0c0-a8749a1358ca tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:20:37.641695 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a87c4b4a-8825-4a61-a0c0-a8749a1358ca tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:20:37.642125 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a87c4b4a-8825-4a61-a0c0-a8749a1358ca tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:20:37.775792 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-a87c4b4a-8825-4a61-a0c0-a8749a1358ca tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:20:37.784192 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-a87c4b4a-8825-4a61-a0c0-a8749a1358ca tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.274801 Oct 20 06:20:37.784776 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 811/1607] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:20:37 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 06:20:38.437749 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-7146a494-ef42-4e3d-815f-dfab0d2a8b66 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:20:38.438359 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-7146a494-ef42-4e3d-815f-dfab0d2a8b66 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:20:38.444474 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7146a494-ef42-4e3d-815f-dfab0d2a8b66 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:20:38.444991 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7146a494-ef42-4e3d-815f-dfab0d2a8b66 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:20:38.445431 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7146a494-ef42-4e3d-815f-dfab0d2a8b66 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:20:38.446130 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7146a494-ef42-4e3d-815f-dfab0d2a8b66 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:20:38.446617 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7146a494-ef42-4e3d-815f-dfab0d2a8b66 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:20:38.447044 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7146a494-ef42-4e3d-815f-dfab0d2a8b66 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:20:38.510380 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-7146a494-ef42-4e3d-815f-dfab0d2a8b66 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:20:38.518710 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-7146a494-ef42-4e3d-815f-dfab0d2a8b66 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.085068 Oct 20 06:20:38.519270 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 797/1608] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:20:38 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:20:38.541151 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-55d592c1-bb1d-495c-b96c-d30785966530 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:20:38.543419 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-55d592c1-bb1d-495c-b96c-d30785966530 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:20:38.551618 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-55d592c1-bb1d-495c-b96c-d30785966530 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:20:38.552103 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-55d592c1-bb1d-495c-b96c-d30785966530 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:20:38.552542 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-55d592c1-bb1d-495c-b96c-d30785966530 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:20:38.553313 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-55d592c1-bb1d-495c-b96c-d30785966530 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:20:38.553764 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-55d592c1-bb1d-495c-b96c-d30785966530 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:20:38.556065 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-55d592c1-bb1d-495c-b96c-d30785966530 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:20:38.585361 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-55d592c1-bb1d-495c-b96c-d30785966530 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048705 Oct 20 06:20:38.585921 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 812/1609] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:20:38 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:20:38.808142 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-89843d45-b596-48fe-8f74-3d2aadd9d124 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:20:38.808675 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-89843d45-b596-48fe-8f74-3d2aadd9d124 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:20:38.814710 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-89843d45-b596-48fe-8f74-3d2aadd9d124 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:20:38.815192 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-89843d45-b596-48fe-8f74-3d2aadd9d124 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:20:38.815627 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-89843d45-b596-48fe-8f74-3d2aadd9d124 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:20:38.816326 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-89843d45-b596-48fe-8f74-3d2aadd9d124 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:20:38.816838 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-89843d45-b596-48fe-8f74-3d2aadd9d124 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:20:38.817266 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-89843d45-b596-48fe-8f74-3d2aadd9d124 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:20:38.944397 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-89843d45-b596-48fe-8f74-3d2aadd9d124 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:20:38.953398 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-89843d45-b596-48fe-8f74-3d2aadd9d124 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.149844 Oct 20 06:20:38.953960 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 798/1610] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:20:38 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:20:39.542290 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-0327ba11-2b86-404a-a1ac-3b15ae724acb tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:20:39.542902 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-0327ba11-2b86-404a-a1ac-3b15ae724acb tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:20:39.549742 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-0327ba11-2b86-404a-a1ac-3b15ae724acb tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:20:39.550231 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-0327ba11-2b86-404a-a1ac-3b15ae724acb tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:20:39.550666 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-0327ba11-2b86-404a-a1ac-3b15ae724acb tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:20:39.551382 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-0327ba11-2b86-404a-a1ac-3b15ae724acb tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:20:39.551830 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-0327ba11-2b86-404a-a1ac-3b15ae724acb tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:20:39.553068 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-0327ba11-2b86-404a-a1ac-3b15ae724acb tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:20:39.597857 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-f68acc41-3b48-4fe9-bfaf-62d2057181c5 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:20:39.600437 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-f68acc41-3b48-4fe9-bfaf-62d2057181c5 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:20:39.607662 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f68acc41-3b48-4fe9-bfaf-62d2057181c5 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:20:39.608256 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f68acc41-3b48-4fe9-bfaf-62d2057181c5 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:20:39.608824 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f68acc41-3b48-4fe9-bfaf-62d2057181c5 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:20:39.609611 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f68acc41-3b48-4fe9-bfaf-62d2057181c5 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:20:39.610142 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f68acc41-3b48-4fe9-bfaf-62d2057181c5 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:20:39.610641 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f68acc41-3b48-4fe9-bfaf-62d2057181c5 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:20:39.621482 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-0327ba11-2b86-404a-a1ac-3b15ae724acb tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:20:39.630600 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-0327ba11-2b86-404a-a1ac-3b15ae724acb tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.092137 Oct 20 06:20:39.631502 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 813/1611] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:20:39 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:20:39.660995 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-f68acc41-3b48-4fe9-bfaf-62d2057181c5 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.066838 Oct 20 06:20:39.662123 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 799/1612] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:20:39 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 20 06:20:39.977554 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-8e617634-70b1-40af-9b7d-bf63420958da tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:20:39.978308 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-8e617634-70b1-40af-9b7d-bf63420958da tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:20:39.984433 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-8e617634-70b1-40af-9b7d-bf63420958da tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:20:39.984958 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-8e617634-70b1-40af-9b7d-bf63420958da tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:20:39.985405 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-8e617634-70b1-40af-9b7d-bf63420958da tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:20:39.986109 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-8e617634-70b1-40af-9b7d-bf63420958da tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:20:39.986566 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-8e617634-70b1-40af-9b7d-bf63420958da tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:20:39.986994 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-8e617634-70b1-40af-9b7d-bf63420958da tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:20:40.119879 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-8e617634-70b1-40af-9b7d-bf63420958da tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:20:40.129100 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-8e617634-70b1-40af-9b7d-bf63420958da tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.155948 Oct 20 06:20:40.129676 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 814/1613] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:20:39 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:20:40.654504 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-a794eecb-61d0-44da-9050-f78efafc261c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:20:40.655168 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-a794eecb-61d0-44da-9050-f78efafc261c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:20:40.661738 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a794eecb-61d0-44da-9050-f78efafc261c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:20:40.662225 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a794eecb-61d0-44da-9050-f78efafc261c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:20:40.662662 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a794eecb-61d0-44da-9050-f78efafc261c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:20:40.663369 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a794eecb-61d0-44da-9050-f78efafc261c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:20:40.663828 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a794eecb-61d0-44da-9050-f78efafc261c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:20:40.664261 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a794eecb-61d0-44da-9050-f78efafc261c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:20:40.673382 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-1a9edcc2-039b-4c84-9fa1-eb84a58c269c tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 06:20:40.675766 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-1a9edcc2-039b-4c84-9fa1-eb84a58c269c tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:20:40.682864 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1a9edcc2-039b-4c84-9fa1-eb84a58c269c tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:20:40.683361 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1a9edcc2-039b-4c84-9fa1-eb84a58c269c tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:20:40.683809 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1a9edcc2-039b-4c84-9fa1-eb84a58c269c tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:20:40.684571 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1a9edcc2-039b-4c84-9fa1-eb84a58c269c tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:20:40.685093 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1a9edcc2-039b-4c84-9fa1-eb84a58c269c tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:20:40.685516 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1a9edcc2-039b-4c84-9fa1-eb84a58c269c tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:20:40.732910 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-a794eecb-61d0-44da-9050-f78efafc261c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:20:40.741152 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-a794eecb-61d0-44da-9050-f78efafc261c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.090642 Oct 20 06:20:40.741712 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 800/1614] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:20:40 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:20:40.779247 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-1a9edcc2-039b-4c84-9fa1-eb84a58c269c tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "POST /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/action" status: 200 len: 76332 microversion: 2.1 time: 0.109594 Oct 20 06:20:40.779930 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 815/1615] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Oct 20 06:20:40 2022] POST /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86/action => generated 76332 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 20 06:20:41.152647 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-b1df8722-ce7e-4e07-847b-c52aceb7506a tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:20:41.153277 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-b1df8722-ce7e-4e07-847b-c52aceb7506a tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:20:41.159427 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b1df8722-ce7e-4e07-847b-c52aceb7506a tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:20:41.159913 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b1df8722-ce7e-4e07-847b-c52aceb7506a tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:20:41.160462 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b1df8722-ce7e-4e07-847b-c52aceb7506a tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:20:41.161178 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b1df8722-ce7e-4e07-847b-c52aceb7506a tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:20:41.161640 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b1df8722-ce7e-4e07-847b-c52aceb7506a tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:20:41.162066 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b1df8722-ce7e-4e07-847b-c52aceb7506a tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:20:41.292439 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-b1df8722-ce7e-4e07-847b-c52aceb7506a tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:20:41.301608 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-b1df8722-ce7e-4e07-847b-c52aceb7506a tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.153284 Oct 20 06:20:41.302378 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 801/1616] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:20:41 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:20:41.765846 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-9f4ce205-943f-4450-a466-041f98852732 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:20:41.766543 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-9f4ce205-943f-4450-a466-041f98852732 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:20:41.773581 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-9f4ce205-943f-4450-a466-041f98852732 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:20:41.774549 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-9f4ce205-943f-4450-a466-041f98852732 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:20:41.775180 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-9f4ce205-943f-4450-a466-041f98852732 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:20:41.775872 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-9f4ce205-943f-4450-a466-041f98852732 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:20:41.776322 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-9f4ce205-943f-4450-a466-041f98852732 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:20:41.776766 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-9f4ce205-943f-4450-a466-041f98852732 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:20:41.843826 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-9f4ce205-943f-4450-a466-041f98852732 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:20:41.853129 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-9f4ce205-943f-4450-a466-041f98852732 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.091416 Oct 20 06:20:41.854829 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 816/1617] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:20:41 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:20:42.325655 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-dc738285-91b0-4d71-b9fb-71fd2e60b6c6 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:20:42.326270 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-dc738285-91b0-4d71-b9fb-71fd2e60b6c6 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:20:42.332891 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-dc738285-91b0-4d71-b9fb-71fd2e60b6c6 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:20:42.333374 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-dc738285-91b0-4d71-b9fb-71fd2e60b6c6 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:20:42.333816 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-dc738285-91b0-4d71-b9fb-71fd2e60b6c6 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:20:42.334508 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-dc738285-91b0-4d71-b9fb-71fd2e60b6c6 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:20:42.334960 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-dc738285-91b0-4d71-b9fb-71fd2e60b6c6 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:20:42.335386 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-dc738285-91b0-4d71-b9fb-71fd2e60b6c6 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:20:42.466559 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-dc738285-91b0-4d71-b9fb-71fd2e60b6c6 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:20:42.474712 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-dc738285-91b0-4d71-b9fb-71fd2e60b6c6 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.153816 Oct 20 06:20:42.475262 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 802/1618] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:20:42 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:20:42.876858 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-7852176c-0f66-4047-9dbb-cec7c992a416 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:20:42.877472 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-7852176c-0f66-4047-9dbb-cec7c992a416 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:20:42.885270 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7852176c-0f66-4047-9dbb-cec7c992a416 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:20:42.885832 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7852176c-0f66-4047-9dbb-cec7c992a416 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:20:42.886281 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7852176c-0f66-4047-9dbb-cec7c992a416 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:20:42.887140 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7852176c-0f66-4047-9dbb-cec7c992a416 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:20:42.887602 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7852176c-0f66-4047-9dbb-cec7c992a416 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:20:42.888032 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7852176c-0f66-4047-9dbb-cec7c992a416 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:20:42.949860 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-7852176c-0f66-4047-9dbb-cec7c992a416 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:20:42.958182 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-7852176c-0f66-4047-9dbb-cec7c992a416 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.085260 Oct 20 06:20:42.958751 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 817/1619] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:20:42 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:20:43.499026 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-0ff6771c-ce35-4e42-b9fd-2211d86667f5 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:20:43.499628 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-0ff6771c-ce35-4e42-b9fd-2211d86667f5 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:20:43.506301 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0ff6771c-ce35-4e42-b9fd-2211d86667f5 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:20:43.507085 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0ff6771c-ce35-4e42-b9fd-2211d86667f5 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:20:43.507519 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0ff6771c-ce35-4e42-b9fd-2211d86667f5 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:20:43.508830 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0ff6771c-ce35-4e42-b9fd-2211d86667f5 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:20:43.509286 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0ff6771c-ce35-4e42-b9fd-2211d86667f5 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:20:43.509735 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0ff6771c-ce35-4e42-b9fd-2211d86667f5 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:20:43.640936 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-0ff6771c-ce35-4e42-b9fd-2211d86667f5 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:20:43.649784 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-0ff6771c-ce35-4e42-b9fd-2211d86667f5 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.154079 Oct 20 06:20:43.650346 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 803/1620] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:20:43 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 06:20:43.982567 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-997c8cff-f1b7-440a-b7f1-5769e9b9c019 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:20:43.983179 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-997c8cff-f1b7-440a-b7f1-5769e9b9c019 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:20:43.989684 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-997c8cff-f1b7-440a-b7f1-5769e9b9c019 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:20:43.990159 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-997c8cff-f1b7-440a-b7f1-5769e9b9c019 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:20:43.990593 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-997c8cff-f1b7-440a-b7f1-5769e9b9c019 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:20:43.991279 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-997c8cff-f1b7-440a-b7f1-5769e9b9c019 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:20:43.991725 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-997c8cff-f1b7-440a-b7f1-5769e9b9c019 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:20:43.992176 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-997c8cff-f1b7-440a-b7f1-5769e9b9c019 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:20:44.054029 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-997c8cff-f1b7-440a-b7f1-5769e9b9c019 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:20:44.063042 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-997c8cff-f1b7-440a-b7f1-5769e9b9c019 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.084714 Oct 20 06:20:44.063616 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 818/1621] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:20:43 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:20:44.672629 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-f820a4fe-e204-4811-a4b3-5a9b9d99688e tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:20:44.673247 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-f820a4fe-e204-4811-a4b3-5a9b9d99688e tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:20:44.679725 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f820a4fe-e204-4811-a4b3-5a9b9d99688e tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:20:44.680900 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f820a4fe-e204-4811-a4b3-5a9b9d99688e tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:20:44.681429 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f820a4fe-e204-4811-a4b3-5a9b9d99688e tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:20:44.682163 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f820a4fe-e204-4811-a4b3-5a9b9d99688e tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:20:44.682619 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f820a4fe-e204-4811-a4b3-5a9b9d99688e tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:20:44.683044 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f820a4fe-e204-4811-a4b3-5a9b9d99688e tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:20:44.810597 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-f820a4fe-e204-4811-a4b3-5a9b9d99688e tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:20:44.818903 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-f820a4fe-e204-4811-a4b3-5a9b9d99688e tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.150134 Oct 20 06:20:44.819468 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 804/1622] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:20:44 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:20:45.086089 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-7a5cd52c-67ae-4e65-957a-48e3e40b3edf tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:20:45.087356 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-7a5cd52c-67ae-4e65-957a-48e3e40b3edf tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:20:45.094020 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7a5cd52c-67ae-4e65-957a-48e3e40b3edf tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:20:45.094510 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7a5cd52c-67ae-4e65-957a-48e3e40b3edf tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:20:45.094952 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7a5cd52c-67ae-4e65-957a-48e3e40b3edf tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:20:45.095658 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7a5cd52c-67ae-4e65-957a-48e3e40b3edf tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:20:45.096110 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7a5cd52c-67ae-4e65-957a-48e3e40b3edf tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:20:45.096533 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7a5cd52c-67ae-4e65-957a-48e3e40b3edf tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:20:45.159441 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-7a5cd52c-67ae-4e65-957a-48e3e40b3edf tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:20:45.168553 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-7a5cd52c-67ae-4e65-957a-48e3e40b3edf tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.086427 Oct 20 06:20:45.169324 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 819/1623] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:20:45 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:20:45.841923 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-23d1fb7e-e99f-45c1-9c35-306f85c2a794 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:20:45.842490 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-23d1fb7e-e99f-45c1-9c35-306f85c2a794 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:20:45.849134 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-23d1fb7e-e99f-45c1-9c35-306f85c2a794 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:20:45.849636 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-23d1fb7e-e99f-45c1-9c35-306f85c2a794 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:20:45.850076 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-23d1fb7e-e99f-45c1-9c35-306f85c2a794 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:20:45.850791 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-23d1fb7e-e99f-45c1-9c35-306f85c2a794 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:20:45.851242 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-23d1fb7e-e99f-45c1-9c35-306f85c2a794 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:20:45.851668 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-23d1fb7e-e99f-45c1-9c35-306f85c2a794 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:20:45.986312 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-23d1fb7e-e99f-45c1-9c35-306f85c2a794 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:20:45.995490 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-23d1fb7e-e99f-45c1-9c35-306f85c2a794 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.157509 Oct 20 06:20:45.996065 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 805/1624] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:20:45 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:20:46.191672 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-d86c9aff-aafe-4194-a79e-b677ffd161d4 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:20:46.192301 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-d86c9aff-aafe-4194-a79e-b677ffd161d4 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:20:46.198823 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d86c9aff-aafe-4194-a79e-b677ffd161d4 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:20:46.199336 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d86c9aff-aafe-4194-a79e-b677ffd161d4 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:20:46.199777 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d86c9aff-aafe-4194-a79e-b677ffd161d4 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:20:46.200496 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d86c9aff-aafe-4194-a79e-b677ffd161d4 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:20:46.200978 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d86c9aff-aafe-4194-a79e-b677ffd161d4 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:20:46.201417 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d86c9aff-aafe-4194-a79e-b677ffd161d4 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:20:46.269910 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-d86c9aff-aafe-4194-a79e-b677ffd161d4 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:20:46.279347 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-d86c9aff-aafe-4194-a79e-b677ffd161d4 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.091566 Oct 20 06:20:46.279786 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 820/1625] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:20:46 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:20:47.019257 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-0636f1ac-7955-4fb7-af21-febbd540453f tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:20:47.019793 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-0636f1ac-7955-4fb7-af21-febbd540453f tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:20:47.026195 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0636f1ac-7955-4fb7-af21-febbd540453f tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:20:47.026673 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0636f1ac-7955-4fb7-af21-febbd540453f tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:20:47.027121 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0636f1ac-7955-4fb7-af21-febbd540453f tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:20:47.027798 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0636f1ac-7955-4fb7-af21-febbd540453f tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:20:47.028246 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0636f1ac-7955-4fb7-af21-febbd540453f tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:20:47.028668 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0636f1ac-7955-4fb7-af21-febbd540453f tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:20:47.175245 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-0636f1ac-7955-4fb7-af21-febbd540453f tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:20:47.184232 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-0636f1ac-7955-4fb7-af21-febbd540453f tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.168867 Oct 20 06:20:47.184849 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 806/1626] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:20:47 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:20:47.308006 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-34723cd1-dfdd-4e0c-8a5e-0e42d868e6b4 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:20:47.308623 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-34723cd1-dfdd-4e0c-8a5e-0e42d868e6b4 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:20:47.315433 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-34723cd1-dfdd-4e0c-8a5e-0e42d868e6b4 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:20:47.315927 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-34723cd1-dfdd-4e0c-8a5e-0e42d868e6b4 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:20:47.316371 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-34723cd1-dfdd-4e0c-8a5e-0e42d868e6b4 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:20:47.317151 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-34723cd1-dfdd-4e0c-8a5e-0e42d868e6b4 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:20:47.317610 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-34723cd1-dfdd-4e0c-8a5e-0e42d868e6b4 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:20:47.318043 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-34723cd1-dfdd-4e0c-8a5e-0e42d868e6b4 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:20:47.382066 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-34723cd1-dfdd-4e0c-8a5e-0e42d868e6b4 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:20:47.391581 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-34723cd1-dfdd-4e0c-8a5e-0e42d868e6b4 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.088922 Oct 20 06:20:47.392353 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 821/1627] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:20:47 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:20:48.207565 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-d28b78ee-c07d-4a15-bb4b-1dbc91ad4a23 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:20:48.208226 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-d28b78ee-c07d-4a15-bb4b-1dbc91ad4a23 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:20:48.215319 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-d28b78ee-c07d-4a15-bb4b-1dbc91ad4a23 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:20:48.215800 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-d28b78ee-c07d-4a15-bb4b-1dbc91ad4a23 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:20:48.216232 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-d28b78ee-c07d-4a15-bb4b-1dbc91ad4a23 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:20:48.216962 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-d28b78ee-c07d-4a15-bb4b-1dbc91ad4a23 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:20:48.217408 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-d28b78ee-c07d-4a15-bb4b-1dbc91ad4a23 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:20:48.217828 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-d28b78ee-c07d-4a15-bb4b-1dbc91ad4a23 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:20:48.356388 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-d28b78ee-c07d-4a15-bb4b-1dbc91ad4a23 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:20:48.364803 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-d28b78ee-c07d-4a15-bb4b-1dbc91ad4a23 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.161204 Oct 20 06:20:48.365377 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 807/1628] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:20:48 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:20:48.415141 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-4efbee8c-4a7d-46ae-bf17-80bcc53b41c3 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:20:48.415832 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-4efbee8c-4a7d-46ae-bf17-80bcc53b41c3 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:20:48.422498 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4efbee8c-4a7d-46ae-bf17-80bcc53b41c3 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:20:48.422978 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4efbee8c-4a7d-46ae-bf17-80bcc53b41c3 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:20:48.423408 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4efbee8c-4a7d-46ae-bf17-80bcc53b41c3 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:20:48.424103 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4efbee8c-4a7d-46ae-bf17-80bcc53b41c3 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:20:48.424548 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4efbee8c-4a7d-46ae-bf17-80bcc53b41c3 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:20:48.424992 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4efbee8c-4a7d-46ae-bf17-80bcc53b41c3 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:20:48.441477 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG dbcounter [-] [118861] Writing DB stats nova_cell1:SELECT=100 {{(pid=118861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:20:48.490227 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-4efbee8c-4a7d-46ae-bf17-80bcc53b41c3 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:20:48.499204 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-4efbee8c-4a7d-46ae-bf17-80bcc53b41c3 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.088600 Oct 20 06:20:48.499770 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 822/1629] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:20:48 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:20:49.388167 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-2a779f7a-e433-43b8-8f1b-29e41496f03b tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:20:49.388802 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-2a779f7a-e433-43b8-8f1b-29e41496f03b tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:20:49.395247 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2a779f7a-e433-43b8-8f1b-29e41496f03b tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:20:49.395721 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2a779f7a-e433-43b8-8f1b-29e41496f03b tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:20:49.396150 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2a779f7a-e433-43b8-8f1b-29e41496f03b tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:20:49.396866 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2a779f7a-e433-43b8-8f1b-29e41496f03b tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:20:49.397317 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2a779f7a-e433-43b8-8f1b-29e41496f03b tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:20:49.397734 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2a779f7a-e433-43b8-8f1b-29e41496f03b tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:20:49.522431 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-d67f0e08-94db-4d6e-a90f-de7056ec5594 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:20:49.523221 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-d67f0e08-94db-4d6e-a90f-de7056ec5594 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:20:49.528543 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-2a779f7a-e433-43b8-8f1b-29e41496f03b tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:20:49.531914 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d67f0e08-94db-4d6e-a90f-de7056ec5594 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:20:49.532420 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d67f0e08-94db-4d6e-a90f-de7056ec5594 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:20:49.532890 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d67f0e08-94db-4d6e-a90f-de7056ec5594 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:20:49.533906 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d67f0e08-94db-4d6e-a90f-de7056ec5594 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:20:49.534565 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d67f0e08-94db-4d6e-a90f-de7056ec5594 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:20:49.535005 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d67f0e08-94db-4d6e-a90f-de7056ec5594 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:20:49.538342 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-2a779f7a-e433-43b8-8f1b-29e41496f03b tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.154012 Oct 20 06:20:49.544507 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 808/1630] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:20:49 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:20:49.603778 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-d67f0e08-94db-4d6e-a90f-de7056ec5594 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:20:49.612192 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-d67f0e08-94db-4d6e-a90f-de7056ec5594 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.093660 Oct 20 06:20:49.613043 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 823/1631] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:20:49 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 06:20:50.563278 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-d2ef44de-17f8-43a3-aa7b-7584430ef35b tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:20:50.563887 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-d2ef44de-17f8-43a3-aa7b-7584430ef35b tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:20:50.570725 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-d2ef44de-17f8-43a3-aa7b-7584430ef35b tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:20:50.571271 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-d2ef44de-17f8-43a3-aa7b-7584430ef35b tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:20:50.572025 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-d2ef44de-17f8-43a3-aa7b-7584430ef35b tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:20:50.572788 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-d2ef44de-17f8-43a3-aa7b-7584430ef35b tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:20:50.573251 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-d2ef44de-17f8-43a3-aa7b-7584430ef35b tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:20:50.573684 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-d2ef44de-17f8-43a3-aa7b-7584430ef35b tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:20:50.635949 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-539551e2-cb0e-45b9-bd5b-5c5220ca474c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:20:50.636567 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-539551e2-cb0e-45b9-bd5b-5c5220ca474c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:20:50.643348 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-539551e2-cb0e-45b9-bd5b-5c5220ca474c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:20:50.644065 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-539551e2-cb0e-45b9-bd5b-5c5220ca474c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:20:50.644905 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-539551e2-cb0e-45b9-bd5b-5c5220ca474c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:20:50.645699 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-539551e2-cb0e-45b9-bd5b-5c5220ca474c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:20:50.646166 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-539551e2-cb0e-45b9-bd5b-5c5220ca474c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:20:50.646602 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-539551e2-cb0e-45b9-bd5b-5c5220ca474c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:20:50.709194 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-d2ef44de-17f8-43a3-aa7b-7584430ef35b tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:20:50.717534 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-539551e2-cb0e-45b9-bd5b-5c5220ca474c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:20:50.718107 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-d2ef44de-17f8-43a3-aa7b-7584430ef35b tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.158651 Oct 20 06:20:50.718882 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 809/1632] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:20:50 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:20:50.726175 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-539551e2-cb0e-45b9-bd5b-5c5220ca474c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.094780 Oct 20 06:20:50.735866 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 824/1633] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:20:50 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:20:51.741801 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-2e04ef68-d839-46ae-b98d-0d766d1fe149 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:20:51.743294 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-2e04ef68-d839-46ae-b98d-0d766d1fe149 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:20:51.748316 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-616cbb87-02fb-4cb4-89c9-345040ec151c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:20:51.748971 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-616cbb87-02fb-4cb4-89c9-345040ec151c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:20:51.749530 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2e04ef68-d839-46ae-b98d-0d766d1fe149 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:20:51.750012 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2e04ef68-d839-46ae-b98d-0d766d1fe149 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:20:51.750515 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2e04ef68-d839-46ae-b98d-0d766d1fe149 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:20:51.751139 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2e04ef68-d839-46ae-b98d-0d766d1fe149 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:20:51.751584 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2e04ef68-d839-46ae-b98d-0d766d1fe149 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:20:51.752064 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2e04ef68-d839-46ae-b98d-0d766d1fe149 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:20:51.755300 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-616cbb87-02fb-4cb4-89c9-345040ec151c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:20:51.757438 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-616cbb87-02fb-4cb4-89c9-345040ec151c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:20:51.757438 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-616cbb87-02fb-4cb4-89c9-345040ec151c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:20:51.757438 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-616cbb87-02fb-4cb4-89c9-345040ec151c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:20:51.757755 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-616cbb87-02fb-4cb4-89c9-345040ec151c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:20:51.758696 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-616cbb87-02fb-4cb4-89c9-345040ec151c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:20:51.826648 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-616cbb87-02fb-4cb4-89c9-345040ec151c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:20:51.835243 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-616cbb87-02fb-4cb4-89c9-345040ec151c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.090605 Oct 20 06:20:51.836520 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 825/1634] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:20:51 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:20:51.891787 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-2e04ef68-d839-46ae-b98d-0d766d1fe149 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:20:51.900218 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-2e04ef68-d839-46ae-b98d-0d766d1fe149 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.162560 Oct 20 06:20:51.900799 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 810/1635] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:20:51 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:20:52.858842 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-7f8a8676-0b63-4a09-a84e-093f79d61f1e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:20:52.859452 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-7f8a8676-0b63-4a09-a84e-093f79d61f1e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:20:52.866234 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7f8a8676-0b63-4a09-a84e-093f79d61f1e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:20:52.866719 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7f8a8676-0b63-4a09-a84e-093f79d61f1e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:20:52.867180 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7f8a8676-0b63-4a09-a84e-093f79d61f1e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:20:52.868549 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7f8a8676-0b63-4a09-a84e-093f79d61f1e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:20:52.869041 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7f8a8676-0b63-4a09-a84e-093f79d61f1e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:20:52.869469 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7f8a8676-0b63-4a09-a84e-093f79d61f1e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:20:52.923755 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-e6020488-7041-478c-b2ab-f647416dec36 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:20:52.924551 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-e6020488-7041-478c-b2ab-f647416dec36 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:20:52.932602 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e6020488-7041-478c-b2ab-f647416dec36 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:20:52.933186 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e6020488-7041-478c-b2ab-f647416dec36 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:20:52.933697 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e6020488-7041-478c-b2ab-f647416dec36 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:20:52.934117 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-7f8a8676-0b63-4a09-a84e-093f79d61f1e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:20:52.934569 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e6020488-7041-478c-b2ab-f647416dec36 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:20:52.935094 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e6020488-7041-478c-b2ab-f647416dec36 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:20:52.935594 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e6020488-7041-478c-b2ab-f647416dec36 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:20:52.943822 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-7f8a8676-0b63-4a09-a84e-093f79d61f1e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.088814 Oct 20 06:20:52.944600 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 826/1636] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:20:52 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:20:53.071212 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-e6020488-7041-478c-b2ab-f647416dec36 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:20:53.079897 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-e6020488-7041-478c-b2ab-f647416dec36 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.160207 Oct 20 06:20:53.091941 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 811/1637] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:20:52 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 06:20:53.966904 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-8d1e681f-e509-4928-a0c0-2e0421e423b2 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:20:53.967526 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-8d1e681f-e509-4928-a0c0-2e0421e423b2 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:20:53.974013 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-8d1e681f-e509-4928-a0c0-2e0421e423b2 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:20:53.974498 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-8d1e681f-e509-4928-a0c0-2e0421e423b2 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:20:53.974934 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-8d1e681f-e509-4928-a0c0-2e0421e423b2 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:20:53.975637 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-8d1e681f-e509-4928-a0c0-2e0421e423b2 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:20:53.976088 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-8d1e681f-e509-4928-a0c0-2e0421e423b2 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:20:53.976514 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-8d1e681f-e509-4928-a0c0-2e0421e423b2 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:20:54.043148 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-8d1e681f-e509-4928-a0c0-2e0421e423b2 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:20:54.051515 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-8d1e681f-e509-4928-a0c0-2e0421e423b2 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.088551 Oct 20 06:20:54.052188 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 827/1638] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:20:53 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:20:54.103987 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-832d52d1-4eda-4dc2-a8ae-c6d132d894c0 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:20:54.104597 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-832d52d1-4eda-4dc2-a8ae-c6d132d894c0 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:20:54.111146 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-832d52d1-4eda-4dc2-a8ae-c6d132d894c0 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:20:54.111668 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-832d52d1-4eda-4dc2-a8ae-c6d132d894c0 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:20:54.112111 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-832d52d1-4eda-4dc2-a8ae-c6d132d894c0 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:20:54.112845 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-832d52d1-4eda-4dc2-a8ae-c6d132d894c0 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:20:54.113300 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-832d52d1-4eda-4dc2-a8ae-c6d132d894c0 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:20:54.114015 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-832d52d1-4eda-4dc2-a8ae-c6d132d894c0 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:20:54.245883 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-832d52d1-4eda-4dc2-a8ae-c6d132d894c0 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:20:54.254241 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-832d52d1-4eda-4dc2-a8ae-c6d132d894c0 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.154774 Oct 20 06:20:54.254805 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 812/1639] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:20:54 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:20:55.074714 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-ef5b2bad-3db6-43eb-b783-f2a41f9cd72c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:20:55.075368 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-ef5b2bad-3db6-43eb-b783-f2a41f9cd72c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:20:55.081719 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ef5b2bad-3db6-43eb-b783-f2a41f9cd72c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:20:55.082195 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ef5b2bad-3db6-43eb-b783-f2a41f9cd72c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:20:55.082625 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ef5b2bad-3db6-43eb-b783-f2a41f9cd72c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:20:55.083340 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ef5b2bad-3db6-43eb-b783-f2a41f9cd72c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:20:55.083786 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ef5b2bad-3db6-43eb-b783-f2a41f9cd72c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:20:55.084205 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ef5b2bad-3db6-43eb-b783-f2a41f9cd72c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:20:55.149220 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-ef5b2bad-3db6-43eb-b783-f2a41f9cd72c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:20:55.157477 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-ef5b2bad-3db6-43eb-b783-f2a41f9cd72c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.086772 Oct 20 06:20:55.158037 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 828/1640] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:20:55 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:20:55.278522 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-0412d82b-d4e4-43bf-95eb-445f77684aeb tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:20:55.279141 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-0412d82b-d4e4-43bf-95eb-445f77684aeb tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:20:55.285641 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0412d82b-d4e4-43bf-95eb-445f77684aeb tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:20:55.286127 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0412d82b-d4e4-43bf-95eb-445f77684aeb tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:20:55.286568 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0412d82b-d4e4-43bf-95eb-445f77684aeb tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:20:55.287267 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0412d82b-d4e4-43bf-95eb-445f77684aeb tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:20:55.287722 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0412d82b-d4e4-43bf-95eb-445f77684aeb tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:20:55.288149 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0412d82b-d4e4-43bf-95eb-445f77684aeb tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:20:55.303763 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG dbcounter [-] [118860] Writing DB stats nova_cell1:SELECT=100 {{(pid=118860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:20:55.418799 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-0412d82b-d4e4-43bf-95eb-445f77684aeb tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:20:55.427002 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-0412d82b-d4e4-43bf-95eb-445f77684aeb tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.152483 Oct 20 06:20:55.427565 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 813/1641] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:20:55 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:20:56.181138 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-9234ffe6-8629-4f0f-a311-1a26503c5ac8 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:20:56.181757 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-9234ffe6-8629-4f0f-a311-1a26503c5ac8 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:20:56.184092 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG dbcounter [-] [118861] Writing DB stats nova_api:SELECT=71,nova_api:UPDATE=1 {{(pid=118861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:20:56.189327 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-9234ffe6-8629-4f0f-a311-1a26503c5ac8 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:20:56.189820 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-9234ffe6-8629-4f0f-a311-1a26503c5ac8 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:20:56.190259 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-9234ffe6-8629-4f0f-a311-1a26503c5ac8 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:20:56.190958 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-9234ffe6-8629-4f0f-a311-1a26503c5ac8 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:20:56.191407 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-9234ffe6-8629-4f0f-a311-1a26503c5ac8 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:20:56.191829 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-9234ffe6-8629-4f0f-a311-1a26503c5ac8 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:20:56.254521 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-9234ffe6-8629-4f0f-a311-1a26503c5ac8 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:20:56.263255 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-9234ffe6-8629-4f0f-a311-1a26503c5ac8 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.086540 Oct 20 06:20:56.264086 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 829/1642] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:20:56 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:20:56.450571 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-42b85762-c4f4-4a28-a39c-29e4cd9a5e89 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:20:56.451110 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-42b85762-c4f4-4a28-a39c-29e4cd9a5e89 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:20:56.453417 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG dbcounter [-] [118860] Writing DB stats nova_api:SELECT=60 {{(pid=118860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:20:56.458597 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-42b85762-c4f4-4a28-a39c-29e4cd9a5e89 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:20:56.459081 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-42b85762-c4f4-4a28-a39c-29e4cd9a5e89 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:20:56.459518 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-42b85762-c4f4-4a28-a39c-29e4cd9a5e89 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:20:56.460216 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-42b85762-c4f4-4a28-a39c-29e4cd9a5e89 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:20:56.460669 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-42b85762-c4f4-4a28-a39c-29e4cd9a5e89 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:20:56.461688 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-42b85762-c4f4-4a28-a39c-29e4cd9a5e89 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:20:56.640308 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-42b85762-c4f4-4a28-a39c-29e4cd9a5e89 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:20:56.649945 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-42b85762-c4f4-4a28-a39c-29e4cd9a5e89 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.203027 Oct 20 06:20:56.650594 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 814/1643] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:20:56 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:20:57.285963 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-901c6b27-6b34-4885-80ec-fb71de2d50a5 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:20:57.286605 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-901c6b27-6b34-4885-80ec-fb71de2d50a5 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:20:57.294087 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-901c6b27-6b34-4885-80ec-fb71de2d50a5 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:20:57.294571 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-901c6b27-6b34-4885-80ec-fb71de2d50a5 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:20:57.295004 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-901c6b27-6b34-4885-80ec-fb71de2d50a5 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:20:57.295916 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-901c6b27-6b34-4885-80ec-fb71de2d50a5 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:20:57.296154 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-901c6b27-6b34-4885-80ec-fb71de2d50a5 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:20:57.296578 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-901c6b27-6b34-4885-80ec-fb71de2d50a5 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:20:57.361207 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-901c6b27-6b34-4885-80ec-fb71de2d50a5 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:20:57.370082 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-901c6b27-6b34-4885-80ec-fb71de2d50a5 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.088068 Oct 20 06:20:57.370651 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 830/1644] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:20:57 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:20:57.673306 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-e2099422-cf5c-490a-8df3-205c6a301046 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:20:57.673904 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-e2099422-cf5c-490a-8df3-205c6a301046 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:20:57.680393 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e2099422-cf5c-490a-8df3-205c6a301046 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:20:57.680942 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e2099422-cf5c-490a-8df3-205c6a301046 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:20:57.681372 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e2099422-cf5c-490a-8df3-205c6a301046 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:20:57.682054 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e2099422-cf5c-490a-8df3-205c6a301046 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:20:57.682491 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e2099422-cf5c-490a-8df3-205c6a301046 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:20:57.682906 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e2099422-cf5c-490a-8df3-205c6a301046 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:20:57.809768 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-e2099422-cf5c-490a-8df3-205c6a301046 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:20:57.818113 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-e2099422-cf5c-490a-8df3-205c6a301046 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.148596 Oct 20 06:20:57.818682 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 815/1645] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:20:57 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:20:58.393492 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-0f6128c5-ab46-476f-a559-39f9354d4933 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:20:58.394214 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-0f6128c5-ab46-476f-a559-39f9354d4933 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:20:58.401237 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-0f6128c5-ab46-476f-a559-39f9354d4933 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:20:58.401725 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-0f6128c5-ab46-476f-a559-39f9354d4933 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:20:58.402160 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-0f6128c5-ab46-476f-a559-39f9354d4933 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:20:58.402863 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-0f6128c5-ab46-476f-a559-39f9354d4933 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:20:58.403312 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-0f6128c5-ab46-476f-a559-39f9354d4933 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:20:58.403739 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-0f6128c5-ab46-476f-a559-39f9354d4933 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:20:58.464212 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-0f6128c5-ab46-476f-a559-39f9354d4933 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:20:58.472313 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-0f6128c5-ab46-476f-a559-39f9354d4933 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.082799 Oct 20 06:20:58.472896 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 831/1646] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:20:58 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:20:58.842148 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-19b93794-8b21-4a1d-81ad-79951b563af1 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:20:58.842746 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-19b93794-8b21-4a1d-81ad-79951b563af1 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:20:58.849242 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-19b93794-8b21-4a1d-81ad-79951b563af1 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:20:58.849727 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-19b93794-8b21-4a1d-81ad-79951b563af1 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:20:58.850177 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-19b93794-8b21-4a1d-81ad-79951b563af1 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:20:58.850880 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-19b93794-8b21-4a1d-81ad-79951b563af1 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:20:58.851339 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-19b93794-8b21-4a1d-81ad-79951b563af1 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:20:58.851768 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-19b93794-8b21-4a1d-81ad-79951b563af1 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:20:58.982829 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-19b93794-8b21-4a1d-81ad-79951b563af1 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:20:58.990980 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-19b93794-8b21-4a1d-81ad-79951b563af1 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.152751 Oct 20 06:20:58.991617 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 816/1647] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:20:58 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:20:59.494942 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-7fe45f58-24f8-44d1-b789-879939a8050b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:20:59.495553 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-7fe45f58-24f8-44d1-b789-879939a8050b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:20:59.502085 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7fe45f58-24f8-44d1-b789-879939a8050b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:20:59.502557 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7fe45f58-24f8-44d1-b789-879939a8050b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:20:59.502990 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7fe45f58-24f8-44d1-b789-879939a8050b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:20:59.503673 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7fe45f58-24f8-44d1-b789-879939a8050b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:20:59.504118 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7fe45f58-24f8-44d1-b789-879939a8050b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:20:59.504536 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7fe45f58-24f8-44d1-b789-879939a8050b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:20:59.568280 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-7fe45f58-24f8-44d1-b789-879939a8050b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:20:59.577254 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-7fe45f58-24f8-44d1-b789-879939a8050b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.086325 Oct 20 06:20:59.577857 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 832/1648] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:20:59 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:21:00.015237 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-269064d7-2e7f-4a68-8258-a88fac46cf4e tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:21:00.015844 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-269064d7-2e7f-4a68-8258-a88fac46cf4e tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:21:00.022293 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-269064d7-2e7f-4a68-8258-a88fac46cf4e tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:21:00.022767 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-269064d7-2e7f-4a68-8258-a88fac46cf4e tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:21:00.023277 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-269064d7-2e7f-4a68-8258-a88fac46cf4e tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:21:00.024113 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-269064d7-2e7f-4a68-8258-a88fac46cf4e tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:21:00.024562 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-269064d7-2e7f-4a68-8258-a88fac46cf4e tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:21:00.025015 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-269064d7-2e7f-4a68-8258-a88fac46cf4e tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:21:00.161840 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-269064d7-2e7f-4a68-8258-a88fac46cf4e tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:21:00.170837 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-269064d7-2e7f-4a68-8258-a88fac46cf4e tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.159471 Oct 20 06:21:00.171405 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 817/1649] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:21:00 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:21:00.601527 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-ff9ccbc0-f475-421a-b2eb-830ba35f8bc9 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:21:00.602620 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-ff9ccbc0-f475-421a-b2eb-830ba35f8bc9 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:21:00.610406 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ff9ccbc0-f475-421a-b2eb-830ba35f8bc9 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:21:00.610914 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ff9ccbc0-f475-421a-b2eb-830ba35f8bc9 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:21:00.611347 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ff9ccbc0-f475-421a-b2eb-830ba35f8bc9 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:21:00.612070 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ff9ccbc0-f475-421a-b2eb-830ba35f8bc9 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:21:00.612558 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ff9ccbc0-f475-421a-b2eb-830ba35f8bc9 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:21:00.613013 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ff9ccbc0-f475-421a-b2eb-830ba35f8bc9 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:21:00.682305 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-ff9ccbc0-f475-421a-b2eb-830ba35f8bc9 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:21:00.690816 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-ff9ccbc0-f475-421a-b2eb-830ba35f8bc9 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.093465 Oct 20 06:21:00.691445 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 833/1650] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:21:00 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:21:01.196062 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-655ac658-740b-4cdc-b520-bb3d3e8ce26c tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:21:01.197042 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-655ac658-740b-4cdc-b520-bb3d3e8ce26c tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:21:01.203626 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-655ac658-740b-4cdc-b520-bb3d3e8ce26c tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:21:01.204111 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-655ac658-740b-4cdc-b520-bb3d3e8ce26c tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:21:01.204815 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-655ac658-740b-4cdc-b520-bb3d3e8ce26c tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:21:01.205521 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-655ac658-740b-4cdc-b520-bb3d3e8ce26c tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:21:01.205977 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-655ac658-740b-4cdc-b520-bb3d3e8ce26c tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:21:01.206406 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-655ac658-740b-4cdc-b520-bb3d3e8ce26c tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:21:01.336546 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-655ac658-740b-4cdc-b520-bb3d3e8ce26c tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:21:01.344751 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-655ac658-740b-4cdc-b520-bb3d3e8ce26c tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.153352 Oct 20 06:21:01.345325 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 818/1651] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:21:01 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 06:21:01.715210 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-04e3a7bc-fcb9-4c59-bab8-c4c527bf4fad tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:21:01.715808 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-04e3a7bc-fcb9-4c59-bab8-c4c527bf4fad tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:21:01.722093 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-04e3a7bc-fcb9-4c59-bab8-c4c527bf4fad tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:21:01.722567 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-04e3a7bc-fcb9-4c59-bab8-c4c527bf4fad tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:21:01.722997 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-04e3a7bc-fcb9-4c59-bab8-c4c527bf4fad tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:21:01.723682 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-04e3a7bc-fcb9-4c59-bab8-c4c527bf4fad tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:21:01.724125 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-04e3a7bc-fcb9-4c59-bab8-c4c527bf4fad tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:21:01.724543 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-04e3a7bc-fcb9-4c59-bab8-c4c527bf4fad tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:21:01.804033 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-04e3a7bc-fcb9-4c59-bab8-c4c527bf4fad tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:21:01.814295 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-04e3a7bc-fcb9-4c59-bab8-c4c527bf4fad tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.102950 Oct 20 06:21:01.815221 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 834/1652] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:21:01 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:21:02.367915 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-d6c43f58-bd64-495e-8354-c727d71d4892 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:21:02.368615 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-d6c43f58-bd64-495e-8354-c727d71d4892 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:21:02.375165 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-d6c43f58-bd64-495e-8354-c727d71d4892 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:21:02.375648 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-d6c43f58-bd64-495e-8354-c727d71d4892 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:21:02.376087 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-d6c43f58-bd64-495e-8354-c727d71d4892 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:21:02.376814 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-d6c43f58-bd64-495e-8354-c727d71d4892 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:21:02.377275 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-d6c43f58-bd64-495e-8354-c727d71d4892 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:21:02.377700 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-d6c43f58-bd64-495e-8354-c727d71d4892 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:21:02.510580 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-d6c43f58-bd64-495e-8354-c727d71d4892 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:21:02.518891 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-d6c43f58-bd64-495e-8354-c727d71d4892 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.155390 Oct 20 06:21:02.519496 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 819/1653] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:21:02 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:21:02.837713 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-80023462-b704-4b0d-bc00-ffb18df85884 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:21:02.838333 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-80023462-b704-4b0d-bc00-ffb18df85884 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:21:02.844885 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-80023462-b704-4b0d-bc00-ffb18df85884 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:21:02.845363 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-80023462-b704-4b0d-bc00-ffb18df85884 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:21:02.845803 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-80023462-b704-4b0d-bc00-ffb18df85884 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:21:02.846498 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-80023462-b704-4b0d-bc00-ffb18df85884 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:21:02.846940 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-80023462-b704-4b0d-bc00-ffb18df85884 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:21:02.847365 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-80023462-b704-4b0d-bc00-ffb18df85884 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:21:02.909525 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-80023462-b704-4b0d-bc00-ffb18df85884 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:21:02.917891 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-80023462-b704-4b0d-bc00-ffb18df85884 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.084173 Oct 20 06:21:02.918474 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 835/1654] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:21:02 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:21:03.542351 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-12856663-1cb7-486c-8648-6317080348b7 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:21:03.543090 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-12856663-1cb7-486c-8648-6317080348b7 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:21:03.549596 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-12856663-1cb7-486c-8648-6317080348b7 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:21:03.550078 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-12856663-1cb7-486c-8648-6317080348b7 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:21:03.550513 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-12856663-1cb7-486c-8648-6317080348b7 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:21:03.551204 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-12856663-1cb7-486c-8648-6317080348b7 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:21:03.551653 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-12856663-1cb7-486c-8648-6317080348b7 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:21:03.552127 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-12856663-1cb7-486c-8648-6317080348b7 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:21:03.680732 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-12856663-1cb7-486c-8648-6317080348b7 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:21:03.688866 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-12856663-1cb7-486c-8648-6317080348b7 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.150423 Oct 20 06:21:03.689429 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 820/1655] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:21:03 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:21:03.941320 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-4566724c-ccdf-45b5-9835-8f6930f2ceac tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:21:03.942080 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-4566724c-ccdf-45b5-9835-8f6930f2ceac tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:21:03.949021 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4566724c-ccdf-45b5-9835-8f6930f2ceac tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:21:03.949508 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4566724c-ccdf-45b5-9835-8f6930f2ceac tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:21:03.949953 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4566724c-ccdf-45b5-9835-8f6930f2ceac tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:21:03.950663 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4566724c-ccdf-45b5-9835-8f6930f2ceac tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:21:03.951108 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4566724c-ccdf-45b5-9835-8f6930f2ceac tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:21:03.951537 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4566724c-ccdf-45b5-9835-8f6930f2ceac tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:21:04.015728 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-4566724c-ccdf-45b5-9835-8f6930f2ceac tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:21:04.024675 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-4566724c-ccdf-45b5-9835-8f6930f2ceac tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.087302 Oct 20 06:21:04.025502 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 836/1656] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:21:03 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:21:04.712086 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-f6a59046-8258-4a1c-8cc8-6cd11530d3a5 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:21:04.712720 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-f6a59046-8258-4a1c-8cc8-6cd11530d3a5 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:21:04.719128 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f6a59046-8258-4a1c-8cc8-6cd11530d3a5 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:21:04.719615 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f6a59046-8258-4a1c-8cc8-6cd11530d3a5 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:21:04.720056 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f6a59046-8258-4a1c-8cc8-6cd11530d3a5 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:21:04.720780 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f6a59046-8258-4a1c-8cc8-6cd11530d3a5 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:21:04.721245 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f6a59046-8258-4a1c-8cc8-6cd11530d3a5 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:21:04.721676 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f6a59046-8258-4a1c-8cc8-6cd11530d3a5 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:21:04.849975 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-f6a59046-8258-4a1c-8cc8-6cd11530d3a5 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:21:04.859173 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-f6a59046-8258-4a1c-8cc8-6cd11530d3a5 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.151526 Oct 20 06:21:04.859750 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 821/1657] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:21:04 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:21:05.048173 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-fe1f36a2-c06c-4d0e-9d04-d303512c5b13 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:21:05.048736 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-fe1f36a2-c06c-4d0e-9d04-d303512c5b13 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:21:05.055527 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-fe1f36a2-c06c-4d0e-9d04-d303512c5b13 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:21:05.056000 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-fe1f36a2-c06c-4d0e-9d04-d303512c5b13 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:21:05.056430 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-fe1f36a2-c06c-4d0e-9d04-d303512c5b13 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:21:05.057148 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-fe1f36a2-c06c-4d0e-9d04-d303512c5b13 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:21:05.057592 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-fe1f36a2-c06c-4d0e-9d04-d303512c5b13 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:21:05.058008 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-fe1f36a2-c06c-4d0e-9d04-d303512c5b13 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:21:05.118936 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-fe1f36a2-c06c-4d0e-9d04-d303512c5b13 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:21:05.127077 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-fe1f36a2-c06c-4d0e-9d04-d303512c5b13 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.082850 Oct 20 06:21:05.127634 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 837/1658] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:21:05 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 06:21:05.884216 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-5aeaf18f-c02c-42f3-9fab-3a6c6a6533ba tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:21:05.884893 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-5aeaf18f-c02c-42f3-9fab-3a6c6a6533ba tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:21:05.891484 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5aeaf18f-c02c-42f3-9fab-3a6c6a6533ba tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:21:05.891960 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5aeaf18f-c02c-42f3-9fab-3a6c6a6533ba tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:21:05.892394 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5aeaf18f-c02c-42f3-9fab-3a6c6a6533ba tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:21:05.893107 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5aeaf18f-c02c-42f3-9fab-3a6c6a6533ba tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:21:05.893559 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5aeaf18f-c02c-42f3-9fab-3a6c6a6533ba tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:21:05.894025 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5aeaf18f-c02c-42f3-9fab-3a6c6a6533ba tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:21:06.024191 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-5aeaf18f-c02c-42f3-9fab-3a6c6a6533ba tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:21:06.032510 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-5aeaf18f-c02c-42f3-9fab-3a6c6a6533ba tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.153295 Oct 20 06:21:06.033098 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 822/1659] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:21:05 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:21:06.150762 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-c0750101-edc1-4a65-b759-f510229e52c3 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:21:06.151297 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-c0750101-edc1-4a65-b759-f510229e52c3 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:21:06.157869 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c0750101-edc1-4a65-b759-f510229e52c3 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:21:06.158348 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c0750101-edc1-4a65-b759-f510229e52c3 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:21:06.158780 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c0750101-edc1-4a65-b759-f510229e52c3 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:21:06.159474 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c0750101-edc1-4a65-b759-f510229e52c3 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:21:06.159921 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c0750101-edc1-4a65-b759-f510229e52c3 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:21:06.160337 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c0750101-edc1-4a65-b759-f510229e52c3 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:21:06.221602 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-c0750101-edc1-4a65-b759-f510229e52c3 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:21:06.230769 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-c0750101-edc1-4a65-b759-f510229e52c3 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.084237 Oct 20 06:21:06.231342 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 838/1660] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:21:06 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:21:07.057973 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-d5996feb-5bae-4557-bf3b-06996dc3e2bd tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:21:07.058509 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-d5996feb-5bae-4557-bf3b-06996dc3e2bd tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:21:07.064860 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-d5996feb-5bae-4557-bf3b-06996dc3e2bd tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:21:07.065337 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-d5996feb-5bae-4557-bf3b-06996dc3e2bd tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:21:07.065764 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-d5996feb-5bae-4557-bf3b-06996dc3e2bd tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:21:07.066451 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-d5996feb-5bae-4557-bf3b-06996dc3e2bd tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:21:07.066897 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-d5996feb-5bae-4557-bf3b-06996dc3e2bd tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:21:07.067316 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-d5996feb-5bae-4557-bf3b-06996dc3e2bd tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:21:07.195679 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-d5996feb-5bae-4557-bf3b-06996dc3e2bd tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:21:07.204090 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-d5996feb-5bae-4557-bf3b-06996dc3e2bd tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.150800 Oct 20 06:21:07.204654 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 823/1661] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:21:07 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:21:07.254053 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-2e59c614-b967-47e9-81bb-0b8592355fdb tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:21:07.254700 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-2e59c614-b967-47e9-81bb-0b8592355fdb tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:21:07.261817 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-2e59c614-b967-47e9-81bb-0b8592355fdb tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:21:07.262308 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-2e59c614-b967-47e9-81bb-0b8592355fdb tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:21:07.262750 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-2e59c614-b967-47e9-81bb-0b8592355fdb tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:21:07.263459 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-2e59c614-b967-47e9-81bb-0b8592355fdb tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:21:07.263915 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-2e59c614-b967-47e9-81bb-0b8592355fdb tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:21:07.264349 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-2e59c614-b967-47e9-81bb-0b8592355fdb tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:21:07.268300 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG dbcounter [-] [118861] Writing DB stats nova_cell1:SELECT=100 {{(pid=118861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:21:07.326917 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-2e59c614-b967-47e9-81bb-0b8592355fdb tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:21:07.335398 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-2e59c614-b967-47e9-81bb-0b8592355fdb tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.085235 Oct 20 06:21:07.336470 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 839/1662] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:21:07 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:21:08.227881 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-d492827d-f97b-4bd7-8ef7-476caf859dbf tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:21:08.228481 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-d492827d-f97b-4bd7-8ef7-476caf859dbf tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:21:08.234847 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-d492827d-f97b-4bd7-8ef7-476caf859dbf tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:21:08.235324 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-d492827d-f97b-4bd7-8ef7-476caf859dbf tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:21:08.235753 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-d492827d-f97b-4bd7-8ef7-476caf859dbf tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:21:08.236436 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-d492827d-f97b-4bd7-8ef7-476caf859dbf tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:21:08.236911 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-d492827d-f97b-4bd7-8ef7-476caf859dbf tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:21:08.237341 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-d492827d-f97b-4bd7-8ef7-476caf859dbf tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:21:08.359269 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-9a2b9de9-1537-4846-a80d-e42129018f30 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:21:08.359876 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-9a2b9de9-1537-4846-a80d-e42129018f30 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:21:08.366614 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-9a2b9de9-1537-4846-a80d-e42129018f30 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:21:08.367135 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-9a2b9de9-1537-4846-a80d-e42129018f30 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:21:08.367585 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-9a2b9de9-1537-4846-a80d-e42129018f30 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:21:08.368357 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-9a2b9de9-1537-4846-a80d-e42129018f30 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:21:08.369067 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-9a2b9de9-1537-4846-a80d-e42129018f30 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:21:08.369491 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-9a2b9de9-1537-4846-a80d-e42129018f30 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:21:08.377439 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-d492827d-f97b-4bd7-8ef7-476caf859dbf tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:21:08.386597 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-d492827d-f97b-4bd7-8ef7-476caf859dbf tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.163160 Oct 20 06:21:08.387408 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 824/1663] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:21:08 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:21:08.444081 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-9a2b9de9-1537-4846-a80d-e42129018f30 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:21:08.452895 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-9a2b9de9-1537-4846-a80d-e42129018f30 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.097531 Oct 20 06:21:08.453461 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 840/1664] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:21:08 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 06:21:09.410377 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-57b97cfc-a517-4ecf-9f5f-d9a25acfda67 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:21:09.410970 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-57b97cfc-a517-4ecf-9f5f-d9a25acfda67 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:21:09.417939 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-57b97cfc-a517-4ecf-9f5f-d9a25acfda67 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:21:09.418417 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-57b97cfc-a517-4ecf-9f5f-d9a25acfda67 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:21:09.418850 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-57b97cfc-a517-4ecf-9f5f-d9a25acfda67 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:21:09.419536 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-57b97cfc-a517-4ecf-9f5f-d9a25acfda67 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:21:09.419982 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-57b97cfc-a517-4ecf-9f5f-d9a25acfda67 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:21:09.420405 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-57b97cfc-a517-4ecf-9f5f-d9a25acfda67 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:21:09.475554 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-5b8bf7df-6584-4630-9c08-4825c51ff332 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:21:09.476809 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-5b8bf7df-6584-4630-9c08-4825c51ff332 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:21:09.483189 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5b8bf7df-6584-4630-9c08-4825c51ff332 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:21:09.484227 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5b8bf7df-6584-4630-9c08-4825c51ff332 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:21:09.484443 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5b8bf7df-6584-4630-9c08-4825c51ff332 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:21:09.485141 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5b8bf7df-6584-4630-9c08-4825c51ff332 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:21:09.485589 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5b8bf7df-6584-4630-9c08-4825c51ff332 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:21:09.486018 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5b8bf7df-6584-4630-9c08-4825c51ff332 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:21:09.551713 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-5b8bf7df-6584-4630-9c08-4825c51ff332 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:21:09.554067 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-57b97cfc-a517-4ecf-9f5f-d9a25acfda67 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:21:09.561167 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-5b8bf7df-6584-4630-9c08-4825c51ff332 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.089424 Oct 20 06:21:09.561861 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 841/1665] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:21:09 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 06:21:09.562463 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-57b97cfc-a517-4ecf-9f5f-d9a25acfda67 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.155901 Oct 20 06:21:09.563185 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 825/1666] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:21:09 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:21:10.583867 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-4b08d266-722a-4a44-9645-0a0440b8c26e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:21:10.584394 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-acf4b729-a24b-4040-95da-8628ae6fc978 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:21:10.584791 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-4b08d266-722a-4a44-9645-0a0440b8c26e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:21:10.585022 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-acf4b729-a24b-4040-95da-8628ae6fc978 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:21:10.591750 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4b08d266-722a-4a44-9645-0a0440b8c26e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:21:10.592230 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4b08d266-722a-4a44-9645-0a0440b8c26e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:21:10.592663 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4b08d266-722a-4a44-9645-0a0440b8c26e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:21:10.593101 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-acf4b729-a24b-4040-95da-8628ae6fc978 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:21:10.593380 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4b08d266-722a-4a44-9645-0a0440b8c26e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:21:10.593829 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4b08d266-722a-4a44-9645-0a0440b8c26e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:21:10.594226 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-acf4b729-a24b-4040-95da-8628ae6fc978 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:21:10.594376 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4b08d266-722a-4a44-9645-0a0440b8c26e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:21:10.594664 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-acf4b729-a24b-4040-95da-8628ae6fc978 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:21:10.595542 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-acf4b729-a24b-4040-95da-8628ae6fc978 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:21:10.595996 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-acf4b729-a24b-4040-95da-8628ae6fc978 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:21:10.596419 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-acf4b729-a24b-4040-95da-8628ae6fc978 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:21:10.665541 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-4b08d266-722a-4a44-9645-0a0440b8c26e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:21:10.674835 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-4b08d266-722a-4a44-9645-0a0440b8c26e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.095081 Oct 20 06:21:10.675408 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 842/1667] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:21:10 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:21:10.737978 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-acf4b729-a24b-4040-95da-8628ae6fc978 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:21:10.746500 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-acf4b729-a24b-4040-95da-8628ae6fc978 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.165782 Oct 20 06:21:10.747111 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 826/1668] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:21:10 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 06:21:11.697875 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-99a7229a-aedc-44b5-bada-2fe29dff212d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:21:11.698483 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-99a7229a-aedc-44b5-bada-2fe29dff212d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:21:11.705311 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-99a7229a-aedc-44b5-bada-2fe29dff212d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:21:11.705795 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-99a7229a-aedc-44b5-bada-2fe29dff212d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:21:11.706235 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-99a7229a-aedc-44b5-bada-2fe29dff212d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:21:11.707209 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-99a7229a-aedc-44b5-bada-2fe29dff212d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:21:11.707669 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-99a7229a-aedc-44b5-bada-2fe29dff212d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:21:11.708099 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-99a7229a-aedc-44b5-bada-2fe29dff212d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:21:11.770304 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-99a7229a-aedc-44b5-bada-2fe29dff212d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:21:11.775216 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-43b76de4-924e-4134-a5ca-2e755d0af140 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:21:11.775933 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-43b76de4-924e-4134-a5ca-2e755d0af140 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:21:11.779851 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-99a7229a-aedc-44b5-bada-2fe29dff212d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.085973 Oct 20 06:21:11.780605 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 843/1669] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:21:11 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:21:11.782469 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-43b76de4-924e-4134-a5ca-2e755d0af140 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:21:11.782955 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-43b76de4-924e-4134-a5ca-2e755d0af140 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:21:11.783508 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-43b76de4-924e-4134-a5ca-2e755d0af140 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:21:11.784209 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-43b76de4-924e-4134-a5ca-2e755d0af140 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:21:11.784655 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-43b76de4-924e-4134-a5ca-2e755d0af140 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:21:11.785098 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-43b76de4-924e-4134-a5ca-2e755d0af140 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:21:11.919791 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-43b76de4-924e-4134-a5ca-2e755d0af140 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:21:11.927942 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-43b76de4-924e-4134-a5ca-2e755d0af140 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.158334 Oct 20 06:21:11.928498 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 827/1670] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:21:11 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 06:21:12.803768 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-7c6ef1ff-cbaf-4bd1-a058-a883054c0dda tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:21:12.805391 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-7c6ef1ff-cbaf-4bd1-a058-a883054c0dda tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:21:12.811860 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7c6ef1ff-cbaf-4bd1-a058-a883054c0dda tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:21:12.812338 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7c6ef1ff-cbaf-4bd1-a058-a883054c0dda tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:21:12.812858 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7c6ef1ff-cbaf-4bd1-a058-a883054c0dda tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:21:12.813546 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7c6ef1ff-cbaf-4bd1-a058-a883054c0dda tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:21:12.814002 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7c6ef1ff-cbaf-4bd1-a058-a883054c0dda tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:21:12.814421 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7c6ef1ff-cbaf-4bd1-a058-a883054c0dda tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:21:12.878599 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-7c6ef1ff-cbaf-4bd1-a058-a883054c0dda tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:21:12.887734 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-7c6ef1ff-cbaf-4bd1-a058-a883054c0dda tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.087874 Oct 20 06:21:12.888304 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 844/1671] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:21:12 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:21:12.951632 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-cfc7e3d6-b347-4d02-9eae-e7a62a0b89e7 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:21:12.952261 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-cfc7e3d6-b347-4d02-9eae-e7a62a0b89e7 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:21:12.958840 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-cfc7e3d6-b347-4d02-9eae-e7a62a0b89e7 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:21:12.959304 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-cfc7e3d6-b347-4d02-9eae-e7a62a0b89e7 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:21:12.959728 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-cfc7e3d6-b347-4d02-9eae-e7a62a0b89e7 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:21:12.960425 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-cfc7e3d6-b347-4d02-9eae-e7a62a0b89e7 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:21:12.960966 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-cfc7e3d6-b347-4d02-9eae-e7a62a0b89e7 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:21:12.961393 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-cfc7e3d6-b347-4d02-9eae-e7a62a0b89e7 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:21:13.091874 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-cfc7e3d6-b347-4d02-9eae-e7a62a0b89e7 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:21:13.100286 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-cfc7e3d6-b347-4d02-9eae-e7a62a0b89e7 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.152598 Oct 20 06:21:13.100868 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 828/1672] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:21:12 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:21:13.910764 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-8778d66b-4ec0-4813-8cb5-ba5f935c91d6 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:21:13.911375 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-8778d66b-4ec0-4813-8cb5-ba5f935c91d6 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:21:13.918053 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-8778d66b-4ec0-4813-8cb5-ba5f935c91d6 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:21:13.918544 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-8778d66b-4ec0-4813-8cb5-ba5f935c91d6 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:21:13.918978 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-8778d66b-4ec0-4813-8cb5-ba5f935c91d6 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:21:13.919678 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-8778d66b-4ec0-4813-8cb5-ba5f935c91d6 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:21:13.920128 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-8778d66b-4ec0-4813-8cb5-ba5f935c91d6 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:21:13.920557 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-8778d66b-4ec0-4813-8cb5-ba5f935c91d6 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:21:13.984396 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-8778d66b-4ec0-4813-8cb5-ba5f935c91d6 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:21:13.993351 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-8778d66b-4ec0-4813-8cb5-ba5f935c91d6 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.086416 Oct 20 06:21:13.993921 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 845/1673] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:21:13 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 06:21:14.124048 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-f30a7440-7f1b-48ef-8429-e742dacb60f2 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:21:14.124633 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-f30a7440-7f1b-48ef-8429-e742dacb60f2 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:21:14.131376 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f30a7440-7f1b-48ef-8429-e742dacb60f2 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:21:14.131853 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f30a7440-7f1b-48ef-8429-e742dacb60f2 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:21:14.132617 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f30a7440-7f1b-48ef-8429-e742dacb60f2 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:21:14.133434 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f30a7440-7f1b-48ef-8429-e742dacb60f2 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:21:14.133882 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f30a7440-7f1b-48ef-8429-e742dacb60f2 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:21:14.134307 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f30a7440-7f1b-48ef-8429-e742dacb60f2 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:21:14.268062 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-f30a7440-7f1b-48ef-8429-e742dacb60f2 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:21:14.277791 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-f30a7440-7f1b-48ef-8429-e742dacb60f2 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.157531 Oct 20 06:21:14.278513 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 829/1674] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:21:14 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:21:15.017103 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-e83e430c-a43f-4c0c-95f8-edf816b7edbf tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:21:15.017750 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-e83e430c-a43f-4c0c-95f8-edf816b7edbf tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:21:15.024834 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e83e430c-a43f-4c0c-95f8-edf816b7edbf tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:21:15.025331 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e83e430c-a43f-4c0c-95f8-edf816b7edbf tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:21:15.025771 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e83e430c-a43f-4c0c-95f8-edf816b7edbf tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:21:15.026483 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e83e430c-a43f-4c0c-95f8-edf816b7edbf tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:21:15.026938 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e83e430c-a43f-4c0c-95f8-edf816b7edbf tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:21:15.027371 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e83e430c-a43f-4c0c-95f8-edf816b7edbf tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:21:15.091928 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-e83e430c-a43f-4c0c-95f8-edf816b7edbf tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:21:15.100549 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-e83e430c-a43f-4c0c-95f8-edf816b7edbf tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.087397 Oct 20 06:21:15.101728 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 846/1675] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:21:15 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:21:15.301573 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-3c8961f7-030f-4a03-9199-f210dd786036 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:21:15.302092 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-3c8961f7-030f-4a03-9199-f210dd786036 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:21:15.308667 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3c8961f7-030f-4a03-9199-f210dd786036 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:21:15.309201 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3c8961f7-030f-4a03-9199-f210dd786036 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:21:15.309642 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3c8961f7-030f-4a03-9199-f210dd786036 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:21:15.310353 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3c8961f7-030f-4a03-9199-f210dd786036 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:21:15.310806 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3c8961f7-030f-4a03-9199-f210dd786036 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:21:15.311265 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3c8961f7-030f-4a03-9199-f210dd786036 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:21:15.313933 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG dbcounter [-] [118860] Writing DB stats nova_cell1:SELECT=100 {{(pid=118860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:21:15.443364 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-3c8961f7-030f-4a03-9199-f210dd786036 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:21:15.452111 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-3c8961f7-030f-4a03-9199-f210dd786036 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.154686 Oct 20 06:21:15.453087 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 830/1676] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:21:15 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:21:16.123621 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-d04dc02b-859c-4bac-aa89-1569b14bfe59 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:21:16.124357 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-d04dc02b-859c-4bac-aa89-1569b14bfe59 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:21:16.132025 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d04dc02b-859c-4bac-aa89-1569b14bfe59 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:21:16.133305 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d04dc02b-859c-4bac-aa89-1569b14bfe59 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:21:16.133798 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d04dc02b-859c-4bac-aa89-1569b14bfe59 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:21:16.134532 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d04dc02b-859c-4bac-aa89-1569b14bfe59 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:21:16.134980 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d04dc02b-859c-4bac-aa89-1569b14bfe59 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:21:16.135403 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d04dc02b-859c-4bac-aa89-1569b14bfe59 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:21:16.197196 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-d04dc02b-859c-4bac-aa89-1569b14bfe59 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:21:16.205663 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-d04dc02b-859c-4bac-aa89-1569b14bfe59 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.085852 Oct 20 06:21:16.206238 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 847/1677] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:21:16 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:21:16.475574 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-539aea55-2eea-4883-b21c-3528cf79cda5 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:21:16.476804 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-539aea55-2eea-4883-b21c-3528cf79cda5 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:21:16.483701 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-539aea55-2eea-4883-b21c-3528cf79cda5 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:21:16.484210 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-539aea55-2eea-4883-b21c-3528cf79cda5 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:21:16.484631 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-539aea55-2eea-4883-b21c-3528cf79cda5 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:21:16.485465 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-539aea55-2eea-4883-b21c-3528cf79cda5 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:21:16.485919 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-539aea55-2eea-4883-b21c-3528cf79cda5 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:21:16.486343 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-539aea55-2eea-4883-b21c-3528cf79cda5 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:21:16.619924 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-539aea55-2eea-4883-b21c-3528cf79cda5 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:21:16.628322 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-539aea55-2eea-4883-b21c-3528cf79cda5 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.156772 Oct 20 06:21:16.629062 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 831/1678] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:21:16 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:21:17.230532 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-de8592bf-e5d5-473d-95ef-b93c8a714dc5 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:21:17.231289 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-de8592bf-e5d5-473d-95ef-b93c8a714dc5 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:21:17.237959 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-de8592bf-e5d5-473d-95ef-b93c8a714dc5 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:21:17.238443 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-de8592bf-e5d5-473d-95ef-b93c8a714dc5 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:21:17.238878 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-de8592bf-e5d5-473d-95ef-b93c8a714dc5 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:21:17.239574 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-de8592bf-e5d5-473d-95ef-b93c8a714dc5 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:21:17.240026 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-de8592bf-e5d5-473d-95ef-b93c8a714dc5 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:21:17.240456 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-de8592bf-e5d5-473d-95ef-b93c8a714dc5 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:21:17.310313 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-de8592bf-e5d5-473d-95ef-b93c8a714dc5 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:21:17.318755 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-de8592bf-e5d5-473d-95ef-b93c8a714dc5 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.092419 Oct 20 06:21:17.319316 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 848/1679] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:21:17 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:21:17.651629 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-721e5f19-f614-4a13-811b-158ebfbd6fd4 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:21:17.652275 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-721e5f19-f614-4a13-811b-158ebfbd6fd4 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:21:17.659536 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-721e5f19-f614-4a13-811b-158ebfbd6fd4 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:21:17.660019 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-721e5f19-f614-4a13-811b-158ebfbd6fd4 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:21:17.660451 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-721e5f19-f614-4a13-811b-158ebfbd6fd4 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:21:17.661227 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-721e5f19-f614-4a13-811b-158ebfbd6fd4 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:21:17.661675 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-721e5f19-f614-4a13-811b-158ebfbd6fd4 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:21:17.662098 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-721e5f19-f614-4a13-811b-158ebfbd6fd4 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:21:17.796355 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-721e5f19-f614-4a13-811b-158ebfbd6fd4 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:21:17.805319 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-721e5f19-f614-4a13-811b-158ebfbd6fd4 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.157585 Oct 20 06:21:17.805890 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 832/1680] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:21:17 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:21:18.342158 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-10022dd1-d1bf-4e0f-90ac-eae2e8db2644 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:21:18.342813 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-10022dd1-d1bf-4e0f-90ac-eae2e8db2644 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:21:18.349299 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-10022dd1-d1bf-4e0f-90ac-eae2e8db2644 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:21:18.349787 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-10022dd1-d1bf-4e0f-90ac-eae2e8db2644 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:21:18.350229 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-10022dd1-d1bf-4e0f-90ac-eae2e8db2644 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:21:18.350924 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-10022dd1-d1bf-4e0f-90ac-eae2e8db2644 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:21:18.352071 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-10022dd1-d1bf-4e0f-90ac-eae2e8db2644 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:21:18.352523 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-10022dd1-d1bf-4e0f-90ac-eae2e8db2644 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:21:18.412736 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-10022dd1-d1bf-4e0f-90ac-eae2e8db2644 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:21:18.421502 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-10022dd1-d1bf-4e0f-90ac-eae2e8db2644 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.083292 Oct 20 06:21:18.422075 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 849/1681] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:21:18 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:21:18.828578 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-725307ee-d709-4273-ae24-dfe8f872c8fd tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:21:18.829308 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-725307ee-d709-4273-ae24-dfe8f872c8fd tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:21:18.836151 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-725307ee-d709-4273-ae24-dfe8f872c8fd tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:21:18.836621 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-725307ee-d709-4273-ae24-dfe8f872c8fd tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:21:18.837078 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-725307ee-d709-4273-ae24-dfe8f872c8fd tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:21:18.837762 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-725307ee-d709-4273-ae24-dfe8f872c8fd tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:21:18.838210 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-725307ee-d709-4273-ae24-dfe8f872c8fd tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:21:18.838632 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-725307ee-d709-4273-ae24-dfe8f872c8fd tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:21:18.967845 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-725307ee-d709-4273-ae24-dfe8f872c8fd tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:21:18.975977 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-725307ee-d709-4273-ae24-dfe8f872c8fd tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.151251 Oct 20 06:21:18.976546 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 833/1682] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:21:18 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:21:19.444197 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-1ea7a4c7-88bb-4a5c-aa0c-3cc15d3b93a3 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:21:19.444877 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-1ea7a4c7-88bb-4a5c-aa0c-3cc15d3b93a3 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:21:19.451307 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1ea7a4c7-88bb-4a5c-aa0c-3cc15d3b93a3 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:21:19.451791 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1ea7a4c7-88bb-4a5c-aa0c-3cc15d3b93a3 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:21:19.452222 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1ea7a4c7-88bb-4a5c-aa0c-3cc15d3b93a3 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:21:19.453009 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1ea7a4c7-88bb-4a5c-aa0c-3cc15d3b93a3 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:21:19.453463 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1ea7a4c7-88bb-4a5c-aa0c-3cc15d3b93a3 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:21:19.453887 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1ea7a4c7-88bb-4a5c-aa0c-3cc15d3b93a3 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:21:19.514724 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-1ea7a4c7-88bb-4a5c-aa0c-3cc15d3b93a3 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:21:19.523381 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-1ea7a4c7-88bb-4a5c-aa0c-3cc15d3b93a3 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.082681 Oct 20 06:21:19.524033 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 850/1683] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:21:19 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:21:19.999014 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-66b40e3c-a3da-4adc-8cfb-2f296930b13b tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:21:19.999621 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-66b40e3c-a3da-4adc-8cfb-2f296930b13b tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:21:20.005989 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-66b40e3c-a3da-4adc-8cfb-2f296930b13b tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:21:20.006461 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-66b40e3c-a3da-4adc-8cfb-2f296930b13b tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:21:20.006892 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-66b40e3c-a3da-4adc-8cfb-2f296930b13b tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:21:20.007976 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-66b40e3c-a3da-4adc-8cfb-2f296930b13b tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:21:20.008499 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-66b40e3c-a3da-4adc-8cfb-2f296930b13b tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:21:20.008948 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-66b40e3c-a3da-4adc-8cfb-2f296930b13b tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:21:20.142871 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-66b40e3c-a3da-4adc-8cfb-2f296930b13b tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:21:20.151496 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-66b40e3c-a3da-4adc-8cfb-2f296930b13b tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.156348 Oct 20 06:21:20.152057 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 834/1684] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:21:19 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:21:20.545918 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-de57c167-802e-47f0-8888-5a880d77ec33 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:21:20.547123 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-de57c167-802e-47f0-8888-5a880d77ec33 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:21:20.553599 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-de57c167-802e-47f0-8888-5a880d77ec33 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:21:20.554088 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-de57c167-802e-47f0-8888-5a880d77ec33 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:21:20.554531 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-de57c167-802e-47f0-8888-5a880d77ec33 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:21:20.555805 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-de57c167-802e-47f0-8888-5a880d77ec33 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:21:20.555805 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-de57c167-802e-47f0-8888-5a880d77ec33 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:21:20.556211 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-de57c167-802e-47f0-8888-5a880d77ec33 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:21:20.618514 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-de57c167-802e-47f0-8888-5a880d77ec33 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:21:20.626864 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-de57c167-802e-47f0-8888-5a880d77ec33 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.084820 Oct 20 06:21:20.627431 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 851/1685] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:21:20 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:21:21.175659 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-fbce4ab2-9f09-4cd7-9ef0-7ff3c7aa25e4 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:21:21.176186 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-fbce4ab2-9f09-4cd7-9ef0-7ff3c7aa25e4 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:21:21.182867 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-fbce4ab2-9f09-4cd7-9ef0-7ff3c7aa25e4 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:21:21.183347 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-fbce4ab2-9f09-4cd7-9ef0-7ff3c7aa25e4 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:21:21.183782 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-fbce4ab2-9f09-4cd7-9ef0-7ff3c7aa25e4 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:21:21.184468 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-fbce4ab2-9f09-4cd7-9ef0-7ff3c7aa25e4 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:21:21.185089 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-fbce4ab2-9f09-4cd7-9ef0-7ff3c7aa25e4 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:21:21.185518 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-fbce4ab2-9f09-4cd7-9ef0-7ff3c7aa25e4 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:21:21.312762 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-fbce4ab2-9f09-4cd7-9ef0-7ff3c7aa25e4 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:21:21.322039 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-fbce4ab2-9f09-4cd7-9ef0-7ff3c7aa25e4 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.150336 Oct 20 06:21:21.322608 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 835/1686] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:21:21 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:21:21.650879 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-3528a0ac-700b-4c93-93dc-be5a454e4bbd tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:21:21.651529 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-3528a0ac-700b-4c93-93dc-be5a454e4bbd tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:21:21.657841 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-3528a0ac-700b-4c93-93dc-be5a454e4bbd tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:21:21.658317 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-3528a0ac-700b-4c93-93dc-be5a454e4bbd tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:21:21.658749 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-3528a0ac-700b-4c93-93dc-be5a454e4bbd tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:21:21.659432 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-3528a0ac-700b-4c93-93dc-be5a454e4bbd tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:21:21.659882 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-3528a0ac-700b-4c93-93dc-be5a454e4bbd tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:21:21.660302 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-3528a0ac-700b-4c93-93dc-be5a454e4bbd tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:21:21.723649 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-3528a0ac-700b-4c93-93dc-be5a454e4bbd tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:21:21.732587 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-3528a0ac-700b-4c93-93dc-be5a454e4bbd tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.086093 Oct 20 06:21:21.733192 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 852/1687] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:21:21 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:21:22.345252 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-01b3abaa-3029-40e2-8aae-8f4e34dab250 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:21:22.345883 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-01b3abaa-3029-40e2-8aae-8f4e34dab250 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:21:22.352948 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-01b3abaa-3029-40e2-8aae-8f4e34dab250 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:21:22.353423 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-01b3abaa-3029-40e2-8aae-8f4e34dab250 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:21:22.353852 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-01b3abaa-3029-40e2-8aae-8f4e34dab250 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:21:22.354533 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-01b3abaa-3029-40e2-8aae-8f4e34dab250 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:21:22.354974 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-01b3abaa-3029-40e2-8aae-8f4e34dab250 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:21:22.355391 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-01b3abaa-3029-40e2-8aae-8f4e34dab250 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:21:22.482662 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-01b3abaa-3029-40e2-8aae-8f4e34dab250 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:21:22.491253 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-01b3abaa-3029-40e2-8aae-8f4e34dab250 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.149862 Oct 20 06:21:22.492489 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 836/1688] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:21:22 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:21:22.755494 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-54803d57-728b-48ac-8742-4fd2cd532fbb tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:21:22.756132 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-54803d57-728b-48ac-8742-4fd2cd532fbb tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:21:22.763440 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-54803d57-728b-48ac-8742-4fd2cd532fbb tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:21:22.763915 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-54803d57-728b-48ac-8742-4fd2cd532fbb tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:21:22.764348 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-54803d57-728b-48ac-8742-4fd2cd532fbb tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:21:22.765065 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-54803d57-728b-48ac-8742-4fd2cd532fbb tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:21:22.765513 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-54803d57-728b-48ac-8742-4fd2cd532fbb tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:21:22.765933 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-54803d57-728b-48ac-8742-4fd2cd532fbb tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:21:22.828922 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-54803d57-728b-48ac-8742-4fd2cd532fbb tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:21:22.838000 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-54803d57-728b-48ac-8742-4fd2cd532fbb tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.086396 Oct 20 06:21:22.838558 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 853/1689] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:21:22 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:21:23.515756 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-56202118-8f10-495f-b81b-eea5e160de59 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:21:23.516392 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-56202118-8f10-495f-b81b-eea5e160de59 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:21:23.523890 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-56202118-8f10-495f-b81b-eea5e160de59 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:21:23.524371 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-56202118-8f10-495f-b81b-eea5e160de59 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:21:23.524833 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-56202118-8f10-495f-b81b-eea5e160de59 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:21:23.525520 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-56202118-8f10-495f-b81b-eea5e160de59 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:21:23.525966 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-56202118-8f10-495f-b81b-eea5e160de59 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:21:23.526388 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-56202118-8f10-495f-b81b-eea5e160de59 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:21:23.652811 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-56202118-8f10-495f-b81b-eea5e160de59 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:21:23.660992 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-56202118-8f10-495f-b81b-eea5e160de59 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.149141 Oct 20 06:21:23.661551 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 837/1690] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:21:23 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:21:23.862910 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-82ea915b-831f-4d7b-b230-b49bf261eb39 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:21:23.863468 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-82ea915b-831f-4d7b-b230-b49bf261eb39 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:21:23.870398 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-82ea915b-831f-4d7b-b230-b49bf261eb39 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:21:23.870878 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-82ea915b-831f-4d7b-b230-b49bf261eb39 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:21:23.871317 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-82ea915b-831f-4d7b-b230-b49bf261eb39 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:21:23.872007 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-82ea915b-831f-4d7b-b230-b49bf261eb39 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:21:23.872462 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-82ea915b-831f-4d7b-b230-b49bf261eb39 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:21:23.872916 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-82ea915b-831f-4d7b-b230-b49bf261eb39 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:21:23.934169 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-82ea915b-831f-4d7b-b230-b49bf261eb39 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:21:23.942413 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-82ea915b-831f-4d7b-b230-b49bf261eb39 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.083558 Oct 20 06:21:23.942975 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 854/1691] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:21:23 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:21:24.684148 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-5a3d7f2a-ade7-4360-aa07-f11ae69bb895 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:21:24.685221 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-5a3d7f2a-ade7-4360-aa07-f11ae69bb895 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:21:24.692206 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5a3d7f2a-ade7-4360-aa07-f11ae69bb895 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:21:24.692710 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5a3d7f2a-ade7-4360-aa07-f11ae69bb895 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:21:24.693155 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5a3d7f2a-ade7-4360-aa07-f11ae69bb895 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:21:24.693858 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5a3d7f2a-ade7-4360-aa07-f11ae69bb895 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:21:24.694444 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5a3d7f2a-ade7-4360-aa07-f11ae69bb895 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:21:24.695473 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5a3d7f2a-ade7-4360-aa07-f11ae69bb895 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:21:24.833877 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-5a3d7f2a-ade7-4360-aa07-f11ae69bb895 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:21:24.842794 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-5a3d7f2a-ade7-4360-aa07-f11ae69bb895 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.162438 Oct 20 06:21:24.843384 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 838/1692] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:21:24 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:21:24.966452 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-f8a98c66-8f71-4c7c-ab7e-88f15edd5a86 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:21:24.967008 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-f8a98c66-8f71-4c7c-ab7e-88f15edd5a86 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:21:24.973674 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f8a98c66-8f71-4c7c-ab7e-88f15edd5a86 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:21:24.974157 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f8a98c66-8f71-4c7c-ab7e-88f15edd5a86 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:21:24.974595 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f8a98c66-8f71-4c7c-ab7e-88f15edd5a86 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:21:24.975297 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f8a98c66-8f71-4c7c-ab7e-88f15edd5a86 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:21:24.975754 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f8a98c66-8f71-4c7c-ab7e-88f15edd5a86 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:21:24.976681 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f8a98c66-8f71-4c7c-ab7e-88f15edd5a86 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:21:25.037796 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-f8a98c66-8f71-4c7c-ab7e-88f15edd5a86 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:21:25.040652 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG dbcounter [-] [118861] Writing DB stats nova_cell1:SELECT=100 {{(pid=118861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:21:25.048031 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-f8a98c66-8f71-4c7c-ab7e-88f15edd5a86 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.085592 Oct 20 06:21:25.048609 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 855/1693] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:21:24 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:21:25.867370 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-0f5048e1-a4a1-44e9-b822-d97a904181bc tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:21:25.868164 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-0f5048e1-a4a1-44e9-b822-d97a904181bc tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:21:25.874736 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0f5048e1-a4a1-44e9-b822-d97a904181bc tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:21:25.875232 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0f5048e1-a4a1-44e9-b822-d97a904181bc tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:21:25.875674 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0f5048e1-a4a1-44e9-b822-d97a904181bc tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:21:25.876389 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0f5048e1-a4a1-44e9-b822-d97a904181bc tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:21:25.876881 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0f5048e1-a4a1-44e9-b822-d97a904181bc tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:21:25.877317 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0f5048e1-a4a1-44e9-b822-d97a904181bc tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:21:26.009448 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-0f5048e1-a4a1-44e9-b822-d97a904181bc tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:21:26.017929 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-0f5048e1-a4a1-44e9-b822-d97a904181bc tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.155114 Oct 20 06:21:26.018514 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 839/1694] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:21:25 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:21:26.071704 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-d0a9d163-e78f-4392-8740-805699954e66 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:21:26.072399 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-d0a9d163-e78f-4392-8740-805699954e66 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:21:26.079142 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d0a9d163-e78f-4392-8740-805699954e66 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:21:26.079632 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d0a9d163-e78f-4392-8740-805699954e66 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:21:26.080075 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d0a9d163-e78f-4392-8740-805699954e66 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:21:26.080820 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d0a9d163-e78f-4392-8740-805699954e66 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:21:26.081274 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d0a9d163-e78f-4392-8740-805699954e66 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:21:26.081706 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d0a9d163-e78f-4392-8740-805699954e66 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:21:26.146519 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-d0a9d163-e78f-4392-8740-805699954e66 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:21:26.155786 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-d0a9d163-e78f-4392-8740-805699954e66 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.088086 Oct 20 06:21:26.156371 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 856/1695] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:21:26 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:21:27.043031 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-471ac221-3466-49bc-98fc-007686dbba64 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:21:27.043647 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-471ac221-3466-49bc-98fc-007686dbba64 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:21:27.045944 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG dbcounter [-] [118860] Writing DB stats nova_api:SELECT=52 {{(pid=118860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:21:27.051075 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-471ac221-3466-49bc-98fc-007686dbba64 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:21:27.051556 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-471ac221-3466-49bc-98fc-007686dbba64 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:21:27.051988 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-471ac221-3466-49bc-98fc-007686dbba64 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:21:27.052682 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-471ac221-3466-49bc-98fc-007686dbba64 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:21:27.053147 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-471ac221-3466-49bc-98fc-007686dbba64 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:21:27.053957 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-471ac221-3466-49bc-98fc-007686dbba64 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:21:27.178839 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-d38d92c5-f653-43d9-aa69-288972a73507 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:21:27.179441 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-d38d92c5-f653-43d9-aa69-288972a73507 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:21:27.184982 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG dbcounter [-] [118861] Writing DB stats nova_api:SELECT=56 {{(pid=118861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:21:27.186658 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d38d92c5-f653-43d9-aa69-288972a73507 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:21:27.186960 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-471ac221-3466-49bc-98fc-007686dbba64 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:21:27.187268 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d38d92c5-f653-43d9-aa69-288972a73507 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:21:27.187754 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d38d92c5-f653-43d9-aa69-288972a73507 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:21:27.188661 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d38d92c5-f653-43d9-aa69-288972a73507 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:21:27.189164 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d38d92c5-f653-43d9-aa69-288972a73507 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:21:27.189571 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d38d92c5-f653-43d9-aa69-288972a73507 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:21:27.196271 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-471ac221-3466-49bc-98fc-007686dbba64 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.157829 Oct 20 06:21:27.197116 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 840/1696] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:21:27 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:21:27.252056 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-d38d92c5-f653-43d9-aa69-288972a73507 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:21:27.261153 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-d38d92c5-f653-43d9-aa69-288972a73507 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.086121 Oct 20 06:21:27.261728 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 857/1697] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:21:27 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 06:21:28.220295 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-b15eb962-17ff-403f-979e-0771d7bc5d22 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:21:28.220924 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-b15eb962-17ff-403f-979e-0771d7bc5d22 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:21:28.227999 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b15eb962-17ff-403f-979e-0771d7bc5d22 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:21:28.228480 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b15eb962-17ff-403f-979e-0771d7bc5d22 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:21:28.228946 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b15eb962-17ff-403f-979e-0771d7bc5d22 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:21:28.229654 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b15eb962-17ff-403f-979e-0771d7bc5d22 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:21:28.230111 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b15eb962-17ff-403f-979e-0771d7bc5d22 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:21:28.230537 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b15eb962-17ff-403f-979e-0771d7bc5d22 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:21:28.290073 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-f9ed5392-2386-4434-943a-270534d6bdb5 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:21:28.290691 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-f9ed5392-2386-4434-943a-270534d6bdb5 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:21:28.297407 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 20 06:21:28.297632 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: Thu Oct 20 06:21:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 (ip 10.222.0.20) !!! Oct 20 06:21:28.301749 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f9ed5392-2386-4434-943a-270534d6bdb5 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:21:28.302493 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f9ed5392-2386-4434-943a-270534d6bdb5 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:21:28.302988 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f9ed5392-2386-4434-943a-270534d6bdb5 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:21:28.303718 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f9ed5392-2386-4434-943a-270534d6bdb5 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:21:28.304186 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f9ed5392-2386-4434-943a-270534d6bdb5 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:21:28.304610 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f9ed5392-2386-4434-943a-270534d6bdb5 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:21:28.371623 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-f9ed5392-2386-4434-943a-270534d6bdb5 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:21:28.381204 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-f9ed5392-2386-4434-943a-270534d6bdb5 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.100031 Oct 20 06:21:28.381799 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 858/1698] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:21:28 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 06:21:28.384785 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-b15eb962-17ff-403f-979e-0771d7bc5d22 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:21:28.393596 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-b15eb962-17ff-403f-979e-0771d7bc5d22 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.177118 Oct 20 06:21:28.394285 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 841/1699] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:21:28 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:21:29.404879 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-87446efb-c4d3-4c14-a9c9-1c7e82bf90b3 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:21:29.405454 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-87446efb-c4d3-4c14-a9c9-1c7e82bf90b3 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:21:29.411880 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-87446efb-c4d3-4c14-a9c9-1c7e82bf90b3 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:21:29.412582 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-87446efb-c4d3-4c14-a9c9-1c7e82bf90b3 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:21:29.412912 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-87446efb-c4d3-4c14-a9c9-1c7e82bf90b3 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:21:29.414273 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-87446efb-c4d3-4c14-a9c9-1c7e82bf90b3 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:21:29.414725 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-87446efb-c4d3-4c14-a9c9-1c7e82bf90b3 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:21:29.415147 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-87446efb-c4d3-4c14-a9c9-1c7e82bf90b3 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:21:29.418243 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-e591459f-7978-4cb6-943b-96a71d364c28 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:21:29.418858 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-e591459f-7978-4cb6-943b-96a71d364c28 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:21:29.425432 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e591459f-7978-4cb6-943b-96a71d364c28 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:21:29.425926 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e591459f-7978-4cb6-943b-96a71d364c28 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:21:29.426480 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e591459f-7978-4cb6-943b-96a71d364c28 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:21:29.427178 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e591459f-7978-4cb6-943b-96a71d364c28 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:21:29.427628 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e591459f-7978-4cb6-943b-96a71d364c28 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:21:29.428053 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e591459f-7978-4cb6-943b-96a71d364c28 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:21:29.477925 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-87446efb-c4d3-4c14-a9c9-1c7e82bf90b3 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:21:29.486460 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-87446efb-c4d3-4c14-a9c9-1c7e82bf90b3 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.085480 Oct 20 06:21:29.500721 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 859/1700] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:21:29 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:21:29.559164 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-e591459f-7978-4cb6-943b-96a71d364c28 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:21:29.567395 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-e591459f-7978-4cb6-943b-96a71d364c28 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.153130 Oct 20 06:21:29.567956 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 842/1701] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:21:29 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 06:21:30.512073 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-bf469c4f-f4a4-419b-b6d5-fab73abb5513 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:21:30.512782 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-bf469c4f-f4a4-419b-b6d5-fab73abb5513 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:21:30.519654 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-bf469c4f-f4a4-419b-b6d5-fab73abb5513 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:21:30.520133 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-bf469c4f-f4a4-419b-b6d5-fab73abb5513 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:21:30.520641 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-bf469c4f-f4a4-419b-b6d5-fab73abb5513 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:21:30.521408 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-bf469c4f-f4a4-419b-b6d5-fab73abb5513 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:21:30.521895 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-bf469c4f-f4a4-419b-b6d5-fab73abb5513 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:21:30.522358 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-bf469c4f-f4a4-419b-b6d5-fab73abb5513 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:21:30.591251 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-bf469c4f-f4a4-419b-b6d5-fab73abb5513 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:21:30.593336 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-d17e27df-dca7-4ea3-840d-a865f7713ccd tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:21:30.594495 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-d17e27df-dca7-4ea3-840d-a865f7713ccd tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:21:30.601492 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-bf469c4f-f4a4-419b-b6d5-fab73abb5513 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.094533 Oct 20 06:21:30.609259 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 860/1702] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:21:30 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:21:30.609448 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-d17e27df-dca7-4ea3-840d-a865f7713ccd tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:21:30.609448 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-d17e27df-dca7-4ea3-840d-a865f7713ccd tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:21:30.609448 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-d17e27df-dca7-4ea3-840d-a865f7713ccd tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:21:30.609448 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-d17e27df-dca7-4ea3-840d-a865f7713ccd tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:21:30.609808 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-d17e27df-dca7-4ea3-840d-a865f7713ccd tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:21:30.609808 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-d17e27df-dca7-4ea3-840d-a865f7713ccd tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:21:30.742287 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-d17e27df-dca7-4ea3-840d-a865f7713ccd tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:21:30.750805 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-d17e27df-dca7-4ea3-840d-a865f7713ccd tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.162378 Oct 20 06:21:30.751378 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 843/1703] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:21:30 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:21:31.625689 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-259cc5eb-138f-419b-830b-bf36b17dcce8 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:21:31.626247 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-259cc5eb-138f-419b-830b-bf36b17dcce8 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:21:31.633410 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-259cc5eb-138f-419b-830b-bf36b17dcce8 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:21:31.633922 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-259cc5eb-138f-419b-830b-bf36b17dcce8 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:21:31.634435 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-259cc5eb-138f-419b-830b-bf36b17dcce8 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:21:31.635169 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-259cc5eb-138f-419b-830b-bf36b17dcce8 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:21:31.635615 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-259cc5eb-138f-419b-830b-bf36b17dcce8 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:21:31.636036 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-259cc5eb-138f-419b-830b-bf36b17dcce8 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:21:31.699200 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-259cc5eb-138f-419b-830b-bf36b17dcce8 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:21:31.707485 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-259cc5eb-138f-419b-830b-bf36b17dcce8 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.085995 Oct 20 06:21:31.708047 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 861/1704] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:21:31 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:21:31.778601 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-bcaa7a2d-174d-49d8-9812-23559d0a0c42 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:21:31.779210 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-bcaa7a2d-174d-49d8-9812-23559d0a0c42 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:21:31.785615 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-bcaa7a2d-174d-49d8-9812-23559d0a0c42 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:21:31.786091 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-bcaa7a2d-174d-49d8-9812-23559d0a0c42 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:21:31.786532 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-bcaa7a2d-174d-49d8-9812-23559d0a0c42 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:21:31.787222 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-bcaa7a2d-174d-49d8-9812-23559d0a0c42 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:21:31.787678 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-bcaa7a2d-174d-49d8-9812-23559d0a0c42 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:21:31.788631 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-bcaa7a2d-174d-49d8-9812-23559d0a0c42 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:21:31.918494 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-bcaa7a2d-174d-49d8-9812-23559d0a0c42 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:21:31.926716 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-bcaa7a2d-174d-49d8-9812-23559d0a0c42 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.151948 Oct 20 06:21:31.927274 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 844/1705] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:21:31 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:21:32.731835 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-6d369903-6466-4468-9b69-4dc24feafe64 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:21:32.732449 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-6d369903-6466-4468-9b69-4dc24feafe64 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:21:32.738961 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-6d369903-6466-4468-9b69-4dc24feafe64 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:21:32.739441 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-6d369903-6466-4468-9b69-4dc24feafe64 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:21:32.739877 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-6d369903-6466-4468-9b69-4dc24feafe64 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:21:32.740564 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-6d369903-6466-4468-9b69-4dc24feafe64 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:21:32.741046 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-6d369903-6466-4468-9b69-4dc24feafe64 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:21:32.742628 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-6d369903-6466-4468-9b69-4dc24feafe64 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:21:32.805655 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-6d369903-6466-4468-9b69-4dc24feafe64 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:21:32.813919 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-6d369903-6466-4468-9b69-4dc24feafe64 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.086019 Oct 20 06:21:32.814481 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 862/1706] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:21:32 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:21:32.950599 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-e14ef917-ce65-480a-be5b-5547e3c68efd tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:21:32.951247 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-e14ef917-ce65-480a-be5b-5547e3c68efd tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:21:32.957691 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e14ef917-ce65-480a-be5b-5547e3c68efd tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:21:32.958173 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e14ef917-ce65-480a-be5b-5547e3c68efd tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:21:32.958609 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e14ef917-ce65-480a-be5b-5547e3c68efd tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:21:32.959297 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e14ef917-ce65-480a-be5b-5547e3c68efd tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:21:32.959751 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e14ef917-ce65-480a-be5b-5547e3c68efd tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:21:32.960829 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e14ef917-ce65-480a-be5b-5547e3c68efd tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:21:33.091891 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-e14ef917-ce65-480a-be5b-5547e3c68efd tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:21:33.100255 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-e14ef917-ce65-480a-be5b-5547e3c68efd tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.153534 Oct 20 06:21:33.101497 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 845/1707] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:21:32 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:21:33.836977 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-408e6f87-ed81-4cc0-85bc-2debee327f2f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:21:33.837566 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-408e6f87-ed81-4cc0-85bc-2debee327f2f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:21:33.844248 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-408e6f87-ed81-4cc0-85bc-2debee327f2f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:21:33.844751 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-408e6f87-ed81-4cc0-85bc-2debee327f2f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:21:33.845188 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-408e6f87-ed81-4cc0-85bc-2debee327f2f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:21:33.845878 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-408e6f87-ed81-4cc0-85bc-2debee327f2f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:21:33.846322 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-408e6f87-ed81-4cc0-85bc-2debee327f2f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:21:33.846742 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-408e6f87-ed81-4cc0-85bc-2debee327f2f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:21:33.909505 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-408e6f87-ed81-4cc0-85bc-2debee327f2f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:21:33.918643 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-408e6f87-ed81-4cc0-85bc-2debee327f2f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.085588 Oct 20 06:21:33.919212 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 863/1708] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:21:33 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:21:34.124993 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-a7349608-a820-4553-85f7-02729eab3e8c tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:21:34.125552 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-a7349608-a820-4553-85f7-02729eab3e8c tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:21:34.133115 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a7349608-a820-4553-85f7-02729eab3e8c tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:21:34.133732 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a7349608-a820-4553-85f7-02729eab3e8c tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:21:34.134182 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a7349608-a820-4553-85f7-02729eab3e8c tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:21:34.134889 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a7349608-a820-4553-85f7-02729eab3e8c tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:21:34.135342 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a7349608-a820-4553-85f7-02729eab3e8c tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:21:34.135769 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a7349608-a820-4553-85f7-02729eab3e8c tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:21:34.272223 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-a7349608-a820-4553-85f7-02729eab3e8c tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:21:34.274804 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG dbcounter [-] [118860] Writing DB stats nova_cell1:SELECT=100 {{(pid=118860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:21:34.282249 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-a7349608-a820-4553-85f7-02729eab3e8c tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.161205 Oct 20 06:21:34.282836 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 846/1709] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:21:34 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 06:21:34.942926 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-2531b418-1b54-40fb-9e43-9ddbd71eef88 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:21:34.943542 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-2531b418-1b54-40fb-9e43-9ddbd71eef88 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:21:34.950096 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-2531b418-1b54-40fb-9e43-9ddbd71eef88 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:21:34.950584 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-2531b418-1b54-40fb-9e43-9ddbd71eef88 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:21:34.951015 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-2531b418-1b54-40fb-9e43-9ddbd71eef88 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:21:34.951714 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-2531b418-1b54-40fb-9e43-9ddbd71eef88 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:21:34.952165 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-2531b418-1b54-40fb-9e43-9ddbd71eef88 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:21:34.952588 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-2531b418-1b54-40fb-9e43-9ddbd71eef88 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:21:35.016531 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-2531b418-1b54-40fb-9e43-9ddbd71eef88 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:21:35.025677 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-2531b418-1b54-40fb-9e43-9ddbd71eef88 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.086810 Oct 20 06:21:35.026213 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 864/1710] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:21:34 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:21:35.306784 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-a74c4cbe-adb4-4375-9a3a-7cdbed3f2a91 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:21:35.307776 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-a74c4cbe-adb4-4375-9a3a-7cdbed3f2a91 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:21:35.313821 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a74c4cbe-adb4-4375-9a3a-7cdbed3f2a91 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:21:35.314297 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a74c4cbe-adb4-4375-9a3a-7cdbed3f2a91 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:21:35.314732 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a74c4cbe-adb4-4375-9a3a-7cdbed3f2a91 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:21:35.315451 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a74c4cbe-adb4-4375-9a3a-7cdbed3f2a91 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:21:35.315898 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a74c4cbe-adb4-4375-9a3a-7cdbed3f2a91 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:21:35.316323 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a74c4cbe-adb4-4375-9a3a-7cdbed3f2a91 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:21:35.449219 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-a74c4cbe-adb4-4375-9a3a-7cdbed3f2a91 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:21:35.458045 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-a74c4cbe-adb4-4375-9a3a-7cdbed3f2a91 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.156082 Oct 20 06:21:35.458625 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 847/1711] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:21:35 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:21:36.049182 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-7fa602a9-46a9-4cae-87b6-da0761fa8b3a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:21:36.049793 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-7fa602a9-46a9-4cae-87b6-da0761fa8b3a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:21:36.056844 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7fa602a9-46a9-4cae-87b6-da0761fa8b3a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:21:36.057324 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7fa602a9-46a9-4cae-87b6-da0761fa8b3a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:21:36.057756 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7fa602a9-46a9-4cae-87b6-da0761fa8b3a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:21:36.058442 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7fa602a9-46a9-4cae-87b6-da0761fa8b3a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:21:36.058886 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7fa602a9-46a9-4cae-87b6-da0761fa8b3a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:21:36.059302 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7fa602a9-46a9-4cae-87b6-da0761fa8b3a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:21:36.122323 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-7fa602a9-46a9-4cae-87b6-da0761fa8b3a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:21:36.130553 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-7fa602a9-46a9-4cae-87b6-da0761fa8b3a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.085232 Oct 20 06:21:36.131117 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 865/1712] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:21:36 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 06:21:36.482747 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-7c6bbc11-b15b-4fe4-948e-687862177321 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:21:36.483351 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-7c6bbc11-b15b-4fe4-948e-687862177321 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:21:36.489759 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7c6bbc11-b15b-4fe4-948e-687862177321 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:21:36.490236 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7c6bbc11-b15b-4fe4-948e-687862177321 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:21:36.490670 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7c6bbc11-b15b-4fe4-948e-687862177321 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:21:36.491362 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7c6bbc11-b15b-4fe4-948e-687862177321 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:21:36.491808 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7c6bbc11-b15b-4fe4-948e-687862177321 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:21:36.492233 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7c6bbc11-b15b-4fe4-948e-687862177321 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:21:36.621993 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-7c6bbc11-b15b-4fe4-948e-687862177321 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:21:36.630190 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-7c6bbc11-b15b-4fe4-948e-687862177321 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.151342 Oct 20 06:21:36.630768 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 848/1713] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:21:36 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 06:21:37.154742 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-1b8d618a-7685-49fb-8e84-a1b31d1e82bc tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:21:37.155360 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-1b8d618a-7685-49fb-8e84-a1b31d1e82bc tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:21:37.161872 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1b8d618a-7685-49fb-8e84-a1b31d1e82bc tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:21:37.162356 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1b8d618a-7685-49fb-8e84-a1b31d1e82bc tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:21:37.162796 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1b8d618a-7685-49fb-8e84-a1b31d1e82bc tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:21:37.163494 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1b8d618a-7685-49fb-8e84-a1b31d1e82bc tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:21:37.163952 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1b8d618a-7685-49fb-8e84-a1b31d1e82bc tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:21:37.164381 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1b8d618a-7685-49fb-8e84-a1b31d1e82bc tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:21:37.228977 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-1b8d618a-7685-49fb-8e84-a1b31d1e82bc tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:21:37.237328 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-1b8d618a-7685-49fb-8e84-a1b31d1e82bc tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.086498 Oct 20 06:21:37.237902 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 866/1714] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:21:37 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:21:37.654488 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-844ac418-5de3-4deb-a054-6aad73b17d78 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:21:37.655112 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-844ac418-5de3-4deb-a054-6aad73b17d78 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:21:37.661141 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-844ac418-5de3-4deb-a054-6aad73b17d78 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:21:37.661630 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-844ac418-5de3-4deb-a054-6aad73b17d78 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:21:37.662072 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-844ac418-5de3-4deb-a054-6aad73b17d78 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:21:37.662773 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-844ac418-5de3-4deb-a054-6aad73b17d78 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:21:37.663232 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-844ac418-5de3-4deb-a054-6aad73b17d78 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:21:37.663661 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-844ac418-5de3-4deb-a054-6aad73b17d78 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:21:37.799304 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-844ac418-5de3-4deb-a054-6aad73b17d78 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:21:37.808306 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-844ac418-5de3-4deb-a054-6aad73b17d78 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.158400 Oct 20 06:21:37.809171 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 849/1715] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:21:37 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:21:38.261972 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-45474b7e-8469-44b4-9d4a-61b6baa9286f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:21:38.262589 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-45474b7e-8469-44b4-9d4a-61b6baa9286f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:21:38.270765 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-45474b7e-8469-44b4-9d4a-61b6baa9286f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:21:38.271252 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-45474b7e-8469-44b4-9d4a-61b6baa9286f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:21:38.271690 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-45474b7e-8469-44b4-9d4a-61b6baa9286f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:21:38.272392 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-45474b7e-8469-44b4-9d4a-61b6baa9286f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:21:38.272926 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-45474b7e-8469-44b4-9d4a-61b6baa9286f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:21:38.273350 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-45474b7e-8469-44b4-9d4a-61b6baa9286f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:21:38.336194 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-45474b7e-8469-44b4-9d4a-61b6baa9286f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:21:38.345499 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-45474b7e-8469-44b4-9d4a-61b6baa9286f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.088053 Oct 20 06:21:38.346106 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 867/1716] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:21:38 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 06:21:38.831493 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-fef51b05-ec22-4421-9259-145fee63678b tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:21:38.832102 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-fef51b05-ec22-4421-9259-145fee63678b tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:21:38.838726 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-fef51b05-ec22-4421-9259-145fee63678b tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:21:38.839198 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-fef51b05-ec22-4421-9259-145fee63678b tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:21:38.839633 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-fef51b05-ec22-4421-9259-145fee63678b tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:21:38.840336 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-fef51b05-ec22-4421-9259-145fee63678b tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:21:38.840813 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-fef51b05-ec22-4421-9259-145fee63678b tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:21:38.841234 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-fef51b05-ec22-4421-9259-145fee63678b tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:21:38.975329 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-fef51b05-ec22-4421-9259-145fee63678b tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:21:38.983686 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-fef51b05-ec22-4421-9259-145fee63678b tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.156040 Oct 20 06:21:38.984258 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 850/1717] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:21:38 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:21:39.369433 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-bb553a8a-bf3a-473c-832e-e747c7597d4f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:21:39.370051 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-bb553a8a-bf3a-473c-832e-e747c7597d4f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:21:39.376542 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-bb553a8a-bf3a-473c-832e-e747c7597d4f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:21:39.377074 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-bb553a8a-bf3a-473c-832e-e747c7597d4f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:21:39.377501 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-bb553a8a-bf3a-473c-832e-e747c7597d4f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:21:39.378202 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-bb553a8a-bf3a-473c-832e-e747c7597d4f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:21:39.378660 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-bb553a8a-bf3a-473c-832e-e747c7597d4f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:21:39.379086 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-bb553a8a-bf3a-473c-832e-e747c7597d4f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:21:39.446324 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-bb553a8a-bf3a-473c-832e-e747c7597d4f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:21:39.454963 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-bb553a8a-bf3a-473c-832e-e747c7597d4f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.090032 Oct 20 06:21:39.455571 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 868/1718] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:21:39 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:21:40.007768 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-3536697f-5f48-4912-98f8-493aeb99fb46 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:21:40.008852 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-3536697f-5f48-4912-98f8-493aeb99fb46 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:21:40.015281 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3536697f-5f48-4912-98f8-493aeb99fb46 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:21:40.015772 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3536697f-5f48-4912-98f8-493aeb99fb46 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:21:40.016447 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3536697f-5f48-4912-98f8-493aeb99fb46 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:21:40.017184 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3536697f-5f48-4912-98f8-493aeb99fb46 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:21:40.017642 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3536697f-5f48-4912-98f8-493aeb99fb46 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:21:40.018072 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3536697f-5f48-4912-98f8-493aeb99fb46 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:21:40.149849 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-3536697f-5f48-4912-98f8-493aeb99fb46 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:21:40.158394 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-3536697f-5f48-4912-98f8-493aeb99fb46 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.154805 Oct 20 06:21:40.158981 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 851/1719] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:21:40 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:21:40.478528 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-44c9da4c-e645-41e3-8e35-d33e78a988be tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:21:40.479211 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-44c9da4c-e645-41e3-8e35-d33e78a988be tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:21:40.485742 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-44c9da4c-e645-41e3-8e35-d33e78a988be tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:21:40.486225 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-44c9da4c-e645-41e3-8e35-d33e78a988be tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:21:40.486662 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-44c9da4c-e645-41e3-8e35-d33e78a988be tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:21:40.487367 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-44c9da4c-e645-41e3-8e35-d33e78a988be tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:21:40.487818 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-44c9da4c-e645-41e3-8e35-d33e78a988be tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:21:40.488241 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-44c9da4c-e645-41e3-8e35-d33e78a988be tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:21:40.559297 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-44c9da4c-e645-41e3-8e35-d33e78a988be tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:21:40.567671 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-44c9da4c-e645-41e3-8e35-d33e78a988be tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.093253 Oct 20 06:21:40.568243 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 869/1720] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:21:40 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:21:41.183111 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-44586b74-9a9c-4e22-8b3e-27375069c204 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:21:41.183750 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-44586b74-9a9c-4e22-8b3e-27375069c204 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:21:41.190211 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-44586b74-9a9c-4e22-8b3e-27375069c204 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:21:41.190692 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-44586b74-9a9c-4e22-8b3e-27375069c204 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:21:41.191228 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-44586b74-9a9c-4e22-8b3e-27375069c204 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:21:41.191934 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-44586b74-9a9c-4e22-8b3e-27375069c204 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:21:41.192386 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-44586b74-9a9c-4e22-8b3e-27375069c204 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:21:41.192869 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-44586b74-9a9c-4e22-8b3e-27375069c204 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:21:41.326426 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-44586b74-9a9c-4e22-8b3e-27375069c204 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:21:41.334646 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-44586b74-9a9c-4e22-8b3e-27375069c204 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.155456 Oct 20 06:21:41.335210 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 852/1721] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:21:41 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:21:41.591168 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-e774e93e-025d-4a66-a3a1-5fcc8fc64dd3 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:21:41.591708 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-e774e93e-025d-4a66-a3a1-5fcc8fc64dd3 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:21:41.598199 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e774e93e-025d-4a66-a3a1-5fcc8fc64dd3 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:21:41.598776 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e774e93e-025d-4a66-a3a1-5fcc8fc64dd3 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:21:41.599207 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e774e93e-025d-4a66-a3a1-5fcc8fc64dd3 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:21:41.599902 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e774e93e-025d-4a66-a3a1-5fcc8fc64dd3 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:21:41.600349 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e774e93e-025d-4a66-a3a1-5fcc8fc64dd3 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:21:41.600913 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e774e93e-025d-4a66-a3a1-5fcc8fc64dd3 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:21:41.662819 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-e774e93e-025d-4a66-a3a1-5fcc8fc64dd3 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:21:41.671517 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-e774e93e-025d-4a66-a3a1-5fcc8fc64dd3 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.084267 Oct 20 06:21:41.672121 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 870/1722] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:21:41 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 06:21:42.359215 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-a2ccb3fe-52bb-4289-97a2-0d66e827ace8 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:21:42.359828 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-a2ccb3fe-52bb-4289-97a2-0d66e827ace8 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:21:42.366312 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a2ccb3fe-52bb-4289-97a2-0d66e827ace8 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:21:42.366799 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a2ccb3fe-52bb-4289-97a2-0d66e827ace8 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:21:42.367239 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a2ccb3fe-52bb-4289-97a2-0d66e827ace8 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:21:42.368432 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a2ccb3fe-52bb-4289-97a2-0d66e827ace8 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:21:42.368920 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a2ccb3fe-52bb-4289-97a2-0d66e827ace8 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:21:42.369355 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a2ccb3fe-52bb-4289-97a2-0d66e827ace8 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:21:42.695149 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-1aa9793a-fde9-4590-8fa6-94088e1f78fd tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:21:42.696544 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-1aa9793a-fde9-4590-8fa6-94088e1f78fd tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:21:42.703173 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1aa9793a-fde9-4590-8fa6-94088e1f78fd tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:21:42.703795 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1aa9793a-fde9-4590-8fa6-94088e1f78fd tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:21:42.704295 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1aa9793a-fde9-4590-8fa6-94088e1f78fd tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:21:42.705109 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1aa9793a-fde9-4590-8fa6-94088e1f78fd tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:21:42.705622 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1aa9793a-fde9-4590-8fa6-94088e1f78fd tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:21:42.706115 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1aa9793a-fde9-4590-8fa6-94088e1f78fd tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:21:42.739548 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-a2ccb3fe-52bb-4289-97a2-0d66e827ace8 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:21:42.752593 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-a2ccb3fe-52bb-4289-97a2-0d66e827ace8 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.397134 Oct 20 06:21:42.753547 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 853/1723] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:21:42 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:21:42.771405 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-1aa9793a-fde9-4590-8fa6-94088e1f78fd tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:21:42.780547 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-1aa9793a-fde9-4590-8fa6-94088e1f78fd tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.089336 Oct 20 06:21:42.781376 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 871/1724] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:21:42 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 06:21:43.777545 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-ed2de9a6-9877-4b5f-9ca8-d9fbc0d6b502 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:21:43.778139 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-ed2de9a6-9877-4b5f-9ca8-d9fbc0d6b502 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:21:43.784493 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-ed2de9a6-9877-4b5f-9ca8-d9fbc0d6b502 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:21:43.784978 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-ed2de9a6-9877-4b5f-9ca8-d9fbc0d6b502 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:21:43.785415 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-ed2de9a6-9877-4b5f-9ca8-d9fbc0d6b502 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:21:43.786098 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-ed2de9a6-9877-4b5f-9ca8-d9fbc0d6b502 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:21:43.786543 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-ed2de9a6-9877-4b5f-9ca8-d9fbc0d6b502 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:21:43.786962 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-ed2de9a6-9877-4b5f-9ca8-d9fbc0d6b502 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:21:43.802813 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-8bf797ef-d837-4b67-b58a-34a841508443 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:21:43.803431 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-8bf797ef-d837-4b67-b58a-34a841508443 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:21:43.811137 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-8bf797ef-d837-4b67-b58a-34a841508443 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:21:43.811700 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-8bf797ef-d837-4b67-b58a-34a841508443 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:21:43.812214 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-8bf797ef-d837-4b67-b58a-34a841508443 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:21:43.813021 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-8bf797ef-d837-4b67-b58a-34a841508443 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:21:43.813476 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-8bf797ef-d837-4b67-b58a-34a841508443 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:21:43.813903 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-8bf797ef-d837-4b67-b58a-34a841508443 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:21:43.829566 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG dbcounter [-] [118861] Writing DB stats nova_cell1:SELECT=100 {{(pid=118861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:21:43.881281 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-8bf797ef-d837-4b67-b58a-34a841508443 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:21:43.891717 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-8bf797ef-d837-4b67-b58a-34a841508443 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.092739 Oct 20 06:21:43.892635 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 872/1725] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:21:43 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 06:21:43.926516 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-ed2de9a6-9877-4b5f-9ca8-d9fbc0d6b502 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:21:43.935189 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-ed2de9a6-9877-4b5f-9ca8-d9fbc0d6b502 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.162079 Oct 20 06:21:43.935762 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 854/1726] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:21:43 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:21:44.915525 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-643c7355-c52a-4ad6-a654-3b7771e7f4ce tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:21:44.916130 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-643c7355-c52a-4ad6-a654-3b7771e7f4ce tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:21:44.922884 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-643c7355-c52a-4ad6-a654-3b7771e7f4ce tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:21:44.923376 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-643c7355-c52a-4ad6-a654-3b7771e7f4ce tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:21:44.923838 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-643c7355-c52a-4ad6-a654-3b7771e7f4ce tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:21:44.924554 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-643c7355-c52a-4ad6-a654-3b7771e7f4ce tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:21:44.925037 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-643c7355-c52a-4ad6-a654-3b7771e7f4ce tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:21:44.925464 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-643c7355-c52a-4ad6-a654-3b7771e7f4ce tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:21:44.958403 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-599cd044-14b7-43e6-8c60-8657c33d5cdd tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:21:44.959110 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-599cd044-14b7-43e6-8c60-8657c33d5cdd tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:21:44.966684 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-599cd044-14b7-43e6-8c60-8657c33d5cdd tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:21:44.967249 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-599cd044-14b7-43e6-8c60-8657c33d5cdd tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:21:44.967918 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-599cd044-14b7-43e6-8c60-8657c33d5cdd tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:21:44.968689 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-599cd044-14b7-43e6-8c60-8657c33d5cdd tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:21:44.969231 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-599cd044-14b7-43e6-8c60-8657c33d5cdd tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:21:44.969744 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-599cd044-14b7-43e6-8c60-8657c33d5cdd tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:21:44.990078 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-643c7355-c52a-4ad6-a654-3b7771e7f4ce tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:21:44.998910 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-643c7355-c52a-4ad6-a654-3b7771e7f4ce tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.087370 Oct 20 06:21:44.999705 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 873/1727] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:21:44 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:21:45.115019 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-599cd044-14b7-43e6-8c60-8657c33d5cdd tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:21:45.124196 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-599cd044-14b7-43e6-8c60-8657c33d5cdd tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.169568 Oct 20 06:21:45.124846 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 855/1728] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:21:44 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 06:21:46.023660 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-eb056373-4491-4e75-b366-91d5cba6bc65 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:21:46.024779 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-eb056373-4491-4e75-b366-91d5cba6bc65 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:21:46.031261 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-eb056373-4491-4e75-b366-91d5cba6bc65 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:21:46.031742 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-eb056373-4491-4e75-b366-91d5cba6bc65 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:21:46.032176 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-eb056373-4491-4e75-b366-91d5cba6bc65 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:21:46.032901 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-eb056373-4491-4e75-b366-91d5cba6bc65 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:21:46.033351 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-eb056373-4491-4e75-b366-91d5cba6bc65 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:21:46.033772 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-eb056373-4491-4e75-b366-91d5cba6bc65 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:21:46.096084 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-eb056373-4491-4e75-b366-91d5cba6bc65 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:21:46.105329 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-eb056373-4491-4e75-b366-91d5cba6bc65 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.085725 Oct 20 06:21:46.105898 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 874/1729] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:21:46 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:21:46.149144 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-7f8008e4-8c6f-44a2-a12b-4e55e333751e tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:21:46.150142 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-7f8008e4-8c6f-44a2-a12b-4e55e333751e tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:21:46.156756 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7f8008e4-8c6f-44a2-a12b-4e55e333751e tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:21:46.157246 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7f8008e4-8c6f-44a2-a12b-4e55e333751e tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:21:46.157682 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7f8008e4-8c6f-44a2-a12b-4e55e333751e tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:21:46.158383 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7f8008e4-8c6f-44a2-a12b-4e55e333751e tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:21:46.158837 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7f8008e4-8c6f-44a2-a12b-4e55e333751e tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:21:46.159260 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7f8008e4-8c6f-44a2-a12b-4e55e333751e tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:21:46.287606 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-7f8008e4-8c6f-44a2-a12b-4e55e333751e tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:21:46.296988 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-7f8008e4-8c6f-44a2-a12b-4e55e333751e tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.152173 Oct 20 06:21:46.312466 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 856/1730] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:21:46 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:21:47.127466 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-657f87ac-6f77-42af-a966-e14b3c9c2ae9 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:21:47.128079 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-657f87ac-6f77-42af-a966-e14b3c9c2ae9 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:21:47.135592 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-657f87ac-6f77-42af-a966-e14b3c9c2ae9 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:21:47.136076 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-657f87ac-6f77-42af-a966-e14b3c9c2ae9 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:21:47.136574 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-657f87ac-6f77-42af-a966-e14b3c9c2ae9 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:21:47.137311 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-657f87ac-6f77-42af-a966-e14b3c9c2ae9 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:21:47.137759 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-657f87ac-6f77-42af-a966-e14b3c9c2ae9 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:21:47.138182 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-657f87ac-6f77-42af-a966-e14b3c9c2ae9 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:21:47.202309 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-657f87ac-6f77-42af-a966-e14b3c9c2ae9 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:21:47.210552 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-657f87ac-6f77-42af-a966-e14b3c9c2ae9 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.087002 Oct 20 06:21:47.211918 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 875/1731] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:21:47 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:21:47.319539 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-0f6fd805-0a4a-457e-bd18-b2c9f7f3de0d tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:21:47.320258 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-0f6fd805-0a4a-457e-bd18-b2c9f7f3de0d tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:21:47.327358 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0f6fd805-0a4a-457e-bd18-b2c9f7f3de0d tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:21:47.327846 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0f6fd805-0a4a-457e-bd18-b2c9f7f3de0d tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:21:47.328290 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0f6fd805-0a4a-457e-bd18-b2c9f7f3de0d tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:21:47.329028 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0f6fd805-0a4a-457e-bd18-b2c9f7f3de0d tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:21:47.329482 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0f6fd805-0a4a-457e-bd18-b2c9f7f3de0d tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:21:47.329908 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0f6fd805-0a4a-457e-bd18-b2c9f7f3de0d tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:21:47.470694 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-0f6fd805-0a4a-457e-bd18-b2c9f7f3de0d tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:21:47.479463 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-0f6fd805-0a4a-457e-bd18-b2c9f7f3de0d tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.163819 Oct 20 06:21:47.480246 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 857/1732] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:21:47 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:21:48.234360 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-79ede322-6f66-440d-9a6f-5c054e508bd6 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:21:48.234967 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-79ede322-6f66-440d-9a6f-5c054e508bd6 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:21:48.241550 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-79ede322-6f66-440d-9a6f-5c054e508bd6 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:21:48.242071 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-79ede322-6f66-440d-9a6f-5c054e508bd6 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:21:48.243054 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-79ede322-6f66-440d-9a6f-5c054e508bd6 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:21:48.243833 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-79ede322-6f66-440d-9a6f-5c054e508bd6 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:21:48.244281 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-79ede322-6f66-440d-9a6f-5c054e508bd6 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:21:48.244719 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-79ede322-6f66-440d-9a6f-5c054e508bd6 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:21:48.312080 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-79ede322-6f66-440d-9a6f-5c054e508bd6 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:21:48.320427 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-79ede322-6f66-440d-9a6f-5c054e508bd6 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.089933 Oct 20 06:21:48.321979 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 876/1733] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:21:48 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:21:48.503023 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-cfd840e8-4ef3-4d04-b3c3-96fb6d1363b3 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:21:48.503536 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-cfd840e8-4ef3-4d04-b3c3-96fb6d1363b3 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:21:48.510503 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-cfd840e8-4ef3-4d04-b3c3-96fb6d1363b3 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:21:48.510980 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-cfd840e8-4ef3-4d04-b3c3-96fb6d1363b3 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:21:48.511414 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-cfd840e8-4ef3-4d04-b3c3-96fb6d1363b3 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:21:48.512106 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-cfd840e8-4ef3-4d04-b3c3-96fb6d1363b3 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:21:48.512557 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-cfd840e8-4ef3-4d04-b3c3-96fb6d1363b3 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:21:48.513010 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-cfd840e8-4ef3-4d04-b3c3-96fb6d1363b3 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:21:48.645451 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-cfd840e8-4ef3-4d04-b3c3-96fb6d1363b3 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:21:48.654645 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-cfd840e8-4ef3-4d04-b3c3-96fb6d1363b3 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.155539 Oct 20 06:21:48.655385 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 858/1734] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:21:48 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:21:49.343628 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-87bfca02-a8d0-48db-a0a0-8855bb084238 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:21:49.344234 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-87bfca02-a8d0-48db-a0a0-8855bb084238 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:21:49.352360 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-87bfca02-a8d0-48db-a0a0-8855bb084238 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:21:49.352980 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-87bfca02-a8d0-48db-a0a0-8855bb084238 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:21:49.353419 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-87bfca02-a8d0-48db-a0a0-8855bb084238 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:21:49.354159 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-87bfca02-a8d0-48db-a0a0-8855bb084238 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:21:49.354614 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-87bfca02-a8d0-48db-a0a0-8855bb084238 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:21:49.355040 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-87bfca02-a8d0-48db-a0a0-8855bb084238 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:21:49.421176 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-87bfca02-a8d0-48db-a0a0-8855bb084238 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:21:49.429840 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-87bfca02-a8d0-48db-a0a0-8855bb084238 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.090107 Oct 20 06:21:49.430421 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 877/1735] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:21:49 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:21:49.678539 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-f6c09a21-d0ff-4c44-853a-54506189bc4f tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:21:49.679228 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-f6c09a21-d0ff-4c44-853a-54506189bc4f tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:21:49.686911 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f6c09a21-d0ff-4c44-853a-54506189bc4f tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:21:49.687396 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f6c09a21-d0ff-4c44-853a-54506189bc4f tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:21:49.687852 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f6c09a21-d0ff-4c44-853a-54506189bc4f tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:21:49.688555 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f6c09a21-d0ff-4c44-853a-54506189bc4f tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:21:49.689032 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f6c09a21-d0ff-4c44-853a-54506189bc4f tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:21:49.689481 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f6c09a21-d0ff-4c44-853a-54506189bc4f tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:21:49.827996 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-f6c09a21-d0ff-4c44-853a-54506189bc4f tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:21:49.836890 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-f6c09a21-d0ff-4c44-853a-54506189bc4f tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.161857 Oct 20 06:21:49.837193 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 859/1736] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:21:49 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:21:50.452777 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-05612592-d8e7-4c63-bd41-2e4d273af897 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:21:50.453419 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-05612592-d8e7-4c63-bd41-2e4d273af897 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:21:50.459981 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-05612592-d8e7-4c63-bd41-2e4d273af897 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:21:50.460464 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-05612592-d8e7-4c63-bd41-2e4d273af897 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:21:50.460939 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-05612592-d8e7-4c63-bd41-2e4d273af897 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:21:50.462422 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-05612592-d8e7-4c63-bd41-2e4d273af897 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:21:50.462871 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-05612592-d8e7-4c63-bd41-2e4d273af897 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:21:50.463297 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-05612592-d8e7-4c63-bd41-2e4d273af897 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:21:50.539867 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-05612592-d8e7-4c63-bd41-2e4d273af897 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:21:50.548899 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-05612592-d8e7-4c63-bd41-2e4d273af897 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.099890 Oct 20 06:21:50.550108 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 878/1737] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:21:50 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:21:50.859859 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-ca5bea98-e819-45e6-aa8d-72f05f889a27 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:21:50.860401 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-ca5bea98-e819-45e6-aa8d-72f05f889a27 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:21:50.867236 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-ca5bea98-e819-45e6-aa8d-72f05f889a27 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:21:50.867851 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-ca5bea98-e819-45e6-aa8d-72f05f889a27 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:21:50.868603 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-ca5bea98-e819-45e6-aa8d-72f05f889a27 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:21:50.869649 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-ca5bea98-e819-45e6-aa8d-72f05f889a27 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:21:50.870118 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-ca5bea98-e819-45e6-aa8d-72f05f889a27 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:21:50.870558 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-ca5bea98-e819-45e6-aa8d-72f05f889a27 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:21:51.002006 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-ca5bea98-e819-45e6-aa8d-72f05f889a27 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:21:51.010947 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-ca5bea98-e819-45e6-aa8d-72f05f889a27 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.155002 Oct 20 06:21:51.011514 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 860/1738] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:21:50 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:21:51.573802 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-bcf8a865-9da1-4859-8b43-199730fe36e5 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:21:51.574336 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-bcf8a865-9da1-4859-8b43-199730fe36e5 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:21:51.580857 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-bcf8a865-9da1-4859-8b43-199730fe36e5 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:21:51.581328 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-bcf8a865-9da1-4859-8b43-199730fe36e5 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:21:51.581769 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-bcf8a865-9da1-4859-8b43-199730fe36e5 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:21:51.582469 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-bcf8a865-9da1-4859-8b43-199730fe36e5 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:21:51.582921 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-bcf8a865-9da1-4859-8b43-199730fe36e5 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:21:51.583346 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-bcf8a865-9da1-4859-8b43-199730fe36e5 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:21:51.649494 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-bcf8a865-9da1-4859-8b43-199730fe36e5 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:21:51.657808 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-bcf8a865-9da1-4859-8b43-199730fe36e5 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.088914 Oct 20 06:21:51.658407 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 879/1739] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:21:51 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:21:52.034700 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-06462501-1811-4d37-84f3-feabe03776b4 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:21:52.035315 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-06462501-1811-4d37-84f3-feabe03776b4 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:21:52.042318 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-06462501-1811-4d37-84f3-feabe03776b4 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:21:52.042807 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-06462501-1811-4d37-84f3-feabe03776b4 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:21:52.043246 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-06462501-1811-4d37-84f3-feabe03776b4 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:21:52.043942 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-06462501-1811-4d37-84f3-feabe03776b4 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:21:52.044396 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-06462501-1811-4d37-84f3-feabe03776b4 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:21:52.044851 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-06462501-1811-4d37-84f3-feabe03776b4 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:21:52.171687 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-06462501-1811-4d37-84f3-feabe03776b4 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:21:52.180739 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-06462501-1811-4d37-84f3-feabe03776b4 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.149119 Oct 20 06:21:52.181590 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 861/1740] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:21:52 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:21:52.680709 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-adc8e6ee-948c-4cce-a215-338967eacbbd tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:21:52.681438 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-adc8e6ee-948c-4cce-a215-338967eacbbd tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:21:52.687866 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-adc8e6ee-948c-4cce-a215-338967eacbbd tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:21:52.688340 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-adc8e6ee-948c-4cce-a215-338967eacbbd tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:21:52.688794 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-adc8e6ee-948c-4cce-a215-338967eacbbd tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:21:52.689482 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-adc8e6ee-948c-4cce-a215-338967eacbbd tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:21:52.689925 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-adc8e6ee-948c-4cce-a215-338967eacbbd tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:21:52.690341 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-adc8e6ee-948c-4cce-a215-338967eacbbd tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:21:52.754141 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-adc8e6ee-948c-4cce-a215-338967eacbbd tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:21:52.765322 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-adc8e6ee-948c-4cce-a215-338967eacbbd tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.089138 Oct 20 06:21:52.765900 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 880/1741] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:21:52 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:21:53.204063 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-e922a232-41e6-4bcb-bbd1-bd91a33ec656 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:21:53.204664 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-e922a232-41e6-4bcb-bbd1-bd91a33ec656 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:21:53.211801 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e922a232-41e6-4bcb-bbd1-bd91a33ec656 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:21:53.212314 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e922a232-41e6-4bcb-bbd1-bd91a33ec656 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:21:53.212767 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e922a232-41e6-4bcb-bbd1-bd91a33ec656 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:21:53.213462 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e922a232-41e6-4bcb-bbd1-bd91a33ec656 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:21:53.213911 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e922a232-41e6-4bcb-bbd1-bd91a33ec656 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:21:53.214336 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e922a232-41e6-4bcb-bbd1-bd91a33ec656 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:21:53.348042 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-e922a232-41e6-4bcb-bbd1-bd91a33ec656 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:21:53.356993 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-e922a232-41e6-4bcb-bbd1-bd91a33ec656 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.156747 Oct 20 06:21:53.357563 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 862/1742] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:21:53 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:21:53.787855 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-78900e0e-8d1a-4b3f-8561-daa9167882d7 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:21:53.788459 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-78900e0e-8d1a-4b3f-8561-daa9167882d7 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:21:53.795074 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-78900e0e-8d1a-4b3f-8561-daa9167882d7 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:21:53.795559 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-78900e0e-8d1a-4b3f-8561-daa9167882d7 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:21:53.795994 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-78900e0e-8d1a-4b3f-8561-daa9167882d7 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:21:53.796689 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-78900e0e-8d1a-4b3f-8561-daa9167882d7 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:21:53.797167 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-78900e0e-8d1a-4b3f-8561-daa9167882d7 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:21:53.797591 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-78900e0e-8d1a-4b3f-8561-daa9167882d7 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:21:53.860294 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-78900e0e-8d1a-4b3f-8561-daa9167882d7 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:21:53.869234 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-78900e0e-8d1a-4b3f-8561-daa9167882d7 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.085351 Oct 20 06:21:53.869797 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 881/1743] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:21:53 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:21:54.380892 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-01a97d27-bcc1-4b86-9746-5fb60fd31809 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:21:54.381494 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-01a97d27-bcc1-4b86-9746-5fb60fd31809 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:21:54.388286 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-01a97d27-bcc1-4b86-9746-5fb60fd31809 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:21:54.388821 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-01a97d27-bcc1-4b86-9746-5fb60fd31809 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:21:54.389249 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-01a97d27-bcc1-4b86-9746-5fb60fd31809 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:21:54.389951 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-01a97d27-bcc1-4b86-9746-5fb60fd31809 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:21:54.390404 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-01a97d27-bcc1-4b86-9746-5fb60fd31809 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:21:54.390834 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-01a97d27-bcc1-4b86-9746-5fb60fd31809 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:21:54.405746 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG dbcounter [-] [118860] Writing DB stats nova_cell1:SELECT=100 {{(pid=118860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:21:54.521061 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-01a97d27-bcc1-4b86-9746-5fb60fd31809 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:21:54.530215 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-01a97d27-bcc1-4b86-9746-5fb60fd31809 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.153161 Oct 20 06:21:54.530794 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 863/1744] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:21:54 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:21:54.892621 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-df51c9f8-2bf2-4f01-8196-9eb15c26c18e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:21:54.893289 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-df51c9f8-2bf2-4f01-8196-9eb15c26c18e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:21:54.900812 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-df51c9f8-2bf2-4f01-8196-9eb15c26c18e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:21:54.903665 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-df51c9f8-2bf2-4f01-8196-9eb15c26c18e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:21:54.904127 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-df51c9f8-2bf2-4f01-8196-9eb15c26c18e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:21:54.905984 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-df51c9f8-2bf2-4f01-8196-9eb15c26c18e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:21:54.906451 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-df51c9f8-2bf2-4f01-8196-9eb15c26c18e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:21:54.906886 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-df51c9f8-2bf2-4f01-8196-9eb15c26c18e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:21:54.969742 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-df51c9f8-2bf2-4f01-8196-9eb15c26c18e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:21:54.978131 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-df51c9f8-2bf2-4f01-8196-9eb15c26c18e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.089381 Oct 20 06:21:54.978709 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 882/1745] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:21:54 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:21:55.553661 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-8c0a66ee-b2bc-4573-966f-bea1134c945e tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:21:55.554330 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-8c0a66ee-b2bc-4573-966f-bea1134c945e tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:21:55.561385 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-8c0a66ee-b2bc-4573-966f-bea1134c945e tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:21:55.561792 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-8c0a66ee-b2bc-4573-966f-bea1134c945e tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:21:55.562228 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-8c0a66ee-b2bc-4573-966f-bea1134c945e tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:21:55.562928 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-8c0a66ee-b2bc-4573-966f-bea1134c945e tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:21:55.563376 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-8c0a66ee-b2bc-4573-966f-bea1134c945e tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:21:55.563801 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-8c0a66ee-b2bc-4573-966f-bea1134c945e tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:21:55.696256 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-8c0a66ee-b2bc-4573-966f-bea1134c945e tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:21:55.704763 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-8c0a66ee-b2bc-4573-966f-bea1134c945e tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.154880 Oct 20 06:21:55.705334 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 864/1746] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:21:55 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:21:56.001098 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-9f7b8dc9-4283-4b17-9cf8-49735f0a4b16 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:21:56.001695 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-9f7b8dc9-4283-4b17-9cf8-49735f0a4b16 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:21:56.008949 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-9f7b8dc9-4283-4b17-9cf8-49735f0a4b16 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:21:56.009429 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-9f7b8dc9-4283-4b17-9cf8-49735f0a4b16 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:21:56.009859 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-9f7b8dc9-4283-4b17-9cf8-49735f0a4b16 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:21:56.010554 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-9f7b8dc9-4283-4b17-9cf8-49735f0a4b16 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:21:56.011003 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-9f7b8dc9-4283-4b17-9cf8-49735f0a4b16 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:21:56.011421 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-9f7b8dc9-4283-4b17-9cf8-49735f0a4b16 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:21:56.073453 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-9f7b8dc9-4283-4b17-9cf8-49735f0a4b16 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:21:56.081878 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-9f7b8dc9-4283-4b17-9cf8-49735f0a4b16 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.084623 Oct 20 06:21:56.082444 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 883/1747] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:21:55 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:21:56.729037 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-22b60b63-5a72-4730-9213-4e5cdb09ecb8 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:21:56.729643 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-22b60b63-5a72-4730-9213-4e5cdb09ecb8 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:21:56.736169 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-22b60b63-5a72-4730-9213-4e5cdb09ecb8 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:21:56.736649 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-22b60b63-5a72-4730-9213-4e5cdb09ecb8 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:21:56.737118 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-22b60b63-5a72-4730-9213-4e5cdb09ecb8 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:21:56.737813 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-22b60b63-5a72-4730-9213-4e5cdb09ecb8 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:21:56.738266 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-22b60b63-5a72-4730-9213-4e5cdb09ecb8 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:21:56.738694 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-22b60b63-5a72-4730-9213-4e5cdb09ecb8 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:21:56.870304 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-22b60b63-5a72-4730-9213-4e5cdb09ecb8 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:21:56.878846 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-22b60b63-5a72-4730-9213-4e5cdb09ecb8 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.153842 Oct 20 06:21:56.879450 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 865/1748] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:21:56 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:21:57.105538 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-bfaabaf4-96c2-4a86-8636-d35ad4e71708 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:21:57.106083 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-bfaabaf4-96c2-4a86-8636-d35ad4e71708 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:21:57.112312 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-bfaabaf4-96c2-4a86-8636-d35ad4e71708 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:21:57.112838 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-bfaabaf4-96c2-4a86-8636-d35ad4e71708 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:21:57.113277 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-bfaabaf4-96c2-4a86-8636-d35ad4e71708 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:21:57.113990 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-bfaabaf4-96c2-4a86-8636-d35ad4e71708 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:21:57.114440 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-bfaabaf4-96c2-4a86-8636-d35ad4e71708 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:21:57.114860 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-bfaabaf4-96c2-4a86-8636-d35ad4e71708 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:21:57.182324 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-bfaabaf4-96c2-4a86-8636-d35ad4e71708 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:21:57.190548 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-bfaabaf4-96c2-4a86-8636-d35ad4e71708 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.089532 Oct 20 06:21:57.191119 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 884/1749] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:21:57 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:21:57.904073 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-c305c0f3-7fce-4009-9a01-f6b29e008b64 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:21:57.904807 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-c305c0f3-7fce-4009-9a01-f6b29e008b64 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:21:57.907053 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG dbcounter [-] [118860] Writing DB stats nova_api:SELECT=52 {{(pid=118860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:21:57.912250 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c305c0f3-7fce-4009-9a01-f6b29e008b64 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:21:57.912754 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c305c0f3-7fce-4009-9a01-f6b29e008b64 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:21:57.913195 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c305c0f3-7fce-4009-9a01-f6b29e008b64 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:21:57.913889 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c305c0f3-7fce-4009-9a01-f6b29e008b64 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:21:57.914920 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c305c0f3-7fce-4009-9a01-f6b29e008b64 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:21:57.915427 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c305c0f3-7fce-4009-9a01-f6b29e008b64 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:21:58.047197 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-c305c0f3-7fce-4009-9a01-f6b29e008b64 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:21:58.055734 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-c305c0f3-7fce-4009-9a01-f6b29e008b64 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.155555 Oct 20 06:21:58.056302 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 866/1750] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:21:57 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 06:21:58.214103 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-ad4af7f4-1dfb-43f7-94ca-5a4ecf37c572 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:21:58.214719 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-ad4af7f4-1dfb-43f7-94ca-5a4ecf37c572 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:21:58.217100 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG dbcounter [-] [118861] Writing DB stats nova_api:SELECT=56 {{(pid=118861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:21:58.222525 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ad4af7f4-1dfb-43f7-94ca-5a4ecf37c572 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:21:58.223014 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ad4af7f4-1dfb-43f7-94ca-5a4ecf37c572 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:21:58.223449 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ad4af7f4-1dfb-43f7-94ca-5a4ecf37c572 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:21:58.224143 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ad4af7f4-1dfb-43f7-94ca-5a4ecf37c572 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:21:58.224596 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ad4af7f4-1dfb-43f7-94ca-5a4ecf37c572 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:21:58.225048 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ad4af7f4-1dfb-43f7-94ca-5a4ecf37c572 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:21:58.292034 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-ad4af7f4-1dfb-43f7-94ca-5a4ecf37c572 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:21:58.301129 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-ad4af7f4-1dfb-43f7-94ca-5a4ecf37c572 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.091349 Oct 20 06:21:58.302044 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 885/1751] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:21:58 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:21:59.079046 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-ca7e9691-170f-4962-aef1-8241080ebe45 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:21:59.079644 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-ca7e9691-170f-4962-aef1-8241080ebe45 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:21:59.086667 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-ca7e9691-170f-4962-aef1-8241080ebe45 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:21:59.087153 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-ca7e9691-170f-4962-aef1-8241080ebe45 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:21:59.087588 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-ca7e9691-170f-4962-aef1-8241080ebe45 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:21:59.088307 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-ca7e9691-170f-4962-aef1-8241080ebe45 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:21:59.088792 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-ca7e9691-170f-4962-aef1-8241080ebe45 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:21:59.089219 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-ca7e9691-170f-4962-aef1-8241080ebe45 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:21:59.229480 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-ca7e9691-170f-4962-aef1-8241080ebe45 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:21:59.238520 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-ca7e9691-170f-4962-aef1-8241080ebe45 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.163261 Oct 20 06:21:59.239113 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 867/1752] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:21:59 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:21:59.324439 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-d56bc991-4bf1-4020-92cf-6d2b4c788932 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:21:59.325088 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-d56bc991-4bf1-4020-92cf-6d2b4c788932 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:21:59.331630 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d56bc991-4bf1-4020-92cf-6d2b4c788932 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:21:59.332055 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d56bc991-4bf1-4020-92cf-6d2b4c788932 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:21:59.332487 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d56bc991-4bf1-4020-92cf-6d2b4c788932 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:21:59.333242 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d56bc991-4bf1-4020-92cf-6d2b4c788932 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:21:59.333697 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d56bc991-4bf1-4020-92cf-6d2b4c788932 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:21:59.334118 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d56bc991-4bf1-4020-92cf-6d2b4c788932 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:21:59.400212 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-d56bc991-4bf1-4020-92cf-6d2b4c788932 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:21:59.408448 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-d56bc991-4bf1-4020-92cf-6d2b4c788932 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.088869 Oct 20 06:21:59.409053 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 886/1753] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:21:59 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:22:00.262031 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-87f7dbc2-a0c1-481e-94f3-87947391278f tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:22:00.262627 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-87f7dbc2-a0c1-481e-94f3-87947391278f tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:22:00.269042 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-87f7dbc2-a0c1-481e-94f3-87947391278f tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:22:00.269525 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-87f7dbc2-a0c1-481e-94f3-87947391278f tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:22:00.269953 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-87f7dbc2-a0c1-481e-94f3-87947391278f tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:22:00.270635 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-87f7dbc2-a0c1-481e-94f3-87947391278f tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:22:00.271078 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-87f7dbc2-a0c1-481e-94f3-87947391278f tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:22:00.271500 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-87f7dbc2-a0c1-481e-94f3-87947391278f tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:22:00.403058 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-87f7dbc2-a0c1-481e-94f3-87947391278f tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:22:00.411323 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-87f7dbc2-a0c1-481e-94f3-87947391278f tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.153401 Oct 20 06:22:00.411944 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 868/1754] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:22:00 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:22:00.432058 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-3859302e-74ab-48a6-b890-e3edfe225cf0 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:22:00.432851 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-3859302e-74ab-48a6-b890-e3edfe225cf0 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:22:00.439343 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-3859302e-74ab-48a6-b890-e3edfe225cf0 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:22:00.439824 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-3859302e-74ab-48a6-b890-e3edfe225cf0 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:22:00.440261 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-3859302e-74ab-48a6-b890-e3edfe225cf0 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:22:00.440985 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-3859302e-74ab-48a6-b890-e3edfe225cf0 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:22:00.441439 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-3859302e-74ab-48a6-b890-e3edfe225cf0 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:22:00.441864 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-3859302e-74ab-48a6-b890-e3edfe225cf0 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:22:00.503692 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-3859302e-74ab-48a6-b890-e3edfe225cf0 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:22:00.513259 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-3859302e-74ab-48a6-b890-e3edfe225cf0 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.085533 Oct 20 06:22:00.513776 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 887/1755] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:22:00 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:22:01.436045 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-78e4ec27-09ce-418b-8a04-a2639758c3d3 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:22:01.436653 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-78e4ec27-09ce-418b-8a04-a2639758c3d3 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:22:01.443092 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-78e4ec27-09ce-418b-8a04-a2639758c3d3 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:22:01.443576 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-78e4ec27-09ce-418b-8a04-a2639758c3d3 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:22:01.444013 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-78e4ec27-09ce-418b-8a04-a2639758c3d3 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:22:01.444720 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-78e4ec27-09ce-418b-8a04-a2639758c3d3 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:22:01.445744 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-78e4ec27-09ce-418b-8a04-a2639758c3d3 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:22:01.446736 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-78e4ec27-09ce-418b-8a04-a2639758c3d3 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:22:01.537403 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-9500e4f9-c29f-4ab4-bb24-f820d34ee1a5 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:22:01.538089 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-9500e4f9-c29f-4ab4-bb24-f820d34ee1a5 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:22:01.544769 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-9500e4f9-c29f-4ab4-bb24-f820d34ee1a5 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:22:01.545358 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-9500e4f9-c29f-4ab4-bb24-f820d34ee1a5 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:22:01.545864 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-9500e4f9-c29f-4ab4-bb24-f820d34ee1a5 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:22:01.547052 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-9500e4f9-c29f-4ab4-bb24-f820d34ee1a5 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:22:01.547196 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-9500e4f9-c29f-4ab4-bb24-f820d34ee1a5 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:22:01.547601 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-9500e4f9-c29f-4ab4-bb24-f820d34ee1a5 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:22:01.581059 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-78e4ec27-09ce-418b-8a04-a2639758c3d3 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:22:01.590483 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-78e4ec27-09ce-418b-8a04-a2639758c3d3 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.158304 Oct 20 06:22:01.604721 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 869/1756] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:22:01 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:22:01.613849 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-9500e4f9-c29f-4ab4-bb24-f820d34ee1a5 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:22:01.622865 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-9500e4f9-c29f-4ab4-bb24-f820d34ee1a5 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.089198 Oct 20 06:22:01.623445 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 888/1757] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:22:01 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 06:22:02.614481 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-24ea829b-0112-4d9a-a32a-d7f9d5a65943 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:22:02.615025 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-24ea829b-0112-4d9a-a32a-d7f9d5a65943 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:22:02.621897 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-24ea829b-0112-4d9a-a32a-d7f9d5a65943 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:22:02.622389 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-24ea829b-0112-4d9a-a32a-d7f9d5a65943 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:22:02.622820 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-24ea829b-0112-4d9a-a32a-d7f9d5a65943 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:22:02.623523 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-24ea829b-0112-4d9a-a32a-d7f9d5a65943 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:22:02.623970 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-24ea829b-0112-4d9a-a32a-d7f9d5a65943 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:22:02.624391 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-24ea829b-0112-4d9a-a32a-d7f9d5a65943 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:22:02.646080 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-29930a9a-6738-44c2-abc2-dbe9273131f4 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:22:02.646799 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-29930a9a-6738-44c2-abc2-dbe9273131f4 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:22:02.654672 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-29930a9a-6738-44c2-abc2-dbe9273131f4 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:22:02.655168 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-29930a9a-6738-44c2-abc2-dbe9273131f4 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:22:02.655612 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-29930a9a-6738-44c2-abc2-dbe9273131f4 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:22:02.656319 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-29930a9a-6738-44c2-abc2-dbe9273131f4 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:22:02.656813 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-29930a9a-6738-44c2-abc2-dbe9273131f4 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:22:02.657251 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-29930a9a-6738-44c2-abc2-dbe9273131f4 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:22:02.659943 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG dbcounter [-] [118861] Writing DB stats nova_cell1:SELECT=100 {{(pid=118861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:22:02.724498 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-29930a9a-6738-44c2-abc2-dbe9273131f4 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:22:02.733560 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-29930a9a-6738-44c2-abc2-dbe9273131f4 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.091312 Oct 20 06:22:02.734379 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 889/1758] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:22:02 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:22:02.757003 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-24ea829b-0112-4d9a-a32a-d7f9d5a65943 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:22:02.766154 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-24ea829b-0112-4d9a-a32a-d7f9d5a65943 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.155499 Oct 20 06:22:02.766735 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 870/1759] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:22:02 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:22:03.757173 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-a2fe5582-3e91-4951-9aaa-94c858254e4d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:22:03.758138 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-a2fe5582-3e91-4951-9aaa-94c858254e4d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:22:03.764809 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a2fe5582-3e91-4951-9aaa-94c858254e4d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:22:03.765298 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a2fe5582-3e91-4951-9aaa-94c858254e4d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:22:03.765738 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a2fe5582-3e91-4951-9aaa-94c858254e4d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:22:03.766440 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a2fe5582-3e91-4951-9aaa-94c858254e4d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:22:03.766889 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a2fe5582-3e91-4951-9aaa-94c858254e4d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:22:03.767313 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a2fe5582-3e91-4951-9aaa-94c858254e4d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:22:03.789885 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-8bf91289-45b6-449d-a8d0-188e87bc7bbe tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:22:03.790731 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-8bf91289-45b6-449d-a8d0-188e87bc7bbe tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:22:03.797341 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-8bf91289-45b6-449d-a8d0-188e87bc7bbe tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:22:03.797833 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-8bf91289-45b6-449d-a8d0-188e87bc7bbe tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:22:03.798267 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-8bf91289-45b6-449d-a8d0-188e87bc7bbe tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:22:03.798969 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-8bf91289-45b6-449d-a8d0-188e87bc7bbe tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:22:03.799419 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-8bf91289-45b6-449d-a8d0-188e87bc7bbe tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:22:03.799840 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-8bf91289-45b6-449d-a8d0-188e87bc7bbe tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:22:03.832200 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-a2fe5582-3e91-4951-9aaa-94c858254e4d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:22:03.842622 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-a2fe5582-3e91-4951-9aaa-94c858254e4d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.089294 Oct 20 06:22:03.843582 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 890/1760] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:22:03 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:22:03.934184 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-8bf91289-45b6-449d-a8d0-188e87bc7bbe tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:22:03.942552 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-8bf91289-45b6-449d-a8d0-188e87bc7bbe tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.157103 Oct 20 06:22:03.943117 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 871/1761] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:22:03 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 06:22:04.868092 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-a21dface-4b2b-474c-926a-298071148c6f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:22:04.868727 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-a21dface-4b2b-474c-926a-298071148c6f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:22:04.875106 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a21dface-4b2b-474c-926a-298071148c6f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:22:04.875581 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a21dface-4b2b-474c-926a-298071148c6f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:22:04.876010 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a21dface-4b2b-474c-926a-298071148c6f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:22:04.876714 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a21dface-4b2b-474c-926a-298071148c6f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:22:04.877168 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a21dface-4b2b-474c-926a-298071148c6f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:22:04.877801 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a21dface-4b2b-474c-926a-298071148c6f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:22:04.940142 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-a21dface-4b2b-474c-926a-298071148c6f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:22:04.948635 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-a21dface-4b2b-474c-926a-298071148c6f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.085246 Oct 20 06:22:04.949281 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 891/1762] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:22:04 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:22:04.966496 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-33db2a54-588f-4463-a7ff-ac95ecd1cff1 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:22:04.967109 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-33db2a54-588f-4463-a7ff-ac95ecd1cff1 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:22:04.973623 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-33db2a54-588f-4463-a7ff-ac95ecd1cff1 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:22:04.974107 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-33db2a54-588f-4463-a7ff-ac95ecd1cff1 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:22:04.974546 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-33db2a54-588f-4463-a7ff-ac95ecd1cff1 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:22:04.975242 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-33db2a54-588f-4463-a7ff-ac95ecd1cff1 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:22:04.975695 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-33db2a54-588f-4463-a7ff-ac95ecd1cff1 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:22:04.976121 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-33db2a54-588f-4463-a7ff-ac95ecd1cff1 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:22:05.107691 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-33db2a54-588f-4463-a7ff-ac95ecd1cff1 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:22:05.115966 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-33db2a54-588f-4463-a7ff-ac95ecd1cff1 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.153267 Oct 20 06:22:05.116530 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 872/1763] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:22:04 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:22:05.972402 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-c18c2624-94d4-4a21-b49a-c2e17aeeddb5 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:22:05.973035 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-c18c2624-94d4-4a21-b49a-c2e17aeeddb5 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:22:05.980407 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c18c2624-94d4-4a21-b49a-c2e17aeeddb5 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:22:05.980932 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c18c2624-94d4-4a21-b49a-c2e17aeeddb5 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:22:05.981369 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c18c2624-94d4-4a21-b49a-c2e17aeeddb5 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:22:05.982075 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c18c2624-94d4-4a21-b49a-c2e17aeeddb5 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:22:05.982529 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c18c2624-94d4-4a21-b49a-c2e17aeeddb5 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:22:05.982951 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c18c2624-94d4-4a21-b49a-c2e17aeeddb5 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:22:06.047759 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-c18c2624-94d4-4a21-b49a-c2e17aeeddb5 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:22:06.057101 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-c18c2624-94d4-4a21-b49a-c2e17aeeddb5 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.088663 Oct 20 06:22:06.057706 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 892/1764] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:22:05 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:22:06.139401 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-b8594c75-3bca-4ec5-aea6-4cd17e5c2b8f tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:22:06.140025 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-b8594c75-3bca-4ec5-aea6-4cd17e5c2b8f tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:22:06.146513 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b8594c75-3bca-4ec5-aea6-4cd17e5c2b8f tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:22:06.147004 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b8594c75-3bca-4ec5-aea6-4cd17e5c2b8f tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:22:06.147441 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b8594c75-3bca-4ec5-aea6-4cd17e5c2b8f tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:22:06.148143 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b8594c75-3bca-4ec5-aea6-4cd17e5c2b8f tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:22:06.148601 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b8594c75-3bca-4ec5-aea6-4cd17e5c2b8f tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:22:06.149064 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b8594c75-3bca-4ec5-aea6-4cd17e5c2b8f tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:22:06.280525 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-b8594c75-3bca-4ec5-aea6-4cd17e5c2b8f tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:22:06.289651 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-b8594c75-3bca-4ec5-aea6-4cd17e5c2b8f tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.153338 Oct 20 06:22:06.290332 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 873/1765] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:22:06 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:22:07.079268 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-2367258d-cee9-429e-b174-113e89bd7e1b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:22:07.080234 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-2367258d-cee9-429e-b174-113e89bd7e1b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:22:07.095848 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-2367258d-cee9-429e-b174-113e89bd7e1b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:22:07.095848 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-2367258d-cee9-429e-b174-113e89bd7e1b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:22:07.095848 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-2367258d-cee9-429e-b174-113e89bd7e1b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:22:07.095848 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-2367258d-cee9-429e-b174-113e89bd7e1b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:22:07.096192 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-2367258d-cee9-429e-b174-113e89bd7e1b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:22:07.096192 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-2367258d-cee9-429e-b174-113e89bd7e1b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:22:07.148283 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-bf245829-5432-4ed8-be99-bfd28ccb8ace tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:22:07.149515 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-bf245829-5432-4ed8-be99-bfd28ccb8ace tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: a8c74b2c-bf36-4b49-8855-9eb732003e66] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:22:07.156013 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-bf245829-5432-4ed8-be99-bfd28ccb8ace tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:22:07.156512 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-bf245829-5432-4ed8-be99-bfd28ccb8ace tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:22:07.156983 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-bf245829-5432-4ed8-be99-bfd28ccb8ace tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:22:07.157699 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-bf245829-5432-4ed8-be99-bfd28ccb8ace tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:22:07.158147 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-bf245829-5432-4ed8-be99-bfd28ccb8ace tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:22:07.158748 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-bf245829-5432-4ed8-be99-bfd28ccb8ace tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:22:07.193793 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-bf245829-5432-4ed8-be99-bfd28ccb8ace tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: a8c74b2c-bf36-4b49-8855-9eb732003e66] Going to try to terminate instance {{(pid=118860) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 20 06:22:07.295110 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-bf245829-5432-4ed8-be99-bfd28ccb8ace tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "DELETE /compute/v2.1/servers/a8c74b2c-bf36-4b49-8855-9eb732003e66" status: 204 len: 0 microversion: 2.20 time: 0.150170 Oct 20 06:22:07.299243 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 874/1766] 10.222.0.20 () {60 vars in 1280 bytes} [Thu Oct 20 06:22:07 2022] DELETE /compute/v2.1/servers/a8c74b2c-bf36-4b49-8855-9eb732003e66 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 20 06:22:07.310601 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-1ec4fe81-822c-46e5-a907-7f5671ae6573 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:22:07.311310 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-1ec4fe81-822c-46e5-a907-7f5671ae6573 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: a8c74b2c-bf36-4b49-8855-9eb732003e66] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:22:07.318378 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1ec4fe81-822c-46e5-a907-7f5671ae6573 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:22:07.318873 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1ec4fe81-822c-46e5-a907-7f5671ae6573 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:22:07.319309 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1ec4fe81-822c-46e5-a907-7f5671ae6573 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:22:07.320620 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1ec4fe81-822c-46e5-a907-7f5671ae6573 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:22:07.321290 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1ec4fe81-822c-46e5-a907-7f5671ae6573 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:22:07.321717 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1ec4fe81-822c-46e5-a907-7f5671ae6573 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:22:07.430507 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-2367258d-cee9-429e-b174-113e89bd7e1b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:22:07.439142 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-2367258d-cee9-429e-b174-113e89bd7e1b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.363678 Oct 20 06:22:07.439723 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 893/1767] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:22:07 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:22:07.446748 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-08d3bae7-fffa-40a5-b1fa-44926e8a1519 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:22:07.447372 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-08d3bae7-fffa-40a5-b1fa-44926e8a1519 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:22:07.453319 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-08d3bae7-fffa-40a5-b1fa-44926e8a1519 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:22:07.453799 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-08d3bae7-fffa-40a5-b1fa-44926e8a1519 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:22:07.454231 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-08d3bae7-fffa-40a5-b1fa-44926e8a1519 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:22:07.454937 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-08d3bae7-fffa-40a5-b1fa-44926e8a1519 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:22:07.455394 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-08d3bae7-fffa-40a5-b1fa-44926e8a1519 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:22:07.455812 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-08d3bae7-fffa-40a5-b1fa-44926e8a1519 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:22:07.479705 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-1ec4fe81-822c-46e5-a907-7f5671ae6573 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:22:07.488212 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-1ec4fe81-822c-46e5-a907-7f5671ae6573 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:22:07.489648 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-1ec4fe81-822c-46e5-a907-7f5671ae6573 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:22:07.490837 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-1ec4fe81-822c-46e5-a907-7f5671ae6573 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/a8c74b2c-bf36-4b49-8855-9eb732003e66" status: 200 len: 1724 microversion: 2.20 time: 0.185105 Oct 20 06:22:07.491600 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 875/1768] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:22:07 2022] GET /compute/v2.1/servers/a8c74b2c-bf36-4b49-8855-9eb732003e66 => generated 1724 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 06:22:07.605555 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-08d3bae7-fffa-40a5-b1fa-44926e8a1519 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:22:07.613862 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-08d3bae7-fffa-40a5-b1fa-44926e8a1519 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.172931 Oct 20 06:22:07.614430 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 894/1769] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:22:07 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:22:08.462846 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-e9635386-d993-4a2d-adaf-080a77d30fa3 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:22:08.463452 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-e9635386-d993-4a2d-adaf-080a77d30fa3 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:22:08.470452 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e9635386-d993-4a2d-adaf-080a77d30fa3 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:22:08.471204 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e9635386-d993-4a2d-adaf-080a77d30fa3 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:22:08.471709 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e9635386-d993-4a2d-adaf-080a77d30fa3 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:22:08.472486 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e9635386-d993-4a2d-adaf-080a77d30fa3 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:22:08.473055 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e9635386-d993-4a2d-adaf-080a77d30fa3 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:22:08.473541 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e9635386-d993-4a2d-adaf-080a77d30fa3 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:22:08.517228 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-ba01a6e7-367e-4f37-9fa9-407f917ec33b tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:22:08.518140 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-ba01a6e7-367e-4f37-9fa9-407f917ec33b tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: a8c74b2c-bf36-4b49-8855-9eb732003e66] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:22:08.524829 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ba01a6e7-367e-4f37-9fa9-407f917ec33b tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:22:08.525397 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ba01a6e7-367e-4f37-9fa9-407f917ec33b tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:22:08.525893 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ba01a6e7-367e-4f37-9fa9-407f917ec33b tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:22:08.526660 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ba01a6e7-367e-4f37-9fa9-407f917ec33b tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:22:08.527179 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ba01a6e7-367e-4f37-9fa9-407f917ec33b tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:22:08.527674 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ba01a6e7-367e-4f37-9fa9-407f917ec33b tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:22:08.542953 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-e9635386-d993-4a2d-adaf-080a77d30fa3 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:22:08.566233 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-e9635386-d993-4a2d-adaf-080a77d30fa3 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.106510 Oct 20 06:22:08.583501 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 876/1770] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:22:08 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:22:08.607424 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [req-4ee63e6b-a256-4886-8090-71fcb1e5d44a req-3d709b17-9d28-4bf3-b35d-29a263a4dbdb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8c74b2c-bf36-4b49-8855-9eb732003e66", "name": "network-vif-deleted", "tag": "b16407be-86ee-4592-929b-a1450b1682e0"}]} {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 06:22:08.619494 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [req-4ee63e6b-a256-4886-8090-71fcb1e5d44a req-3d709b17-9d28-4bf3-b35d-29a263a4dbdb service nova] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:22:08.619983 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [req-4ee63e6b-a256-4886-8090-71fcb1e5d44a req-3d709b17-9d28-4bf3-b35d-29a263a4dbdb service nova] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:22:08.620424 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [req-4ee63e6b-a256-4886-8090-71fcb1e5d44a req-3d709b17-9d28-4bf3-b35d-29a263a4dbdb service nova] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:22:08.620575 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-ba01a6e7-367e-4f37-9fa9-407f917ec33b tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:22:08.638487 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.compute.server_external_events [req-4ee63e6b-a256-4886-8090-71fcb1e5d44a req-3d709b17-9d28-4bf3-b35d-29a263a4dbdb service nova] Creating event network-vif-deleted:b16407be-86ee-4592-929b-a1450b1682e0 for instance a8c74b2c-bf36-4b49-8855-9eb732003e66 on hv-cinder-86156 Oct 20 06:22:08.643878 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-ba01a6e7-367e-4f37-9fa9-407f917ec33b tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:22:08.644332 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [req-4ee63e6b-a256-4886-8090-71fcb1e5d44a req-3d709b17-9d28-4bf3-b35d-29a263a4dbdb service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040426 Oct 20 06:22:08.645508 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 877/1771] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 20 06:22:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 20 06:22:08.647622 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-ba01a6e7-367e-4f37-9fa9-407f917ec33b tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db34ffc8f90247daac1548bbb421b015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a33a727f9c40b99fb14bd2e0fc5090', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:22:08.651894 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-ba01a6e7-367e-4f37-9fa9-407f917ec33b tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/a8c74b2c-bf36-4b49-8855-9eb732003e66" status: 200 len: 1657 microversion: 2.20 time: 0.138478 Oct 20 06:22:08.653562 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 895/1772] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:22:08 2022] GET /compute/v2.1/servers/a8c74b2c-bf36-4b49-8855-9eb732003e66 => generated 1657 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 20 06:22:08.654018 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-cf6c63f6-1ebe-42a7-b616-62dc70cae1ee tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:22:08.654910 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-cf6c63f6-1ebe-42a7-b616-62dc70cae1ee tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:22:08.662264 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-cf6c63f6-1ebe-42a7-b616-62dc70cae1ee tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:22:08.663235 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-cf6c63f6-1ebe-42a7-b616-62dc70cae1ee tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:22:08.664453 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-cf6c63f6-1ebe-42a7-b616-62dc70cae1ee tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:22:08.665687 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-cf6c63f6-1ebe-42a7-b616-62dc70cae1ee tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:22:08.671759 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-cf6c63f6-1ebe-42a7-b616-62dc70cae1ee tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:22:08.672530 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-cf6c63f6-1ebe-42a7-b616-62dc70cae1ee tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:22:08.874716 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-cf6c63f6-1ebe-42a7-b616-62dc70cae1ee tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:22:08.886243 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-cf6c63f6-1ebe-42a7-b616-62dc70cae1ee tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.238832 Oct 20 06:22:08.887147 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 878/1773] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:22:08 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:22:09.591314 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-8bdf0ab8-5e8c-498f-b658-0b9f8baf5033 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:22:09.592006 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-8bdf0ab8-5e8c-498f-b658-0b9f8baf5033 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:22:09.599619 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-8bdf0ab8-5e8c-498f-b658-0b9f8baf5033 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:22:09.600153 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-8bdf0ab8-5e8c-498f-b658-0b9f8baf5033 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:22:09.600609 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-8bdf0ab8-5e8c-498f-b658-0b9f8baf5033 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:22:09.601971 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-8bdf0ab8-5e8c-498f-b658-0b9f8baf5033 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:22:09.602438 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-8bdf0ab8-5e8c-498f-b658-0b9f8baf5033 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:22:09.602861 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-8bdf0ab8-5e8c-498f-b658-0b9f8baf5033 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:22:09.681136 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-8bdf0ab8-5e8c-498f-b658-0b9f8baf5033 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:22:09.684489 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-318d62dd-b9a1-4d31-809a-f5d52ea06a6f tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:22:09.686112 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-318d62dd-b9a1-4d31-809a-f5d52ea06a6f tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: a8c74b2c-bf36-4b49-8855-9eb732003e66] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:22:09.692410 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-8bdf0ab8-5e8c-498f-b658-0b9f8baf5033 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.105359 Oct 20 06:22:09.692662 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-318d62dd-b9a1-4d31-809a-f5d52ea06a6f tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:22:09.693480 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-318d62dd-b9a1-4d31-809a-f5d52ea06a6f tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:22:09.694183 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-318d62dd-b9a1-4d31-809a-f5d52ea06a6f tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:22:09.695899 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-318d62dd-b9a1-4d31-809a-f5d52ea06a6f tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:22:09.696739 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-318d62dd-b9a1-4d31-809a-f5d52ea06a6f tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:22:09.697457 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-318d62dd-b9a1-4d31-809a-f5d52ea06a6f tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:22:09.700684 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG dbcounter [-] [118860] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:22:09.708437 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 896/1774] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:22:09 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:22:09.722382 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.wsgi [None req-318d62dd-b9a1-4d31-809a-f5d52ea06a6f tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] HTTP exception thrown: Instance a8c74b2c-bf36-4b49-8855-9eb732003e66 could not be found. Oct 20 06:22:09.724480 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-318d62dd-b9a1-4d31-809a-f5d52ea06a6f tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Request method failure captured: Oct 20 06:22:09.724480 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: request: GET /compute/v2.1/servers/a8c74b2c-bf36-4b49-8855-9eb732003e66 HTTP/1.1 Oct 20 06:22:09.724480 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: Accept: application/json Oct 20 06:22:09.724480 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: Accept-Encoding: identity Oct 20 06:22:09.724480 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: Connection: close Oct 20 06:22:09.724480 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: Content-Length: 0 Oct 20 06:22:09.724480 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: Content-Type: application/json Oct 20 06:22:09.724480 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: Host: 10.222.0.20 Oct 20 06:22:09.724480 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: Openstack-System-Scope: None Oct 20 06:22:09.724480 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: User-Agent: python-urllib3/1.26.12 Oct 20 06:22:09.724480 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Auth-Token: gAAAAABjUOT4WE-GeZ9nIY9RvQJPLx5cfKBHzS8w2P3ohAEeWZ7MhC3JV8mQEPTHfIaK5zuvYmNfTMyv3TZQQoGbyre2yxtMqG3RrbumkPK47M1IYrJzUzzgVth48PWOx3W0AtdNXY07UuKLEobMmvxQ_9GrsNYkeXVZIvq9kqYpG7ipSg6jPmI Oct 20 06:22:09.724480 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Domain-Id: None Oct 20 06:22:09.724480 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Domain-Name: None Oct 20 06:22:09.724480 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Identity-Status: Confirmed Oct 20 06:22:09.724480 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Is-Admin-Project: True Oct 20 06:22:09.724480 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Openstack-Nova-Api-Version: 2.20 Oct 20 06:22:09.724480 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Project-Domain-Id: default Oct 20 06:22:09.724480 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Project-Domain-Name: Default Oct 20 06:22:09.724480 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Project-Id: 66a33a727f9c40b99fb14bd2e0fc5090 Oct 20 06:22:09.724480 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1640997354 Oct 20 06:22:09.724480 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Role: reader,member Oct 20 06:22:09.724480 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Roles: reader,member Oct 20 06:22:09.726490 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/66a33a727f9c40b99fb14bd2e0fc5090"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_66a33a727f9c40b99fb14bd2e0fc5090"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/66a33a727f9c40b99fb14bd2e0fc5090"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/66a33a727f9c40b99fb14bd2e0fc5090"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 20 06:22:09.726490 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1640997354 Oct 20 06:22:09.726490 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Tenant-Id: 66a33a727f9c40b99fb14bd2e0fc5090 Oct 20 06:22:09.726490 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1640997354 Oct 20 06:22:09.726490 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-User: tempest-AttachVolumeShelveTestJSON-1640997354-project Oct 20 06:22:09.726490 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-User-Domain-Id: default Oct 20 06:22:09.726490 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-User-Domain-Name: Default Oct 20 06:22:09.726490 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-User-Id: db34ffc8f90247daac1548bbb421b015 Oct 20 06:22:09.726490 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1640997354-project Oct 20 06:22:09.726490 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: method: > Oct 20 06:22:09.726490 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: exception: Instance a8c74b2c-bf36-4b49-8855-9eb732003e66 could not be found. Oct 20 06:22:09.726490 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: action_args: {'id': 'a8c74b2c-bf36-4b49-8855-9eb732003e66'} Oct 20 06:22:09.727433 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 20 06:22:09.727433 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 06:22:09.727433 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 20 06:22:09.727433 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 20 06:22:09.727433 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 20 06:22:09.727433 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 20 06:22:09.727433 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 20 06:22:09.727433 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 20 06:22:09.727433 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 20 06:22:09.727433 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 20 06:22:09.727433 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a8c74b2c-bf36-4b49-8855-9eb732003e66 could not be found. Oct 20 06:22:09.727433 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi Oct 20 06:22:09.727433 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 06:22:09.727433 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi Oct 20 06:22:09.727433 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 06:22:09.727433 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 06:22:09.727433 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 06:22:09.727433 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 20 06:22:09.727433 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 20 06:22:09.727433 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 20 06:22:09.729168 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 20 06:22:09.729168 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 20 06:22:09.729168 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 20 06:22:09.729168 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 20 06:22:09.729168 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 20 06:22:09.729168 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 20 06:22:09.729168 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 20 06:22:09.729168 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a8c74b2c-bf36-4b49-8855-9eb732003e66 could not be found. Oct 20 06:22:09.729168 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi Oct 20 06:22:09.729168 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 06:22:09.729168 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi Oct 20 06:22:09.729168 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 06:22:09.729168 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 06:22:09.729168 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 06:22:09.729168 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 20 06:22:09.729168 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 20 06:22:09.729168 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a8c74b2c-bf36-4b49-8855-9eb732003e66 could not be found. Oct 20 06:22:09.729168 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi Oct 20 06:22:09.730908 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-318d62dd-b9a1-4d31-809a-f5d52ea06a6f tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Returning 404 to user: Instance a8c74b2c-bf36-4b49-8855-9eb732003e66 could not be found. {{(pid=118860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 20 06:22:09.730908 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-318d62dd-b9a1-4d31-809a-f5d52ea06a6f tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/a8c74b2c-bf36-4b49-8855-9eb732003e66" status: 404 len: 111 microversion: 2.20 time: 0.048270 Oct 20 06:22:09.732517 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 879/1775] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:22:09 2022] GET /compute/v2.1/servers/a8c74b2c-bf36-4b49-8855-9eb732003e66 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 20 06:22:09.737681 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-73dfcba8-054f-496f-a67f-983e04361fee tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '.version_select at 0x7fbe4ac578b0>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:22:09.764123 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-73dfcba8-054f-496f-a67f-983e04361fee tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1581360041" status: 204 len: 0 microversion: 2.20 time: 0.030377 Oct 20 06:22:09.765182 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 897/1776] 10.222.0.20 () {60 vars in 1262 bytes} [Thu Oct 20 06:22:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1581360041 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 20 06:22:09.913490 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-2f21476e-abd7-4115-af1d-ec9b122e7e14 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:22:09.915332 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-2f21476e-abd7-4115-af1d-ec9b122e7e14 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:22:09.927496 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2f21476e-abd7-4115-af1d-ec9b122e7e14 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:22:09.928263 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2f21476e-abd7-4115-af1d-ec9b122e7e14 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:22:09.928780 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2f21476e-abd7-4115-af1d-ec9b122e7e14 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:22:09.930411 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2f21476e-abd7-4115-af1d-ec9b122e7e14 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:22:09.931147 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2f21476e-abd7-4115-af1d-ec9b122e7e14 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:22:09.931632 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2f21476e-abd7-4115-af1d-ec9b122e7e14 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:22:10.120215 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-2f21476e-abd7-4115-af1d-ec9b122e7e14 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:22:10.128920 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-2f21476e-abd7-4115-af1d-ec9b122e7e14 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.222516 Oct 20 06:22:10.139722 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 880/1777] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:22:09 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:22:10.717035 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-10c30fc9-cefc-4ac5-aa73-c8157d2d60a7 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:22:10.717630 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-10c30fc9-cefc-4ac5-aa73-c8157d2d60a7 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:22:10.724630 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-10c30fc9-cefc-4ac5-aa73-c8157d2d60a7 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:22:10.725132 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-10c30fc9-cefc-4ac5-aa73-c8157d2d60a7 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:22:10.725562 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-10c30fc9-cefc-4ac5-aa73-c8157d2d60a7 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:22:10.726892 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-10c30fc9-cefc-4ac5-aa73-c8157d2d60a7 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:22:10.727344 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-10c30fc9-cefc-4ac5-aa73-c8157d2d60a7 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:22:10.727768 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-10c30fc9-cefc-4ac5-aa73-c8157d2d60a7 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:22:10.791877 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-10c30fc9-cefc-4ac5-aa73-c8157d2d60a7 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:22:10.800781 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-10c30fc9-cefc-4ac5-aa73-c8157d2d60a7 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.087763 Oct 20 06:22:10.801368 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 898/1778] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:22:10 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 06:22:11.153099 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-2265c85e-05dd-4208-af55-558f5a53e749 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:22:11.153710 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-2265c85e-05dd-4208-af55-558f5a53e749 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:22:11.160576 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2265c85e-05dd-4208-af55-558f5a53e749 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:22:11.161090 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2265c85e-05dd-4208-af55-558f5a53e749 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:22:11.161520 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2265c85e-05dd-4208-af55-558f5a53e749 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:22:11.162215 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2265c85e-05dd-4208-af55-558f5a53e749 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:22:11.162658 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2265c85e-05dd-4208-af55-558f5a53e749 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:22:11.163077 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2265c85e-05dd-4208-af55-558f5a53e749 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:22:11.297488 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-2265c85e-05dd-4208-af55-558f5a53e749 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:22:11.308227 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-2265c85e-05dd-4208-af55-558f5a53e749 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.158880 Oct 20 06:22:11.309188 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 881/1779] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:22:11 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:22:11.824100 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-e5924f38-c2af-47a7-b2ec-6119e655be33 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:22:11.824867 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-e5924f38-c2af-47a7-b2ec-6119e655be33 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:22:11.831316 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e5924f38-c2af-47a7-b2ec-6119e655be33 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:22:11.831798 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e5924f38-c2af-47a7-b2ec-6119e655be33 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:22:11.832235 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e5924f38-c2af-47a7-b2ec-6119e655be33 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:22:11.832963 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e5924f38-c2af-47a7-b2ec-6119e655be33 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:22:11.833429 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e5924f38-c2af-47a7-b2ec-6119e655be33 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:22:11.833853 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e5924f38-c2af-47a7-b2ec-6119e655be33 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:22:11.896188 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-e5924f38-c2af-47a7-b2ec-6119e655be33 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:22:11.905158 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-e5924f38-c2af-47a7-b2ec-6119e655be33 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.085456 Oct 20 06:22:11.905725 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 899/1780] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:22:11 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:22:12.332045 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-05b18826-72ed-4ca8-9e85-61129dcb09cf tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:22:12.332649 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-05b18826-72ed-4ca8-9e85-61129dcb09cf tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:22:12.339604 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-05b18826-72ed-4ca8-9e85-61129dcb09cf tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:22:12.340080 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-05b18826-72ed-4ca8-9e85-61129dcb09cf tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:22:12.340510 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-05b18826-72ed-4ca8-9e85-61129dcb09cf tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:22:12.341226 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-05b18826-72ed-4ca8-9e85-61129dcb09cf tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:22:12.341672 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-05b18826-72ed-4ca8-9e85-61129dcb09cf tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:22:12.342091 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-05b18826-72ed-4ca8-9e85-61129dcb09cf tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:22:12.471258 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-05b18826-72ed-4ca8-9e85-61129dcb09cf tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:22:12.480169 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-05b18826-72ed-4ca8-9e85-61129dcb09cf tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.151971 Oct 20 06:22:12.480742 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 882/1781] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:22:12 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:22:12.928053 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-d7bbc3a4-68c9-47f0-b932-30701eaf3fcb tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:22:12.928796 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-d7bbc3a4-68c9-47f0-b932-30701eaf3fcb tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:22:12.935879 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d7bbc3a4-68c9-47f0-b932-30701eaf3fcb tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:22:12.936371 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d7bbc3a4-68c9-47f0-b932-30701eaf3fcb tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:22:12.936824 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d7bbc3a4-68c9-47f0-b932-30701eaf3fcb tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:22:12.937519 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d7bbc3a4-68c9-47f0-b932-30701eaf3fcb tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:22:12.937969 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d7bbc3a4-68c9-47f0-b932-30701eaf3fcb tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:22:12.938396 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d7bbc3a4-68c9-47f0-b932-30701eaf3fcb tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:22:13.005515 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-d7bbc3a4-68c9-47f0-b932-30701eaf3fcb tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:22:13.015481 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-d7bbc3a4-68c9-47f0-b932-30701eaf3fcb tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.091259 Oct 20 06:22:13.016060 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 900/1782] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:22:12 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:22:13.503688 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-7d1a97ee-7eea-4f82-89ac-401343302d0f tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:22:13.504300 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-7d1a97ee-7eea-4f82-89ac-401343302d0f tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:22:13.511121 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7d1a97ee-7eea-4f82-89ac-401343302d0f tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:22:13.511609 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7d1a97ee-7eea-4f82-89ac-401343302d0f tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:22:13.512054 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7d1a97ee-7eea-4f82-89ac-401343302d0f tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:22:13.512789 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7d1a97ee-7eea-4f82-89ac-401343302d0f tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:22:13.513254 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7d1a97ee-7eea-4f82-89ac-401343302d0f tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:22:13.513687 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7d1a97ee-7eea-4f82-89ac-401343302d0f tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:22:13.655268 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-7d1a97ee-7eea-4f82-89ac-401343302d0f tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:22:13.668269 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-7d1a97ee-7eea-4f82-89ac-401343302d0f tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.168491 Oct 20 06:22:13.668875 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 883/1783] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:22:13 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:22:14.040276 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-c26e0bba-cb2e-45b3-b00b-986dc1a1b651 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:22:14.040924 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-c26e0bba-cb2e-45b3-b00b-986dc1a1b651 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:22:14.047708 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c26e0bba-cb2e-45b3-b00b-986dc1a1b651 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:22:14.048196 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c26e0bba-cb2e-45b3-b00b-986dc1a1b651 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:22:14.048633 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c26e0bba-cb2e-45b3-b00b-986dc1a1b651 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:22:14.049398 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c26e0bba-cb2e-45b3-b00b-986dc1a1b651 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:22:14.049847 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c26e0bba-cb2e-45b3-b00b-986dc1a1b651 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:22:14.050269 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c26e0bba-cb2e-45b3-b00b-986dc1a1b651 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:22:14.114361 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-c26e0bba-cb2e-45b3-b00b-986dc1a1b651 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:22:14.122880 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-c26e0bba-cb2e-45b3-b00b-986dc1a1b651 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.087283 Oct 20 06:22:14.123455 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 901/1784] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:22:14 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:22:14.694860 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-bf2a1afb-bd24-4b32-aad7-c85ab4b293d0 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:22:14.695564 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-bf2a1afb-bd24-4b32-aad7-c85ab4b293d0 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:22:14.702223 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-bf2a1afb-bd24-4b32-aad7-c85ab4b293d0 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:22:14.702738 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-bf2a1afb-bd24-4b32-aad7-c85ab4b293d0 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:22:14.703192 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-bf2a1afb-bd24-4b32-aad7-c85ab4b293d0 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:22:14.703890 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-bf2a1afb-bd24-4b32-aad7-c85ab4b293d0 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:22:14.704342 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-bf2a1afb-bd24-4b32-aad7-c85ab4b293d0 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:22:14.704832 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-bf2a1afb-bd24-4b32-aad7-c85ab4b293d0 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:22:14.835211 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-bf2a1afb-bd24-4b32-aad7-c85ab4b293d0 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:22:14.844337 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-bf2a1afb-bd24-4b32-aad7-c85ab4b293d0 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.153441 Oct 20 06:22:14.844945 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 884/1785] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:22:14 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:22:15.146906 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-be368946-edd5-4b88-a7dc-071f1f426109 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:22:15.147534 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-be368946-edd5-4b88-a7dc-071f1f426109 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:22:15.154419 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-be368946-edd5-4b88-a7dc-071f1f426109 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:22:15.154911 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-be368946-edd5-4b88-a7dc-071f1f426109 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:22:15.155329 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-be368946-edd5-4b88-a7dc-071f1f426109 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:22:15.156018 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-be368946-edd5-4b88-a7dc-071f1f426109 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:22:15.156465 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-be368946-edd5-4b88-a7dc-071f1f426109 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:22:15.156916 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-be368946-edd5-4b88-a7dc-071f1f426109 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:22:15.219207 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-be368946-edd5-4b88-a7dc-071f1f426109 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:22:15.228211 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-be368946-edd5-4b88-a7dc-071f1f426109 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.085267 Oct 20 06:22:15.229046 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 902/1786] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:22:15 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:22:15.869434 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-8844635c-dfd9-4d7d-bab6-f9a9d3d94394 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:22:15.871940 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-8844635c-dfd9-4d7d-bab6-f9a9d3d94394 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:22:15.878580 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-8844635c-dfd9-4d7d-bab6-f9a9d3d94394 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:22:15.879070 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-8844635c-dfd9-4d7d-bab6-f9a9d3d94394 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:22:15.879506 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-8844635c-dfd9-4d7d-bab6-f9a9d3d94394 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:22:15.880206 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-8844635c-dfd9-4d7d-bab6-f9a9d3d94394 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:22:15.880658 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-8844635c-dfd9-4d7d-bab6-f9a9d3d94394 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:22:15.881108 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-8844635c-dfd9-4d7d-bab6-f9a9d3d94394 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:22:16.012887 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-8844635c-dfd9-4d7d-bab6-f9a9d3d94394 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:22:16.021495 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-8844635c-dfd9-4d7d-bab6-f9a9d3d94394 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.157090 Oct 20 06:22:16.022065 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 885/1787] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:22:15 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:22:16.250648 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-e48c5481-02a7-4157-a7b0-d0ca7dfe3ccc tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:22:16.251257 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-e48c5481-02a7-4157-a7b0-d0ca7dfe3ccc tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:22:16.257728 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e48c5481-02a7-4157-a7b0-d0ca7dfe3ccc tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:22:16.258472 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e48c5481-02a7-4157-a7b0-d0ca7dfe3ccc tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:22:16.258903 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e48c5481-02a7-4157-a7b0-d0ca7dfe3ccc tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:22:16.259587 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e48c5481-02a7-4157-a7b0-d0ca7dfe3ccc tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:22:16.260033 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e48c5481-02a7-4157-a7b0-d0ca7dfe3ccc tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:22:16.260451 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e48c5481-02a7-4157-a7b0-d0ca7dfe3ccc tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:22:16.322495 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-e48c5481-02a7-4157-a7b0-d0ca7dfe3ccc tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:22:16.331245 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-e48c5481-02a7-4157-a7b0-d0ca7dfe3ccc tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.084438 Oct 20 06:22:16.331807 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 903/1788] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:22:16 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:22:17.045728 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-63103254-1c43-47e1-9a08-b02bf9274900 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:22:17.046345 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-63103254-1c43-47e1-9a08-b02bf9274900 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:22:17.052822 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-63103254-1c43-47e1-9a08-b02bf9274900 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:22:17.053309 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-63103254-1c43-47e1-9a08-b02bf9274900 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:22:17.053758 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-63103254-1c43-47e1-9a08-b02bf9274900 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:22:17.055181 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-63103254-1c43-47e1-9a08-b02bf9274900 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:22:17.055620 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-63103254-1c43-47e1-9a08-b02bf9274900 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:22:17.056048 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-63103254-1c43-47e1-9a08-b02bf9274900 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:22:17.186428 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-63103254-1c43-47e1-9a08-b02bf9274900 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:22:17.195269 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-63103254-1c43-47e1-9a08-b02bf9274900 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.152998 Oct 20 06:22:17.195995 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 886/1789] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:22:17 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:22:17.354837 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-1767adcf-1fe6-4ded-b1f7-78077725a1d3 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:22:17.355443 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-1767adcf-1fe6-4ded-b1f7-78077725a1d3 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:22:17.361851 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1767adcf-1fe6-4ded-b1f7-78077725a1d3 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:22:17.362328 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1767adcf-1fe6-4ded-b1f7-78077725a1d3 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:22:17.362757 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1767adcf-1fe6-4ded-b1f7-78077725a1d3 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:22:17.363445 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1767adcf-1fe6-4ded-b1f7-78077725a1d3 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:22:17.363888 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1767adcf-1fe6-4ded-b1f7-78077725a1d3 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:22:17.364308 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1767adcf-1fe6-4ded-b1f7-78077725a1d3 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:22:17.428326 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-1767adcf-1fe6-4ded-b1f7-78077725a1d3 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:22:17.437210 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-1767adcf-1fe6-4ded-b1f7-78077725a1d3 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.086339 Oct 20 06:22:17.437768 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 904/1790] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:22:17 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:22:18.219239 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-cbffed9a-f0bd-4bbe-990a-0cf793b01c3d tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:22:18.219838 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-cbffed9a-f0bd-4bbe-990a-0cf793b01c3d tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:22:18.226903 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-cbffed9a-f0bd-4bbe-990a-0cf793b01c3d tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:22:18.227483 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-cbffed9a-f0bd-4bbe-990a-0cf793b01c3d tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:22:18.227910 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-cbffed9a-f0bd-4bbe-990a-0cf793b01c3d tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:22:18.228606 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-cbffed9a-f0bd-4bbe-990a-0cf793b01c3d tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:22:18.229077 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-cbffed9a-f0bd-4bbe-990a-0cf793b01c3d tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:22:18.229494 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-cbffed9a-f0bd-4bbe-990a-0cf793b01c3d tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:22:18.365227 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-cbffed9a-f0bd-4bbe-990a-0cf793b01c3d tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:22:18.373659 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-cbffed9a-f0bd-4bbe-990a-0cf793b01c3d tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.158360 Oct 20 06:22:18.374219 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 887/1791] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:22:18 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:22:18.462046 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-403c7b62-e141-4275-8466-dd5dd356f527 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:22:18.462773 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-403c7b62-e141-4275-8466-dd5dd356f527 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:22:18.469304 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-403c7b62-e141-4275-8466-dd5dd356f527 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:22:18.469719 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-403c7b62-e141-4275-8466-dd5dd356f527 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:22:18.470149 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-403c7b62-e141-4275-8466-dd5dd356f527 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:22:18.470842 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-403c7b62-e141-4275-8466-dd5dd356f527 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:22:18.471287 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-403c7b62-e141-4275-8466-dd5dd356f527 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:22:18.471707 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-403c7b62-e141-4275-8466-dd5dd356f527 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:22:18.534948 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-403c7b62-e141-4275-8466-dd5dd356f527 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:22:18.544034 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-403c7b62-e141-4275-8466-dd5dd356f527 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.086330 Oct 20 06:22:18.544613 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 905/1792] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:22:18 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:22:19.398904 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-f22baa1e-5020-4a6e-9a5b-8efc9560bc84 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:22:19.399585 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-f22baa1e-5020-4a6e-9a5b-8efc9560bc84 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:22:19.406449 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f22baa1e-5020-4a6e-9a5b-8efc9560bc84 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:22:19.406946 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f22baa1e-5020-4a6e-9a5b-8efc9560bc84 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:22:19.407388 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f22baa1e-5020-4a6e-9a5b-8efc9560bc84 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:22:19.408113 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f22baa1e-5020-4a6e-9a5b-8efc9560bc84 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:22:19.408574 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f22baa1e-5020-4a6e-9a5b-8efc9560bc84 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:22:19.409032 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f22baa1e-5020-4a6e-9a5b-8efc9560bc84 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:22:19.544429 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-f22baa1e-5020-4a6e-9a5b-8efc9560bc84 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:22:19.552728 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-f22baa1e-5020-4a6e-9a5b-8efc9560bc84 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.158543 Oct 20 06:22:19.553287 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 888/1793] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:22:19 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:22:19.567282 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-7c215bd5-851f-42ce-b355-6842bbd28083 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:22:19.567891 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-7c215bd5-851f-42ce-b355-6842bbd28083 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:22:19.575288 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7c215bd5-851f-42ce-b355-6842bbd28083 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:22:19.575774 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7c215bd5-851f-42ce-b355-6842bbd28083 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:22:19.576213 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7c215bd5-851f-42ce-b355-6842bbd28083 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:22:19.576952 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7c215bd5-851f-42ce-b355-6842bbd28083 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:22:19.577391 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7c215bd5-851f-42ce-b355-6842bbd28083 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:22:19.577815 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7c215bd5-851f-42ce-b355-6842bbd28083 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:22:19.640146 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-7c215bd5-851f-42ce-b355-6842bbd28083 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:22:19.642316 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG dbcounter [-] [118861] Writing DB stats nova_cell1:SELECT=100 {{(pid=118861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:22:19.651022 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-7c215bd5-851f-42ce-b355-6842bbd28083 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.087521 Oct 20 06:22:19.651634 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 906/1794] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:22:19 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:22:20.576501 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-108c5162-f969-4eab-a9f6-b3e7eb1f4b6d tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:22:20.577122 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-108c5162-f969-4eab-a9f6-b3e7eb1f4b6d tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:22:20.584314 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-108c5162-f969-4eab-a9f6-b3e7eb1f4b6d tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:22:20.585057 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-108c5162-f969-4eab-a9f6-b3e7eb1f4b6d tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:22:20.585802 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-108c5162-f969-4eab-a9f6-b3e7eb1f4b6d tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:22:20.586873 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-108c5162-f969-4eab-a9f6-b3e7eb1f4b6d tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:22:20.587518 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-108c5162-f969-4eab-a9f6-b3e7eb1f4b6d tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:22:20.588108 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-108c5162-f969-4eab-a9f6-b3e7eb1f4b6d tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:22:20.675282 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-ce65cd43-69f4-4219-bbc9-8e5ff31393d3 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:22:20.675885 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-ce65cd43-69f4-4219-bbc9-8e5ff31393d3 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:22:20.683533 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ce65cd43-69f4-4219-bbc9-8e5ff31393d3 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:22:20.684070 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ce65cd43-69f4-4219-bbc9-8e5ff31393d3 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:22:20.684498 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ce65cd43-69f4-4219-bbc9-8e5ff31393d3 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:22:20.685226 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ce65cd43-69f4-4219-bbc9-8e5ff31393d3 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:22:20.685679 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ce65cd43-69f4-4219-bbc9-8e5ff31393d3 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:22:20.686116 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ce65cd43-69f4-4219-bbc9-8e5ff31393d3 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:22:20.722840 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-108c5162-f969-4eab-a9f6-b3e7eb1f4b6d tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:22:20.731854 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-108c5162-f969-4eab-a9f6-b3e7eb1f4b6d tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.159481 Oct 20 06:22:20.732784 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 889/1795] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:22:20 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:22:20.750751 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-ce65cd43-69f4-4219-bbc9-8e5ff31393d3 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:22:20.759761 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-ce65cd43-69f4-4219-bbc9-8e5ff31393d3 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.088588 Oct 20 06:22:20.760357 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 907/1796] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:22:20 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:22:21.755490 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-fa09d1a2-31dc-4e0a-83f5-3a9ff56a8ecc tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:22:21.756131 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-fa09d1a2-31dc-4e0a-83f5-3a9ff56a8ecc tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:22:21.762993 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-fa09d1a2-31dc-4e0a-83f5-3a9ff56a8ecc tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:22:21.763468 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-fa09d1a2-31dc-4e0a-83f5-3a9ff56a8ecc tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:22:21.763898 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-fa09d1a2-31dc-4e0a-83f5-3a9ff56a8ecc tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:22:21.764584 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-fa09d1a2-31dc-4e0a-83f5-3a9ff56a8ecc tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:22:21.765057 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-fa09d1a2-31dc-4e0a-83f5-3a9ff56a8ecc tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:22:21.765477 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-fa09d1a2-31dc-4e0a-83f5-3a9ff56a8ecc tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:22:21.783405 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-0f5315d6-4c3a-48db-8008-c3ffb10a8458 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:22:21.784039 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-0f5315d6-4c3a-48db-8008-c3ffb10a8458 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:22:21.791210 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-0f5315d6-4c3a-48db-8008-c3ffb10a8458 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:22:21.791964 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-0f5315d6-4c3a-48db-8008-c3ffb10a8458 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:22:21.792410 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-0f5315d6-4c3a-48db-8008-c3ffb10a8458 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:22:21.793156 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-0f5315d6-4c3a-48db-8008-c3ffb10a8458 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:22:21.793607 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-0f5315d6-4c3a-48db-8008-c3ffb10a8458 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:22:21.794031 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-0f5315d6-4c3a-48db-8008-c3ffb10a8458 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:22:21.861937 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-0f5315d6-4c3a-48db-8008-c3ffb10a8458 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:22:21.870553 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-0f5315d6-4c3a-48db-8008-c3ffb10a8458 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.091062 Oct 20 06:22:21.871135 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 908/1797] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:22:21 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 06:22:21.906781 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-fa09d1a2-31dc-4e0a-83f5-3a9ff56a8ecc tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:22:21.915624 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-fa09d1a2-31dc-4e0a-83f5-3a9ff56a8ecc tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.164001 Oct 20 06:22:21.916186 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 890/1798] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:22:21 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:22:22.895247 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-0cf4911d-b8b8-4060-8062-92f9390ba06b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:22:22.895989 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-0cf4911d-b8b8-4060-8062-92f9390ba06b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:22:22.903506 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-0cf4911d-b8b8-4060-8062-92f9390ba06b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:22:22.904017 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-0cf4911d-b8b8-4060-8062-92f9390ba06b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:22:22.904450 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-0cf4911d-b8b8-4060-8062-92f9390ba06b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:22:22.905171 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-0cf4911d-b8b8-4060-8062-92f9390ba06b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:22:22.905623 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-0cf4911d-b8b8-4060-8062-92f9390ba06b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:22:22.906044 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-0cf4911d-b8b8-4060-8062-92f9390ba06b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:22:22.939351 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-bd63b101-5c78-4dae-8948-568b036dcc5a tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:22:22.940086 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-bd63b101-5c78-4dae-8948-568b036dcc5a tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:22:22.947379 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-bd63b101-5c78-4dae-8948-568b036dcc5a tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:22:22.947870 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-bd63b101-5c78-4dae-8948-568b036dcc5a tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:22:22.948301 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-bd63b101-5c78-4dae-8948-568b036dcc5a tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:22:22.949038 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-bd63b101-5c78-4dae-8948-568b036dcc5a tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:22:22.949488 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-bd63b101-5c78-4dae-8948-568b036dcc5a tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:22:22.949938 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-bd63b101-5c78-4dae-8948-568b036dcc5a tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:22:22.970448 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-0cf4911d-b8b8-4060-8062-92f9390ba06b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:22:22.979947 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-0cf4911d-b8b8-4060-8062-92f9390ba06b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.088401 Oct 20 06:22:22.981703 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 909/1799] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:22:22 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:22:23.099748 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-bd63b101-5c78-4dae-8948-568b036dcc5a tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:22:23.108901 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-bd63b101-5c78-4dae-8948-568b036dcc5a tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.173359 Oct 20 06:22:23.109471 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 891/1800] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:22:22 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:22:24.003602 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-9ddc58a3-eaa3-4ff7-80a0-3d67465285e9 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:22:24.004232 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-9ddc58a3-eaa3-4ff7-80a0-3d67465285e9 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:22:24.011224 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-9ddc58a3-eaa3-4ff7-80a0-3d67465285e9 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:22:24.011754 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-9ddc58a3-eaa3-4ff7-80a0-3d67465285e9 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:22:24.012191 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-9ddc58a3-eaa3-4ff7-80a0-3d67465285e9 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:22:24.012923 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-9ddc58a3-eaa3-4ff7-80a0-3d67465285e9 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:22:24.013377 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-9ddc58a3-eaa3-4ff7-80a0-3d67465285e9 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:22:24.013796 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-9ddc58a3-eaa3-4ff7-80a0-3d67465285e9 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:22:24.076129 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-9ddc58a3-eaa3-4ff7-80a0-3d67465285e9 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:22:24.084321 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-9ddc58a3-eaa3-4ff7-80a0-3d67465285e9 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.084657 Oct 20 06:22:24.084908 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 910/1801] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:22:23 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:22:24.131444 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-bb27d2bf-339b-4b18-9af4-db17700ab71f tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:22:24.132228 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-bb27d2bf-339b-4b18-9af4-db17700ab71f tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:22:24.138997 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-bb27d2bf-339b-4b18-9af4-db17700ab71f tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:22:24.139475 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-bb27d2bf-339b-4b18-9af4-db17700ab71f tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:22:24.139906 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-bb27d2bf-339b-4b18-9af4-db17700ab71f tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:22:24.140593 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-bb27d2bf-339b-4b18-9af4-db17700ab71f tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:22:24.141064 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-bb27d2bf-339b-4b18-9af4-db17700ab71f tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:22:24.141481 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-bb27d2bf-339b-4b18-9af4-db17700ab71f tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:22:24.270627 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-bb27d2bf-339b-4b18-9af4-db17700ab71f tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:22:24.279497 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-bb27d2bf-339b-4b18-9af4-db17700ab71f tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.151887 Oct 20 06:22:24.280072 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 892/1802] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:22:24 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:22:25.108274 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-cca1d2fd-7f2f-41da-9e11-1014808b7d16 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:22:25.108894 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-cca1d2fd-7f2f-41da-9e11-1014808b7d16 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:22:25.115362 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-cca1d2fd-7f2f-41da-9e11-1014808b7d16 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:22:25.115860 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-cca1d2fd-7f2f-41da-9e11-1014808b7d16 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:22:25.116272 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-cca1d2fd-7f2f-41da-9e11-1014808b7d16 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:22:25.117554 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-cca1d2fd-7f2f-41da-9e11-1014808b7d16 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:22:25.118087 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-cca1d2fd-7f2f-41da-9e11-1014808b7d16 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:22:25.118506 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-cca1d2fd-7f2f-41da-9e11-1014808b7d16 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:22:25.178569 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-cca1d2fd-7f2f-41da-9e11-1014808b7d16 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:22:25.187979 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-cca1d2fd-7f2f-41da-9e11-1014808b7d16 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.083563 Oct 20 06:22:25.188556 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 911/1803] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:22:25 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:22:25.302782 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-257af8d8-d873-439c-9c7d-213a5a28f3ea tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:22:25.304853 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-257af8d8-d873-439c-9c7d-213a5a28f3ea tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:22:25.311606 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-257af8d8-d873-439c-9c7d-213a5a28f3ea tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:22:25.312096 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-257af8d8-d873-439c-9c7d-213a5a28f3ea tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:22:25.312532 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-257af8d8-d873-439c-9c7d-213a5a28f3ea tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:22:25.313466 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-257af8d8-d873-439c-9c7d-213a5a28f3ea tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:22:25.320997 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-257af8d8-d873-439c-9c7d-213a5a28f3ea tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:22:25.321794 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-257af8d8-d873-439c-9c7d-213a5a28f3ea tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:22:25.453681 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-257af8d8-d873-439c-9c7d-213a5a28f3ea tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:22:25.462498 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-257af8d8-d873-439c-9c7d-213a5a28f3ea tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.163590 Oct 20 06:22:25.463066 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 893/1804] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:22:25 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:22:26.211677 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-ab884007-3ffc-4958-9d8a-152fe8da3b3d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:22:26.212339 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-ab884007-3ffc-4958-9d8a-152fe8da3b3d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:22:26.219119 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ab884007-3ffc-4958-9d8a-152fe8da3b3d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:22:26.219615 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ab884007-3ffc-4958-9d8a-152fe8da3b3d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:22:26.220059 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ab884007-3ffc-4958-9d8a-152fe8da3b3d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:22:26.220792 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ab884007-3ffc-4958-9d8a-152fe8da3b3d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:22:26.221252 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ab884007-3ffc-4958-9d8a-152fe8da3b3d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:22:26.221682 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ab884007-3ffc-4958-9d8a-152fe8da3b3d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:22:26.286103 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-ab884007-3ffc-4958-9d8a-152fe8da3b3d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:22:26.294984 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-ab884007-3ffc-4958-9d8a-152fe8da3b3d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.087682 Oct 20 06:22:26.295810 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 912/1805] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:22:26 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:22:26.486608 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-90b398a0-f9d3-4fe7-bef4-143e6fe8daec tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:22:26.487160 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-90b398a0-f9d3-4fe7-bef4-143e6fe8daec tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:22:26.493763 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-90b398a0-f9d3-4fe7-bef4-143e6fe8daec tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:22:26.494239 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-90b398a0-f9d3-4fe7-bef4-143e6fe8daec tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:22:26.494669 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-90b398a0-f9d3-4fe7-bef4-143e6fe8daec tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:22:26.495356 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-90b398a0-f9d3-4fe7-bef4-143e6fe8daec tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:22:26.495802 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-90b398a0-f9d3-4fe7-bef4-143e6fe8daec tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:22:26.496218 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-90b398a0-f9d3-4fe7-bef4-143e6fe8daec tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:22:26.627873 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-90b398a0-f9d3-4fe7-bef4-143e6fe8daec tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:22:26.637206 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-90b398a0-f9d3-4fe7-bef4-143e6fe8daec tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.154403 Oct 20 06:22:26.637788 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 894/1806] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:22:26 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:22:27.321928 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-cdf19bcf-ccb6-4d81-982f-8f700f8d970b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:22:27.322538 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-cdf19bcf-ccb6-4d81-982f-8f700f8d970b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:22:27.328641 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-cdf19bcf-ccb6-4d81-982f-8f700f8d970b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:22:27.329150 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-cdf19bcf-ccb6-4d81-982f-8f700f8d970b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:22:27.329576 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-cdf19bcf-ccb6-4d81-982f-8f700f8d970b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:22:27.330258 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-cdf19bcf-ccb6-4d81-982f-8f700f8d970b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:22:27.330702 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-cdf19bcf-ccb6-4d81-982f-8f700f8d970b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:22:27.331116 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-cdf19bcf-ccb6-4d81-982f-8f700f8d970b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:22:27.392619 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-cdf19bcf-ccb6-4d81-982f-8f700f8d970b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:22:27.401500 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-cdf19bcf-ccb6-4d81-982f-8f700f8d970b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.083592 Oct 20 06:22:27.402069 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 913/1807] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:22:27 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 06:22:27.659983 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-9b569bed-1c4e-43d2-9728-8380cd7fdf98 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:22:27.660598 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-9b569bed-1c4e-43d2-9728-8380cd7fdf98 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:22:27.667885 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-9b569bed-1c4e-43d2-9728-8380cd7fdf98 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:22:27.668375 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-9b569bed-1c4e-43d2-9728-8380cd7fdf98 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:22:27.668851 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-9b569bed-1c4e-43d2-9728-8380cd7fdf98 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:22:27.669557 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-9b569bed-1c4e-43d2-9728-8380cd7fdf98 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:22:27.670015 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-9b569bed-1c4e-43d2-9728-8380cd7fdf98 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:22:27.670448 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-9b569bed-1c4e-43d2-9728-8380cd7fdf98 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:22:27.801410 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-9b569bed-1c4e-43d2-9728-8380cd7fdf98 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:22:27.809645 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-9b569bed-1c4e-43d2-9728-8380cd7fdf98 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.153540 Oct 20 06:22:27.810213 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 895/1808] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:22:27 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:22:28.424733 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-ff1c8379-c595-404d-986f-be29b0a487c8 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:22:28.425344 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-ff1c8379-c595-404d-986f-be29b0a487c8 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:22:28.427634 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG dbcounter [-] [118861] Writing DB stats nova_api:SELECT=59,nova_api:DELETE=1 {{(pid=118861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:22:28.433481 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ff1c8379-c595-404d-986f-be29b0a487c8 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:22:28.433959 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ff1c8379-c595-404d-986f-be29b0a487c8 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:22:28.434391 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ff1c8379-c595-404d-986f-be29b0a487c8 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:22:28.435080 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ff1c8379-c595-404d-986f-be29b0a487c8 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:22:28.435528 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ff1c8379-c595-404d-986f-be29b0a487c8 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:22:28.435946 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ff1c8379-c595-404d-986f-be29b0a487c8 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:22:28.501257 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-ff1c8379-c595-404d-986f-be29b0a487c8 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:22:28.510370 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-ff1c8379-c595-404d-986f-be29b0a487c8 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.089508 Oct 20 06:22:28.511132 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 914/1809] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:22:28 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:22:28.833671 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-e40b6bd1-53ee-4ede-a1ae-03bfd623c109 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:22:28.834268 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-e40b6bd1-53ee-4ede-a1ae-03bfd623c109 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:22:28.837596 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG dbcounter [-] [118860] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=1 {{(pid=118860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:22:28.844034 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e40b6bd1-53ee-4ede-a1ae-03bfd623c109 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:22:28.844533 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e40b6bd1-53ee-4ede-a1ae-03bfd623c109 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:22:28.845033 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e40b6bd1-53ee-4ede-a1ae-03bfd623c109 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:22:28.845749 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e40b6bd1-53ee-4ede-a1ae-03bfd623c109 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:22:28.846475 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e40b6bd1-53ee-4ede-a1ae-03bfd623c109 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:22:28.846916 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e40b6bd1-53ee-4ede-a1ae-03bfd623c109 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:22:28.863138 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG dbcounter [-] [118860] Writing DB stats nova_cell1:SELECT=100 {{(pid=118860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:22:28.983358 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-e40b6bd1-53ee-4ede-a1ae-03bfd623c109 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:22:28.992478 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-e40b6bd1-53ee-4ede-a1ae-03bfd623c109 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.162508 Oct 20 06:22:28.993161 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 896/1810] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:22:28 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:22:29.533614 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-1741dbab-490b-4801-b242-48f619bc93e6 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:22:29.534276 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-1741dbab-490b-4801-b242-48f619bc93e6 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:22:29.541648 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1741dbab-490b-4801-b242-48f619bc93e6 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:22:29.542123 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1741dbab-490b-4801-b242-48f619bc93e6 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:22:29.542552 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1741dbab-490b-4801-b242-48f619bc93e6 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:22:29.543251 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1741dbab-490b-4801-b242-48f619bc93e6 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:22:29.543681 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1741dbab-490b-4801-b242-48f619bc93e6 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:22:29.544102 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1741dbab-490b-4801-b242-48f619bc93e6 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:22:29.605938 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-1741dbab-490b-4801-b242-48f619bc93e6 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:22:29.614414 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-1741dbab-490b-4801-b242-48f619bc93e6 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.084678 Oct 20 06:22:29.615072 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 915/1811] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:22:29 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:22:30.017561 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-79e83319-55d9-4e20-88d2-d55964529e2e tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:22:30.018175 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-79e83319-55d9-4e20-88d2-d55964529e2e tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:22:30.025352 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-79e83319-55d9-4e20-88d2-d55964529e2e tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:22:30.025839 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-79e83319-55d9-4e20-88d2-d55964529e2e tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:22:30.026276 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-79e83319-55d9-4e20-88d2-d55964529e2e tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:22:30.026981 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-79e83319-55d9-4e20-88d2-d55964529e2e tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:22:30.027432 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-79e83319-55d9-4e20-88d2-d55964529e2e tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:22:30.027854 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-79e83319-55d9-4e20-88d2-d55964529e2e tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:22:30.159835 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-79e83319-55d9-4e20-88d2-d55964529e2e tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:22:30.169022 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-79e83319-55d9-4e20-88d2-d55964529e2e tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.155351 Oct 20 06:22:30.169613 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 897/1812] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:22:30 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:22:30.637477 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-cf3ee575-a7f3-480a-8c33-0fdebf15dccb tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:22:30.638286 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-cf3ee575-a7f3-480a-8c33-0fdebf15dccb tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:22:30.644973 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-cf3ee575-a7f3-480a-8c33-0fdebf15dccb tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:22:30.645465 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-cf3ee575-a7f3-480a-8c33-0fdebf15dccb tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:22:30.645894 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-cf3ee575-a7f3-480a-8c33-0fdebf15dccb tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:22:30.646706 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-cf3ee575-a7f3-480a-8c33-0fdebf15dccb tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:22:30.647154 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-cf3ee575-a7f3-480a-8c33-0fdebf15dccb tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:22:30.647636 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-cf3ee575-a7f3-480a-8c33-0fdebf15dccb tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:22:30.712961 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-cf3ee575-a7f3-480a-8c33-0fdebf15dccb tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:22:30.721372 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-cf3ee575-a7f3-480a-8c33-0fdebf15dccb tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.088166 Oct 20 06:22:30.722011 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 916/1813] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:22:30 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:22:31.192666 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-4e138772-29b9-478f-8229-63c5facf3e6b tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:22:31.193295 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-4e138772-29b9-478f-8229-63c5facf3e6b tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:22:31.200234 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-4e138772-29b9-478f-8229-63c5facf3e6b tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:22:31.200753 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-4e138772-29b9-478f-8229-63c5facf3e6b tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:22:31.201186 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-4e138772-29b9-478f-8229-63c5facf3e6b tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:22:31.201882 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-4e138772-29b9-478f-8229-63c5facf3e6b tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:22:31.202333 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-4e138772-29b9-478f-8229-63c5facf3e6b tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:22:31.202850 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-4e138772-29b9-478f-8229-63c5facf3e6b tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:22:31.336329 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-4e138772-29b9-478f-8229-63c5facf3e6b tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:22:31.344626 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-4e138772-29b9-478f-8229-63c5facf3e6b tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.155848 Oct 20 06:22:31.345220 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 898/1814] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:22:31 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:22:31.745452 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-15a9c034-848a-464e-bd13-e522f97d9d74 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:22:31.746062 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-15a9c034-848a-464e-bd13-e522f97d9d74 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:22:31.752616 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-15a9c034-848a-464e-bd13-e522f97d9d74 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:22:31.753131 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-15a9c034-848a-464e-bd13-e522f97d9d74 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:22:31.753570 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-15a9c034-848a-464e-bd13-e522f97d9d74 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:22:31.754282 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-15a9c034-848a-464e-bd13-e522f97d9d74 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:22:31.754736 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-15a9c034-848a-464e-bd13-e522f97d9d74 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:22:31.755157 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-15a9c034-848a-464e-bd13-e522f97d9d74 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:22:31.818185 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-15a9c034-848a-464e-bd13-e522f97d9d74 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:22:31.827434 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-15a9c034-848a-464e-bd13-e522f97d9d74 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.086581 Oct 20 06:22:31.828012 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 917/1815] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:22:31 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:22:32.368222 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-b729c5c8-ce4f-481f-af4b-77835e1210be tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:22:32.368959 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-b729c5c8-ce4f-481f-af4b-77835e1210be tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:22:32.375599 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b729c5c8-ce4f-481f-af4b-77835e1210be tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:22:32.376079 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b729c5c8-ce4f-481f-af4b-77835e1210be tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:22:32.376514 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b729c5c8-ce4f-481f-af4b-77835e1210be tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:22:32.377269 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b729c5c8-ce4f-481f-af4b-77835e1210be tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:22:32.377714 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b729c5c8-ce4f-481f-af4b-77835e1210be tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:22:32.378138 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b729c5c8-ce4f-481f-af4b-77835e1210be tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:22:32.510019 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-b729c5c8-ce4f-481f-af4b-77835e1210be tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:22:32.518563 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-b729c5c8-ce4f-481f-af4b-77835e1210be tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.154965 Oct 20 06:22:32.519752 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 899/1816] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:22:32 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:22:32.850922 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-00838164-44f2-492b-9861-aaacd9340c08 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:22:32.851994 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-00838164-44f2-492b-9861-aaacd9340c08 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:22:32.858599 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-00838164-44f2-492b-9861-aaacd9340c08 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:22:32.859073 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-00838164-44f2-492b-9861-aaacd9340c08 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:22:32.859506 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-00838164-44f2-492b-9861-aaacd9340c08 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:22:32.860205 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-00838164-44f2-492b-9861-aaacd9340c08 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:22:32.860660 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-00838164-44f2-492b-9861-aaacd9340c08 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:22:32.861113 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-00838164-44f2-492b-9861-aaacd9340c08 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:22:32.929680 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-00838164-44f2-492b-9861-aaacd9340c08 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:22:32.938015 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-00838164-44f2-492b-9861-aaacd9340c08 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.091391 Oct 20 06:22:32.938790 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 918/1817] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:22:32 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:22:33.543838 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-0e8cbf73-21c3-4680-ba91-5225439e8113 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:22:33.544453 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-0e8cbf73-21c3-4680-ba91-5225439e8113 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:22:33.550979 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0e8cbf73-21c3-4680-ba91-5225439e8113 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:22:33.551507 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0e8cbf73-21c3-4680-ba91-5225439e8113 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:22:33.551951 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0e8cbf73-21c3-4680-ba91-5225439e8113 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:22:33.552649 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0e8cbf73-21c3-4680-ba91-5225439e8113 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:22:33.553247 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0e8cbf73-21c3-4680-ba91-5225439e8113 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:22:33.553558 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0e8cbf73-21c3-4680-ba91-5225439e8113 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:22:33.688772 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-0e8cbf73-21c3-4680-ba91-5225439e8113 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:22:33.697828 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-0e8cbf73-21c3-4680-ba91-5225439e8113 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.157851 Oct 20 06:22:33.698630 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 900/1818] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:22:33 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 06:22:33.961672 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-90aa6232-a902-49c1-8557-8c0093dbff39 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:22:33.962221 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-90aa6232-a902-49c1-8557-8c0093dbff39 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:22:33.968763 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-90aa6232-a902-49c1-8557-8c0093dbff39 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:22:33.969227 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-90aa6232-a902-49c1-8557-8c0093dbff39 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:22:33.969671 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-90aa6232-a902-49c1-8557-8c0093dbff39 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:22:33.970374 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-90aa6232-a902-49c1-8557-8c0093dbff39 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:22:33.970831 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-90aa6232-a902-49c1-8557-8c0093dbff39 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:22:33.971259 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-90aa6232-a902-49c1-8557-8c0093dbff39 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:22:34.034291 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-90aa6232-a902-49c1-8557-8c0093dbff39 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:22:34.043340 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-90aa6232-a902-49c1-8557-8c0093dbff39 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.086287 Oct 20 06:22:34.043897 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 919/1819] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:22:33 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:22:34.721711 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-8e905067-16ab-4351-aeed-5c6ea94df761 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:22:34.722401 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-8e905067-16ab-4351-aeed-5c6ea94df761 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:22:34.729454 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-8e905067-16ab-4351-aeed-5c6ea94df761 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:22:34.729974 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-8e905067-16ab-4351-aeed-5c6ea94df761 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:22:34.730416 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-8e905067-16ab-4351-aeed-5c6ea94df761 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:22:34.731126 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-8e905067-16ab-4351-aeed-5c6ea94df761 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:22:34.731579 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-8e905067-16ab-4351-aeed-5c6ea94df761 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:22:34.732009 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-8e905067-16ab-4351-aeed-5c6ea94df761 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:22:34.863751 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-8e905067-16ab-4351-aeed-5c6ea94df761 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:22:34.873039 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-8e905067-16ab-4351-aeed-5c6ea94df761 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.155183 Oct 20 06:22:34.873593 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 901/1820] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:22:34 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:22:35.066353 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-65ae1874-8ab4-4e3b-b316-98887994cf95 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:22:35.066876 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-65ae1874-8ab4-4e3b-b316-98887994cf95 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:22:35.074259 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-65ae1874-8ab4-4e3b-b316-98887994cf95 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:22:35.074747 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-65ae1874-8ab4-4e3b-b316-98887994cf95 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:22:35.075189 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-65ae1874-8ab4-4e3b-b316-98887994cf95 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:22:35.075893 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-65ae1874-8ab4-4e3b-b316-98887994cf95 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:22:35.076348 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-65ae1874-8ab4-4e3b-b316-98887994cf95 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:22:35.076802 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-65ae1874-8ab4-4e3b-b316-98887994cf95 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:22:35.145278 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-65ae1874-8ab4-4e3b-b316-98887994cf95 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:22:35.153786 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-65ae1874-8ab4-4e3b-b316-98887994cf95 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.091458 Oct 20 06:22:35.154439 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 920/1821] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:22:35 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:22:35.897194 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-33e181b8-a4a3-4998-bb81-91ed3215a8ae tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:22:35.899074 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-33e181b8-a4a3-4998-bb81-91ed3215a8ae tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:22:35.905546 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-33e181b8-a4a3-4998-bb81-91ed3215a8ae tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:22:35.906036 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-33e181b8-a4a3-4998-bb81-91ed3215a8ae tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:22:35.906473 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-33e181b8-a4a3-4998-bb81-91ed3215a8ae tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:22:35.907172 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-33e181b8-a4a3-4998-bb81-91ed3215a8ae tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:22:35.907623 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-33e181b8-a4a3-4998-bb81-91ed3215a8ae tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:22:35.908049 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-33e181b8-a4a3-4998-bb81-91ed3215a8ae tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:22:36.038827 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-33e181b8-a4a3-4998-bb81-91ed3215a8ae tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:22:36.047882 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-33e181b8-a4a3-4998-bb81-91ed3215a8ae tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.154626 Oct 20 06:22:36.048453 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 902/1822] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:22:35 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:22:36.177190 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-ba4eff6e-0594-4839-b320-7b2d64d1a729 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:22:36.177751 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-ba4eff6e-0594-4839-b320-7b2d64d1a729 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:22:36.184584 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ba4eff6e-0594-4839-b320-7b2d64d1a729 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:22:36.185152 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ba4eff6e-0594-4839-b320-7b2d64d1a729 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:22:36.185585 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ba4eff6e-0594-4839-b320-7b2d64d1a729 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:22:36.186283 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ba4eff6e-0594-4839-b320-7b2d64d1a729 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:22:36.186744 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ba4eff6e-0594-4839-b320-7b2d64d1a729 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:22:36.187164 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ba4eff6e-0594-4839-b320-7b2d64d1a729 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:22:36.251789 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-ba4eff6e-0594-4839-b320-7b2d64d1a729 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:22:36.260654 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-ba4eff6e-0594-4839-b320-7b2d64d1a729 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.087433 Oct 20 06:22:36.261240 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 921/1823] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:22:36 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:22:37.072018 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-141e8d65-e827-4c73-8f47-f1c8a683c701 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:22:37.072543 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-141e8d65-e827-4c73-8f47-f1c8a683c701 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:22:37.079216 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-141e8d65-e827-4c73-8f47-f1c8a683c701 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:22:37.079816 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-141e8d65-e827-4c73-8f47-f1c8a683c701 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:22:37.080295 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-141e8d65-e827-4c73-8f47-f1c8a683c701 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:22:37.081019 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-141e8d65-e827-4c73-8f47-f1c8a683c701 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:22:37.081474 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-141e8d65-e827-4c73-8f47-f1c8a683c701 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:22:37.081900 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-141e8d65-e827-4c73-8f47-f1c8a683c701 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:22:37.213629 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-141e8d65-e827-4c73-8f47-f1c8a683c701 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:22:37.222120 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-141e8d65-e827-4c73-8f47-f1c8a683c701 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.154586 Oct 20 06:22:37.222803 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 903/1824] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:22:37 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:22:37.286780 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-d169bb67-e16d-46ad-a1e1-26d592e2ab66 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:22:37.287517 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-d169bb67-e16d-46ad-a1e1-26d592e2ab66 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:22:37.294837 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d169bb67-e16d-46ad-a1e1-26d592e2ab66 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:22:37.295331 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d169bb67-e16d-46ad-a1e1-26d592e2ab66 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:22:37.295793 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d169bb67-e16d-46ad-a1e1-26d592e2ab66 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:22:37.296497 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d169bb67-e16d-46ad-a1e1-26d592e2ab66 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:22:37.297096 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d169bb67-e16d-46ad-a1e1-26d592e2ab66 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:22:37.297530 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d169bb67-e16d-46ad-a1e1-26d592e2ab66 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:22:37.361973 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-d169bb67-e16d-46ad-a1e1-26d592e2ab66 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:22:37.370629 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-d169bb67-e16d-46ad-a1e1-26d592e2ab66 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.087730 Oct 20 06:22:37.371205 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 922/1825] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:22:37 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:22:38.247129 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-bdb951f6-9a8c-423b-afc9-fe0cf89cba2d tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:22:38.247771 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-bdb951f6-9a8c-423b-afc9-fe0cf89cba2d tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:22:38.254266 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-bdb951f6-9a8c-423b-afc9-fe0cf89cba2d tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:22:38.254744 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-bdb951f6-9a8c-423b-afc9-fe0cf89cba2d tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:22:38.255179 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-bdb951f6-9a8c-423b-afc9-fe0cf89cba2d tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:22:38.255867 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-bdb951f6-9a8c-423b-afc9-fe0cf89cba2d tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:22:38.256315 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-bdb951f6-9a8c-423b-afc9-fe0cf89cba2d tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:22:38.256950 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-bdb951f6-9a8c-423b-afc9-fe0cf89cba2d tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:22:38.387394 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-bdb951f6-9a8c-423b-afc9-fe0cf89cba2d tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:22:38.393272 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-2c65f433-6f28-434e-ac73-14ef9544e678 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:22:38.393887 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-2c65f433-6f28-434e-ac73-14ef9544e678 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:22:38.403222 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-2c65f433-6f28-434e-ac73-14ef9544e678 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:22:38.403702 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-2c65f433-6f28-434e-ac73-14ef9544e678 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:22:38.404378 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-2c65f433-6f28-434e-ac73-14ef9544e678 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:22:38.405099 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-2c65f433-6f28-434e-ac73-14ef9544e678 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:22:38.405534 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-bdb951f6-9a8c-423b-afc9-fe0cf89cba2d tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.162242 Oct 20 06:22:38.405663 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-2c65f433-6f28-434e-ac73-14ef9544e678 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:22:38.405961 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-2c65f433-6f28-434e-ac73-14ef9544e678 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:22:38.406484 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 904/1826] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:22:38 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:22:38.434199 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG dbcounter [-] [118861] Writing DB stats nova_cell1:SELECT=100 {{(pid=118861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:22:38.481497 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-2c65f433-6f28-434e-ac73-14ef9544e678 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:22:38.489673 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-2c65f433-6f28-434e-ac73-14ef9544e678 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.100200 Oct 20 06:22:38.490241 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 923/1827] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:22:38 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:22:39.430262 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-aab8083c-620a-4691-84f0-aabec3a99d66 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:22:39.430876 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-aab8083c-620a-4691-84f0-aabec3a99d66 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:22:39.437422 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-aab8083c-620a-4691-84f0-aabec3a99d66 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:22:39.437906 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-aab8083c-620a-4691-84f0-aabec3a99d66 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:22:39.438347 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-aab8083c-620a-4691-84f0-aabec3a99d66 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:22:39.439075 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-aab8083c-620a-4691-84f0-aabec3a99d66 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:22:39.439540 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-aab8083c-620a-4691-84f0-aabec3a99d66 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:22:39.439969 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-aab8083c-620a-4691-84f0-aabec3a99d66 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:22:39.513849 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-dd0c079b-347c-4959-a66f-2096bdf8e979 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:22:39.514454 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-dd0c079b-347c-4959-a66f-2096bdf8e979 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:22:39.521461 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-dd0c079b-347c-4959-a66f-2096bdf8e979 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:22:39.521933 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-dd0c079b-347c-4959-a66f-2096bdf8e979 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:22:39.522555 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-dd0c079b-347c-4959-a66f-2096bdf8e979 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:22:39.523571 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-dd0c079b-347c-4959-a66f-2096bdf8e979 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:22:39.524093 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-dd0c079b-347c-4959-a66f-2096bdf8e979 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:22:39.524586 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-dd0c079b-347c-4959-a66f-2096bdf8e979 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:22:39.572403 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-aab8083c-620a-4691-84f0-aabec3a99d66 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:22:39.583560 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-aab8083c-620a-4691-84f0-aabec3a99d66 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.157791 Oct 20 06:22:39.585017 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 905/1828] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:22:39 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:22:39.607414 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-dd0c079b-347c-4959-a66f-2096bdf8e979 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:22:39.615959 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-dd0c079b-347c-4959-a66f-2096bdf8e979 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.106003 Oct 20 06:22:39.616832 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 924/1829] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:22:39 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 06:22:40.607633 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-452dab6f-bab1-4f27-a9f1-4e3dbfd2937a tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:22:40.608231 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-452dab6f-bab1-4f27-a9f1-4e3dbfd2937a tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:22:40.614623 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-452dab6f-bab1-4f27-a9f1-4e3dbfd2937a tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:22:40.615096 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-452dab6f-bab1-4f27-a9f1-4e3dbfd2937a tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:22:40.615540 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-452dab6f-bab1-4f27-a9f1-4e3dbfd2937a tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:22:40.616202 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-452dab6f-bab1-4f27-a9f1-4e3dbfd2937a tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:22:40.616648 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-452dab6f-bab1-4f27-a9f1-4e3dbfd2937a tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:22:40.617093 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-452dab6f-bab1-4f27-a9f1-4e3dbfd2937a tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:22:40.638706 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-1a40b65a-4c32-4f97-a181-90e47c37155a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:22:40.640025 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-1a40b65a-4c32-4f97-a181-90e47c37155a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:22:40.646582 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1a40b65a-4c32-4f97-a181-90e47c37155a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:22:40.647069 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1a40b65a-4c32-4f97-a181-90e47c37155a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:22:40.648366 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1a40b65a-4c32-4f97-a181-90e47c37155a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:22:40.649091 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1a40b65a-4c32-4f97-a181-90e47c37155a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:22:40.649541 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1a40b65a-4c32-4f97-a181-90e47c37155a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:22:40.650030 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1a40b65a-4c32-4f97-a181-90e47c37155a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:22:40.716892 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-1a40b65a-4c32-4f97-a181-90e47c37155a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:22:40.727466 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-1a40b65a-4c32-4f97-a181-90e47c37155a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.092548 Oct 20 06:22:40.728261 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 925/1830] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:22:40 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 06:22:40.749901 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-452dab6f-bab1-4f27-a9f1-4e3dbfd2937a tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:22:40.758194 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-452dab6f-bab1-4f27-a9f1-4e3dbfd2937a tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.154516 Oct 20 06:22:40.758990 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 906/1831] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:22:40 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:22:41.750398 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-0b81c16c-b107-4ea4-9d39-2dd05b22ea02 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:22:41.750993 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-0b81c16c-b107-4ea4-9d39-2dd05b22ea02 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:22:41.757993 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-0b81c16c-b107-4ea4-9d39-2dd05b22ea02 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:22:41.758749 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-0b81c16c-b107-4ea4-9d39-2dd05b22ea02 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:22:41.759191 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-0b81c16c-b107-4ea4-9d39-2dd05b22ea02 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:22:41.759893 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-0b81c16c-b107-4ea4-9d39-2dd05b22ea02 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:22:41.760350 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-0b81c16c-b107-4ea4-9d39-2dd05b22ea02 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:22:41.760806 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-0b81c16c-b107-4ea4-9d39-2dd05b22ea02 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:22:41.782332 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-038b85d6-6f0f-4e59-8e82-fddea72e31cc tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:22:41.782949 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-038b85d6-6f0f-4e59-8e82-fddea72e31cc tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:22:41.790000 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-038b85d6-6f0f-4e59-8e82-fddea72e31cc tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:22:41.800801 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-038b85d6-6f0f-4e59-8e82-fddea72e31cc tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:22:41.801260 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-038b85d6-6f0f-4e59-8e82-fddea72e31cc tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:22:41.801994 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-038b85d6-6f0f-4e59-8e82-fddea72e31cc tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:22:41.802456 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-038b85d6-6f0f-4e59-8e82-fddea72e31cc tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:22:41.802915 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-038b85d6-6f0f-4e59-8e82-fddea72e31cc tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:22:41.829675 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-0b81c16c-b107-4ea4-9d39-2dd05b22ea02 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:22:41.838420 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-0b81c16c-b107-4ea4-9d39-2dd05b22ea02 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.091849 Oct 20 06:22:41.855019 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 926/1832] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:22:41 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:22:41.941218 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-038b85d6-6f0f-4e59-8e82-fddea72e31cc tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:22:41.950133 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-038b85d6-6f0f-4e59-8e82-fddea72e31cc tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.171671 Oct 20 06:22:41.950698 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 907/1833] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:22:41 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 06:22:42.861400 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-bad61d2d-de41-4fa7-af13-34e5e0a3e983 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:22:42.861993 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-bad61d2d-de41-4fa7-af13-34e5e0a3e983 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:22:42.868896 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-bad61d2d-de41-4fa7-af13-34e5e0a3e983 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:22:42.869373 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-bad61d2d-de41-4fa7-af13-34e5e0a3e983 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:22:42.869801 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-bad61d2d-de41-4fa7-af13-34e5e0a3e983 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:22:42.870487 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-bad61d2d-de41-4fa7-af13-34e5e0a3e983 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:22:42.870931 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-bad61d2d-de41-4fa7-af13-34e5e0a3e983 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:22:42.871348 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-bad61d2d-de41-4fa7-af13-34e5e0a3e983 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:22:42.935471 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-bad61d2d-de41-4fa7-af13-34e5e0a3e983 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:22:42.943684 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-bad61d2d-de41-4fa7-af13-34e5e0a3e983 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.086216 Oct 20 06:22:42.944908 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 927/1834] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:22:42 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:22:42.974002 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-38ef704b-c7e2-4487-8ebe-c5adf645fcd0 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:22:42.974662 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-38ef704b-c7e2-4487-8ebe-c5adf645fcd0 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:22:42.981175 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-38ef704b-c7e2-4487-8ebe-c5adf645fcd0 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:22:42.981651 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-38ef704b-c7e2-4487-8ebe-c5adf645fcd0 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:22:42.982109 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-38ef704b-c7e2-4487-8ebe-c5adf645fcd0 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:22:42.982800 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-38ef704b-c7e2-4487-8ebe-c5adf645fcd0 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:22:42.983246 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-38ef704b-c7e2-4487-8ebe-c5adf645fcd0 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:22:42.983662 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-38ef704b-c7e2-4487-8ebe-c5adf645fcd0 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:22:43.119113 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-38ef704b-c7e2-4487-8ebe-c5adf645fcd0 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:22:43.127586 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-38ef704b-c7e2-4487-8ebe-c5adf645fcd0 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.157461 Oct 20 06:22:43.128326 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 908/1835] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:22:42 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:22:43.967499 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-44e4c85c-019f-41ff-baae-26a0b1722745 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:22:43.968200 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-44e4c85c-019f-41ff-baae-26a0b1722745 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:22:43.974875 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-44e4c85c-019f-41ff-baae-26a0b1722745 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:22:43.976257 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-44e4c85c-019f-41ff-baae-26a0b1722745 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:22:43.976888 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-44e4c85c-019f-41ff-baae-26a0b1722745 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:22:43.977619 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-44e4c85c-019f-41ff-baae-26a0b1722745 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:22:43.978077 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-44e4c85c-019f-41ff-baae-26a0b1722745 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:22:43.978509 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-44e4c85c-019f-41ff-baae-26a0b1722745 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:22:44.048428 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-44e4c85c-019f-41ff-baae-26a0b1722745 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:22:44.057729 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-44e4c85c-019f-41ff-baae-26a0b1722745 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.094301 Oct 20 06:22:44.058313 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 928/1836] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:22:43 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:22:44.152188 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-24c088f8-e503-4ae8-b689-70f2c87b6150 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:22:44.152831 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-24c088f8-e503-4ae8-b689-70f2c87b6150 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:22:44.159365 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-24c088f8-e503-4ae8-b689-70f2c87b6150 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:22:44.159852 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-24c088f8-e503-4ae8-b689-70f2c87b6150 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:22:44.160326 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-24c088f8-e503-4ae8-b689-70f2c87b6150 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:22:44.161054 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-24c088f8-e503-4ae8-b689-70f2c87b6150 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:22:44.161512 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-24c088f8-e503-4ae8-b689-70f2c87b6150 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:22:44.161943 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-24c088f8-e503-4ae8-b689-70f2c87b6150 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:22:44.292374 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-24c088f8-e503-4ae8-b689-70f2c87b6150 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:22:44.301263 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-24c088f8-e503-4ae8-b689-70f2c87b6150 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.153660 Oct 20 06:22:44.303029 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 909/1837] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:22:44 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:22:45.081024 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-07b2da54-13bf-4414-96f5-60c3f44f14cc tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:22:45.081652 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-07b2da54-13bf-4414-96f5-60c3f44f14cc tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:22:45.090571 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-07b2da54-13bf-4414-96f5-60c3f44f14cc tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:22:45.091272 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-07b2da54-13bf-4414-96f5-60c3f44f14cc tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:22:45.092031 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-07b2da54-13bf-4414-96f5-60c3f44f14cc tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:22:45.093466 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-07b2da54-13bf-4414-96f5-60c3f44f14cc tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:22:45.093606 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-07b2da54-13bf-4414-96f5-60c3f44f14cc tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:22:45.093916 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-07b2da54-13bf-4414-96f5-60c3f44f14cc tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:22:45.159148 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-07b2da54-13bf-4414-96f5-60c3f44f14cc tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:22:45.167579 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-07b2da54-13bf-4414-96f5-60c3f44f14cc tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.090511 Oct 20 06:22:45.168142 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 929/1838] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:22:45 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:22:45.327665 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-aed28332-ba73-40f7-991d-e0d771ae59ea tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:22:45.328918 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-aed28332-ba73-40f7-991d-e0d771ae59ea tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:22:45.336359 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-aed28332-ba73-40f7-991d-e0d771ae59ea tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:22:45.336781 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-aed28332-ba73-40f7-991d-e0d771ae59ea tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:22:45.337222 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-aed28332-ba73-40f7-991d-e0d771ae59ea tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:22:45.337927 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-aed28332-ba73-40f7-991d-e0d771ae59ea tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:22:45.338379 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-aed28332-ba73-40f7-991d-e0d771ae59ea tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:22:45.338809 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-aed28332-ba73-40f7-991d-e0d771ae59ea tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:22:45.474105 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-aed28332-ba73-40f7-991d-e0d771ae59ea tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:22:45.482973 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-aed28332-ba73-40f7-991d-e0d771ae59ea tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.159343 Oct 20 06:22:45.483537 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 910/1839] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:22:45 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 06:22:46.191189 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-a9c665c8-2f24-4146-9ca0-f63a00fce745 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:22:46.191970 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-a9c665c8-2f24-4146-9ca0-f63a00fce745 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:22:46.198626 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a9c665c8-2f24-4146-9ca0-f63a00fce745 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:22:46.199111 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a9c665c8-2f24-4146-9ca0-f63a00fce745 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:22:46.199548 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a9c665c8-2f24-4146-9ca0-f63a00fce745 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:22:46.200250 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a9c665c8-2f24-4146-9ca0-f63a00fce745 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:22:46.200717 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a9c665c8-2f24-4146-9ca0-f63a00fce745 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:22:46.201144 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a9c665c8-2f24-4146-9ca0-f63a00fce745 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:22:46.263139 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-a9c665c8-2f24-4146-9ca0-f63a00fce745 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:22:46.271550 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-a9c665c8-2f24-4146-9ca0-f63a00fce745 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.084277 Oct 20 06:22:46.272868 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 930/1840] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:22:46 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:22:46.506911 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-7328f8b3-3f1e-447e-847e-5ec08c09b8d3 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:22:46.507517 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-7328f8b3-3f1e-447e-847e-5ec08c09b8d3 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:22:46.514167 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7328f8b3-3f1e-447e-847e-5ec08c09b8d3 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:22:46.514641 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7328f8b3-3f1e-447e-847e-5ec08c09b8d3 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:22:46.515070 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7328f8b3-3f1e-447e-847e-5ec08c09b8d3 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:22:46.515760 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7328f8b3-3f1e-447e-847e-5ec08c09b8d3 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:22:46.516203 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7328f8b3-3f1e-447e-847e-5ec08c09b8d3 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:22:46.516625 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7328f8b3-3f1e-447e-847e-5ec08c09b8d3 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:22:46.645586 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-7328f8b3-3f1e-447e-847e-5ec08c09b8d3 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:22:46.653784 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-7328f8b3-3f1e-447e-847e-5ec08c09b8d3 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.150822 Oct 20 06:22:46.654351 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 911/1841] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:22:46 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:22:47.294618 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-6aaccfcf-3136-44dd-86cd-b6a267993b48 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:22:47.295228 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-6aaccfcf-3136-44dd-86cd-b6a267993b48 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:22:47.302562 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-6aaccfcf-3136-44dd-86cd-b6a267993b48 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:22:47.302562 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-6aaccfcf-3136-44dd-86cd-b6a267993b48 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:22:47.302923 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-6aaccfcf-3136-44dd-86cd-b6a267993b48 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:22:47.303630 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-6aaccfcf-3136-44dd-86cd-b6a267993b48 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:22:47.304032 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-6aaccfcf-3136-44dd-86cd-b6a267993b48 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:22:47.304456 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-6aaccfcf-3136-44dd-86cd-b6a267993b48 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:22:47.369241 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-6aaccfcf-3136-44dd-86cd-b6a267993b48 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:22:47.378323 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-6aaccfcf-3136-44dd-86cd-b6a267993b48 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.087597 Oct 20 06:22:47.378888 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 931/1842] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:22:47 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:22:47.677848 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-70eaba82-36e9-4b46-9483-0aacfb1930be tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:22:47.678471 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-70eaba82-36e9-4b46-9483-0aacfb1930be tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:22:47.684818 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-70eaba82-36e9-4b46-9483-0aacfb1930be tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:22:47.685306 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-70eaba82-36e9-4b46-9483-0aacfb1930be tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:22:47.685785 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-70eaba82-36e9-4b46-9483-0aacfb1930be tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:22:47.686494 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-70eaba82-36e9-4b46-9483-0aacfb1930be tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:22:47.686948 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-70eaba82-36e9-4b46-9483-0aacfb1930be tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:22:47.687379 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-70eaba82-36e9-4b46-9483-0aacfb1930be tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:22:47.825971 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-70eaba82-36e9-4b46-9483-0aacfb1930be tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:22:47.834443 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-70eaba82-36e9-4b46-9483-0aacfb1930be tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.160442 Oct 20 06:22:47.835663 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 912/1843] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:22:47 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:22:48.403539 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-8f60a49a-9aa5-4523-bbf9-ac93c9c76a5a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:22:48.404159 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-8f60a49a-9aa5-4523-bbf9-ac93c9c76a5a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:22:48.410683 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-8f60a49a-9aa5-4523-bbf9-ac93c9c76a5a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:22:48.411172 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-8f60a49a-9aa5-4523-bbf9-ac93c9c76a5a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:22:48.411617 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-8f60a49a-9aa5-4523-bbf9-ac93c9c76a5a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:22:48.412373 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-8f60a49a-9aa5-4523-bbf9-ac93c9c76a5a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:22:48.413480 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-8f60a49a-9aa5-4523-bbf9-ac93c9c76a5a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:22:48.414006 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-8f60a49a-9aa5-4523-bbf9-ac93c9c76a5a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:22:48.477627 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-8f60a49a-9aa5-4523-bbf9-ac93c9c76a5a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:22:48.485900 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-8f60a49a-9aa5-4523-bbf9-ac93c9c76a5a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.086374 Oct 20 06:22:48.486478 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 932/1844] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:22:48 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:22:48.858388 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-da8d4af0-86e2-4cb1-a4ba-fa45b14add08 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:22:48.859007 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-da8d4af0-86e2-4cb1-a4ba-fa45b14add08 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:22:48.866652 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-da8d4af0-86e2-4cb1-a4ba-fa45b14add08 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:22:48.867166 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-da8d4af0-86e2-4cb1-a4ba-fa45b14add08 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:22:48.867608 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-da8d4af0-86e2-4cb1-a4ba-fa45b14add08 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:22:48.868320 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-da8d4af0-86e2-4cb1-a4ba-fa45b14add08 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:22:48.868798 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-da8d4af0-86e2-4cb1-a4ba-fa45b14add08 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:22:48.869232 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-da8d4af0-86e2-4cb1-a4ba-fa45b14add08 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:22:48.871910 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG dbcounter [-] [118860] Writing DB stats nova_cell1:SELECT=100 {{(pid=118860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:22:49.004424 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-da8d4af0-86e2-4cb1-a4ba-fa45b14add08 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:22:49.013815 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-da8d4af0-86e2-4cb1-a4ba-fa45b14add08 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.159294 Oct 20 06:22:49.014393 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 913/1845] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:22:48 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:22:49.508188 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-e74c1770-e8b1-4a8b-b02f-1cadec8ad968 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:22:49.509043 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-e74c1770-e8b1-4a8b-b02f-1cadec8ad968 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:22:49.515569 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e74c1770-e8b1-4a8b-b02f-1cadec8ad968 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:22:49.516056 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e74c1770-e8b1-4a8b-b02f-1cadec8ad968 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:22:49.516499 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e74c1770-e8b1-4a8b-b02f-1cadec8ad968 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:22:49.517237 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e74c1770-e8b1-4a8b-b02f-1cadec8ad968 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:22:49.517690 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e74c1770-e8b1-4a8b-b02f-1cadec8ad968 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:22:49.518119 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e74c1770-e8b1-4a8b-b02f-1cadec8ad968 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:22:49.582861 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-e74c1770-e8b1-4a8b-b02f-1cadec8ad968 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:22:49.591373 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-e74c1770-e8b1-4a8b-b02f-1cadec8ad968 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.087779 Oct 20 06:22:49.592225 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 933/1846] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:22:49 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:22:50.038601 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-b7c86be2-701f-4a26-bbbb-086e83a2e680 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:22:50.039223 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-b7c86be2-701f-4a26-bbbb-086e83a2e680 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:22:50.045785 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b7c86be2-701f-4a26-bbbb-086e83a2e680 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:22:50.046267 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b7c86be2-701f-4a26-bbbb-086e83a2e680 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:22:50.046704 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b7c86be2-701f-4a26-bbbb-086e83a2e680 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:22:50.047688 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b7c86be2-701f-4a26-bbbb-086e83a2e680 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:22:50.048150 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b7c86be2-701f-4a26-bbbb-086e83a2e680 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:22:50.048923 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b7c86be2-701f-4a26-bbbb-086e83a2e680 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:22:50.240433 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-b7c86be2-701f-4a26-bbbb-086e83a2e680 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:22:50.250366 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-b7c86be2-701f-4a26-bbbb-086e83a2e680 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.216176 Oct 20 06:22:50.251205 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 914/1847] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:22:50 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:22:50.614570 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-c90d861b-5089-4ed1-b1e7-a35cde94318b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:22:50.615172 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-c90d861b-5089-4ed1-b1e7-a35cde94318b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:22:50.622522 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c90d861b-5089-4ed1-b1e7-a35cde94318b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:22:50.623386 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c90d861b-5089-4ed1-b1e7-a35cde94318b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:22:50.624124 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c90d861b-5089-4ed1-b1e7-a35cde94318b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:22:50.625290 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c90d861b-5089-4ed1-b1e7-a35cde94318b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:22:50.626111 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c90d861b-5089-4ed1-b1e7-a35cde94318b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:22:50.626804 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c90d861b-5089-4ed1-b1e7-a35cde94318b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:22:50.690890 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-c90d861b-5089-4ed1-b1e7-a35cde94318b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:22:50.700316 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-c90d861b-5089-4ed1-b1e7-a35cde94318b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.089711 Oct 20 06:22:50.701259 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 934/1848] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:22:50 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:22:51.274102 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-7218552e-3cf1-4a8e-944b-f8f5ae46a03f tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:22:51.274731 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-7218552e-3cf1-4a8e-944b-f8f5ae46a03f tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:22:51.280812 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7218552e-3cf1-4a8e-944b-f8f5ae46a03f tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:22:51.281309 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7218552e-3cf1-4a8e-944b-f8f5ae46a03f tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:22:51.281750 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7218552e-3cf1-4a8e-944b-f8f5ae46a03f tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:22:51.282451 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7218552e-3cf1-4a8e-944b-f8f5ae46a03f tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:22:51.282909 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7218552e-3cf1-4a8e-944b-f8f5ae46a03f tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:22:51.283342 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7218552e-3cf1-4a8e-944b-f8f5ae46a03f tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:22:51.413680 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-7218552e-3cf1-4a8e-944b-f8f5ae46a03f tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:22:51.422144 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-7218552e-3cf1-4a8e-944b-f8f5ae46a03f tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.152430 Oct 20 06:22:51.422724 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 915/1849] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:22:51 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:22:51.723050 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-b3c13f20-92a4-413a-9f1c-3b9ba91b7d31 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:22:51.723690 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-b3c13f20-92a4-413a-9f1c-3b9ba91b7d31 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:22:51.730466 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b3c13f20-92a4-413a-9f1c-3b9ba91b7d31 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:22:51.730944 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b3c13f20-92a4-413a-9f1c-3b9ba91b7d31 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:22:51.731372 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b3c13f20-92a4-413a-9f1c-3b9ba91b7d31 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:22:51.732063 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b3c13f20-92a4-413a-9f1c-3b9ba91b7d31 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:22:51.732506 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b3c13f20-92a4-413a-9f1c-3b9ba91b7d31 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:22:51.732953 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b3c13f20-92a4-413a-9f1c-3b9ba91b7d31 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:22:51.795197 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-b3c13f20-92a4-413a-9f1c-3b9ba91b7d31 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:22:51.804637 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-b3c13f20-92a4-413a-9f1c-3b9ba91b7d31 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.084829 Oct 20 06:22:51.805228 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 935/1850] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:22:51 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:22:52.446010 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-a77b4af8-37b7-43c0-aca5-d08bfcda40f1 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:22:52.447270 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-a77b4af8-37b7-43c0-aca5-d08bfcda40f1 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:22:52.454611 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a77b4af8-37b7-43c0-aca5-d08bfcda40f1 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:22:52.455096 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a77b4af8-37b7-43c0-aca5-d08bfcda40f1 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:22:52.455526 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a77b4af8-37b7-43c0-aca5-d08bfcda40f1 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:22:52.456259 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a77b4af8-37b7-43c0-aca5-d08bfcda40f1 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:22:52.456724 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a77b4af8-37b7-43c0-aca5-d08bfcda40f1 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:22:52.457152 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a77b4af8-37b7-43c0-aca5-d08bfcda40f1 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:22:52.586294 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-a77b4af8-37b7-43c0-aca5-d08bfcda40f1 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:22:52.594792 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-a77b4af8-37b7-43c0-aca5-d08bfcda40f1 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.152615 Oct 20 06:22:52.595720 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 916/1851] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:22:52 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:22:52.828345 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-56c9175a-c250-4339-9e8d-e188760d30fb tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:22:52.828994 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-56c9175a-c250-4339-9e8d-e188760d30fb tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:22:52.836049 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-56c9175a-c250-4339-9e8d-e188760d30fb tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:22:52.836449 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-56c9175a-c250-4339-9e8d-e188760d30fb tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:22:52.836924 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-56c9175a-c250-4339-9e8d-e188760d30fb tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:22:52.837622 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-56c9175a-c250-4339-9e8d-e188760d30fb tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:22:52.838068 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-56c9175a-c250-4339-9e8d-e188760d30fb tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:22:52.838486 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-56c9175a-c250-4339-9e8d-e188760d30fb tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:22:52.906130 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-56c9175a-c250-4339-9e8d-e188760d30fb tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:22:52.914876 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-56c9175a-c250-4339-9e8d-e188760d30fb tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.090418 Oct 20 06:22:52.927832 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 936/1852] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:22:52 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:22:53.618378 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-060c0532-c72e-47f7-b19a-d75e251be554 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:22:53.618917 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-060c0532-c72e-47f7-b19a-d75e251be554 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:22:53.625451 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-060c0532-c72e-47f7-b19a-d75e251be554 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:22:53.625933 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-060c0532-c72e-47f7-b19a-d75e251be554 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:22:53.626385 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-060c0532-c72e-47f7-b19a-d75e251be554 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:22:53.627063 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-060c0532-c72e-47f7-b19a-d75e251be554 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:22:53.627536 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-060c0532-c72e-47f7-b19a-d75e251be554 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:22:53.628024 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-060c0532-c72e-47f7-b19a-d75e251be554 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:22:53.773863 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-060c0532-c72e-47f7-b19a-d75e251be554 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:22:53.782622 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-060c0532-c72e-47f7-b19a-d75e251be554 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.168271 Oct 20 06:22:53.783342 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 917/1853] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:22:53 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:22:53.939012 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-c883df7a-8b0c-4967-8b7a-0ffa3d4cedd4 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:22:53.939766 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-c883df7a-8b0c-4967-8b7a-0ffa3d4cedd4 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:22:53.946769 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c883df7a-8b0c-4967-8b7a-0ffa3d4cedd4 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:22:53.947247 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c883df7a-8b0c-4967-8b7a-0ffa3d4cedd4 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:22:53.947680 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c883df7a-8b0c-4967-8b7a-0ffa3d4cedd4 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:22:53.948376 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c883df7a-8b0c-4967-8b7a-0ffa3d4cedd4 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:22:53.948852 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c883df7a-8b0c-4967-8b7a-0ffa3d4cedd4 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:22:53.949270 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c883df7a-8b0c-4967-8b7a-0ffa3d4cedd4 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:22:54.013760 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-c883df7a-8b0c-4967-8b7a-0ffa3d4cedd4 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:22:54.022519 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-c883df7a-8b0c-4967-8b7a-0ffa3d4cedd4 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.087216 Oct 20 06:22:54.023052 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 937/1854] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:22:53 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:22:54.807236 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-5bb99099-d01a-447c-bb8d-99d3aac5e203 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:22:54.807880 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-5bb99099-d01a-447c-bb8d-99d3aac5e203 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:22:54.814429 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5bb99099-d01a-447c-bb8d-99d3aac5e203 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:22:54.814910 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5bb99099-d01a-447c-bb8d-99d3aac5e203 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:22:54.815350 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5bb99099-d01a-447c-bb8d-99d3aac5e203 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:22:54.816050 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5bb99099-d01a-447c-bb8d-99d3aac5e203 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:22:54.816501 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5bb99099-d01a-447c-bb8d-99d3aac5e203 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:22:54.816959 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5bb99099-d01a-447c-bb8d-99d3aac5e203 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:22:54.949801 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-5bb99099-d01a-447c-bb8d-99d3aac5e203 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:22:54.958223 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-5bb99099-d01a-447c-bb8d-99d3aac5e203 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.155435 Oct 20 06:22:54.958800 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 918/1855] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:22:54 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:22:55.045313 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-6b322919-cc40-42ed-acbc-267d858f74f3 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:22:55.045938 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-6b322919-cc40-42ed-acbc-267d858f74f3 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:22:55.052706 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-6b322919-cc40-42ed-acbc-267d858f74f3 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:22:55.053266 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-6b322919-cc40-42ed-acbc-267d858f74f3 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:22:55.053696 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-6b322919-cc40-42ed-acbc-267d858f74f3 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:22:55.054404 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-6b322919-cc40-42ed-acbc-267d858f74f3 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:22:55.054883 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-6b322919-cc40-42ed-acbc-267d858f74f3 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:22:55.055306 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-6b322919-cc40-42ed-acbc-267d858f74f3 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:22:55.119328 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-6b322919-cc40-42ed-acbc-267d858f74f3 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:22:55.127818 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-6b322919-cc40-42ed-acbc-267d858f74f3 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.086328 Oct 20 06:22:55.128404 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 938/1856] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:22:55 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:22:55.982473 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-2aedf60e-58f7-4599-bfa0-9f0a114e8f52 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:22:55.983079 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-2aedf60e-58f7-4599-bfa0-9f0a114e8f52 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:22:55.989851 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2aedf60e-58f7-4599-bfa0-9f0a114e8f52 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:22:55.990339 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2aedf60e-58f7-4599-bfa0-9f0a114e8f52 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:22:55.991020 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2aedf60e-58f7-4599-bfa0-9f0a114e8f52 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:22:55.991477 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2aedf60e-58f7-4599-bfa0-9f0a114e8f52 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:22:55.991932 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2aedf60e-58f7-4599-bfa0-9f0a114e8f52 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:22:55.992360 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2aedf60e-58f7-4599-bfa0-9f0a114e8f52 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:22:56.151419 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-ea61ea9f-3418-4162-8e67-c4eaf9970816 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:22:56.152014 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-ea61ea9f-3418-4162-8e67-c4eaf9970816 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:22:56.158827 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ea61ea9f-3418-4162-8e67-c4eaf9970816 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:22:56.159315 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ea61ea9f-3418-4162-8e67-c4eaf9970816 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:22:56.159747 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ea61ea9f-3418-4162-8e67-c4eaf9970816 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:22:56.160483 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ea61ea9f-3418-4162-8e67-c4eaf9970816 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:22:56.160958 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ea61ea9f-3418-4162-8e67-c4eaf9970816 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:22:56.161390 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ea61ea9f-3418-4162-8e67-c4eaf9970816 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:22:56.228475 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-ea61ea9f-3418-4162-8e67-c4eaf9970816 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:22:56.237620 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-ea61ea9f-3418-4162-8e67-c4eaf9970816 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.089951 Oct 20 06:22:56.238328 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 939/1857] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:22:56 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 06:22:56.359126 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-2aedf60e-58f7-4599-bfa0-9f0a114e8f52 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:22:56.368432 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-2aedf60e-58f7-4599-bfa0-9f0a114e8f52 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.389893 Oct 20 06:22:56.369032 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 919/1858] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:22:55 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:22:57.260714 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-5b94132c-cf09-4301-99ea-2821f0c1a9f9 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:22:57.261335 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-5b94132c-cf09-4301-99ea-2821f0c1a9f9 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:22:57.267718 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5b94132c-cf09-4301-99ea-2821f0c1a9f9 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:22:57.268207 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5b94132c-cf09-4301-99ea-2821f0c1a9f9 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:22:57.268649 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5b94132c-cf09-4301-99ea-2821f0c1a9f9 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:22:57.269368 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5b94132c-cf09-4301-99ea-2821f0c1a9f9 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:22:57.269827 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5b94132c-cf09-4301-99ea-2821f0c1a9f9 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:22:57.270257 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5b94132c-cf09-4301-99ea-2821f0c1a9f9 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:22:57.273462 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG dbcounter [-] [118861] Writing DB stats nova_cell1:SELECT=100 {{(pid=118861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:22:57.338743 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-5b94132c-cf09-4301-99ea-2821f0c1a9f9 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:22:57.347064 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-5b94132c-cf09-4301-99ea-2821f0c1a9f9 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.091038 Oct 20 06:22:57.347637 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 940/1859] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:22:57 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:22:57.392605 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-daf8020e-1c29-41ba-a8b1-c5859a915220 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:22:57.393239 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-daf8020e-1c29-41ba-a8b1-c5859a915220 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:22:57.400292 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-daf8020e-1c29-41ba-a8b1-c5859a915220 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:22:57.400789 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-daf8020e-1c29-41ba-a8b1-c5859a915220 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:22:57.401223 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-daf8020e-1c29-41ba-a8b1-c5859a915220 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:22:57.401908 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-daf8020e-1c29-41ba-a8b1-c5859a915220 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:22:57.402351 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-daf8020e-1c29-41ba-a8b1-c5859a915220 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:22:57.402772 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-daf8020e-1c29-41ba-a8b1-c5859a915220 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:22:57.532016 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-daf8020e-1c29-41ba-a8b1-c5859a915220 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:22:57.540303 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-daf8020e-1c29-41ba-a8b1-c5859a915220 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.151581 Oct 20 06:22:57.540907 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 920/1860] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:22:57 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:22:58.368943 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-02fd5cc7-5a6f-4c5a-a67a-f12c50ca167b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:22:58.369575 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-02fd5cc7-5a6f-4c5a-a67a-f12c50ca167b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:22:58.375954 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-02fd5cc7-5a6f-4c5a-a67a-f12c50ca167b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:22:58.376431 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-02fd5cc7-5a6f-4c5a-a67a-f12c50ca167b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:22:58.376893 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-02fd5cc7-5a6f-4c5a-a67a-f12c50ca167b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:22:58.377588 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-02fd5cc7-5a6f-4c5a-a67a-f12c50ca167b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:22:58.378031 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-02fd5cc7-5a6f-4c5a-a67a-f12c50ca167b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:22:58.378451 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-02fd5cc7-5a6f-4c5a-a67a-f12c50ca167b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:22:58.440268 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-02fd5cc7-5a6f-4c5a-a67a-f12c50ca167b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:22:58.448617 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-02fd5cc7-5a6f-4c5a-a67a-f12c50ca167b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.083832 Oct 20 06:22:58.449231 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 941/1861] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:22:58 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:22:58.563547 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-582c3978-83bd-4ddf-9f97-058715feb391 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:22:58.564084 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-582c3978-83bd-4ddf-9f97-058715feb391 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:22:58.570894 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-582c3978-83bd-4ddf-9f97-058715feb391 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:22:58.571384 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-582c3978-83bd-4ddf-9f97-058715feb391 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:22:58.571825 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-582c3978-83bd-4ddf-9f97-058715feb391 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:22:58.572532 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-582c3978-83bd-4ddf-9f97-058715feb391 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:22:58.573019 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-582c3978-83bd-4ddf-9f97-058715feb391 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:22:58.573453 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-582c3978-83bd-4ddf-9f97-058715feb391 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:22:58.704353 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-582c3978-83bd-4ddf-9f97-058715feb391 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:22:58.713096 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-582c3978-83bd-4ddf-9f97-058715feb391 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.153495 Oct 20 06:22:58.713663 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 921/1862] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:22:58 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:22:59.471482 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-87df0f72-ac29-4ad2-9593-4a61348cf525 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:22:59.472102 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-87df0f72-ac29-4ad2-9593-4a61348cf525 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:22:59.474425 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG dbcounter [-] [118861] Writing DB stats nova_api:SELECT=56 {{(pid=118861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:22:59.480439 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-87df0f72-ac29-4ad2-9593-4a61348cf525 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:22:59.480951 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-87df0f72-ac29-4ad2-9593-4a61348cf525 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:22:59.481393 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-87df0f72-ac29-4ad2-9593-4a61348cf525 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:22:59.482131 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-87df0f72-ac29-4ad2-9593-4a61348cf525 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:22:59.482589 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-87df0f72-ac29-4ad2-9593-4a61348cf525 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:22:59.483018 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-87df0f72-ac29-4ad2-9593-4a61348cf525 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:22:59.545347 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-87df0f72-ac29-4ad2-9593-4a61348cf525 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:22:59.554180 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-87df0f72-ac29-4ad2-9593-4a61348cf525 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.086584 Oct 20 06:22:59.554752 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 942/1863] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:22:59 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:22:59.735791 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-b2268c92-5208-422a-b877-b8d7fa5bb5be tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:22:59.736403 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-b2268c92-5208-422a-b877-b8d7fa5bb5be tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:22:59.739081 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG dbcounter [-] [118860] Writing DB stats nova_api:SELECT=52 {{(pid=118860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:22:59.745708 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b2268c92-5208-422a-b877-b8d7fa5bb5be tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:22:59.746205 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b2268c92-5208-422a-b877-b8d7fa5bb5be tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:22:59.746649 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b2268c92-5208-422a-b877-b8d7fa5bb5be tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:22:59.747354 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b2268c92-5208-422a-b877-b8d7fa5bb5be tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:22:59.747809 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b2268c92-5208-422a-b877-b8d7fa5bb5be tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:22:59.748244 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b2268c92-5208-422a-b877-b8d7fa5bb5be tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:22:59.876802 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-b2268c92-5208-422a-b877-b8d7fa5bb5be tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:22:59.885407 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-b2268c92-5208-422a-b877-b8d7fa5bb5be tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.153497 Oct 20 06:22:59.885982 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 922/1864] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:22:59 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:23:00.576676 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-34de3131-2f39-4555-80a5-59a4f943090a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:23:00.577282 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-34de3131-2f39-4555-80a5-59a4f943090a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:23:00.583714 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-34de3131-2f39-4555-80a5-59a4f943090a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:23:00.584953 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-34de3131-2f39-4555-80a5-59a4f943090a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:23:00.585533 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-34de3131-2f39-4555-80a5-59a4f943090a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:23:00.586308 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-34de3131-2f39-4555-80a5-59a4f943090a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:23:00.586707 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-34de3131-2f39-4555-80a5-59a4f943090a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:23:00.587468 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-34de3131-2f39-4555-80a5-59a4f943090a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:23:00.651753 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-34de3131-2f39-4555-80a5-59a4f943090a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:23:00.659874 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-34de3131-2f39-4555-80a5-59a4f943090a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.087170 Oct 20 06:23:00.660431 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 943/1865] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:23:00 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:23:00.909284 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-8eb32212-4cb9-40a1-989b-7886501ff8e4 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:23:00.910591 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-8eb32212-4cb9-40a1-989b-7886501ff8e4 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:23:00.917551 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-8eb32212-4cb9-40a1-989b-7886501ff8e4 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:23:00.918036 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-8eb32212-4cb9-40a1-989b-7886501ff8e4 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:23:00.918471 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-8eb32212-4cb9-40a1-989b-7886501ff8e4 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:23:00.919166 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-8eb32212-4cb9-40a1-989b-7886501ff8e4 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:23:00.919617 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-8eb32212-4cb9-40a1-989b-7886501ff8e4 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:23:00.920040 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-8eb32212-4cb9-40a1-989b-7886501ff8e4 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:23:01.050953 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-8eb32212-4cb9-40a1-989b-7886501ff8e4 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:23:01.060538 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-8eb32212-4cb9-40a1-989b-7886501ff8e4 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.155072 Oct 20 06:23:01.061146 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 923/1866] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:23:00 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:23:01.683473 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-ad78decd-d22c-45f1-a782-5c96caf4c95f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:23:01.684084 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-ad78decd-d22c-45f1-a782-5c96caf4c95f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:23:01.690615 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ad78decd-d22c-45f1-a782-5c96caf4c95f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:23:01.691099 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ad78decd-d22c-45f1-a782-5c96caf4c95f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:23:01.691538 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ad78decd-d22c-45f1-a782-5c96caf4c95f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:23:01.692235 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ad78decd-d22c-45f1-a782-5c96caf4c95f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:23:01.692687 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ad78decd-d22c-45f1-a782-5c96caf4c95f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:23:01.693134 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ad78decd-d22c-45f1-a782-5c96caf4c95f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:23:01.758862 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-ad78decd-d22c-45f1-a782-5c96caf4c95f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:23:01.767202 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-ad78decd-d22c-45f1-a782-5c96caf4c95f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.087615 Oct 20 06:23:01.767785 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 944/1867] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:23:01 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:23:02.084529 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-5b2a8619-7fd9-431e-b252-7a9a675a18ec tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:23:02.085178 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-5b2a8619-7fd9-431e-b252-7a9a675a18ec tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:23:02.091621 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5b2a8619-7fd9-431e-b252-7a9a675a18ec tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:23:02.092091 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5b2a8619-7fd9-431e-b252-7a9a675a18ec tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:23:02.092603 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5b2a8619-7fd9-431e-b252-7a9a675a18ec tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:23:02.093327 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5b2a8619-7fd9-431e-b252-7a9a675a18ec tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:23:02.093781 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5b2a8619-7fd9-431e-b252-7a9a675a18ec tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:23:02.094210 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5b2a8619-7fd9-431e-b252-7a9a675a18ec tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:23:02.228525 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-5b2a8619-7fd9-431e-b252-7a9a675a18ec tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:23:02.236938 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-5b2a8619-7fd9-431e-b252-7a9a675a18ec tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.156656 Oct 20 06:23:02.237512 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 924/1868] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:23:02 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:23:02.791945 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-c95b0eb3-2049-4195-a587-12d2af0d8a18 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:23:02.792561 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-c95b0eb3-2049-4195-a587-12d2af0d8a18 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:23:02.799002 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c95b0eb3-2049-4195-a587-12d2af0d8a18 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:23:02.799487 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c95b0eb3-2049-4195-a587-12d2af0d8a18 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:23:02.799923 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c95b0eb3-2049-4195-a587-12d2af0d8a18 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:23:02.800621 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c95b0eb3-2049-4195-a587-12d2af0d8a18 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:23:02.801144 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c95b0eb3-2049-4195-a587-12d2af0d8a18 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:23:02.801598 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c95b0eb3-2049-4195-a587-12d2af0d8a18 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:23:02.866751 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-c95b0eb3-2049-4195-a587-12d2af0d8a18 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:23:02.875010 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-c95b0eb3-2049-4195-a587-12d2af0d8a18 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.087705 Oct 20 06:23:02.875573 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 945/1869] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:23:02 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:23:03.260385 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-ede7d1af-4ddd-4d4c-a92e-1016ce176ca5 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:23:03.261056 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-ede7d1af-4ddd-4d4c-a92e-1016ce176ca5 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:23:03.267545 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-ede7d1af-4ddd-4d4c-a92e-1016ce176ca5 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:23:03.268030 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-ede7d1af-4ddd-4d4c-a92e-1016ce176ca5 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:23:03.268469 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-ede7d1af-4ddd-4d4c-a92e-1016ce176ca5 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:23:03.269201 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-ede7d1af-4ddd-4d4c-a92e-1016ce176ca5 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:23:03.269655 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-ede7d1af-4ddd-4d4c-a92e-1016ce176ca5 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:23:03.270084 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-ede7d1af-4ddd-4d4c-a92e-1016ce176ca5 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:23:03.398440 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-ede7d1af-4ddd-4d4c-a92e-1016ce176ca5 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:23:03.406677 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-ede7d1af-4ddd-4d4c-a92e-1016ce176ca5 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.151045 Oct 20 06:23:03.407235 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 925/1870] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:23:03 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:23:03.898263 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-f8bc6bbc-e089-4f1f-bf71-5cb8740cdc0b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:23:03.898875 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-f8bc6bbc-e089-4f1f-bf71-5cb8740cdc0b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:23:03.905854 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f8bc6bbc-e089-4f1f-bf71-5cb8740cdc0b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:23:03.906346 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f8bc6bbc-e089-4f1f-bf71-5cb8740cdc0b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:23:03.906783 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f8bc6bbc-e089-4f1f-bf71-5cb8740cdc0b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:23:03.907509 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f8bc6bbc-e089-4f1f-bf71-5cb8740cdc0b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:23:03.907964 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f8bc6bbc-e089-4f1f-bf71-5cb8740cdc0b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:23:03.908391 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f8bc6bbc-e089-4f1f-bf71-5cb8740cdc0b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:23:03.976248 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-f8bc6bbc-e089-4f1f-bf71-5cb8740cdc0b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:23:03.984670 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-f8bc6bbc-e089-4f1f-bf71-5cb8740cdc0b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.090512 Oct 20 06:23:03.985263 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 946/1871] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:23:03 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:23:04.429867 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-25e1a4c9-a7c9-4a24-92c0-f082d3eb4264 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:23:04.430478 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-25e1a4c9-a7c9-4a24-92c0-f082d3eb4264 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:23:04.437146 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-25e1a4c9-a7c9-4a24-92c0-f082d3eb4264 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:23:04.437623 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-25e1a4c9-a7c9-4a24-92c0-f082d3eb4264 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:23:04.438054 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-25e1a4c9-a7c9-4a24-92c0-f082d3eb4264 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:23:04.438743 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-25e1a4c9-a7c9-4a24-92c0-f082d3eb4264 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:23:04.439188 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-25e1a4c9-a7c9-4a24-92c0-f082d3eb4264 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:23:04.439611 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-25e1a4c9-a7c9-4a24-92c0-f082d3eb4264 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:23:04.579356 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-25e1a4c9-a7c9-4a24-92c0-f082d3eb4264 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:23:04.588356 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-25e1a4c9-a7c9-4a24-92c0-f082d3eb4264 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.162528 Oct 20 06:23:04.588971 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 926/1872] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:23:04 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:23:05.008290 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-ecc9e19a-095a-474f-9661-df199fc3601d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:23:05.009201 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-ecc9e19a-095a-474f-9661-df199fc3601d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:23:05.015638 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ecc9e19a-095a-474f-9661-df199fc3601d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:23:05.016115 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ecc9e19a-095a-474f-9661-df199fc3601d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:23:05.016543 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ecc9e19a-095a-474f-9661-df199fc3601d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:23:05.017272 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ecc9e19a-095a-474f-9661-df199fc3601d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:23:05.017716 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ecc9e19a-095a-474f-9661-df199fc3601d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:23:05.018137 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ecc9e19a-095a-474f-9661-df199fc3601d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:23:05.088538 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-ecc9e19a-095a-474f-9661-df199fc3601d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:23:05.097082 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-ecc9e19a-095a-474f-9661-df199fc3601d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.093324 Oct 20 06:23:05.097659 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 947/1873] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:23:05 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:23:05.611681 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-dceeaf5f-03e7-44bf-97a0-98d30115c6b7 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:23:05.613078 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-dceeaf5f-03e7-44bf-97a0-98d30115c6b7 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:23:05.620984 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-dceeaf5f-03e7-44bf-97a0-98d30115c6b7 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:23:05.621467 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-dceeaf5f-03e7-44bf-97a0-98d30115c6b7 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:23:05.621900 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-dceeaf5f-03e7-44bf-97a0-98d30115c6b7 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:23:05.622608 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-dceeaf5f-03e7-44bf-97a0-98d30115c6b7 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:23:05.623056 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-dceeaf5f-03e7-44bf-97a0-98d30115c6b7 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:23:05.623474 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-dceeaf5f-03e7-44bf-97a0-98d30115c6b7 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:23:05.908233 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-dceeaf5f-03e7-44bf-97a0-98d30115c6b7 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:23:05.916913 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-dceeaf5f-03e7-44bf-97a0-98d30115c6b7 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.309207 Oct 20 06:23:05.917483 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 927/1874] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:23:05 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 06:23:06.119623 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-4c6e7d13-4123-45de-a5c0-675ce474d61e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:23:06.120239 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-4c6e7d13-4123-45de-a5c0-675ce474d61e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:23:06.126633 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4c6e7d13-4123-45de-a5c0-675ce474d61e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:23:06.127113 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4c6e7d13-4123-45de-a5c0-675ce474d61e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:23:06.127549 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4c6e7d13-4123-45de-a5c0-675ce474d61e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:23:06.128264 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4c6e7d13-4123-45de-a5c0-675ce474d61e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:23:06.128713 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4c6e7d13-4123-45de-a5c0-675ce474d61e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:23:06.129137 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4c6e7d13-4123-45de-a5c0-675ce474d61e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:23:06.193940 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-4c6e7d13-4123-45de-a5c0-675ce474d61e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:23:06.202521 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-4c6e7d13-4123-45de-a5c0-675ce474d61e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.086954 Oct 20 06:23:06.203093 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 948/1875] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:23:06 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:23:06.941476 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-15247835-9507-4381-9fc1-a4452e2be636 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:23:06.942084 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-15247835-9507-4381-9fc1-a4452e2be636 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:23:06.948621 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-15247835-9507-4381-9fc1-a4452e2be636 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:23:06.949131 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-15247835-9507-4381-9fc1-a4452e2be636 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:23:06.949567 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-15247835-9507-4381-9fc1-a4452e2be636 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:23:06.950255 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-15247835-9507-4381-9fc1-a4452e2be636 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:23:06.950702 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-15247835-9507-4381-9fc1-a4452e2be636 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:23:06.951152 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-15247835-9507-4381-9fc1-a4452e2be636 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:23:07.083670 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-15247835-9507-4381-9fc1-a4452e2be636 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:23:07.092589 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-15247835-9507-4381-9fc1-a4452e2be636 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.155356 Oct 20 06:23:07.093192 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 928/1876] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:23:06 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:23:07.226233 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-5eaa39be-5a3a-457a-a655-339b09389a29 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:23:07.226950 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-5eaa39be-5a3a-457a-a655-339b09389a29 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:23:07.233586 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5eaa39be-5a3a-457a-a655-339b09389a29 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:23:07.234074 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5eaa39be-5a3a-457a-a655-339b09389a29 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:23:07.234515 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5eaa39be-5a3a-457a-a655-339b09389a29 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:23:07.235219 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5eaa39be-5a3a-457a-a655-339b09389a29 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:23:07.235671 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5eaa39be-5a3a-457a-a655-339b09389a29 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:23:07.236099 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5eaa39be-5a3a-457a-a655-339b09389a29 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:23:07.304453 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-5eaa39be-5a3a-457a-a655-339b09389a29 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:23:07.310867 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-5eaa39be-5a3a-457a-a655-339b09389a29 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.088865 Oct 20 06:23:07.311438 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 949/1877] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:23:07 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:23:08.116503 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-ab1c26b6-be1a-42d1-a1b8-616226af46a1 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:23:08.117138 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-ab1c26b6-be1a-42d1-a1b8-616226af46a1 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:23:08.123658 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-ab1c26b6-be1a-42d1-a1b8-616226af46a1 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:23:08.124133 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-ab1c26b6-be1a-42d1-a1b8-616226af46a1 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:23:08.124560 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-ab1c26b6-be1a-42d1-a1b8-616226af46a1 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:23:08.125287 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-ab1c26b6-be1a-42d1-a1b8-616226af46a1 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:23:08.125737 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-ab1c26b6-be1a-42d1-a1b8-616226af46a1 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:23:08.126157 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-ab1c26b6-be1a-42d1-a1b8-616226af46a1 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:23:08.257434 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-ab1c26b6-be1a-42d1-a1b8-616226af46a1 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:23:08.259983 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG dbcounter [-] [118860] Writing DB stats nova_cell1:SELECT=100 {{(pid=118860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:23:08.267455 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-ab1c26b6-be1a-42d1-a1b8-616226af46a1 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.155306 Oct 20 06:23:08.268022 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 929/1878] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:23:08 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:23:08.334913 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-0a7e741b-29b2-4176-adbd-8b25e8a04695 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:23:08.335529 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-0a7e741b-29b2-4176-adbd-8b25e8a04695 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:23:08.342507 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-0a7e741b-29b2-4176-adbd-8b25e8a04695 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:23:08.342988 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-0a7e741b-29b2-4176-adbd-8b25e8a04695 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:23:08.343423 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-0a7e741b-29b2-4176-adbd-8b25e8a04695 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:23:08.344120 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-0a7e741b-29b2-4176-adbd-8b25e8a04695 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:23:08.344570 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-0a7e741b-29b2-4176-adbd-8b25e8a04695 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:23:08.345041 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-0a7e741b-29b2-4176-adbd-8b25e8a04695 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:23:08.407098 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-0a7e741b-29b2-4176-adbd-8b25e8a04695 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:23:08.416018 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-0a7e741b-29b2-4176-adbd-8b25e8a04695 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.085566 Oct 20 06:23:08.416592 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 950/1879] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:23:08 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:23:09.291846 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-b542422c-ea8c-4e9f-b744-4a1076497d30 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:23:09.292444 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-b542422c-ea8c-4e9f-b744-4a1076497d30 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:23:09.299074 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b542422c-ea8c-4e9f-b744-4a1076497d30 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:23:09.299558 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b542422c-ea8c-4e9f-b744-4a1076497d30 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:23:09.299988 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b542422c-ea8c-4e9f-b744-4a1076497d30 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:23:09.300715 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b542422c-ea8c-4e9f-b744-4a1076497d30 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:23:09.301176 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b542422c-ea8c-4e9f-b744-4a1076497d30 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:23:09.301601 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b542422c-ea8c-4e9f-b744-4a1076497d30 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:23:09.424980 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 20 06:23:09.425194 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: Thu Oct 20 06:23:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f (ip 10.222.0.20) !!! Oct 20 06:23:09.435370 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-b542422c-ea8c-4e9f-b744-4a1076497d30 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:23:09.438415 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-835c6737-3c83-43b1-abcc-fe4296f03374 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:23:09.439041 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-835c6737-3c83-43b1-abcc-fe4296f03374 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:23:09.444461 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-b542422c-ea8c-4e9f-b744-4a1076497d30 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.156492 Oct 20 06:23:09.445118 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 930/1880] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:23:09 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:23:09.449465 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-835c6737-3c83-43b1-abcc-fe4296f03374 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:23:09.450099 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-835c6737-3c83-43b1-abcc-fe4296f03374 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:23:09.450545 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-835c6737-3c83-43b1-abcc-fe4296f03374 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:23:09.451260 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-835c6737-3c83-43b1-abcc-fe4296f03374 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:23:09.451717 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-835c6737-3c83-43b1-abcc-fe4296f03374 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:23:09.452147 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-835c6737-3c83-43b1-abcc-fe4296f03374 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:23:09.514321 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-835c6737-3c83-43b1-abcc-fe4296f03374 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:23:09.522654 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-835c6737-3c83-43b1-abcc-fe4296f03374 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.088025 Oct 20 06:23:09.523204 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 951/1881] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:23:09 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 06:23:10.467456 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-5283c87f-c04e-4217-a469-188a43b68235 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:23:10.468094 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-5283c87f-c04e-4217-a469-188a43b68235 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:23:10.474682 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5283c87f-c04e-4217-a469-188a43b68235 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:23:10.475170 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5283c87f-c04e-4217-a469-188a43b68235 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:23:10.475599 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5283c87f-c04e-4217-a469-188a43b68235 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:23:10.476295 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5283c87f-c04e-4217-a469-188a43b68235 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:23:10.476771 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5283c87f-c04e-4217-a469-188a43b68235 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:23:10.477199 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5283c87f-c04e-4217-a469-188a43b68235 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:23:10.546548 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-37a5c85a-d028-4187-bc47-cbbe75795e43 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:23:10.547594 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-37a5c85a-d028-4187-bc47-cbbe75795e43 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:23:10.554604 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-37a5c85a-d028-4187-bc47-cbbe75795e43 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:23:10.555025 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-37a5c85a-d028-4187-bc47-cbbe75795e43 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:23:10.555553 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-37a5c85a-d028-4187-bc47-cbbe75795e43 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:23:10.556203 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-37a5c85a-d028-4187-bc47-cbbe75795e43 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:23:10.556681 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-37a5c85a-d028-4187-bc47-cbbe75795e43 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:23:10.557284 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-37a5c85a-d028-4187-bc47-cbbe75795e43 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:23:10.637318 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-37a5c85a-d028-4187-bc47-cbbe75795e43 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:23:10.640590 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-5283c87f-c04e-4217-a469-188a43b68235 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:23:10.649428 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-5283c87f-c04e-4217-a469-188a43b68235 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.185859 Oct 20 06:23:10.649994 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 931/1882] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:23:10 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:23:10.657865 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-37a5c85a-d028-4187-bc47-cbbe75795e43 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.115098 Oct 20 06:23:10.658438 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 952/1883] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:23:10 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 06:23:11.673138 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-3c98b00f-7f07-4ee4-9fc9-0419c21797ef tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:23:11.673863 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-3c98b00f-7f07-4ee4-9fc9-0419c21797ef tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:23:11.680155 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-66981b56-a776-455d-afb1-c0a1f0729467 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:23:11.680777 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3c98b00f-7f07-4ee4-9fc9-0419c21797ef tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:23:11.680924 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-66981b56-a776-455d-afb1-c0a1f0729467 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:23:11.681261 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3c98b00f-7f07-4ee4-9fc9-0419c21797ef tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:23:11.681693 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3c98b00f-7f07-4ee4-9fc9-0419c21797ef tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:23:11.682388 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3c98b00f-7f07-4ee4-9fc9-0419c21797ef tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:23:11.682837 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3c98b00f-7f07-4ee4-9fc9-0419c21797ef tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:23:11.683257 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3c98b00f-7f07-4ee4-9fc9-0419c21797ef tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:23:11.687633 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-66981b56-a776-455d-afb1-c0a1f0729467 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:23:11.688113 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-66981b56-a776-455d-afb1-c0a1f0729467 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:23:11.688549 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-66981b56-a776-455d-afb1-c0a1f0729467 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:23:11.689269 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-66981b56-a776-455d-afb1-c0a1f0729467 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:23:11.689716 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-66981b56-a776-455d-afb1-c0a1f0729467 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:23:11.690322 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-66981b56-a776-455d-afb1-c0a1f0729467 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:23:11.759835 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-66981b56-a776-455d-afb1-c0a1f0729467 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:23:11.769585 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-66981b56-a776-455d-afb1-c0a1f0729467 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.094071 Oct 20 06:23:11.770240 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 953/1884] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:23:11 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:23:11.813547 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-3c98b00f-7f07-4ee4-9fc9-0419c21797ef tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:23:11.822202 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-3c98b00f-7f07-4ee4-9fc9-0419c21797ef tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.152948 Oct 20 06:23:11.822758 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 932/1885] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:23:11 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:23:12.792412 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-a288d42a-dfd7-42bc-8675-22d03c010e7a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:23:12.793097 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-a288d42a-dfd7-42bc-8675-22d03c010e7a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:23:12.799422 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a288d42a-dfd7-42bc-8675-22d03c010e7a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:23:12.799902 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a288d42a-dfd7-42bc-8675-22d03c010e7a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:23:12.800336 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a288d42a-dfd7-42bc-8675-22d03c010e7a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:23:12.801056 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a288d42a-dfd7-42bc-8675-22d03c010e7a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:23:12.801507 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a288d42a-dfd7-42bc-8675-22d03c010e7a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:23:12.801930 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a288d42a-dfd7-42bc-8675-22d03c010e7a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:23:12.846008 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-6b70d452-3c12-4fa8-8203-61ac0da65db9 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:23:12.846618 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-6b70d452-3c12-4fa8-8203-61ac0da65db9 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:23:12.854954 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-6b70d452-3c12-4fa8-8203-61ac0da65db9 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:23:12.855828 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-6b70d452-3c12-4fa8-8203-61ac0da65db9 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:23:12.856267 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-6b70d452-3c12-4fa8-8203-61ac0da65db9 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:23:12.857031 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-6b70d452-3c12-4fa8-8203-61ac0da65db9 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:23:12.857483 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-6b70d452-3c12-4fa8-8203-61ac0da65db9 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:23:12.857906 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-6b70d452-3c12-4fa8-8203-61ac0da65db9 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:23:12.874267 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-a288d42a-dfd7-42bc-8675-22d03c010e7a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:23:12.882960 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-a288d42a-dfd7-42bc-8675-22d03c010e7a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.094403 Oct 20 06:23:12.883817 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 954/1886] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:23:12 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:23:12.997874 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-6b70d452-3c12-4fa8-8203-61ac0da65db9 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:23:13.006805 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-6b70d452-3c12-4fa8-8203-61ac0da65db9 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.164665 Oct 20 06:23:13.007371 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 933/1887] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:23:12 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 06:23:13.907396 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-c64b2887-a0f7-40e6-8387-ec6c44663107 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:23:13.908016 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-c64b2887-a0f7-40e6-8387-ec6c44663107 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:23:13.915095 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c64b2887-a0f7-40e6-8387-ec6c44663107 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:23:13.915581 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c64b2887-a0f7-40e6-8387-ec6c44663107 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:23:13.916023 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c64b2887-a0f7-40e6-8387-ec6c44663107 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:23:13.916743 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c64b2887-a0f7-40e6-8387-ec6c44663107 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:23:13.917199 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c64b2887-a0f7-40e6-8387-ec6c44663107 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:23:13.917630 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c64b2887-a0f7-40e6-8387-ec6c44663107 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:23:13.980614 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-c64b2887-a0f7-40e6-8387-ec6c44663107 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:23:13.989276 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-c64b2887-a0f7-40e6-8387-ec6c44663107 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.085744 Oct 20 06:23:13.990681 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 955/1888] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:23:13 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:23:14.030920 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-85258bd2-b833-42db-88c1-47bb71efbb4e tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:23:14.031528 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-85258bd2-b833-42db-88c1-47bb71efbb4e tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:23:14.038450 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-85258bd2-b833-42db-88c1-47bb71efbb4e tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:23:14.038933 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-85258bd2-b833-42db-88c1-47bb71efbb4e tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:23:14.039367 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-85258bd2-b833-42db-88c1-47bb71efbb4e tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:23:14.040063 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-85258bd2-b833-42db-88c1-47bb71efbb4e tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:23:14.040514 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-85258bd2-b833-42db-88c1-47bb71efbb4e tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:23:14.040962 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-85258bd2-b833-42db-88c1-47bb71efbb4e tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:23:14.173751 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-85258bd2-b833-42db-88c1-47bb71efbb4e tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:23:14.182463 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-85258bd2-b833-42db-88c1-47bb71efbb4e tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.155411 Oct 20 06:23:14.183032 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 934/1889] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:23:14 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:23:15.012476 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-86d1a930-3d0a-4b77-ab5d-035be3a319f1 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:23:15.013144 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-86d1a930-3d0a-4b77-ab5d-035be3a319f1 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:23:15.019378 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-86d1a930-3d0a-4b77-ab5d-035be3a319f1 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:23:15.019855 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-86d1a930-3d0a-4b77-ab5d-035be3a319f1 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:23:15.020286 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-86d1a930-3d0a-4b77-ab5d-035be3a319f1 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:23:15.021001 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-86d1a930-3d0a-4b77-ab5d-035be3a319f1 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:23:15.021488 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-86d1a930-3d0a-4b77-ab5d-035be3a319f1 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:23:15.021908 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-86d1a930-3d0a-4b77-ab5d-035be3a319f1 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:23:15.085552 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-86d1a930-3d0a-4b77-ab5d-035be3a319f1 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:23:15.087708 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG dbcounter [-] [118861] Writing DB stats nova_cell1:SELECT=100 {{(pid=118861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:23:15.095751 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-86d1a930-3d0a-4b77-ab5d-035be3a319f1 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.087657 Oct 20 06:23:15.096324 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 956/1890] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:23:15 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:23:15.206283 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-73a54552-0ffb-4dc7-aa65-d9bcbe4a3397 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:23:15.206917 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-73a54552-0ffb-4dc7-aa65-d9bcbe4a3397 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:23:15.213774 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-73a54552-0ffb-4dc7-aa65-d9bcbe4a3397 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:23:15.214257 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-73a54552-0ffb-4dc7-aa65-d9bcbe4a3397 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:23:15.214695 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-73a54552-0ffb-4dc7-aa65-d9bcbe4a3397 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:23:15.215392 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-73a54552-0ffb-4dc7-aa65-d9bcbe4a3397 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:23:15.215845 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-73a54552-0ffb-4dc7-aa65-d9bcbe4a3397 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:23:15.216271 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-73a54552-0ffb-4dc7-aa65-d9bcbe4a3397 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:23:15.355022 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-73a54552-0ffb-4dc7-aa65-d9bcbe4a3397 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:23:15.363705 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-73a54552-0ffb-4dc7-aa65-d9bcbe4a3397 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.161356 Oct 20 06:23:15.364305 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 935/1891] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:23:15 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:23:16.119346 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-58caf1ea-be8a-4c4b-b87e-04328e83cf6b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:23:16.119892 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-58caf1ea-be8a-4c4b-b87e-04328e83cf6b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:23:16.126860 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-58caf1ea-be8a-4c4b-b87e-04328e83cf6b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:23:16.127342 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-58caf1ea-be8a-4c4b-b87e-04328e83cf6b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:23:16.127776 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-58caf1ea-be8a-4c4b-b87e-04328e83cf6b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:23:16.128477 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-58caf1ea-be8a-4c4b-b87e-04328e83cf6b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:23:16.128974 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-58caf1ea-be8a-4c4b-b87e-04328e83cf6b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:23:16.129402 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-58caf1ea-be8a-4c4b-b87e-04328e83cf6b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:23:16.196147 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-58caf1ea-be8a-4c4b-b87e-04328e83cf6b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:23:16.204797 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-58caf1ea-be8a-4c4b-b87e-04328e83cf6b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.090708 Oct 20 06:23:16.205375 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 957/1892] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:23:16 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:23:16.387779 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-8bb3ce42-f077-4b32-8a79-4bbbb5d39f18 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:23:16.388405 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-8bb3ce42-f077-4b32-8a79-4bbbb5d39f18 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:23:16.395016 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-8bb3ce42-f077-4b32-8a79-4bbbb5d39f18 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:23:16.395507 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-8bb3ce42-f077-4b32-8a79-4bbbb5d39f18 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:23:16.395988 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-8bb3ce42-f077-4b32-8a79-4bbbb5d39f18 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:23:16.397295 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-8bb3ce42-f077-4b32-8a79-4bbbb5d39f18 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:23:16.397741 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-8bb3ce42-f077-4b32-8a79-4bbbb5d39f18 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:23:16.398197 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-8bb3ce42-f077-4b32-8a79-4bbbb5d39f18 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:23:16.533609 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-8bb3ce42-f077-4b32-8a79-4bbbb5d39f18 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:23:16.542034 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-8bb3ce42-f077-4b32-8a79-4bbbb5d39f18 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.158384 Oct 20 06:23:16.542797 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 936/1893] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:23:16 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:23:17.227787 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-94fb380a-3b1b-404d-83dd-a78f9f05e289 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:23:17.228405 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-94fb380a-3b1b-404d-83dd-a78f9f05e289 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:23:17.234812 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-94fb380a-3b1b-404d-83dd-a78f9f05e289 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:23:17.235300 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-94fb380a-3b1b-404d-83dd-a78f9f05e289 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:23:17.235773 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-94fb380a-3b1b-404d-83dd-a78f9f05e289 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:23:17.236501 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-94fb380a-3b1b-404d-83dd-a78f9f05e289 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:23:17.236981 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-94fb380a-3b1b-404d-83dd-a78f9f05e289 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:23:17.237411 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-94fb380a-3b1b-404d-83dd-a78f9f05e289 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:23:17.301696 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-94fb380a-3b1b-404d-83dd-a78f9f05e289 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:23:17.312884 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-94fb380a-3b1b-404d-83dd-a78f9f05e289 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.089052 Oct 20 06:23:17.313477 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 958/1894] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:23:17 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:23:17.565813 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-c9ea4c53-45e4-432f-bf15-9069dcf77349 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:23:17.566417 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-c9ea4c53-45e4-432f-bf15-9069dcf77349 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:23:17.574061 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c9ea4c53-45e4-432f-bf15-9069dcf77349 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:23:17.574553 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c9ea4c53-45e4-432f-bf15-9069dcf77349 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:23:17.574994 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c9ea4c53-45e4-432f-bf15-9069dcf77349 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:23:17.575701 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c9ea4c53-45e4-432f-bf15-9069dcf77349 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:23:17.576154 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c9ea4c53-45e4-432f-bf15-9069dcf77349 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:23:17.576581 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c9ea4c53-45e4-432f-bf15-9069dcf77349 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:23:17.711816 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-c9ea4c53-45e4-432f-bf15-9069dcf77349 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:23:17.720174 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-c9ea4c53-45e4-432f-bf15-9069dcf77349 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.158231 Oct 20 06:23:17.720830 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 937/1895] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:23:17 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:23:18.335752 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-26f172f8-c182-4b70-89dd-c150070141d6 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:23:18.336390 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-26f172f8-c182-4b70-89dd-c150070141d6 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:23:18.342861 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-26f172f8-c182-4b70-89dd-c150070141d6 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:23:18.343335 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-26f172f8-c182-4b70-89dd-c150070141d6 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:23:18.343764 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-26f172f8-c182-4b70-89dd-c150070141d6 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:23:18.344446 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-26f172f8-c182-4b70-89dd-c150070141d6 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:23:18.344923 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-26f172f8-c182-4b70-89dd-c150070141d6 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:23:18.345341 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-26f172f8-c182-4b70-89dd-c150070141d6 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:23:18.410279 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-26f172f8-c182-4b70-89dd-c150070141d6 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:23:18.419084 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-26f172f8-c182-4b70-89dd-c150070141d6 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.087356 Oct 20 06:23:18.419652 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 959/1896] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:23:18 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:23:18.746477 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-674fd913-28bd-46da-be21-b75d6a4bf0b0 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:23:18.747098 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-674fd913-28bd-46da-be21-b75d6a4bf0b0 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:23:18.753400 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-674fd913-28bd-46da-be21-b75d6a4bf0b0 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:23:18.753890 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-674fd913-28bd-46da-be21-b75d6a4bf0b0 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:23:18.754333 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-674fd913-28bd-46da-be21-b75d6a4bf0b0 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:23:18.755039 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-674fd913-28bd-46da-be21-b75d6a4bf0b0 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:23:18.756146 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-674fd913-28bd-46da-be21-b75d6a4bf0b0 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:23:18.756583 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-674fd913-28bd-46da-be21-b75d6a4bf0b0 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:23:18.888831 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-674fd913-28bd-46da-be21-b75d6a4bf0b0 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:23:18.897404 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-674fd913-28bd-46da-be21-b75d6a4bf0b0 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.156347 Oct 20 06:23:18.897965 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 938/1897] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:23:18 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:23:19.442279 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-caf69601-994a-4715-bc9a-43e3b3a32abc tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:23:19.442825 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-caf69601-994a-4715-bc9a-43e3b3a32abc tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:23:19.449815 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-caf69601-994a-4715-bc9a-43e3b3a32abc tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:23:19.450289 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-caf69601-994a-4715-bc9a-43e3b3a32abc tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:23:19.450719 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-caf69601-994a-4715-bc9a-43e3b3a32abc tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:23:19.451403 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-caf69601-994a-4715-bc9a-43e3b3a32abc tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:23:19.451849 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-caf69601-994a-4715-bc9a-43e3b3a32abc tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:23:19.452266 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-caf69601-994a-4715-bc9a-43e3b3a32abc tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:23:19.516636 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-caf69601-994a-4715-bc9a-43e3b3a32abc tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:23:19.524963 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-caf69601-994a-4715-bc9a-43e3b3a32abc tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.086532 Oct 20 06:23:19.525521 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 960/1898] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:23:19 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:23:19.921429 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-cb3075a9-b08e-4cb8-84fd-e00f6f594844 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:23:19.922037 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-cb3075a9-b08e-4cb8-84fd-e00f6f594844 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:23:19.928949 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-cb3075a9-b08e-4cb8-84fd-e00f6f594844 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:23:19.929429 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-cb3075a9-b08e-4cb8-84fd-e00f6f594844 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:23:19.929862 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-cb3075a9-b08e-4cb8-84fd-e00f6f594844 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:23:19.930582 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-cb3075a9-b08e-4cb8-84fd-e00f6f594844 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:23:19.931029 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-cb3075a9-b08e-4cb8-84fd-e00f6f594844 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:23:19.931448 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-cb3075a9-b08e-4cb8-84fd-e00f6f594844 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:23:20.062283 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-cb3075a9-b08e-4cb8-84fd-e00f6f594844 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:23:20.070844 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-cb3075a9-b08e-4cb8-84fd-e00f6f594844 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.153228 Oct 20 06:23:20.071528 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 939/1899] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:23:19 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:23:20.547916 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-61448776-06df-475e-ad68-d09e655afe03 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:23:20.548744 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-61448776-06df-475e-ad68-d09e655afe03 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:23:20.556729 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-61448776-06df-475e-ad68-d09e655afe03 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:23:20.557175 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-61448776-06df-475e-ad68-d09e655afe03 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:23:20.557616 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-61448776-06df-475e-ad68-d09e655afe03 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:23:20.558340 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-61448776-06df-475e-ad68-d09e655afe03 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:23:20.558784 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-61448776-06df-475e-ad68-d09e655afe03 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:23:20.559216 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-61448776-06df-475e-ad68-d09e655afe03 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:23:20.624204 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-61448776-06df-475e-ad68-d09e655afe03 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:23:20.633574 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-61448776-06df-475e-ad68-d09e655afe03 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.089710 Oct 20 06:23:20.634419 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 961/1900] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:23:20 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:23:21.095111 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-87b3bc3c-0fd8-47be-abd4-cc7e4896dd8e tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:23:21.095830 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-87b3bc3c-0fd8-47be-abd4-cc7e4896dd8e tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:23:21.102090 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-87b3bc3c-0fd8-47be-abd4-cc7e4896dd8e tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:23:21.102570 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-87b3bc3c-0fd8-47be-abd4-cc7e4896dd8e tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:23:21.103009 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-87b3bc3c-0fd8-47be-abd4-cc7e4896dd8e tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:23:21.103701 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-87b3bc3c-0fd8-47be-abd4-cc7e4896dd8e tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:23:21.104153 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-87b3bc3c-0fd8-47be-abd4-cc7e4896dd8e tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:23:21.104578 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-87b3bc3c-0fd8-47be-abd4-cc7e4896dd8e tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:23:21.236913 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-87b3bc3c-0fd8-47be-abd4-cc7e4896dd8e tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:23:21.245838 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-87b3bc3c-0fd8-47be-abd4-cc7e4896dd8e tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.154670 Oct 20 06:23:21.246408 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 940/1901] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:23:21 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:23:21.656414 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-027dc410-dbc1-4720-a50a-368b720df4c6 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:23:21.657206 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-027dc410-dbc1-4720-a50a-368b720df4c6 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:23:21.664284 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-027dc410-dbc1-4720-a50a-368b720df4c6 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:23:21.664799 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-027dc410-dbc1-4720-a50a-368b720df4c6 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:23:21.665231 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-027dc410-dbc1-4720-a50a-368b720df4c6 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:23:21.665918 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-027dc410-dbc1-4720-a50a-368b720df4c6 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:23:21.666360 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-027dc410-dbc1-4720-a50a-368b720df4c6 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:23:21.666776 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-027dc410-dbc1-4720-a50a-368b720df4c6 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:23:21.727957 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-027dc410-dbc1-4720-a50a-368b720df4c6 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:23:21.736166 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-027dc410-dbc1-4720-a50a-368b720df4c6 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.083606 Oct 20 06:23:21.736762 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 962/1902] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:23:21 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:23:22.269410 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-6ffe206e-52e4-48e4-80df-7658dc247460 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:23:22.270020 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-6ffe206e-52e4-48e4-80df-7658dc247460 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:23:22.277776 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-6ffe206e-52e4-48e4-80df-7658dc247460 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:23:22.278256 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-6ffe206e-52e4-48e4-80df-7658dc247460 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:23:22.278692 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-6ffe206e-52e4-48e4-80df-7658dc247460 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:23:22.279386 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-6ffe206e-52e4-48e4-80df-7658dc247460 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:23:22.279838 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-6ffe206e-52e4-48e4-80df-7658dc247460 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:23:22.280262 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-6ffe206e-52e4-48e4-80df-7658dc247460 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:23:22.416912 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-6ffe206e-52e4-48e4-80df-7658dc247460 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:23:22.425142 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-6ffe206e-52e4-48e4-80df-7658dc247460 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.159588 Oct 20 06:23:22.425713 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 941/1903] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:23:22 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:23:22.758998 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-1c982c5c-6da0-486c-827e-b8536e104291 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:23:22.759615 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-1c982c5c-6da0-486c-827e-b8536e104291 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:23:22.766119 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1c982c5c-6da0-486c-827e-b8536e104291 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:23:22.766600 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1c982c5c-6da0-486c-827e-b8536e104291 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:23:22.767037 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1c982c5c-6da0-486c-827e-b8536e104291 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:23:22.767734 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1c982c5c-6da0-486c-827e-b8536e104291 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:23:22.768185 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1c982c5c-6da0-486c-827e-b8536e104291 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:23:22.768611 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1c982c5c-6da0-486c-827e-b8536e104291 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:23:22.830746 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-1c982c5c-6da0-486c-827e-b8536e104291 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:23:22.839896 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-1c982c5c-6da0-486c-827e-b8536e104291 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.085537 Oct 20 06:23:22.840468 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 963/1904] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:23:22 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:23:23.449400 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-211c32ba-9125-47b7-8005-6bfd619a0f84 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:23:23.450021 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-211c32ba-9125-47b7-8005-6bfd619a0f84 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:23:23.456736 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-211c32ba-9125-47b7-8005-6bfd619a0f84 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:23:23.457234 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-211c32ba-9125-47b7-8005-6bfd619a0f84 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:23:23.457671 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-211c32ba-9125-47b7-8005-6bfd619a0f84 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:23:23.458444 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-211c32ba-9125-47b7-8005-6bfd619a0f84 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:23:23.459024 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-211c32ba-9125-47b7-8005-6bfd619a0f84 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:23:23.459453 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-211c32ba-9125-47b7-8005-6bfd619a0f84 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:23:23.587848 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-211c32ba-9125-47b7-8005-6bfd619a0f84 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:23:23.596102 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-211c32ba-9125-47b7-8005-6bfd619a0f84 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.150639 Oct 20 06:23:23.596677 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 942/1905] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:23:23 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:23:23.862668 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-0d62f981-c087-4b77-80ae-a6b76d5b15f7 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:23:23.863207 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-0d62f981-c087-4b77-80ae-a6b76d5b15f7 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:23:23.869813 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-0d62f981-c087-4b77-80ae-a6b76d5b15f7 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:23:23.870278 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-0d62f981-c087-4b77-80ae-a6b76d5b15f7 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:23:23.870716 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-0d62f981-c087-4b77-80ae-a6b76d5b15f7 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:23:23.871418 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-0d62f981-c087-4b77-80ae-a6b76d5b15f7 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:23:23.871872 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-0d62f981-c087-4b77-80ae-a6b76d5b15f7 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:23:23.872298 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-0d62f981-c087-4b77-80ae-a6b76d5b15f7 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:23:23.937647 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-0d62f981-c087-4b77-80ae-a6b76d5b15f7 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:23:23.945992 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-0d62f981-c087-4b77-80ae-a6b76d5b15f7 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.087310 Oct 20 06:23:23.946563 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 964/1906] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:23:23 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:23:24.620230 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-faad3dee-3691-4a6b-ba48-076c4092e81f tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:23:24.620806 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-faad3dee-3691-4a6b-ba48-076c4092e81f tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:23:24.627175 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-faad3dee-3691-4a6b-ba48-076c4092e81f tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:23:24.627651 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-faad3dee-3691-4a6b-ba48-076c4092e81f tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:23:24.628083 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-faad3dee-3691-4a6b-ba48-076c4092e81f tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:23:24.628794 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-faad3dee-3691-4a6b-ba48-076c4092e81f tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:23:24.629245 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-faad3dee-3691-4a6b-ba48-076c4092e81f tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:23:24.629667 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-faad3dee-3691-4a6b-ba48-076c4092e81f tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:23:24.763175 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-faad3dee-3691-4a6b-ba48-076c4092e81f tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:23:24.772727 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-faad3dee-3691-4a6b-ba48-076c4092e81f tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.156440 Oct 20 06:23:24.773318 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 943/1907] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:23:24 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 06:23:24.969316 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-627bddef-7617-46a6-8f63-aa9c249e65e4 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:23:24.969934 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-627bddef-7617-46a6-8f63-aa9c249e65e4 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:23:24.977244 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-627bddef-7617-46a6-8f63-aa9c249e65e4 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:23:24.977730 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-627bddef-7617-46a6-8f63-aa9c249e65e4 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:23:24.978167 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-627bddef-7617-46a6-8f63-aa9c249e65e4 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:23:24.978875 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-627bddef-7617-46a6-8f63-aa9c249e65e4 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:23:24.979331 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-627bddef-7617-46a6-8f63-aa9c249e65e4 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:23:24.979756 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-627bddef-7617-46a6-8f63-aa9c249e65e4 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:23:25.042078 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-627bddef-7617-46a6-8f63-aa9c249e65e4 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:23:25.050587 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-627bddef-7617-46a6-8f63-aa9c249e65e4 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.085036 Oct 20 06:23:25.051375 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 965/1908] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:23:24 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:23:25.796589 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-32ccf3f5-53c8-476c-a073-a10a1b2cde2c tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:23:25.797361 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-32ccf3f5-53c8-476c-a073-a10a1b2cde2c tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:23:25.804488 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-32ccf3f5-53c8-476c-a073-a10a1b2cde2c tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:23:25.805000 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-32ccf3f5-53c8-476c-a073-a10a1b2cde2c tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:23:25.805442 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-32ccf3f5-53c8-476c-a073-a10a1b2cde2c tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:23:25.806174 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-32ccf3f5-53c8-476c-a073-a10a1b2cde2c tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:23:25.806634 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-32ccf3f5-53c8-476c-a073-a10a1b2cde2c tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:23:25.807065 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-32ccf3f5-53c8-476c-a073-a10a1b2cde2c tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:23:25.937377 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-32ccf3f5-53c8-476c-a073-a10a1b2cde2c tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:23:25.945715 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-32ccf3f5-53c8-476c-a073-a10a1b2cde2c tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.153013 Oct 20 06:23:25.946275 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 944/1909] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:23:25 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:23:26.074185 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-facc5fa7-0de2-488e-9705-da0f761ea5f1 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:23:26.074778 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-facc5fa7-0de2-488e-9705-da0f761ea5f1 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:23:26.081191 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-facc5fa7-0de2-488e-9705-da0f761ea5f1 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:23:26.081665 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-facc5fa7-0de2-488e-9705-da0f761ea5f1 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:23:26.082094 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-facc5fa7-0de2-488e-9705-da0f761ea5f1 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:23:26.082779 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-facc5fa7-0de2-488e-9705-da0f761ea5f1 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:23:26.083223 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-facc5fa7-0de2-488e-9705-da0f761ea5f1 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:23:26.084288 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-facc5fa7-0de2-488e-9705-da0f761ea5f1 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:23:26.147523 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-facc5fa7-0de2-488e-9705-da0f761ea5f1 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:23:26.155959 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-facc5fa7-0de2-488e-9705-da0f761ea5f1 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.085778 Oct 20 06:23:26.156526 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 966/1910] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:23:26 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:23:26.968719 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-413f72f7-fa76-4f6b-a65b-581be1c34e3b tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:23:26.969435 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-413f72f7-fa76-4f6b-a65b-581be1c34e3b tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:23:26.976868 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-413f72f7-fa76-4f6b-a65b-581be1c34e3b tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:23:26.977356 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-413f72f7-fa76-4f6b-a65b-581be1c34e3b tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:23:26.977795 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-413f72f7-fa76-4f6b-a65b-581be1c34e3b tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:23:26.978494 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-413f72f7-fa76-4f6b-a65b-581be1c34e3b tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:23:26.978950 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-413f72f7-fa76-4f6b-a65b-581be1c34e3b tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:23:26.979378 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-413f72f7-fa76-4f6b-a65b-581be1c34e3b tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:23:27.121124 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-413f72f7-fa76-4f6b-a65b-581be1c34e3b tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:23:27.130100 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-413f72f7-fa76-4f6b-a65b-581be1c34e3b tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.165253 Oct 20 06:23:27.131218 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 945/1911] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:23:26 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:23:27.180046 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-c3af9a51-7795-4275-8dd7-4159bf9e3b5e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:23:27.180661 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-c3af9a51-7795-4275-8dd7-4159bf9e3b5e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:23:27.186675 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c3af9a51-7795-4275-8dd7-4159bf9e3b5e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:23:27.187155 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c3af9a51-7795-4275-8dd7-4159bf9e3b5e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:23:27.187610 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c3af9a51-7795-4275-8dd7-4159bf9e3b5e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:23:27.188285 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c3af9a51-7795-4275-8dd7-4159bf9e3b5e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:23:27.188758 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c3af9a51-7795-4275-8dd7-4159bf9e3b5e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:23:27.189186 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c3af9a51-7795-4275-8dd7-4159bf9e3b5e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:23:27.251997 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-c3af9a51-7795-4275-8dd7-4159bf9e3b5e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:23:27.261027 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-c3af9a51-7795-4275-8dd7-4159bf9e3b5e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.085537 Oct 20 06:23:27.261625 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 967/1912] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:23:27 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:23:28.155210 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-6ab5d526-0102-4872-b885-783c4f7e71ce tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:23:28.155807 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-6ab5d526-0102-4872-b885-783c4f7e71ce tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:23:28.162709 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-6ab5d526-0102-4872-b885-783c4f7e71ce tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:23:28.163197 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-6ab5d526-0102-4872-b885-783c4f7e71ce tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:23:28.163656 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-6ab5d526-0102-4872-b885-783c4f7e71ce tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:23:28.164352 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-6ab5d526-0102-4872-b885-783c4f7e71ce tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:23:28.164829 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-6ab5d526-0102-4872-b885-783c4f7e71ce tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:23:28.165254 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-6ab5d526-0102-4872-b885-783c4f7e71ce tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:23:28.182321 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG dbcounter [-] [118860] Writing DB stats nova_cell1:SELECT=100 {{(pid=118860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:23:28.283996 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-02cb7018-6ebd-4207-9853-4522266fbf5c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:23:28.285402 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-02cb7018-6ebd-4207-9853-4522266fbf5c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:23:28.293125 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-02cb7018-6ebd-4207-9853-4522266fbf5c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:23:28.293893 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-02cb7018-6ebd-4207-9853-4522266fbf5c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:23:28.294559 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-02cb7018-6ebd-4207-9853-4522266fbf5c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:23:28.303443 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-6ab5d526-0102-4872-b885-783c4f7e71ce tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:23:28.307554 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-02cb7018-6ebd-4207-9853-4522266fbf5c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:23:28.308154 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-02cb7018-6ebd-4207-9853-4522266fbf5c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:23:28.308615 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-02cb7018-6ebd-4207-9853-4522266fbf5c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:23:28.314955 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-6ab5d526-0102-4872-b885-783c4f7e71ce tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.163574 Oct 20 06:23:28.315819 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 946/1913] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:23:28 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:23:28.377255 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-02cb7018-6ebd-4207-9853-4522266fbf5c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:23:28.386664 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-02cb7018-6ebd-4207-9853-4522266fbf5c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.106838 Oct 20 06:23:28.387253 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 968/1914] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:23:28 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:23:29.338598 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-0be33309-9864-49e9-a3e0-fd794f960053 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:23:29.339301 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-0be33309-9864-49e9-a3e0-fd794f960053 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:23:29.345876 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0be33309-9864-49e9-a3e0-fd794f960053 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:23:29.346352 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0be33309-9864-49e9-a3e0-fd794f960053 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:23:29.346782 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0be33309-9864-49e9-a3e0-fd794f960053 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:23:29.347488 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0be33309-9864-49e9-a3e0-fd794f960053 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:23:29.347914 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0be33309-9864-49e9-a3e0-fd794f960053 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:23:29.348335 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0be33309-9864-49e9-a3e0-fd794f960053 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:23:29.409751 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-a71b7110-2170-44ad-a64a-ab853605c04f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:23:29.410362 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-a71b7110-2170-44ad-a64a-ab853605c04f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:23:29.414910 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 20 06:23:29.415368 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: Thu Oct 20 06:23:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 (ip 10.222.0.20) !!! Oct 20 06:23:29.421342 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a71b7110-2170-44ad-a64a-ab853605c04f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:23:29.421832 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a71b7110-2170-44ad-a64a-ab853605c04f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:23:29.422274 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a71b7110-2170-44ad-a64a-ab853605c04f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:23:29.423016 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a71b7110-2170-44ad-a64a-ab853605c04f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:23:29.423469 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a71b7110-2170-44ad-a64a-ab853605c04f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:23:29.423890 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a71b7110-2170-44ad-a64a-ab853605c04f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:23:29.486075 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-0be33309-9864-49e9-a3e0-fd794f960053 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:23:29.494553 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-0be33309-9864-49e9-a3e0-fd794f960053 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.159757 Oct 20 06:23:29.497367 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 947/1915] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:23:29 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 06:23:29.508663 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-a71b7110-2170-44ad-a64a-ab853605c04f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:23:29.517426 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-a71b7110-2170-44ad-a64a-ab853605c04f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.111529 Oct 20 06:23:29.518029 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 969/1916] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:23:29 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:23:30.519321 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-48db5b7d-a7c7-4712-8110-180cecd50d82 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:23:30.519947 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-48db5b7d-a7c7-4712-8110-180cecd50d82 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:23:30.523675 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG dbcounter [-] [118860] Writing DB stats nova_api:SELECT=52 {{(pid=118860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:23:30.529231 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-48db5b7d-a7c7-4712-8110-180cecd50d82 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:23:30.529794 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-48db5b7d-a7c7-4712-8110-180cecd50d82 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:23:30.530234 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-48db5b7d-a7c7-4712-8110-180cecd50d82 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:23:30.530982 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-48db5b7d-a7c7-4712-8110-180cecd50d82 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:23:30.531444 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-48db5b7d-a7c7-4712-8110-180cecd50d82 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:23:30.531871 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-48db5b7d-a7c7-4712-8110-180cecd50d82 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:23:30.549864 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-2ec9926e-23af-4b28-904d-650b25741b49 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:23:30.551537 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-2ec9926e-23af-4b28-904d-650b25741b49 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:23:30.561050 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG dbcounter [-] [118861] Writing DB stats nova_api:SELECT=56 {{(pid=118861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:23:30.562710 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-2ec9926e-23af-4b28-904d-650b25741b49 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:23:30.563409 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-2ec9926e-23af-4b28-904d-650b25741b49 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:23:30.564175 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-2ec9926e-23af-4b28-904d-650b25741b49 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:23:30.565089 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-2ec9926e-23af-4b28-904d-650b25741b49 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:23:30.565544 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-2ec9926e-23af-4b28-904d-650b25741b49 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:23:30.566005 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-2ec9926e-23af-4b28-904d-650b25741b49 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:23:30.634547 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-2ec9926e-23af-4b28-904d-650b25741b49 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:23:30.643786 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-2ec9926e-23af-4b28-904d-650b25741b49 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.107016 Oct 20 06:23:30.644734 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 970/1917] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:23:30 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:23:30.694236 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-48db5b7d-a7c7-4712-8110-180cecd50d82 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:23:30.702747 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-48db5b7d-a7c7-4712-8110-180cecd50d82 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.187369 Oct 20 06:23:30.703319 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 948/1918] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:23:30 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:23:31.668140 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-1e16d7af-5dde-4892-868f-c89877607326 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:23:31.668776 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-1e16d7af-5dde-4892-868f-c89877607326 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:23:31.675265 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1e16d7af-5dde-4892-868f-c89877607326 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:23:31.675757 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1e16d7af-5dde-4892-868f-c89877607326 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:23:31.676194 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1e16d7af-5dde-4892-868f-c89877607326 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:23:31.676952 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1e16d7af-5dde-4892-868f-c89877607326 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:23:31.677914 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1e16d7af-5dde-4892-868f-c89877607326 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:23:31.678343 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1e16d7af-5dde-4892-868f-c89877607326 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:23:31.726703 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-643ab876-82df-4da8-b36e-dbd42ebf334c tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:23:31.727431 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-643ab876-82df-4da8-b36e-dbd42ebf334c tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:23:31.734636 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-643ab876-82df-4da8-b36e-dbd42ebf334c tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:23:31.735128 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-643ab876-82df-4da8-b36e-dbd42ebf334c tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:23:31.735570 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-643ab876-82df-4da8-b36e-dbd42ebf334c tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:23:31.736283 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-643ab876-82df-4da8-b36e-dbd42ebf334c tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:23:31.736762 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-643ab876-82df-4da8-b36e-dbd42ebf334c tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:23:31.737195 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-643ab876-82df-4da8-b36e-dbd42ebf334c tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:23:31.742179 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-1e16d7af-5dde-4892-868f-c89877607326 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:23:31.750908 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-1e16d7af-5dde-4892-868f-c89877607326 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.086617 Oct 20 06:23:31.751839 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 971/1919] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:23:31 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:23:31.870280 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-643ab876-82df-4da8-b36e-dbd42ebf334c tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:23:31.878631 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-643ab876-82df-4da8-b36e-dbd42ebf334c tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.156410 Oct 20 06:23:31.879196 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 949/1920] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:23:31 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 06:23:32.775197 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-9fbf6e99-b277-41c6-b469-5599b02ec608 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:23:32.775811 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-9fbf6e99-b277-41c6-b469-5599b02ec608 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:23:32.782334 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-9fbf6e99-b277-41c6-b469-5599b02ec608 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:23:32.782807 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-9fbf6e99-b277-41c6-b469-5599b02ec608 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:23:32.783236 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-9fbf6e99-b277-41c6-b469-5599b02ec608 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:23:32.783959 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-9fbf6e99-b277-41c6-b469-5599b02ec608 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:23:32.784407 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-9fbf6e99-b277-41c6-b469-5599b02ec608 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:23:32.784853 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-9fbf6e99-b277-41c6-b469-5599b02ec608 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:23:32.848658 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-9fbf6e99-b277-41c6-b469-5599b02ec608 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:23:32.857347 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-9fbf6e99-b277-41c6-b469-5599b02ec608 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.086587 Oct 20 06:23:32.858109 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 972/1921] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:23:32 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:23:32.902296 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-7e93474a-81f4-4d5c-90d3-5d474344c0ed tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:23:32.902944 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-7e93474a-81f4-4d5c-90d3-5d474344c0ed tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:23:32.909308 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7e93474a-81f4-4d5c-90d3-5d474344c0ed tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:23:32.909792 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7e93474a-81f4-4d5c-90d3-5d474344c0ed tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:23:32.910238 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7e93474a-81f4-4d5c-90d3-5d474344c0ed tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:23:32.911112 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7e93474a-81f4-4d5c-90d3-5d474344c0ed tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:23:32.911622 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7e93474a-81f4-4d5c-90d3-5d474344c0ed tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:23:32.912529 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7e93474a-81f4-4d5c-90d3-5d474344c0ed tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:23:33.047328 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-7e93474a-81f4-4d5c-90d3-5d474344c0ed tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:23:33.056171 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-7e93474a-81f4-4d5c-90d3-5d474344c0ed tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.157718 Oct 20 06:23:33.056758 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 950/1922] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:23:32 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:23:33.879393 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-7a772743-26d8-4844-87f4-054629bf0057 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:23:33.880004 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-7a772743-26d8-4844-87f4-054629bf0057 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:23:33.887072 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7a772743-26d8-4844-87f4-054629bf0057 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:23:33.887559 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7a772743-26d8-4844-87f4-054629bf0057 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:23:33.887999 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7a772743-26d8-4844-87f4-054629bf0057 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:23:33.888717 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7a772743-26d8-4844-87f4-054629bf0057 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:23:33.889185 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7a772743-26d8-4844-87f4-054629bf0057 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:23:33.889613 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7a772743-26d8-4844-87f4-054629bf0057 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:23:33.907343 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG dbcounter [-] [118861] Writing DB stats nova_cell1:SELECT=100 {{(pid=118861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:23:33.955647 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-7a772743-26d8-4844-87f4-054629bf0057 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:23:33.964805 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-7a772743-26d8-4844-87f4-054629bf0057 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.089274 Oct 20 06:23:33.965375 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 973/1923] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:23:33 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:23:34.079758 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-11826adc-b725-4ecf-9562-06cfeb02e241 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:23:34.080275 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-11826adc-b725-4ecf-9562-06cfeb02e241 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:23:34.087401 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-11826adc-b725-4ecf-9562-06cfeb02e241 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:23:34.087874 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-11826adc-b725-4ecf-9562-06cfeb02e241 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:23:34.088300 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-11826adc-b725-4ecf-9562-06cfeb02e241 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:23:34.089018 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-11826adc-b725-4ecf-9562-06cfeb02e241 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:23:34.089468 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-11826adc-b725-4ecf-9562-06cfeb02e241 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:23:34.089887 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-11826adc-b725-4ecf-9562-06cfeb02e241 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:23:34.219893 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-11826adc-b725-4ecf-9562-06cfeb02e241 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:23:34.228202 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-11826adc-b725-4ecf-9562-06cfeb02e241 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.152621 Oct 20 06:23:34.228812 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 951/1924] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:23:34 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:23:34.987491 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-8d7d9d82-a054-4ddd-8899-ea25c823c627 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:23:34.988133 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-8d7d9d82-a054-4ddd-8899-ea25c823c627 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:23:34.994935 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-8d7d9d82-a054-4ddd-8899-ea25c823c627 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:23:34.995422 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-8d7d9d82-a054-4ddd-8899-ea25c823c627 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:23:34.995865 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-8d7d9d82-a054-4ddd-8899-ea25c823c627 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:23:34.996575 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-8d7d9d82-a054-4ddd-8899-ea25c823c627 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:23:34.997064 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-8d7d9d82-a054-4ddd-8899-ea25c823c627 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:23:34.997492 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-8d7d9d82-a054-4ddd-8899-ea25c823c627 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:23:35.061312 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-8d7d9d82-a054-4ddd-8899-ea25c823c627 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:23:35.070328 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-8d7d9d82-a054-4ddd-8899-ea25c823c627 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.086686 Oct 20 06:23:35.070926 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 974/1925] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:23:34 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:23:35.251336 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-5d8255ac-de49-4e9f-ac90-b9feb9be6b72 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:23:35.251856 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-5d8255ac-de49-4e9f-ac90-b9feb9be6b72 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:23:35.259434 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5d8255ac-de49-4e9f-ac90-b9feb9be6b72 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:23:35.259920 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5d8255ac-de49-4e9f-ac90-b9feb9be6b72 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:23:35.260352 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5d8255ac-de49-4e9f-ac90-b9feb9be6b72 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:23:35.261157 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5d8255ac-de49-4e9f-ac90-b9feb9be6b72 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:23:35.261613 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5d8255ac-de49-4e9f-ac90-b9feb9be6b72 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:23:35.262036 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5d8255ac-de49-4e9f-ac90-b9feb9be6b72 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:23:35.398789 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-5d8255ac-de49-4e9f-ac90-b9feb9be6b72 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:23:35.407066 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-5d8255ac-de49-4e9f-ac90-b9feb9be6b72 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.159710 Oct 20 06:23:35.407628 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 952/1926] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:23:35 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:23:36.093610 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-be4e0e4b-1600-4010-911a-cbdb6ca8793e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:23:36.094216 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-be4e0e4b-1600-4010-911a-cbdb6ca8793e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:23:36.101505 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-be4e0e4b-1600-4010-911a-cbdb6ca8793e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:23:36.101984 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-be4e0e4b-1600-4010-911a-cbdb6ca8793e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:23:36.102416 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-be4e0e4b-1600-4010-911a-cbdb6ca8793e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:23:36.103105 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-be4e0e4b-1600-4010-911a-cbdb6ca8793e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:23:36.103554 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-be4e0e4b-1600-4010-911a-cbdb6ca8793e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:23:36.103971 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-be4e0e4b-1600-4010-911a-cbdb6ca8793e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:23:36.165523 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-be4e0e4b-1600-4010-911a-cbdb6ca8793e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:23:36.173662 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-be4e0e4b-1600-4010-911a-cbdb6ca8793e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.083909 Oct 20 06:23:36.174233 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 975/1927] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:23:36 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:23:36.431042 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-53ec2196-f1d8-4d6e-ae93-fcdb9e11de0d tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:23:36.431641 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-53ec2196-f1d8-4d6e-ae93-fcdb9e11de0d tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:23:36.438122 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-53ec2196-f1d8-4d6e-ae93-fcdb9e11de0d tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:23:36.438613 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-53ec2196-f1d8-4d6e-ae93-fcdb9e11de0d tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:23:36.439057 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-53ec2196-f1d8-4d6e-ae93-fcdb9e11de0d tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:23:36.439760 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-53ec2196-f1d8-4d6e-ae93-fcdb9e11de0d tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:23:36.440218 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-53ec2196-f1d8-4d6e-ae93-fcdb9e11de0d tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:23:36.440649 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-53ec2196-f1d8-4d6e-ae93-fcdb9e11de0d tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:23:36.573440 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-53ec2196-f1d8-4d6e-ae93-fcdb9e11de0d tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:23:36.581769 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-53ec2196-f1d8-4d6e-ae93-fcdb9e11de0d tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.155222 Oct 20 06:23:36.582432 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 953/1928] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:23:36 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:23:37.196996 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-12dc25e0-f117-48c6-bef2-bcff7379cf94 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:23:37.197688 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-12dc25e0-f117-48c6-bef2-bcff7379cf94 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:23:37.204245 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-12dc25e0-f117-48c6-bef2-bcff7379cf94 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:23:37.204763 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-12dc25e0-f117-48c6-bef2-bcff7379cf94 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:23:37.205215 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-12dc25e0-f117-48c6-bef2-bcff7379cf94 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:23:37.205922 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-12dc25e0-f117-48c6-bef2-bcff7379cf94 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:23:37.206377 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-12dc25e0-f117-48c6-bef2-bcff7379cf94 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:23:37.206805 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-12dc25e0-f117-48c6-bef2-bcff7379cf94 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:23:37.272805 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-12dc25e0-f117-48c6-bef2-bcff7379cf94 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:23:37.281113 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-12dc25e0-f117-48c6-bef2-bcff7379cf94 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.088798 Oct 20 06:23:37.281690 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 976/1929] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:23:37 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:23:37.605945 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-266dab7c-0b6e-454f-848c-5eebc9df2900 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:23:37.606500 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-266dab7c-0b6e-454f-848c-5eebc9df2900 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:23:37.612981 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-266dab7c-0b6e-454f-848c-5eebc9df2900 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:23:37.613467 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-266dab7c-0b6e-454f-848c-5eebc9df2900 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:23:37.613906 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-266dab7c-0b6e-454f-848c-5eebc9df2900 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:23:37.615108 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-266dab7c-0b6e-454f-848c-5eebc9df2900 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:23:37.615570 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-266dab7c-0b6e-454f-848c-5eebc9df2900 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:23:37.616191 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-266dab7c-0b6e-454f-848c-5eebc9df2900 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:23:37.747495 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-266dab7c-0b6e-454f-848c-5eebc9df2900 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:23:37.756470 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-266dab7c-0b6e-454f-848c-5eebc9df2900 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.154462 Oct 20 06:23:37.757145 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 954/1930] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:23:37 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 06:23:38.304116 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-481fad43-d710-4845-b647-e02a9b1dda23 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:23:38.304837 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-481fad43-d710-4845-b647-e02a9b1dda23 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:23:38.311337 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-481fad43-d710-4845-b647-e02a9b1dda23 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:23:38.311819 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-481fad43-d710-4845-b647-e02a9b1dda23 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:23:38.312258 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-481fad43-d710-4845-b647-e02a9b1dda23 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:23:38.313017 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-481fad43-d710-4845-b647-e02a9b1dda23 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:23:38.313468 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-481fad43-d710-4845-b647-e02a9b1dda23 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:23:38.313894 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-481fad43-d710-4845-b647-e02a9b1dda23 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:23:38.376470 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-481fad43-d710-4845-b647-e02a9b1dda23 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:23:38.385221 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-481fad43-d710-4845-b647-e02a9b1dda23 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.085679 Oct 20 06:23:38.385782 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 977/1931] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:23:38 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:23:38.779639 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-1b943269-5f51-422f-ad95-3004ea2ea98c tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:23:38.780244 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-1b943269-5f51-422f-ad95-3004ea2ea98c tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:23:38.787589 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1b943269-5f51-422f-ad95-3004ea2ea98c tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:23:38.788082 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1b943269-5f51-422f-ad95-3004ea2ea98c tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:23:38.788520 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1b943269-5f51-422f-ad95-3004ea2ea98c tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:23:38.789274 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1b943269-5f51-422f-ad95-3004ea2ea98c tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:23:38.789731 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1b943269-5f51-422f-ad95-3004ea2ea98c tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:23:38.790165 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1b943269-5f51-422f-ad95-3004ea2ea98c tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:23:38.925673 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-1b943269-5f51-422f-ad95-3004ea2ea98c tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:23:38.934260 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-1b943269-5f51-422f-ad95-3004ea2ea98c tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.158520 Oct 20 06:23:38.934833 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 955/1932] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:23:38 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:23:39.408493 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-67a046bf-2cc5-4cb1-88b7-5c41ba3b2080 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:23:39.409163 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-67a046bf-2cc5-4cb1-88b7-5c41ba3b2080 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:23:39.415852 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-67a046bf-2cc5-4cb1-88b7-5c41ba3b2080 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:23:39.416343 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-67a046bf-2cc5-4cb1-88b7-5c41ba3b2080 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:23:39.416826 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-67a046bf-2cc5-4cb1-88b7-5c41ba3b2080 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:23:39.417535 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-67a046bf-2cc5-4cb1-88b7-5c41ba3b2080 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:23:39.417992 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-67a046bf-2cc5-4cb1-88b7-5c41ba3b2080 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:23:39.418419 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-67a046bf-2cc5-4cb1-88b7-5c41ba3b2080 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:23:39.480808 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-67a046bf-2cc5-4cb1-88b7-5c41ba3b2080 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:23:39.488960 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-67a046bf-2cc5-4cb1-88b7-5c41ba3b2080 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.084333 Oct 20 06:23:39.489517 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 978/1933] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:23:39 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:23:39.958334 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-e00ec41e-2edf-4258-bc89-c3326d4d81e1 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:23:39.959051 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-e00ec41e-2edf-4258-bc89-c3326d4d81e1 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:23:39.966001 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e00ec41e-2edf-4258-bc89-c3326d4d81e1 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:23:39.966496 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e00ec41e-2edf-4258-bc89-c3326d4d81e1 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:23:39.966947 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e00ec41e-2edf-4258-bc89-c3326d4d81e1 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:23:39.967667 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e00ec41e-2edf-4258-bc89-c3326d4d81e1 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:23:39.968128 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e00ec41e-2edf-4258-bc89-c3326d4d81e1 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:23:39.968561 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e00ec41e-2edf-4258-bc89-c3326d4d81e1 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:23:40.102841 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-e00ec41e-2edf-4258-bc89-c3326d4d81e1 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:23:40.111069 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-e00ec41e-2edf-4258-bc89-c3326d4d81e1 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.156699 Oct 20 06:23:40.111628 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 956/1934] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:23:39 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:23:40.512112 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-09c1e873-7ca5-447f-ae90-10bdfe6f4dcd tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:23:40.512791 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-09c1e873-7ca5-447f-ae90-10bdfe6f4dcd tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:23:40.519656 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-09c1e873-7ca5-447f-ae90-10bdfe6f4dcd tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:23:40.520147 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-09c1e873-7ca5-447f-ae90-10bdfe6f4dcd tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:23:40.520618 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-09c1e873-7ca5-447f-ae90-10bdfe6f4dcd tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:23:40.521848 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-09c1e873-7ca5-447f-ae90-10bdfe6f4dcd tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:23:40.522462 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-09c1e873-7ca5-447f-ae90-10bdfe6f4dcd tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:23:40.522913 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-09c1e873-7ca5-447f-ae90-10bdfe6f4dcd tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:23:40.593027 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-09c1e873-7ca5-447f-ae90-10bdfe6f4dcd tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:23:40.601672 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-09c1e873-7ca5-447f-ae90-10bdfe6f4dcd tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.093694 Oct 20 06:23:40.602352 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 979/1935] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:23:40 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:23:41.135858 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-20e06bab-a263-4a66-b1e0-658adb7295c4 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:23:41.136468 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-20e06bab-a263-4a66-b1e0-658adb7295c4 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:23:41.142956 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-20e06bab-a263-4a66-b1e0-658adb7295c4 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:23:41.143436 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-20e06bab-a263-4a66-b1e0-658adb7295c4 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:23:41.143873 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-20e06bab-a263-4a66-b1e0-658adb7295c4 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:23:41.144571 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-20e06bab-a263-4a66-b1e0-658adb7295c4 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:23:41.145051 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-20e06bab-a263-4a66-b1e0-658adb7295c4 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:23:41.145479 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-20e06bab-a263-4a66-b1e0-658adb7295c4 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:23:41.280631 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-20e06bab-a263-4a66-b1e0-658adb7295c4 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:23:41.290069 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-20e06bab-a263-4a66-b1e0-658adb7295c4 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.158278 Oct 20 06:23:41.290678 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 957/1936] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:23:41 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:23:41.625112 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-259d4b85-31c4-4964-9775-03152af6c455 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:23:41.625662 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-259d4b85-31c4-4964-9775-03152af6c455 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:23:41.632463 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-259d4b85-31c4-4964-9775-03152af6c455 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:23:41.632989 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-259d4b85-31c4-4964-9775-03152af6c455 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:23:41.633430 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-259d4b85-31c4-4964-9775-03152af6c455 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:23:41.634407 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-259d4b85-31c4-4964-9775-03152af6c455 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:23:41.634858 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-259d4b85-31c4-4964-9775-03152af6c455 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:23:41.635284 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-259d4b85-31c4-4964-9775-03152af6c455 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:23:41.702474 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-259d4b85-31c4-4964-9775-03152af6c455 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:23:41.710811 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-259d4b85-31c4-4964-9775-03152af6c455 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.089639 Oct 20 06:23:41.711380 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 980/1937] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:23:41 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:23:42.313659 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-c6032b8b-fbd6-4089-9482-874b5e6e9aa6 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:23:42.314264 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-c6032b8b-fbd6-4089-9482-874b5e6e9aa6 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:23:42.321228 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c6032b8b-fbd6-4089-9482-874b5e6e9aa6 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:23:42.321703 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c6032b8b-fbd6-4089-9482-874b5e6e9aa6 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:23:42.322137 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c6032b8b-fbd6-4089-9482-874b5e6e9aa6 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:23:42.322854 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c6032b8b-fbd6-4089-9482-874b5e6e9aa6 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:23:42.323302 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c6032b8b-fbd6-4089-9482-874b5e6e9aa6 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:23:42.323721 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c6032b8b-fbd6-4089-9482-874b5e6e9aa6 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:23:42.454610 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-c6032b8b-fbd6-4089-9482-874b5e6e9aa6 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:23:42.463523 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-c6032b8b-fbd6-4089-9482-874b5e6e9aa6 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.153819 Oct 20 06:23:42.464171 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 958/1938] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:23:42 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:23:42.734051 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-bd81bb17-c268-47b5-8950-0b3ebf4de51c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:23:42.734664 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-bd81bb17-c268-47b5-8950-0b3ebf4de51c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:23:42.741697 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-bd81bb17-c268-47b5-8950-0b3ebf4de51c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:23:42.742179 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-bd81bb17-c268-47b5-8950-0b3ebf4de51c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:23:42.742615 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-bd81bb17-c268-47b5-8950-0b3ebf4de51c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:23:42.743313 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-bd81bb17-c268-47b5-8950-0b3ebf4de51c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:23:42.743764 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-bd81bb17-c268-47b5-8950-0b3ebf4de51c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:23:42.744187 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-bd81bb17-c268-47b5-8950-0b3ebf4de51c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:23:42.910792 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-bd81bb17-c268-47b5-8950-0b3ebf4de51c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:23:42.919715 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-bd81bb17-c268-47b5-8950-0b3ebf4de51c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.189484 Oct 20 06:23:42.920334 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 981/1939] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:23:42 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:23:43.486844 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-c747b497-f9c1-4db8-9400-837e2f1df587 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:23:43.487453 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-c747b497-f9c1-4db8-9400-837e2f1df587 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:23:43.494140 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c747b497-f9c1-4db8-9400-837e2f1df587 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:23:43.494615 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c747b497-f9c1-4db8-9400-837e2f1df587 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:23:43.495045 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c747b497-f9c1-4db8-9400-837e2f1df587 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:23:43.495732 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c747b497-f9c1-4db8-9400-837e2f1df587 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:23:43.496178 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c747b497-f9c1-4db8-9400-837e2f1df587 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:23:43.496597 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c747b497-f9c1-4db8-9400-837e2f1df587 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:23:43.627670 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-c747b497-f9c1-4db8-9400-837e2f1df587 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:23:43.636328 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-c747b497-f9c1-4db8-9400-837e2f1df587 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.153337 Oct 20 06:23:43.636912 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 959/1940] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:23:43 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:23:43.944197 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-5fbf7138-b657-4972-91b0-24b86c3cf315 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:23:43.944858 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-5fbf7138-b657-4972-91b0-24b86c3cf315 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:23:43.951374 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5fbf7138-b657-4972-91b0-24b86c3cf315 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:23:43.951884 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5fbf7138-b657-4972-91b0-24b86c3cf315 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:23:43.952324 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5fbf7138-b657-4972-91b0-24b86c3cf315 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:23:43.953059 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5fbf7138-b657-4972-91b0-24b86c3cf315 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:23:43.953512 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5fbf7138-b657-4972-91b0-24b86c3cf315 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:23:43.953940 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5fbf7138-b657-4972-91b0-24b86c3cf315 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:23:44.017214 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-5fbf7138-b657-4972-91b0-24b86c3cf315 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:23:44.026244 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-5fbf7138-b657-4972-91b0-24b86c3cf315 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.086570 Oct 20 06:23:44.026819 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 982/1941] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:23:43 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:23:44.660685 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-43c77914-8607-4568-9aea-4fefba56afe6 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:23:44.662039 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-43c77914-8607-4568-9aea-4fefba56afe6 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:23:44.668602 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-43c77914-8607-4568-9aea-4fefba56afe6 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:23:44.669120 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-43c77914-8607-4568-9aea-4fefba56afe6 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:23:44.669561 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-43c77914-8607-4568-9aea-4fefba56afe6 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:23:44.670266 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-43c77914-8607-4568-9aea-4fefba56afe6 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:23:44.670720 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-43c77914-8607-4568-9aea-4fefba56afe6 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:23:44.671149 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-43c77914-8607-4568-9aea-4fefba56afe6 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:23:44.803898 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-43c77914-8607-4568-9aea-4fefba56afe6 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:23:44.812250 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-43c77914-8607-4568-9aea-4fefba56afe6 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.155488 Oct 20 06:23:44.812839 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 960/1942] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:23:44 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:23:45.049497 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-1b604ed9-e991-404c-a632-30fbed5719be tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:23:45.050208 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-1b604ed9-e991-404c-a632-30fbed5719be tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:23:45.056948 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1b604ed9-e991-404c-a632-30fbed5719be tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:23:45.057427 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1b604ed9-e991-404c-a632-30fbed5719be tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:23:45.057862 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1b604ed9-e991-404c-a632-30fbed5719be tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:23:45.058557 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1b604ed9-e991-404c-a632-30fbed5719be tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:23:45.059003 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1b604ed9-e991-404c-a632-30fbed5719be tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:23:45.059420 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1b604ed9-e991-404c-a632-30fbed5719be tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:23:45.120633 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-1b604ed9-e991-404c-a632-30fbed5719be tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:23:45.129074 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-1b604ed9-e991-404c-a632-30fbed5719be tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.083518 Oct 20 06:23:45.129651 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 983/1943] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:23:45 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:23:45.836140 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-7648883b-ab2a-4986-9aee-dda076380581 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:23:45.836776 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-7648883b-ab2a-4986-9aee-dda076380581 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:23:45.843272 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7648883b-ab2a-4986-9aee-dda076380581 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:23:45.843693 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7648883b-ab2a-4986-9aee-dda076380581 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:23:45.844125 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7648883b-ab2a-4986-9aee-dda076380581 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:23:45.844846 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7648883b-ab2a-4986-9aee-dda076380581 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:23:45.845299 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7648883b-ab2a-4986-9aee-dda076380581 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:23:45.845721 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7648883b-ab2a-4986-9aee-dda076380581 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:23:45.976017 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-7648883b-ab2a-4986-9aee-dda076380581 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:23:45.984282 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-7648883b-ab2a-4986-9aee-dda076380581 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.152687 Oct 20 06:23:45.984927 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 961/1944] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:23:45 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:23:46.151572 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-2950ad0a-9883-4921-80ce-dcf1d6a4525f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:23:46.152187 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-2950ad0a-9883-4921-80ce-dcf1d6a4525f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:23:46.158816 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-2950ad0a-9883-4921-80ce-dcf1d6a4525f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:23:46.159299 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-2950ad0a-9883-4921-80ce-dcf1d6a4525f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:23:46.159734 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-2950ad0a-9883-4921-80ce-dcf1d6a4525f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:23:46.160432 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-2950ad0a-9883-4921-80ce-dcf1d6a4525f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:23:46.160916 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-2950ad0a-9883-4921-80ce-dcf1d6a4525f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:23:46.161878 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-2950ad0a-9883-4921-80ce-dcf1d6a4525f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:23:46.226920 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-2950ad0a-9883-4921-80ce-dcf1d6a4525f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:23:46.235228 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-2950ad0a-9883-4921-80ce-dcf1d6a4525f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.087484 Oct 20 06:23:46.235806 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 984/1945] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:23:46 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:23:47.007902 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-d8f7f530-a379-4cab-8464-23027605d2ae tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:23:47.008517 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-d8f7f530-a379-4cab-8464-23027605d2ae tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:23:47.015177 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-d8f7f530-a379-4cab-8464-23027605d2ae tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:23:47.015655 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-d8f7f530-a379-4cab-8464-23027605d2ae tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:23:47.016088 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-d8f7f530-a379-4cab-8464-23027605d2ae tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:23:47.016801 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-d8f7f530-a379-4cab-8464-23027605d2ae tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:23:47.017251 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-d8f7f530-a379-4cab-8464-23027605d2ae tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:23:47.017674 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-d8f7f530-a379-4cab-8464-23027605d2ae tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:23:47.151955 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-d8f7f530-a379-4cab-8464-23027605d2ae tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:23:47.160205 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-d8f7f530-a379-4cab-8464-23027605d2ae tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.156730 Oct 20 06:23:47.160783 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 962/1946] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:23:47 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:23:47.260554 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-99c3a95a-61e2-4e3f-9070-d348969186a7 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:23:47.261124 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-99c3a95a-61e2-4e3f-9070-d348969186a7 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:23:47.267653 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-99c3a95a-61e2-4e3f-9070-d348969186a7 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:23:47.268146 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-99c3a95a-61e2-4e3f-9070-d348969186a7 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:23:47.268588 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-99c3a95a-61e2-4e3f-9070-d348969186a7 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:23:47.269324 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-99c3a95a-61e2-4e3f-9070-d348969186a7 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:23:47.269782 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-99c3a95a-61e2-4e3f-9070-d348969186a7 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:23:47.270213 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-99c3a95a-61e2-4e3f-9070-d348969186a7 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:23:47.337835 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-99c3a95a-61e2-4e3f-9070-d348969186a7 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:23:47.346915 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-99c3a95a-61e2-4e3f-9070-d348969186a7 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.090684 Oct 20 06:23:47.347865 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 985/1947] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:23:47 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:23:48.184378 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-6bdeefe8-c884-4ccf-9412-d3b0e0e9531e tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:23:48.185051 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-6bdeefe8-c884-4ccf-9412-d3b0e0e9531e tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:23:48.191717 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-6bdeefe8-c884-4ccf-9412-d3b0e0e9531e tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:23:48.192198 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-6bdeefe8-c884-4ccf-9412-d3b0e0e9531e tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:23:48.193490 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-6bdeefe8-c884-4ccf-9412-d3b0e0e9531e tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:23:48.194188 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-6bdeefe8-c884-4ccf-9412-d3b0e0e9531e tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:23:48.194659 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-6bdeefe8-c884-4ccf-9412-d3b0e0e9531e tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:23:48.195104 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-6bdeefe8-c884-4ccf-9412-d3b0e0e9531e tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:23:48.197728 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG dbcounter [-] [118860] Writing DB stats nova_cell1:SELECT=100 {{(pid=118860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:23:48.329548 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-6bdeefe8-c884-4ccf-9412-d3b0e0e9531e tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:23:48.338026 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-6bdeefe8-c884-4ccf-9412-d3b0e0e9531e tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.157552 Oct 20 06:23:48.338590 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 963/1948] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:23:48 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:23:48.370485 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-9d0db5d6-5709-4dbb-a4ad-37d4ffb62166 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:23:48.371084 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-9d0db5d6-5709-4dbb-a4ad-37d4ffb62166 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:23:48.377568 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-9d0db5d6-5709-4dbb-a4ad-37d4ffb62166 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:23:48.378047 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-9d0db5d6-5709-4dbb-a4ad-37d4ffb62166 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:23:48.378487 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-9d0db5d6-5709-4dbb-a4ad-37d4ffb62166 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:23:48.379199 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-9d0db5d6-5709-4dbb-a4ad-37d4ffb62166 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:23:48.379622 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-9d0db5d6-5709-4dbb-a4ad-37d4ffb62166 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:23:48.380079 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-9d0db5d6-5709-4dbb-a4ad-37d4ffb62166 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:23:48.441681 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-9d0db5d6-5709-4dbb-a4ad-37d4ffb62166 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:23:48.450163 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-9d0db5d6-5709-4dbb-a4ad-37d4ffb62166 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.083475 Oct 20 06:23:48.450748 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 986/1949] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:23:48 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:23:49.361341 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-4f5157ba-e21a-4351-a317-82bee4d2fbd8 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:23:49.361948 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-4f5157ba-e21a-4351-a317-82bee4d2fbd8 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:23:49.369208 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-4f5157ba-e21a-4351-a317-82bee4d2fbd8 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:23:49.369692 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-4f5157ba-e21a-4351-a317-82bee4d2fbd8 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:23:49.370130 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-4f5157ba-e21a-4351-a317-82bee4d2fbd8 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:23:49.370832 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-4f5157ba-e21a-4351-a317-82bee4d2fbd8 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:23:49.371289 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-4f5157ba-e21a-4351-a317-82bee4d2fbd8 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:23:49.371721 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-4f5157ba-e21a-4351-a317-82bee4d2fbd8 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:23:49.473122 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-b5086a9d-aef6-4ef1-923b-01755887dd51 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:23:49.473878 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-b5086a9d-aef6-4ef1-923b-01755887dd51 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:23:49.480175 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b5086a9d-aef6-4ef1-923b-01755887dd51 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:23:49.480661 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b5086a9d-aef6-4ef1-923b-01755887dd51 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:23:49.481126 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b5086a9d-aef6-4ef1-923b-01755887dd51 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:23:49.481834 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b5086a9d-aef6-4ef1-923b-01755887dd51 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:23:49.482291 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b5086a9d-aef6-4ef1-923b-01755887dd51 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:23:49.482721 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b5086a9d-aef6-4ef1-923b-01755887dd51 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:23:49.503567 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-4f5157ba-e21a-4351-a317-82bee4d2fbd8 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:23:49.513530 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-4f5157ba-e21a-4351-a317-82bee4d2fbd8 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.156044 Oct 20 06:23:49.514290 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 964/1950] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:23:49 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:23:49.546391 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-b5086a9d-aef6-4ef1-923b-01755887dd51 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:23:49.555265 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-b5086a9d-aef6-4ef1-923b-01755887dd51 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.086035 Oct 20 06:23:49.555841 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 987/1951] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:23:49 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 06:23:50.538063 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-fef00f35-5783-4744-8a0e-7278d5675e04 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:23:50.538816 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-fef00f35-5783-4744-8a0e-7278d5675e04 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:23:50.550805 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-fef00f35-5783-4744-8a0e-7278d5675e04 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:23:50.551583 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-fef00f35-5783-4744-8a0e-7278d5675e04 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:23:50.551583 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-fef00f35-5783-4744-8a0e-7278d5675e04 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:23:50.552824 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-fef00f35-5783-4744-8a0e-7278d5675e04 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:23:50.553289 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-fef00f35-5783-4744-8a0e-7278d5675e04 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:23:50.553720 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-fef00f35-5783-4744-8a0e-7278d5675e04 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:23:50.578705 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-71bbc231-62fe-4e37-877f-f48a99261917 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:23:50.579268 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-71bbc231-62fe-4e37-877f-f48a99261917 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:23:50.586731 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-71bbc231-62fe-4e37-877f-f48a99261917 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:23:50.587224 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-71bbc231-62fe-4e37-877f-f48a99261917 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:23:50.588289 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-71bbc231-62fe-4e37-877f-f48a99261917 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:23:50.598360 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-71bbc231-62fe-4e37-877f-f48a99261917 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:23:50.599632 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-71bbc231-62fe-4e37-877f-f48a99261917 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:23:50.600113 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-71bbc231-62fe-4e37-877f-f48a99261917 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:23:50.671947 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-71bbc231-62fe-4e37-877f-f48a99261917 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:23:50.680580 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-71bbc231-62fe-4e37-877f-f48a99261917 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.106098 Oct 20 06:23:50.681213 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 988/1952] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:23:50 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 06:23:50.720089 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-fef00f35-5783-4744-8a0e-7278d5675e04 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:23:50.729062 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-fef00f35-5783-4744-8a0e-7278d5675e04 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.195482 Oct 20 06:23:50.729622 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 965/1953] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:23:50 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 06:23:51.703449 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-bf017755-ff07-47d0-b504-a86c1021e7be tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:23:51.704069 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-bf017755-ff07-47d0-b504-a86c1021e7be tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:23:51.711024 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-bf017755-ff07-47d0-b504-a86c1021e7be tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:23:51.711507 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-bf017755-ff07-47d0-b504-a86c1021e7be tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:23:51.711946 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-bf017755-ff07-47d0-b504-a86c1021e7be tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:23:51.712643 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-bf017755-ff07-47d0-b504-a86c1021e7be tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:23:51.713151 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-bf017755-ff07-47d0-b504-a86c1021e7be tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:23:51.713575 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-bf017755-ff07-47d0-b504-a86c1021e7be tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:23:51.753117 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-3d86f589-9f14-4bb6-ad8b-871db578403f tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:23:51.754540 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-3d86f589-9f14-4bb6-ad8b-871db578403f tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:23:51.761228 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3d86f589-9f14-4bb6-ad8b-871db578403f tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:23:51.761706 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3d86f589-9f14-4bb6-ad8b-871db578403f tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:23:51.762138 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3d86f589-9f14-4bb6-ad8b-871db578403f tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:23:51.762831 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3d86f589-9f14-4bb6-ad8b-871db578403f tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:23:51.763278 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3d86f589-9f14-4bb6-ad8b-871db578403f tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:23:51.763696 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3d86f589-9f14-4bb6-ad8b-871db578403f tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:23:51.775970 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-bf017755-ff07-47d0-b504-a86c1021e7be tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:23:51.785087 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-bf017755-ff07-47d0-b504-a86c1021e7be tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.085408 Oct 20 06:23:51.785666 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 989/1954] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:23:51 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 06:23:51.896662 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-3d86f589-9f14-4bb6-ad8b-871db578403f tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:23:51.905076 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-3d86f589-9f14-4bb6-ad8b-871db578403f tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.155726 Oct 20 06:23:51.905644 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 966/1955] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:23:51 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 06:23:52.809111 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-6d3eba4f-9b40-4234-a06a-399bffa14c6a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:23:52.809800 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-6d3eba4f-9b40-4234-a06a-399bffa14c6a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:23:52.816713 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-6d3eba4f-9b40-4234-a06a-399bffa14c6a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:23:52.817206 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-6d3eba4f-9b40-4234-a06a-399bffa14c6a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:23:52.817734 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-6d3eba4f-9b40-4234-a06a-399bffa14c6a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:23:52.818770 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-6d3eba4f-9b40-4234-a06a-399bffa14c6a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:23:52.819296 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-6d3eba4f-9b40-4234-a06a-399bffa14c6a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:23:52.819726 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-6d3eba4f-9b40-4234-a06a-399bffa14c6a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:23:52.822317 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG dbcounter [-] [118861] Writing DB stats nova_cell1:SELECT=100 {{(pid=118861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:23:52.883630 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-6d3eba4f-9b40-4234-a06a-399bffa14c6a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:23:52.892683 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-6d3eba4f-9b40-4234-a06a-399bffa14c6a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.087507 Oct 20 06:23:52.903251 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 990/1956] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:23:52 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:23:52.932027 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-0b49f3af-ba40-429d-b834-6ec8d548209b tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:23:52.932815 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-0b49f3af-ba40-429d-b834-6ec8d548209b tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:23:52.940266 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0b49f3af-ba40-429d-b834-6ec8d548209b tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:23:52.940856 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0b49f3af-ba40-429d-b834-6ec8d548209b tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:23:52.941366 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0b49f3af-ba40-429d-b834-6ec8d548209b tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:23:52.942174 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0b49f3af-ba40-429d-b834-6ec8d548209b tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:23:52.942732 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0b49f3af-ba40-429d-b834-6ec8d548209b tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:23:52.943299 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0b49f3af-ba40-429d-b834-6ec8d548209b tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:23:53.084045 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-0b49f3af-ba40-429d-b834-6ec8d548209b tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:23:53.093268 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-0b49f3af-ba40-429d-b834-6ec8d548209b tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.167711 Oct 20 06:23:53.093840 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 967/1957] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:23:52 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:23:53.915705 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-73b90e73-3e0c-41d4-a2a6-618884f6589c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:23:53.916378 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-73b90e73-3e0c-41d4-a2a6-618884f6589c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:23:53.922929 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-73b90e73-3e0c-41d4-a2a6-618884f6589c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:23:53.923407 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-73b90e73-3e0c-41d4-a2a6-618884f6589c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:23:53.923846 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-73b90e73-3e0c-41d4-a2a6-618884f6589c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:23:53.924537 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-73b90e73-3e0c-41d4-a2a6-618884f6589c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:23:53.925022 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-73b90e73-3e0c-41d4-a2a6-618884f6589c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:23:53.925442 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-73b90e73-3e0c-41d4-a2a6-618884f6589c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:23:53.987844 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-73b90e73-3e0c-41d4-a2a6-618884f6589c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:23:53.997002 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-73b90e73-3e0c-41d4-a2a6-618884f6589c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.085447 Oct 20 06:23:53.997787 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 991/1958] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:23:53 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 06:23:54.118148 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-4cef28d6-5c31-4834-b45e-18eab04e8e4a tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:23:54.118707 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-4cef28d6-5c31-4834-b45e-18eab04e8e4a tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:23:54.125255 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-4cef28d6-5c31-4834-b45e-18eab04e8e4a tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:23:54.125733 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-4cef28d6-5c31-4834-b45e-18eab04e8e4a tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:23:54.126169 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-4cef28d6-5c31-4834-b45e-18eab04e8e4a tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:23:54.126864 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-4cef28d6-5c31-4834-b45e-18eab04e8e4a tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:23:54.127316 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-4cef28d6-5c31-4834-b45e-18eab04e8e4a tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:23:54.127738 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-4cef28d6-5c31-4834-b45e-18eab04e8e4a tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:23:54.258571 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-4cef28d6-5c31-4834-b45e-18eab04e8e4a tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:23:54.267310 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-4cef28d6-5c31-4834-b45e-18eab04e8e4a tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.154058 Oct 20 06:23:54.267880 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 968/1959] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:23:54 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:23:55.019832 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-868a07b5-a11d-4853-9a7e-0022a99ef4a1 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:23:55.020423 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-868a07b5-a11d-4853-9a7e-0022a99ef4a1 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:23:55.026869 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-868a07b5-a11d-4853-9a7e-0022a99ef4a1 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:23:55.027344 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-868a07b5-a11d-4853-9a7e-0022a99ef4a1 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:23:55.027771 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-868a07b5-a11d-4853-9a7e-0022a99ef4a1 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:23:55.028457 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-868a07b5-a11d-4853-9a7e-0022a99ef4a1 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:23:55.028931 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-868a07b5-a11d-4853-9a7e-0022a99ef4a1 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:23:55.029353 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-868a07b5-a11d-4853-9a7e-0022a99ef4a1 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:23:55.094116 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-868a07b5-a11d-4853-9a7e-0022a99ef4a1 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:23:55.102941 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-868a07b5-a11d-4853-9a7e-0022a99ef4a1 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.086993 Oct 20 06:23:55.103496 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 992/1960] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:23:55 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:23:55.291082 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-55817f7a-7a66-4274-b425-bb2ef9f6eed7 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:23:55.291624 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-55817f7a-7a66-4274-b425-bb2ef9f6eed7 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:23:55.298218 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-55817f7a-7a66-4274-b425-bb2ef9f6eed7 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:23:55.298703 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-55817f7a-7a66-4274-b425-bb2ef9f6eed7 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:23:55.299136 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-55817f7a-7a66-4274-b425-bb2ef9f6eed7 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:23:55.299828 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-55817f7a-7a66-4274-b425-bb2ef9f6eed7 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:23:55.300274 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-55817f7a-7a66-4274-b425-bb2ef9f6eed7 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:23:55.300722 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-55817f7a-7a66-4274-b425-bb2ef9f6eed7 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:23:55.455787 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-55817f7a-7a66-4274-b425-bb2ef9f6eed7 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:23:55.464659 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-55817f7a-7a66-4274-b425-bb2ef9f6eed7 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.177986 Oct 20 06:23:55.465270 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 969/1961] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:23:55 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:23:56.126439 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-d7f2cfb4-a814-43bf-9a33-9e1010e169fe tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:23:56.127182 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-d7f2cfb4-a814-43bf-9a33-9e1010e169fe tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:23:56.133767 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d7f2cfb4-a814-43bf-9a33-9e1010e169fe tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:23:56.134500 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d7f2cfb4-a814-43bf-9a33-9e1010e169fe tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:23:56.134930 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d7f2cfb4-a814-43bf-9a33-9e1010e169fe tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:23:56.135615 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d7f2cfb4-a814-43bf-9a33-9e1010e169fe tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:23:56.136061 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d7f2cfb4-a814-43bf-9a33-9e1010e169fe tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:23:56.136479 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d7f2cfb4-a814-43bf-9a33-9e1010e169fe tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:23:56.201592 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-d7f2cfb4-a814-43bf-9a33-9e1010e169fe tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:23:56.210667 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-d7f2cfb4-a814-43bf-9a33-9e1010e169fe tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.088073 Oct 20 06:23:56.211231 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 993/1962] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:23:56 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:23:56.489063 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-125f7fb8-9e15-4daf-b205-73aa829fe1f9 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:23:56.490805 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-125f7fb8-9e15-4daf-b205-73aa829fe1f9 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:23:56.498733 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-125f7fb8-9e15-4daf-b205-73aa829fe1f9 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:23:56.499359 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-125f7fb8-9e15-4daf-b205-73aa829fe1f9 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:23:56.499805 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-125f7fb8-9e15-4daf-b205-73aa829fe1f9 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:23:56.500554 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-125f7fb8-9e15-4daf-b205-73aa829fe1f9 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:23:56.502110 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-125f7fb8-9e15-4daf-b205-73aa829fe1f9 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:23:56.502110 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-125f7fb8-9e15-4daf-b205-73aa829fe1f9 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:23:56.647497 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-125f7fb8-9e15-4daf-b205-73aa829fe1f9 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:23:56.647497 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-125f7fb8-9e15-4daf-b205-73aa829fe1f9 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.160387 Oct 20 06:23:56.647497 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 970/1963] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:23:56 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:23:57.234239 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-fe8d08ad-3df3-404c-aeb8-5fb6b3d1ffd1 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:23:57.247148 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-fe8d08ad-3df3-404c-aeb8-5fb6b3d1ffd1 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:23:57.247148 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-fe8d08ad-3df3-404c-aeb8-5fb6b3d1ffd1 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:23:57.247148 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-fe8d08ad-3df3-404c-aeb8-5fb6b3d1ffd1 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:23:57.247148 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-fe8d08ad-3df3-404c-aeb8-5fb6b3d1ffd1 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:23:57.247558 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-fe8d08ad-3df3-404c-aeb8-5fb6b3d1ffd1 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:23:57.247558 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-fe8d08ad-3df3-404c-aeb8-5fb6b3d1ffd1 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:23:57.247558 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-fe8d08ad-3df3-404c-aeb8-5fb6b3d1ffd1 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:23:57.315431 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-fe8d08ad-3df3-404c-aeb8-5fb6b3d1ffd1 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:23:57.317005 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-fe8d08ad-3df3-404c-aeb8-5fb6b3d1ffd1 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.086782 Oct 20 06:23:57.318131 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 994/1964] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:23:57 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:23:57.687562 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-f61c38f4-f151-451d-9c9e-315e5cf1c960 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:23:57.703985 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-f61c38f4-f151-451d-9c9e-315e5cf1c960 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:23:57.703985 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f61c38f4-f151-451d-9c9e-315e5cf1c960 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:23:57.703985 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f61c38f4-f151-451d-9c9e-315e5cf1c960 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:23:57.703985 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f61c38f4-f151-451d-9c9e-315e5cf1c960 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:23:57.704445 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f61c38f4-f151-451d-9c9e-315e5cf1c960 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:23:57.704445 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f61c38f4-f151-451d-9c9e-315e5cf1c960 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:23:57.704445 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f61c38f4-f151-451d-9c9e-315e5cf1c960 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:23:57.827366 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-f61c38f4-f151-451d-9c9e-315e5cf1c960 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:23:57.836380 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-f61c38f4-f151-451d-9c9e-315e5cf1c960 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.152773 Oct 20 06:23:57.837037 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 971/1965] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:23:57 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:23:58.353196 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-9b20e50b-e946-4e83-8024-e83022a3081d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:23:58.353805 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-9b20e50b-e946-4e83-8024-e83022a3081d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:23:58.360206 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-9b20e50b-e946-4e83-8024-e83022a3081d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:23:58.360680 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-9b20e50b-e946-4e83-8024-e83022a3081d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:23:58.361144 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-9b20e50b-e946-4e83-8024-e83022a3081d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:23:58.361832 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-9b20e50b-e946-4e83-8024-e83022a3081d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:23:58.362275 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-9b20e50b-e946-4e83-8024-e83022a3081d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:23:58.362693 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-9b20e50b-e946-4e83-8024-e83022a3081d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:23:58.425201 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-9b20e50b-e946-4e83-8024-e83022a3081d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:23:58.434134 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-9b20e50b-e946-4e83-8024-e83022a3081d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.084846 Oct 20 06:23:58.434693 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 995/1966] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:23:58 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:23:58.861811 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-255e0fe8-5ce9-4e07-a93a-1ea42863b378 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:23:58.862427 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-255e0fe8-5ce9-4e07-a93a-1ea42863b378 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:23:58.869814 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-255e0fe8-5ce9-4e07-a93a-1ea42863b378 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:23:58.870302 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-255e0fe8-5ce9-4e07-a93a-1ea42863b378 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:23:58.870744 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-255e0fe8-5ce9-4e07-a93a-1ea42863b378 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:23:58.871453 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-255e0fe8-5ce9-4e07-a93a-1ea42863b378 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:23:58.871908 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-255e0fe8-5ce9-4e07-a93a-1ea42863b378 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:23:58.872340 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-255e0fe8-5ce9-4e07-a93a-1ea42863b378 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:23:59.009786 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-255e0fe8-5ce9-4e07-a93a-1ea42863b378 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:23:59.018103 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-255e0fe8-5ce9-4e07-a93a-1ea42863b378 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.160205 Oct 20 06:23:59.018766 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 972/1967] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:23:58 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:23:59.459284 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-0b71b972-b1c3-4a36-bd70-9eaa7db89f94 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:23:59.475846 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-0b71b972-b1c3-4a36-bd70-9eaa7db89f94 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:23:59.475846 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-0b71b972-b1c3-4a36-bd70-9eaa7db89f94 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:23:59.475846 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-0b71b972-b1c3-4a36-bd70-9eaa7db89f94 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:23:59.475846 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-0b71b972-b1c3-4a36-bd70-9eaa7db89f94 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:23:59.476265 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-0b71b972-b1c3-4a36-bd70-9eaa7db89f94 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:23:59.476265 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-0b71b972-b1c3-4a36-bd70-9eaa7db89f94 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:23:59.476265 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-0b71b972-b1c3-4a36-bd70-9eaa7db89f94 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:23:59.539950 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-0b71b972-b1c3-4a36-bd70-9eaa7db89f94 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:23:59.549667 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-0b71b972-b1c3-4a36-bd70-9eaa7db89f94 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.095001 Oct 20 06:23:59.550393 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 996/1968] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:23:59 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:24:00.052930 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-17775c56-a56e-4372-addd-900a2a6fb3ac tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:24:00.052930 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-17775c56-a56e-4372-addd-900a2a6fb3ac tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:24:00.052930 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-17775c56-a56e-4372-addd-900a2a6fb3ac tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:24:00.052930 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-17775c56-a56e-4372-addd-900a2a6fb3ac tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:24:00.054067 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-17775c56-a56e-4372-addd-900a2a6fb3ac tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:24:00.054067 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-17775c56-a56e-4372-addd-900a2a6fb3ac tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:24:00.054067 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-17775c56-a56e-4372-addd-900a2a6fb3ac tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:24:00.054067 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-17775c56-a56e-4372-addd-900a2a6fb3ac tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:24:00.184476 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-17775c56-a56e-4372-addd-900a2a6fb3ac tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:24:00.193093 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-17775c56-a56e-4372-addd-900a2a6fb3ac tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.155111 Oct 20 06:24:00.193656 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 973/1969] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:24:00 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:24:00.582100 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-7c05c2df-b1c6-48b9-8fe0-17fe80fa6c23 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:24:00.582645 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-7c05c2df-b1c6-48b9-8fe0-17fe80fa6c23 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:24:00.584994 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG dbcounter [-] [118861] Writing DB stats nova_api:SELECT=54 {{(pid=118861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:24:00.590410 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7c05c2df-b1c6-48b9-8fe0-17fe80fa6c23 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:24:00.590894 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7c05c2df-b1c6-48b9-8fe0-17fe80fa6c23 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:24:00.591330 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7c05c2df-b1c6-48b9-8fe0-17fe80fa6c23 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:24:00.592034 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7c05c2df-b1c6-48b9-8fe0-17fe80fa6c23 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:24:00.592484 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7c05c2df-b1c6-48b9-8fe0-17fe80fa6c23 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:24:00.593003 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7c05c2df-b1c6-48b9-8fe0-17fe80fa6c23 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:24:00.662926 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-7c05c2df-b1c6-48b9-8fe0-17fe80fa6c23 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:24:00.671918 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-7c05c2df-b1c6-48b9-8fe0-17fe80fa6c23 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.093702 Oct 20 06:24:00.672487 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 997/1970] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:24:00 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 06:24:01.219651 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-18e4c7f6-90c6-4115-b159-47de5e5436dd tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:24:01.220265 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-18e4c7f6-90c6-4115-b159-47de5e5436dd tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:24:01.222609 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG dbcounter [-] [118860] Writing DB stats nova_api:SELECT=52 {{(pid=118860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:24:01.228972 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-18e4c7f6-90c6-4115-b159-47de5e5436dd tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:24:01.229520 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-18e4c7f6-90c6-4115-b159-47de5e5436dd tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:24:01.229976 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-18e4c7f6-90c6-4115-b159-47de5e5436dd tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:24:01.230678 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-18e4c7f6-90c6-4115-b159-47de5e5436dd tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:24:01.231136 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-18e4c7f6-90c6-4115-b159-47de5e5436dd tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:24:01.231571 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-18e4c7f6-90c6-4115-b159-47de5e5436dd tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:24:01.369556 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-18e4c7f6-90c6-4115-b159-47de5e5436dd tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:24:01.377967 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-18e4c7f6-90c6-4115-b159-47de5e5436dd tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.162177 Oct 20 06:24:01.378527 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 974/1971] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:24:01 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:24:01.695924 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-8680c7cd-6451-4d65-8c83-8ede1b0e9946 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:24:01.696789 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-8680c7cd-6451-4d65-8c83-8ede1b0e9946 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:24:01.703304 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-8680c7cd-6451-4d65-8c83-8ede1b0e9946 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:24:01.703781 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-8680c7cd-6451-4d65-8c83-8ede1b0e9946 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:24:01.704219 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-8680c7cd-6451-4d65-8c83-8ede1b0e9946 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:24:01.704940 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-8680c7cd-6451-4d65-8c83-8ede1b0e9946 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:24:01.705397 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-8680c7cd-6451-4d65-8c83-8ede1b0e9946 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:24:01.705820 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-8680c7cd-6451-4d65-8c83-8ede1b0e9946 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:24:01.767255 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-8680c7cd-6451-4d65-8c83-8ede1b0e9946 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:24:01.776348 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-8680c7cd-6451-4d65-8c83-8ede1b0e9946 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.084974 Oct 20 06:24:01.776968 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 998/1972] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:24:01 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:24:02.413806 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-1106e441-8e60-4f0c-afe3-1089c28936bb tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:24:02.415040 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-1106e441-8e60-4f0c-afe3-1089c28936bb tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:24:02.421756 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1106e441-8e60-4f0c-afe3-1089c28936bb tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:24:02.422234 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1106e441-8e60-4f0c-afe3-1089c28936bb tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:24:02.422668 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1106e441-8e60-4f0c-afe3-1089c28936bb tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:24:02.423361 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1106e441-8e60-4f0c-afe3-1089c28936bb tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:24:02.423809 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1106e441-8e60-4f0c-afe3-1089c28936bb tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:24:02.424232 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1106e441-8e60-4f0c-afe3-1089c28936bb tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:24:02.559049 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-1106e441-8e60-4f0c-afe3-1089c28936bb tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:24:02.568199 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-1106e441-8e60-4f0c-afe3-1089c28936bb tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.168165 Oct 20 06:24:02.569194 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 975/1973] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:24:02 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:24:02.799334 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-60f88b13-c167-4516-93ec-17292367c6c7 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:24:02.799907 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-60f88b13-c167-4516-93ec-17292367c6c7 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:24:02.806972 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-60f88b13-c167-4516-93ec-17292367c6c7 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:24:02.807456 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-60f88b13-c167-4516-93ec-17292367c6c7 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:24:02.807897 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-60f88b13-c167-4516-93ec-17292367c6c7 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:24:02.808609 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-60f88b13-c167-4516-93ec-17292367c6c7 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:24:02.809088 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-60f88b13-c167-4516-93ec-17292367c6c7 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:24:02.809514 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-60f88b13-c167-4516-93ec-17292367c6c7 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:24:02.873779 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-60f88b13-c167-4516-93ec-17292367c6c7 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:24:02.882181 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-60f88b13-c167-4516-93ec-17292367c6c7 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.086787 Oct 20 06:24:02.896883 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 999/1974] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:24:02 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:24:03.592272 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-5f2c0237-2709-423c-803b-b2216ba2cc5a tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:24:03.592858 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-5f2c0237-2709-423c-803b-b2216ba2cc5a tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:24:03.599894 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5f2c0237-2709-423c-803b-b2216ba2cc5a tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:24:03.600416 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5f2c0237-2709-423c-803b-b2216ba2cc5a tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:24:03.600894 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5f2c0237-2709-423c-803b-b2216ba2cc5a tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:24:03.602211 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5f2c0237-2709-423c-803b-b2216ba2cc5a tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:24:03.602696 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5f2c0237-2709-423c-803b-b2216ba2cc5a tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:24:03.603201 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5f2c0237-2709-423c-803b-b2216ba2cc5a tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:24:03.733867 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-5f2c0237-2709-423c-803b-b2216ba2cc5a tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:24:03.742142 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-5f2c0237-2709-423c-803b-b2216ba2cc5a tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.153824 Oct 20 06:24:03.742843 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 976/1975] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:24:03 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:24:03.906007 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-9d36a245-8bee-4b7d-90af-61c8abe9d256 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:24:03.906656 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-9d36a245-8bee-4b7d-90af-61c8abe9d256 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:24:03.913230 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-9d36a245-8bee-4b7d-90af-61c8abe9d256 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:24:03.913720 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-9d36a245-8bee-4b7d-90af-61c8abe9d256 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:24:03.914212 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-9d36a245-8bee-4b7d-90af-61c8abe9d256 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:24:03.915202 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-9d36a245-8bee-4b7d-90af-61c8abe9d256 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:24:03.915662 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-9d36a245-8bee-4b7d-90af-61c8abe9d256 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:24:03.916096 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-9d36a245-8bee-4b7d-90af-61c8abe9d256 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:24:03.981432 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-9d36a245-8bee-4b7d-90af-61c8abe9d256 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:24:03.989753 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-9d36a245-8bee-4b7d-90af-61c8abe9d256 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.087617 Oct 20 06:24:03.990322 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1000/1976] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:24:03 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:24:04.765341 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-a63ccd89-64da-44b5-8d2d-664c244aefd8 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:24:04.765930 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-a63ccd89-64da-44b5-8d2d-664c244aefd8 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:24:04.772363 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a63ccd89-64da-44b5-8d2d-664c244aefd8 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:24:04.772872 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a63ccd89-64da-44b5-8d2d-664c244aefd8 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:24:04.773352 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a63ccd89-64da-44b5-8d2d-664c244aefd8 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:24:04.774038 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a63ccd89-64da-44b5-8d2d-664c244aefd8 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:24:04.774484 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a63ccd89-64da-44b5-8d2d-664c244aefd8 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:24:04.774906 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a63ccd89-64da-44b5-8d2d-664c244aefd8 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:24:04.906385 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-a63ccd89-64da-44b5-8d2d-664c244aefd8 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:24:04.914818 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-a63ccd89-64da-44b5-8d2d-664c244aefd8 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.153226 Oct 20 06:24:04.915584 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 977/1977] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:24:04 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:24:05.014022 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-924ff4b3-a12c-4e24-8907-6da39f8b2158 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:24:05.014635 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-924ff4b3-a12c-4e24-8907-6da39f8b2158 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:24:05.021168 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-924ff4b3-a12c-4e24-8907-6da39f8b2158 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:24:05.021634 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-924ff4b3-a12c-4e24-8907-6da39f8b2158 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:24:05.021634 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-924ff4b3-a12c-4e24-8907-6da39f8b2158 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:24:05.022805 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-924ff4b3-a12c-4e24-8907-6da39f8b2158 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:24:05.023175 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-924ff4b3-a12c-4e24-8907-6da39f8b2158 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:24:05.023595 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-924ff4b3-a12c-4e24-8907-6da39f8b2158 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:24:05.086667 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-924ff4b3-a12c-4e24-8907-6da39f8b2158 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:24:05.095000 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-924ff4b3-a12c-4e24-8907-6da39f8b2158 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.084801 Oct 20 06:24:05.095563 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1001/1978] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:24:05 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:24:05.938349 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-3fd4b2c2-ca1b-4404-af83-7792f2a4066d tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:24:05.938922 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-3fd4b2c2-ca1b-4404-af83-7792f2a4066d tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:24:05.945334 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3fd4b2c2-ca1b-4404-af83-7792f2a4066d tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:24:05.945803 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3fd4b2c2-ca1b-4404-af83-7792f2a4066d tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:24:05.946235 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3fd4b2c2-ca1b-4404-af83-7792f2a4066d tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:24:05.946955 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3fd4b2c2-ca1b-4404-af83-7792f2a4066d tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:24:05.947410 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3fd4b2c2-ca1b-4404-af83-7792f2a4066d tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:24:05.947832 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3fd4b2c2-ca1b-4404-af83-7792f2a4066d tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:24:06.081345 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-3fd4b2c2-ca1b-4404-af83-7792f2a4066d tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:24:06.089830 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-3fd4b2c2-ca1b-4404-af83-7792f2a4066d tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.155389 Oct 20 06:24:06.090391 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 978/1979] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:24:05 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:24:06.118192 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-76c4b649-8718-4bb4-8914-a142d681f8c6 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:24:06.118795 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-76c4b649-8718-4bb4-8914-a142d681f8c6 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:24:06.125238 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-76c4b649-8718-4bb4-8914-a142d681f8c6 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:24:06.125716 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-76c4b649-8718-4bb4-8914-a142d681f8c6 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:24:06.126145 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-76c4b649-8718-4bb4-8914-a142d681f8c6 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:24:06.126841 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-76c4b649-8718-4bb4-8914-a142d681f8c6 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:24:06.127284 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-76c4b649-8718-4bb4-8914-a142d681f8c6 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:24:06.127712 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-76c4b649-8718-4bb4-8914-a142d681f8c6 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:24:06.190195 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-76c4b649-8718-4bb4-8914-a142d681f8c6 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:24:06.198606 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-76c4b649-8718-4bb4-8914-a142d681f8c6 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.084711 Oct 20 06:24:06.199176 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1002/1980] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:24:06 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:24:07.113108 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-98e62fc5-70aa-4a44-869b-9efe947cf4a6 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:24:07.113657 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-98e62fc5-70aa-4a44-869b-9efe947cf4a6 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:24:07.120219 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-98e62fc5-70aa-4a44-869b-9efe947cf4a6 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:24:07.120719 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-98e62fc5-70aa-4a44-869b-9efe947cf4a6 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:24:07.121164 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-98e62fc5-70aa-4a44-869b-9efe947cf4a6 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:24:07.121865 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-98e62fc5-70aa-4a44-869b-9efe947cf4a6 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:24:07.122320 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-98e62fc5-70aa-4a44-869b-9efe947cf4a6 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:24:07.122747 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-98e62fc5-70aa-4a44-869b-9efe947cf4a6 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:24:07.221381 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-917841cd-1bc3-407b-b845-f9289d45da8b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:24:07.222160 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-917841cd-1bc3-407b-b845-f9289d45da8b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:24:07.231130 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-917841cd-1bc3-407b-b845-f9289d45da8b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:24:07.231739 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-917841cd-1bc3-407b-b845-f9289d45da8b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:24:07.232274 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-917841cd-1bc3-407b-b845-f9289d45da8b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:24:07.233103 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-917841cd-1bc3-407b-b845-f9289d45da8b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:24:07.233667 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-917841cd-1bc3-407b-b845-f9289d45da8b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:24:07.234187 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-917841cd-1bc3-407b-b845-f9289d45da8b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:24:07.255389 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-98e62fc5-70aa-4a44-869b-9efe947cf4a6 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:24:07.257800 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG dbcounter [-] [118860] Writing DB stats nova_cell1:SELECT=100 {{(pid=118860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:24:07.272989 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-98e62fc5-70aa-4a44-869b-9efe947cf4a6 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.163711 Oct 20 06:24:07.274611 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 979/1981] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:24:07 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:24:07.316404 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-917841cd-1bc3-407b-b845-f9289d45da8b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:24:07.325735 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-917841cd-1bc3-407b-b845-f9289d45da8b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.108311 Oct 20 06:24:07.326312 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1003/1982] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:24:07 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 06:24:08.297538 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-c40d50ac-131f-4b0c-af13-4908fc4fe378 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:24:08.298142 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-c40d50ac-131f-4b0c-af13-4908fc4fe378 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:24:08.305708 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c40d50ac-131f-4b0c-af13-4908fc4fe378 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:24:08.306360 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c40d50ac-131f-4b0c-af13-4908fc4fe378 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:24:08.306800 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c40d50ac-131f-4b0c-af13-4908fc4fe378 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:24:08.307512 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c40d50ac-131f-4b0c-af13-4908fc4fe378 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:24:08.307967 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c40d50ac-131f-4b0c-af13-4908fc4fe378 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:24:08.308413 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c40d50ac-131f-4b0c-af13-4908fc4fe378 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:24:08.347843 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-cb2526ff-3dab-43fa-b19d-5aef69df7c06 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:24:08.348632 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-cb2526ff-3dab-43fa-b19d-5aef69df7c06 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:24:08.355616 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-cb2526ff-3dab-43fa-b19d-5aef69df7c06 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:24:08.356107 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-cb2526ff-3dab-43fa-b19d-5aef69df7c06 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:24:08.356544 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-cb2526ff-3dab-43fa-b19d-5aef69df7c06 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:24:08.357287 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-cb2526ff-3dab-43fa-b19d-5aef69df7c06 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:24:08.357733 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-cb2526ff-3dab-43fa-b19d-5aef69df7c06 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:24:08.358154 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-cb2526ff-3dab-43fa-b19d-5aef69df7c06 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:24:08.429269 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-cb2526ff-3dab-43fa-b19d-5aef69df7c06 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:24:08.438279 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-cb2526ff-3dab-43fa-b19d-5aef69df7c06 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.094239 Oct 20 06:24:08.438934 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1004/1983] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:24:08 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:24:08.446063 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-c40d50ac-131f-4b0c-af13-4908fc4fe378 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:24:08.454363 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-c40d50ac-131f-4b0c-af13-4908fc4fe378 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.161196 Oct 20 06:24:08.454928 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 980/1984] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:24:08 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:24:09.462789 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-0037cd4a-992e-42e8-98d2-007bd5574ddf tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:24:09.463375 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-0037cd4a-992e-42e8-98d2-007bd5574ddf tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:24:09.469904 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-0037cd4a-992e-42e8-98d2-007bd5574ddf tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:24:09.470385 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-0037cd4a-992e-42e8-98d2-007bd5574ddf tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:24:09.470820 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-0037cd4a-992e-42e8-98d2-007bd5574ddf tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:24:09.471587 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-0037cd4a-992e-42e8-98d2-007bd5574ddf tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:24:09.472039 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-0037cd4a-992e-42e8-98d2-007bd5574ddf tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:24:09.472497 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-0037cd4a-992e-42e8-98d2-007bd5574ddf tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:24:09.478139 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-52a02d43-53d9-4e9b-9613-0fe53b427526 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:24:09.479332 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-52a02d43-53d9-4e9b-9613-0fe53b427526 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:24:09.485538 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-52a02d43-53d9-4e9b-9613-0fe53b427526 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:24:09.486028 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-52a02d43-53d9-4e9b-9613-0fe53b427526 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:24:09.486459 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-52a02d43-53d9-4e9b-9613-0fe53b427526 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:24:09.487155 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-52a02d43-53d9-4e9b-9613-0fe53b427526 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:24:09.488005 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-52a02d43-53d9-4e9b-9613-0fe53b427526 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:24:09.488005 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-52a02d43-53d9-4e9b-9613-0fe53b427526 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:24:09.539861 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-0037cd4a-992e-42e8-98d2-007bd5574ddf tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:24:09.548523 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-0037cd4a-992e-42e8-98d2-007bd5574ddf tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.090485 Oct 20 06:24:09.550160 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1005/1985] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:24:09 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:24:09.624418 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-52a02d43-53d9-4e9b-9613-0fe53b427526 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:24:09.634328 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-52a02d43-53d9-4e9b-9613-0fe53b427526 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.158659 Oct 20 06:24:09.634914 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 981/1986] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:24:09 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 06:24:10.573505 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-7c68ef51-8aa7-433e-8b2c-8eb4224a3090 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:24:10.574061 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-7c68ef51-8aa7-433e-8b2c-8eb4224a3090 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:24:10.580652 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7c68ef51-8aa7-433e-8b2c-8eb4224a3090 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:24:10.581170 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7c68ef51-8aa7-433e-8b2c-8eb4224a3090 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:24:10.581636 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7c68ef51-8aa7-433e-8b2c-8eb4224a3090 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:24:10.582630 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7c68ef51-8aa7-433e-8b2c-8eb4224a3090 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:24:10.583220 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7c68ef51-8aa7-433e-8b2c-8eb4224a3090 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:24:10.583654 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7c68ef51-8aa7-433e-8b2c-8eb4224a3090 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:24:10.646121 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-7c68ef51-8aa7-433e-8b2c-8eb4224a3090 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:24:10.648596 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG dbcounter [-] [118861] Writing DB stats nova_cell1:SELECT=100 {{(pid=118861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:24:10.656900 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-7c68ef51-8aa7-433e-8b2c-8eb4224a3090 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.087883 Oct 20 06:24:10.657712 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1006/1987] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:24:10 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:24:10.658343 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-0feac28e-8105-4838-8118-51cfb4b795e3 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:24:10.658964 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-0feac28e-8105-4838-8118-51cfb4b795e3 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:24:10.666075 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0feac28e-8105-4838-8118-51cfb4b795e3 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:24:10.666562 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0feac28e-8105-4838-8118-51cfb4b795e3 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:24:10.667005 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0feac28e-8105-4838-8118-51cfb4b795e3 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:24:10.667711 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0feac28e-8105-4838-8118-51cfb4b795e3 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:24:10.668365 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0feac28e-8105-4838-8118-51cfb4b795e3 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:24:10.668829 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0feac28e-8105-4838-8118-51cfb4b795e3 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:24:10.800607 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-0feac28e-8105-4838-8118-51cfb4b795e3 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:24:10.808996 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-0feac28e-8105-4838-8118-51cfb4b795e3 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.154819 Oct 20 06:24:10.809565 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 982/1988] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:24:10 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 06:24:11.681679 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-f4ed7e01-0359-4e2d-9402-cd8a5e1ae868 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:24:11.682263 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-f4ed7e01-0359-4e2d-9402-cd8a5e1ae868 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:24:11.688607 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f4ed7e01-0359-4e2d-9402-cd8a5e1ae868 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:24:11.689116 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f4ed7e01-0359-4e2d-9402-cd8a5e1ae868 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:24:11.689544 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f4ed7e01-0359-4e2d-9402-cd8a5e1ae868 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:24:11.690230 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f4ed7e01-0359-4e2d-9402-cd8a5e1ae868 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:24:11.690675 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f4ed7e01-0359-4e2d-9402-cd8a5e1ae868 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:24:11.691097 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f4ed7e01-0359-4e2d-9402-cd8a5e1ae868 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:24:11.752380 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-f4ed7e01-0359-4e2d-9402-cd8a5e1ae868 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:24:11.760942 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-f4ed7e01-0359-4e2d-9402-cd8a5e1ae868 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.083869 Oct 20 06:24:11.761508 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1007/1989] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:24:11 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:24:11.833035 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-2d5a99a0-0854-4d68-8262-5ff7a6ba065a tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:24:11.833766 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-2d5a99a0-0854-4d68-8262-5ff7a6ba065a tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:24:11.840295 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2d5a99a0-0854-4d68-8262-5ff7a6ba065a tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:24:11.840841 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2d5a99a0-0854-4d68-8262-5ff7a6ba065a tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:24:11.841287 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2d5a99a0-0854-4d68-8262-5ff7a6ba065a tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:24:11.841987 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2d5a99a0-0854-4d68-8262-5ff7a6ba065a tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:24:11.842446 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2d5a99a0-0854-4d68-8262-5ff7a6ba065a tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:24:11.842873 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2d5a99a0-0854-4d68-8262-5ff7a6ba065a tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:24:11.973704 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-2d5a99a0-0854-4d68-8262-5ff7a6ba065a tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:24:11.982139 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-2d5a99a0-0854-4d68-8262-5ff7a6ba065a tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.153140 Oct 20 06:24:11.982796 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 983/1990] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:24:11 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:24:12.783980 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-2ac0b2e7-fbcb-4902-b957-1e7c15cca043 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:24:12.784597 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-2ac0b2e7-fbcb-4902-b957-1e7c15cca043 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:24:12.792046 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-2ac0b2e7-fbcb-4902-b957-1e7c15cca043 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:24:12.792536 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-2ac0b2e7-fbcb-4902-b957-1e7c15cca043 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:24:12.793022 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-2ac0b2e7-fbcb-4902-b957-1e7c15cca043 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:24:12.793744 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-2ac0b2e7-fbcb-4902-b957-1e7c15cca043 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:24:12.794204 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-2ac0b2e7-fbcb-4902-b957-1e7c15cca043 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:24:12.794637 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-2ac0b2e7-fbcb-4902-b957-1e7c15cca043 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:24:12.863030 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-2ac0b2e7-fbcb-4902-b957-1e7c15cca043 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:24:12.872218 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-2ac0b2e7-fbcb-4902-b957-1e7c15cca043 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.092076 Oct 20 06:24:12.872824 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1008/1991] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:24:12 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:24:13.006411 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-cf5518fc-9b9e-45d8-a4cd-6cc85670dba0 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:24:13.007026 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-cf5518fc-9b9e-45d8-a4cd-6cc85670dba0 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:24:13.014308 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-cf5518fc-9b9e-45d8-a4cd-6cc85670dba0 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:24:13.014795 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-cf5518fc-9b9e-45d8-a4cd-6cc85670dba0 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:24:13.015230 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-cf5518fc-9b9e-45d8-a4cd-6cc85670dba0 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:24:13.015936 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-cf5518fc-9b9e-45d8-a4cd-6cc85670dba0 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:24:13.016390 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-cf5518fc-9b9e-45d8-a4cd-6cc85670dba0 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:24:13.016884 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-cf5518fc-9b9e-45d8-a4cd-6cc85670dba0 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:24:13.161336 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-cf5518fc-9b9e-45d8-a4cd-6cc85670dba0 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:24:13.169691 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-cf5518fc-9b9e-45d8-a4cd-6cc85670dba0 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.167142 Oct 20 06:24:13.170366 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 984/1992] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:24:13 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:24:13.895471 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-651ed355-f646-48ff-811f-76f417e9c23d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:24:13.896179 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-651ed355-f646-48ff-811f-76f417e9c23d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:24:13.902739 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-651ed355-f646-48ff-811f-76f417e9c23d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:24:13.903226 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-651ed355-f646-48ff-811f-76f417e9c23d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:24:13.903659 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-651ed355-f646-48ff-811f-76f417e9c23d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:24:13.904362 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-651ed355-f646-48ff-811f-76f417e9c23d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:24:13.904834 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-651ed355-f646-48ff-811f-76f417e9c23d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:24:13.905255 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-651ed355-f646-48ff-811f-76f417e9c23d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:24:14.169807 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-651ed355-f646-48ff-811f-76f417e9c23d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:24:14.178599 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-651ed355-f646-48ff-811f-76f417e9c23d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.286966 Oct 20 06:24:14.179779 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1009/1993] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:24:13 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:24:14.197364 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-f6ed41bf-6ba4-495f-9a96-adca0866eaed tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:24:14.197966 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-f6ed41bf-6ba4-495f-9a96-adca0866eaed tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:24:14.204578 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f6ed41bf-6ba4-495f-9a96-adca0866eaed tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:24:14.205105 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f6ed41bf-6ba4-495f-9a96-adca0866eaed tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:24:14.205548 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f6ed41bf-6ba4-495f-9a96-adca0866eaed tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:24:14.206254 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f6ed41bf-6ba4-495f-9a96-adca0866eaed tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:24:14.206707 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f6ed41bf-6ba4-495f-9a96-adca0866eaed tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:24:14.207135 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f6ed41bf-6ba4-495f-9a96-adca0866eaed tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:24:14.340962 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-f6ed41bf-6ba4-495f-9a96-adca0866eaed tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:24:14.349308 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-f6ed41bf-6ba4-495f-9a96-adca0866eaed tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.156508 Oct 20 06:24:14.349880 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 985/1994] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:24:14 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:24:15.202507 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-8126f057-d3ce-44f2-adf0-bec9ebaa33d3 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:24:15.203102 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-8126f057-d3ce-44f2-adf0-bec9ebaa33d3 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:24:15.209628 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-8126f057-d3ce-44f2-adf0-bec9ebaa33d3 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:24:15.210111 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-8126f057-d3ce-44f2-adf0-bec9ebaa33d3 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:24:15.211427 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-8126f057-d3ce-44f2-adf0-bec9ebaa33d3 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:24:15.212235 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-8126f057-d3ce-44f2-adf0-bec9ebaa33d3 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:24:15.212681 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-8126f057-d3ce-44f2-adf0-bec9ebaa33d3 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:24:15.213122 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-8126f057-d3ce-44f2-adf0-bec9ebaa33d3 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:24:15.275925 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-8126f057-d3ce-44f2-adf0-bec9ebaa33d3 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:24:15.284260 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-8126f057-d3ce-44f2-adf0-bec9ebaa33d3 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.085844 Oct 20 06:24:15.284850 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1010/1995] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:24:15 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:24:15.373248 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-da9d5a21-42c4-4d13-a384-daa55766398e tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:24:15.373864 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-da9d5a21-42c4-4d13-a384-daa55766398e tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:24:15.380618 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-da9d5a21-42c4-4d13-a384-daa55766398e tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:24:15.381129 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-da9d5a21-42c4-4d13-a384-daa55766398e tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:24:15.381563 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-da9d5a21-42c4-4d13-a384-daa55766398e tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:24:15.382736 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-da9d5a21-42c4-4d13-a384-daa55766398e tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:24:15.383335 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-da9d5a21-42c4-4d13-a384-daa55766398e tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:24:15.383767 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-da9d5a21-42c4-4d13-a384-daa55766398e tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:24:15.519491 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-da9d5a21-42c4-4d13-a384-daa55766398e tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:24:15.528236 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-da9d5a21-42c4-4d13-a384-daa55766398e tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.158917 Oct 20 06:24:15.528829 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 986/1996] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:24:15 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:24:16.307748 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-bd8ff110-8803-4d41-9903-dcda4c9c8fa3 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:24:16.308543 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-bd8ff110-8803-4d41-9903-dcda4c9c8fa3 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:24:16.315199 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-bd8ff110-8803-4d41-9903-dcda4c9c8fa3 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:24:16.315683 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-bd8ff110-8803-4d41-9903-dcda4c9c8fa3 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:24:16.316124 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-bd8ff110-8803-4d41-9903-dcda4c9c8fa3 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:24:16.316856 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-bd8ff110-8803-4d41-9903-dcda4c9c8fa3 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:24:16.317312 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-bd8ff110-8803-4d41-9903-dcda4c9c8fa3 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:24:16.317742 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-bd8ff110-8803-4d41-9903-dcda4c9c8fa3 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:24:16.379055 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-bd8ff110-8803-4d41-9903-dcda4c9c8fa3 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:24:16.387724 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-bd8ff110-8803-4d41-9903-dcda4c9c8fa3 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.084015 Oct 20 06:24:16.388313 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1011/1997] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:24:16 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:24:16.551474 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-0658afbf-5ed6-42b0-8971-642f50bcb7ec tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:24:16.552294 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-0658afbf-5ed6-42b0-8971-642f50bcb7ec tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:24:16.559141 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0658afbf-5ed6-42b0-8971-642f50bcb7ec tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:24:16.559551 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0658afbf-5ed6-42b0-8971-642f50bcb7ec tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:24:16.559987 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0658afbf-5ed6-42b0-8971-642f50bcb7ec tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:24:16.560743 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0658afbf-5ed6-42b0-8971-642f50bcb7ec tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:24:16.561198 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0658afbf-5ed6-42b0-8971-642f50bcb7ec tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:24:16.561623 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0658afbf-5ed6-42b0-8971-642f50bcb7ec tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:24:16.690131 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-0658afbf-5ed6-42b0-8971-642f50bcb7ec tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:24:16.698923 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-0658afbf-5ed6-42b0-8971-642f50bcb7ec tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.151355 Oct 20 06:24:16.699499 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 987/1998] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:24:16 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:24:17.410425 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-0bfe47b3-9c26-4973-95a7-2654d7c5497e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:24:17.411041 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-0bfe47b3-9c26-4973-95a7-2654d7c5497e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:24:17.417630 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-0bfe47b3-9c26-4973-95a7-2654d7c5497e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:24:17.418114 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-0bfe47b3-9c26-4973-95a7-2654d7c5497e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:24:17.418553 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-0bfe47b3-9c26-4973-95a7-2654d7c5497e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:24:17.419261 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-0bfe47b3-9c26-4973-95a7-2654d7c5497e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:24:17.419709 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-0bfe47b3-9c26-4973-95a7-2654d7c5497e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:24:17.420142 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-0bfe47b3-9c26-4973-95a7-2654d7c5497e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:24:17.484272 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-0bfe47b3-9c26-4973-95a7-2654d7c5497e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:24:17.492820 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-0bfe47b3-9c26-4973-95a7-2654d7c5497e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.086160 Oct 20 06:24:17.493714 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1012/1999] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:24:17 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:24:17.723297 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-e8ff0b9d-d55b-4de9-b8fa-c745bbd55ea2 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:24:17.723854 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-e8ff0b9d-d55b-4de9-b8fa-c745bbd55ea2 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:24:17.730256 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e8ff0b9d-d55b-4de9-b8fa-c745bbd55ea2 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:24:17.730732 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e8ff0b9d-d55b-4de9-b8fa-c745bbd55ea2 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:24:17.731161 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e8ff0b9d-d55b-4de9-b8fa-c745bbd55ea2 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:24:17.731865 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e8ff0b9d-d55b-4de9-b8fa-c745bbd55ea2 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:24:17.732292 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e8ff0b9d-d55b-4de9-b8fa-c745bbd55ea2 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:24:17.732721 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e8ff0b9d-d55b-4de9-b8fa-c745bbd55ea2 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:24:17.870685 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-e8ff0b9d-d55b-4de9-b8fa-c745bbd55ea2 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:24:17.878935 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-e8ff0b9d-d55b-4de9-b8fa-c745bbd55ea2 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.159614 Oct 20 06:24:17.879514 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 988/2000] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:24:17 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:24:18.515824 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-dd6c1c15-96a0-4a76-84c0-8d9d4abeaf14 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:24:18.516432 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-dd6c1c15-96a0-4a76-84c0-8d9d4abeaf14 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:24:18.523398 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-dd6c1c15-96a0-4a76-84c0-8d9d4abeaf14 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:24:18.523881 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-dd6c1c15-96a0-4a76-84c0-8d9d4abeaf14 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:24:18.524318 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-dd6c1c15-96a0-4a76-84c0-8d9d4abeaf14 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:24:18.525045 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-dd6c1c15-96a0-4a76-84c0-8d9d4abeaf14 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:24:18.525497 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-dd6c1c15-96a0-4a76-84c0-8d9d4abeaf14 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:24:18.525917 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-dd6c1c15-96a0-4a76-84c0-8d9d4abeaf14 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:24:18.589432 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-dd6c1c15-96a0-4a76-84c0-8d9d4abeaf14 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:24:18.597687 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-dd6c1c15-96a0-4a76-84c0-8d9d4abeaf14 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.085787 Oct 20 06:24:18.598249 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1013/2001] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:24:18 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:24:18.904032 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-e80ab1b2-0078-4cab-a6e5-9dcf9e7961ba tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:24:18.904627 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-e80ab1b2-0078-4cab-a6e5-9dcf9e7961ba tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:24:18.911141 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e80ab1b2-0078-4cab-a6e5-9dcf9e7961ba tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:24:18.911628 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e80ab1b2-0078-4cab-a6e5-9dcf9e7961ba tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:24:18.912067 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e80ab1b2-0078-4cab-a6e5-9dcf9e7961ba tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:24:18.912792 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e80ab1b2-0078-4cab-a6e5-9dcf9e7961ba tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:24:18.913245 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e80ab1b2-0078-4cab-a6e5-9dcf9e7961ba tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:24:18.913823 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e80ab1b2-0078-4cab-a6e5-9dcf9e7961ba tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:24:19.047707 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-e80ab1b2-0078-4cab-a6e5-9dcf9e7961ba tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:24:19.056605 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-e80ab1b2-0078-4cab-a6e5-9dcf9e7961ba tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.156374 Oct 20 06:24:19.057479 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 989/2002] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:24:18 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:24:19.621346 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-665ccfb2-04de-4f9c-9165-51c00e9620bb tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:24:19.621909 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-665ccfb2-04de-4f9c-9165-51c00e9620bb tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:24:19.628528 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-665ccfb2-04de-4f9c-9165-51c00e9620bb tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:24:19.629065 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-665ccfb2-04de-4f9c-9165-51c00e9620bb tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:24:19.629507 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-665ccfb2-04de-4f9c-9165-51c00e9620bb tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:24:19.630197 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-665ccfb2-04de-4f9c-9165-51c00e9620bb tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:24:19.630665 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-665ccfb2-04de-4f9c-9165-51c00e9620bb tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:24:19.631068 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-665ccfb2-04de-4f9c-9165-51c00e9620bb tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:24:19.695159 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-665ccfb2-04de-4f9c-9165-51c00e9620bb tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:24:19.703786 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-665ccfb2-04de-4f9c-9165-51c00e9620bb tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.086793 Oct 20 06:24:19.704570 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1014/2003] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:24:19 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:24:20.080784 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-947ee83d-1e8d-477e-a7bf-fcc151bb17c6 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:24:20.081496 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-947ee83d-1e8d-477e-a7bf-fcc151bb17c6 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:24:20.087989 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-947ee83d-1e8d-477e-a7bf-fcc151bb17c6 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:24:20.088470 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-947ee83d-1e8d-477e-a7bf-fcc151bb17c6 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:24:20.088978 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-947ee83d-1e8d-477e-a7bf-fcc151bb17c6 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:24:20.089638 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-947ee83d-1e8d-477e-a7bf-fcc151bb17c6 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:24:20.090086 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-947ee83d-1e8d-477e-a7bf-fcc151bb17c6 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:24:20.090505 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-947ee83d-1e8d-477e-a7bf-fcc151bb17c6 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:24:20.220053 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-947ee83d-1e8d-477e-a7bf-fcc151bb17c6 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:24:20.229046 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-947ee83d-1e8d-477e-a7bf-fcc151bb17c6 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.152123 Oct 20 06:24:20.229608 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 990/2004] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:24:20 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:24:20.726553 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-47d1474c-e91f-4407-8644-1aac90776ef1 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:24:20.727094 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-47d1474c-e91f-4407-8644-1aac90776ef1 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:24:20.733603 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-47d1474c-e91f-4407-8644-1aac90776ef1 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:24:20.734086 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-47d1474c-e91f-4407-8644-1aac90776ef1 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:24:20.734523 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-47d1474c-e91f-4407-8644-1aac90776ef1 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:24:20.735216 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-47d1474c-e91f-4407-8644-1aac90776ef1 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:24:20.735666 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-47d1474c-e91f-4407-8644-1aac90776ef1 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:24:20.736090 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-47d1474c-e91f-4407-8644-1aac90776ef1 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:24:20.797103 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-47d1474c-e91f-4407-8644-1aac90776ef1 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:24:20.805916 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-47d1474c-e91f-4407-8644-1aac90776ef1 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.083342 Oct 20 06:24:20.806492 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1015/2005] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:24:20 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:24:21.252563 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-23da11f3-a903-4f43-811a-14a5e79df08c tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:24:21.253220 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-23da11f3-a903-4f43-811a-14a5e79df08c tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:24:21.259838 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-23da11f3-a903-4f43-811a-14a5e79df08c tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:24:21.260323 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-23da11f3-a903-4f43-811a-14a5e79df08c tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:24:21.260815 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-23da11f3-a903-4f43-811a-14a5e79df08c tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:24:21.261527 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-23da11f3-a903-4f43-811a-14a5e79df08c tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:24:21.261979 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-23da11f3-a903-4f43-811a-14a5e79df08c tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:24:21.262406 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-23da11f3-a903-4f43-811a-14a5e79df08c tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:24:21.398018 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-23da11f3-a903-4f43-811a-14a5e79df08c tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:24:21.406567 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-23da11f3-a903-4f43-811a-14a5e79df08c tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.157929 Oct 20 06:24:21.407123 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 991/2006] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:24:21 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:24:21.829753 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-b519cddd-a3ce-47a0-8bf5-eef95a122c45 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:24:21.830381 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-b519cddd-a3ce-47a0-8bf5-eef95a122c45 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:24:21.837710 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b519cddd-a3ce-47a0-8bf5-eef95a122c45 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:24:21.838193 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b519cddd-a3ce-47a0-8bf5-eef95a122c45 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:24:21.838626 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b519cddd-a3ce-47a0-8bf5-eef95a122c45 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:24:21.839325 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b519cddd-a3ce-47a0-8bf5-eef95a122c45 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:24:21.839841 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b519cddd-a3ce-47a0-8bf5-eef95a122c45 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:24:21.840256 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b519cddd-a3ce-47a0-8bf5-eef95a122c45 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:24:21.902124 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-b519cddd-a3ce-47a0-8bf5-eef95a122c45 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:24:21.910433 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-b519cddd-a3ce-47a0-8bf5-eef95a122c45 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.084600 Oct 20 06:24:21.910994 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1016/2007] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:24:21 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:24:22.430502 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-edfd75e7-426a-4e5f-9e3d-65bc633c14e1 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:24:22.431116 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-edfd75e7-426a-4e5f-9e3d-65bc633c14e1 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:24:22.437566 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-edfd75e7-426a-4e5f-9e3d-65bc633c14e1 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:24:22.438050 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-edfd75e7-426a-4e5f-9e3d-65bc633c14e1 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:24:22.438485 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-edfd75e7-426a-4e5f-9e3d-65bc633c14e1 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:24:22.439182 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-edfd75e7-426a-4e5f-9e3d-65bc633c14e1 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:24:22.439661 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-edfd75e7-426a-4e5f-9e3d-65bc633c14e1 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:24:22.440091 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-edfd75e7-426a-4e5f-9e3d-65bc633c14e1 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:24:22.571295 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-edfd75e7-426a-4e5f-9e3d-65bc633c14e1 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:24:22.579615 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-edfd75e7-426a-4e5f-9e3d-65bc633c14e1 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.153119 Oct 20 06:24:22.580371 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 992/2008] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:24:22 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 06:24:22.933612 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-151144a2-c956-4f49-88c2-b778bad8984f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:24:22.934307 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-151144a2-c956-4f49-88c2-b778bad8984f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:24:22.940949 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-151144a2-c956-4f49-88c2-b778bad8984f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:24:22.941448 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-151144a2-c956-4f49-88c2-b778bad8984f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:24:22.941867 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-151144a2-c956-4f49-88c2-b778bad8984f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:24:22.942569 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-151144a2-c956-4f49-88c2-b778bad8984f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:24:22.943029 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-151144a2-c956-4f49-88c2-b778bad8984f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:24:22.943449 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-151144a2-c956-4f49-88c2-b778bad8984f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:24:23.010865 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-151144a2-c956-4f49-88c2-b778bad8984f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:24:23.019203 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-151144a2-c956-4f49-88c2-b778bad8984f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.090266 Oct 20 06:24:23.019776 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1017/2009] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:24:22 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 06:24:23.604364 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-cff89f3d-4d93-4c97-9429-60a26e64447b tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:24:23.605284 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-cff89f3d-4d93-4c97-9429-60a26e64447b tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:24:23.611737 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-cff89f3d-4d93-4c97-9429-60a26e64447b tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:24:23.612218 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-cff89f3d-4d93-4c97-9429-60a26e64447b tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:24:23.612662 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-cff89f3d-4d93-4c97-9429-60a26e64447b tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:24:23.613371 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-cff89f3d-4d93-4c97-9429-60a26e64447b tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:24:23.613830 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-cff89f3d-4d93-4c97-9429-60a26e64447b tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:24:23.614254 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-cff89f3d-4d93-4c97-9429-60a26e64447b tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:24:23.749402 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-cff89f3d-4d93-4c97-9429-60a26e64447b tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:24:23.758308 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-cff89f3d-4d93-4c97-9429-60a26e64447b tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.158653 Oct 20 06:24:23.771230 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 993/2010] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:24:23 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:24:24.042921 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-99cce09a-cfd9-4549-bbc0-e7ef7c557c1a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:24:24.043531 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-99cce09a-cfd9-4549-bbc0-e7ef7c557c1a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:24:24.050163 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-99cce09a-cfd9-4549-bbc0-e7ef7c557c1a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:24:24.050637 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-99cce09a-cfd9-4549-bbc0-e7ef7c557c1a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:24:24.051071 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-99cce09a-cfd9-4549-bbc0-e7ef7c557c1a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:24:24.051762 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-99cce09a-cfd9-4549-bbc0-e7ef7c557c1a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:24:24.052207 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-99cce09a-cfd9-4549-bbc0-e7ef7c557c1a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:24:24.052623 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-99cce09a-cfd9-4549-bbc0-e7ef7c557c1a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:24:24.119447 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-99cce09a-cfd9-4549-bbc0-e7ef7c557c1a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:24:24.127607 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-99cce09a-cfd9-4549-bbc0-e7ef7c557c1a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.088595 Oct 20 06:24:24.128165 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1018/2011] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:24:24 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:24:24.784008 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-7d897b00-6ed4-487b-ab58-a7dc0faf7b87 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:24:24.784665 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-7d897b00-6ed4-487b-ab58-a7dc0faf7b87 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:24:24.792042 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7d897b00-6ed4-487b-ab58-a7dc0faf7b87 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:24:24.792516 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7d897b00-6ed4-487b-ab58-a7dc0faf7b87 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:24:24.792988 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7d897b00-6ed4-487b-ab58-a7dc0faf7b87 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:24:24.793699 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7d897b00-6ed4-487b-ab58-a7dc0faf7b87 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:24:24.794151 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7d897b00-6ed4-487b-ab58-a7dc0faf7b87 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:24:24.794578 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7d897b00-6ed4-487b-ab58-a7dc0faf7b87 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:24:24.929262 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-7d897b00-6ed4-487b-ab58-a7dc0faf7b87 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:24:24.938266 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-7d897b00-6ed4-487b-ab58-a7dc0faf7b87 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.158092 Oct 20 06:24:24.938838 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 994/2012] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:24:24 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:24:25.151306 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-77ee3bcd-0850-415d-8abd-07d47a303d26 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:24:25.151926 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-77ee3bcd-0850-415d-8abd-07d47a303d26 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:24:25.158431 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-77ee3bcd-0850-415d-8abd-07d47a303d26 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:24:25.158918 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-77ee3bcd-0850-415d-8abd-07d47a303d26 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:24:25.159377 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-77ee3bcd-0850-415d-8abd-07d47a303d26 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:24:25.160074 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-77ee3bcd-0850-415d-8abd-07d47a303d26 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:24:25.160516 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-77ee3bcd-0850-415d-8abd-07d47a303d26 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:24:25.160974 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-77ee3bcd-0850-415d-8abd-07d47a303d26 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:24:25.223844 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-77ee3bcd-0850-415d-8abd-07d47a303d26 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:24:25.232473 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-77ee3bcd-0850-415d-8abd-07d47a303d26 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.085584 Oct 20 06:24:25.233070 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1019/2013] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:24:25 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:24:25.962412 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-13deeaa5-9db6-464f-a6f8-45278a796e98 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:24:25.963698 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-13deeaa5-9db6-464f-a6f8-45278a796e98 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:24:25.970199 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-13deeaa5-9db6-464f-a6f8-45278a796e98 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:24:25.970683 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-13deeaa5-9db6-464f-a6f8-45278a796e98 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:24:25.971119 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-13deeaa5-9db6-464f-a6f8-45278a796e98 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:24:25.971833 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-13deeaa5-9db6-464f-a6f8-45278a796e98 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:24:25.972287 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-13deeaa5-9db6-464f-a6f8-45278a796e98 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:24:25.972734 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-13deeaa5-9db6-464f-a6f8-45278a796e98 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:24:26.108938 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-13deeaa5-9db6-464f-a6f8-45278a796e98 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:24:26.117907 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-13deeaa5-9db6-464f-a6f8-45278a796e98 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.159386 Oct 20 06:24:26.118483 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 995/2014] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:24:25 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:24:26.255579 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-adbfe322-ed00-49b3-8fe2-d866c0bb3c6b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:24:26.256147 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-adbfe322-ed00-49b3-8fe2-d866c0bb3c6b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:24:26.262865 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-adbfe322-ed00-49b3-8fe2-d866c0bb3c6b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:24:26.263349 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-adbfe322-ed00-49b3-8fe2-d866c0bb3c6b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:24:26.263789 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-adbfe322-ed00-49b3-8fe2-d866c0bb3c6b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:24:26.264487 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-adbfe322-ed00-49b3-8fe2-d866c0bb3c6b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:24:26.265009 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-adbfe322-ed00-49b3-8fe2-d866c0bb3c6b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:24:26.265401 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-adbfe322-ed00-49b3-8fe2-d866c0bb3c6b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:24:26.327818 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-adbfe322-ed00-49b3-8fe2-d866c0bb3c6b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:24:26.337061 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-adbfe322-ed00-49b3-8fe2-d866c0bb3c6b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.085374 Oct 20 06:24:26.337648 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1020/2015] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:24:26 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:24:27.141301 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-30d6bde5-672a-41df-835a-e82a0183f773 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:24:27.141946 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-30d6bde5-672a-41df-835a-e82a0183f773 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:24:27.148851 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-30d6bde5-672a-41df-835a-e82a0183f773 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:24:27.149337 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-30d6bde5-672a-41df-835a-e82a0183f773 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:24:27.149773 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-30d6bde5-672a-41df-835a-e82a0183f773 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:24:27.150479 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-30d6bde5-672a-41df-835a-e82a0183f773 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:24:27.150927 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-30d6bde5-672a-41df-835a-e82a0183f773 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:24:27.151346 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-30d6bde5-672a-41df-835a-e82a0183f773 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:24:27.167946 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG dbcounter [-] [118860] Writing DB stats nova_cell1:SELECT=100 {{(pid=118860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:24:27.291733 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-30d6bde5-672a-41df-835a-e82a0183f773 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:24:27.300424 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-30d6bde5-672a-41df-835a-e82a0183f773 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.162960 Oct 20 06:24:27.308787 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 996/2016] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:24:27 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:24:27.361232 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-8147dcc4-9f4d-4cdd-8881-86ce3a540c61 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:24:27.361874 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-8147dcc4-9f4d-4cdd-8881-86ce3a540c61 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:24:27.368290 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-8147dcc4-9f4d-4cdd-8881-86ce3a540c61 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:24:27.368806 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-8147dcc4-9f4d-4cdd-8881-86ce3a540c61 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:24:27.369242 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-8147dcc4-9f4d-4cdd-8881-86ce3a540c61 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:24:27.369940 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-8147dcc4-9f4d-4cdd-8881-86ce3a540c61 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:24:27.370390 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-8147dcc4-9f4d-4cdd-8881-86ce3a540c61 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:24:27.370816 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-8147dcc4-9f4d-4cdd-8881-86ce3a540c61 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:24:27.438420 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-8147dcc4-9f4d-4cdd-8881-86ce3a540c61 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:24:27.447342 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-8147dcc4-9f4d-4cdd-8881-86ce3a540c61 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.089911 Oct 20 06:24:27.447938 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1021/2017] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:24:27 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:24:28.323460 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-4b2f5bce-90fa-4da8-b1cd-171100e75789 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:24:28.324075 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-4b2f5bce-90fa-4da8-b1cd-171100e75789 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:24:28.330597 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-4b2f5bce-90fa-4da8-b1cd-171100e75789 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:24:28.331075 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-4b2f5bce-90fa-4da8-b1cd-171100e75789 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:24:28.331510 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-4b2f5bce-90fa-4da8-b1cd-171100e75789 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:24:28.332199 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-4b2f5bce-90fa-4da8-b1cd-171100e75789 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:24:28.332685 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-4b2f5bce-90fa-4da8-b1cd-171100e75789 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:24:28.333130 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-4b2f5bce-90fa-4da8-b1cd-171100e75789 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:24:28.466882 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-4b2f5bce-90fa-4da8-b1cd-171100e75789 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:24:28.470902 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-bcbb2e1a-db41-48b1-b76a-f244b65d402b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:24:28.472160 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-bcbb2e1a-db41-48b1-b76a-f244b65d402b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:24:28.475434 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-4b2f5bce-90fa-4da8-b1cd-171100e75789 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.155929 Oct 20 06:24:28.476301 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 997/2018] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:24:28 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:24:28.478923 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-bcbb2e1a-db41-48b1-b76a-f244b65d402b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:24:28.479593 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-bcbb2e1a-db41-48b1-b76a-f244b65d402b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:24:28.480111 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-bcbb2e1a-db41-48b1-b76a-f244b65d402b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:24:28.480911 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-bcbb2e1a-db41-48b1-b76a-f244b65d402b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:24:28.481986 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-bcbb2e1a-db41-48b1-b76a-f244b65d402b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:24:28.482699 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-bcbb2e1a-db41-48b1-b76a-f244b65d402b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:24:28.546158 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-bcbb2e1a-db41-48b1-b76a-f244b65d402b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:24:28.554868 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-bcbb2e1a-db41-48b1-b76a-f244b65d402b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.087650 Oct 20 06:24:28.555443 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1022/2019] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:24:28 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 06:24:29.499481 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-e465226f-eff4-4320-8bec-931879e815c4 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:24:29.500093 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-e465226f-eff4-4320-8bec-931879e815c4 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:24:29.506613 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e465226f-eff4-4320-8bec-931879e815c4 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:24:29.507710 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e465226f-eff4-4320-8bec-931879e815c4 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:24:29.508471 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e465226f-eff4-4320-8bec-931879e815c4 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:24:29.509867 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e465226f-eff4-4320-8bec-931879e815c4 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:24:29.510339 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e465226f-eff4-4320-8bec-931879e815c4 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:24:29.510776 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e465226f-eff4-4320-8bec-931879e815c4 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:24:29.577142 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-f91cfe60-ebfd-40bc-8382-5bc4ad9b7c19 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:24:29.577699 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-f91cfe60-ebfd-40bc-8382-5bc4ad9b7c19 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:24:29.584127 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f91cfe60-ebfd-40bc-8382-5bc4ad9b7c19 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:24:29.585868 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f91cfe60-ebfd-40bc-8382-5bc4ad9b7c19 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:24:29.586338 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f91cfe60-ebfd-40bc-8382-5bc4ad9b7c19 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:24:29.587056 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f91cfe60-ebfd-40bc-8382-5bc4ad9b7c19 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:24:29.587520 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f91cfe60-ebfd-40bc-8382-5bc4ad9b7c19 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:24:29.587956 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f91cfe60-ebfd-40bc-8382-5bc4ad9b7c19 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:24:29.603729 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG dbcounter [-] [118861] Writing DB stats nova_cell1:SELECT=100 {{(pid=118861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:24:29.650846 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-e465226f-eff4-4320-8bec-931879e815c4 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:24:29.657257 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-f91cfe60-ebfd-40bc-8382-5bc4ad9b7c19 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:24:29.662108 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-e465226f-eff4-4320-8bec-931879e815c4 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.166479 Oct 20 06:24:29.662871 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 998/2020] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:24:29 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:24:29.665078 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-f91cfe60-ebfd-40bc-8382-5bc4ad9b7c19 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.091963 Oct 20 06:24:29.665735 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1023/2021] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:24:29 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 06:24:30.690005 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-54314029-cd57-4a02-a385-bc111e9f6162 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:24:30.690606 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-54314029-cd57-4a02-a385-bc111e9f6162 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:24:30.697797 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-54314029-cd57-4a02-a385-bc111e9f6162 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:24:30.698284 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-54314029-cd57-4a02-a385-bc111e9f6162 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:24:30.698772 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-54314029-cd57-4a02-a385-bc111e9f6162 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:24:30.699479 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-54314029-cd57-4a02-a385-bc111e9f6162 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:24:30.699949 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-54314029-cd57-4a02-a385-bc111e9f6162 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:24:30.700274 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-1ed75c06-8025-4d12-8215-a0e411b7dbff tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:24:30.700818 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-54314029-cd57-4a02-a385-bc111e9f6162 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:24:30.700942 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-1ed75c06-8025-4d12-8215-a0e411b7dbff tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:24:30.703272 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG dbcounter [-] [118861] Writing DB stats nova_api:SELECT=54 {{(pid=118861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:24:30.709017 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1ed75c06-8025-4d12-8215-a0e411b7dbff tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:24:30.709508 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1ed75c06-8025-4d12-8215-a0e411b7dbff tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:24:30.709954 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1ed75c06-8025-4d12-8215-a0e411b7dbff tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:24:30.710661 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1ed75c06-8025-4d12-8215-a0e411b7dbff tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:24:30.711118 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1ed75c06-8025-4d12-8215-a0e411b7dbff tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:24:30.711539 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1ed75c06-8025-4d12-8215-a0e411b7dbff tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:24:30.778023 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-1ed75c06-8025-4d12-8215-a0e411b7dbff tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:24:30.797538 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-1ed75c06-8025-4d12-8215-a0e411b7dbff tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.101293 Oct 20 06:24:30.798696 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1024/2022] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:24:30 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 06:24:30.836676 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-54314029-cd57-4a02-a385-bc111e9f6162 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:24:30.845087 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-54314029-cd57-4a02-a385-bc111e9f6162 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.159143 Oct 20 06:24:30.845662 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 999/2023] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:24:30 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:24:31.821930 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-5b0434bb-3394-4f21-a47e-ea34f57cd38c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:24:31.822599 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-5b0434bb-3394-4f21-a47e-ea34f57cd38c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:24:31.829007 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5b0434bb-3394-4f21-a47e-ea34f57cd38c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:24:31.829488 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5b0434bb-3394-4f21-a47e-ea34f57cd38c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:24:31.829924 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5b0434bb-3394-4f21-a47e-ea34f57cd38c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:24:31.830617 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5b0434bb-3394-4f21-a47e-ea34f57cd38c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:24:31.831068 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5b0434bb-3394-4f21-a47e-ea34f57cd38c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:24:31.831491 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5b0434bb-3394-4f21-a47e-ea34f57cd38c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:24:31.869514 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-ce9a75b3-6872-40de-8a17-611096bfe0f8 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:24:31.870258 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-ce9a75b3-6872-40de-8a17-611096bfe0f8 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:24:31.873042 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG dbcounter [-] [118860] Writing DB stats nova_api:SELECT=52 {{(pid=118860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:24:31.878637 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-ce9a75b3-6872-40de-8a17-611096bfe0f8 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:24:31.879206 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-ce9a75b3-6872-40de-8a17-611096bfe0f8 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:24:31.879712 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-ce9a75b3-6872-40de-8a17-611096bfe0f8 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:24:31.880527 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-ce9a75b3-6872-40de-8a17-611096bfe0f8 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:24:31.881086 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-ce9a75b3-6872-40de-8a17-611096bfe0f8 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:24:31.881586 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-ce9a75b3-6872-40de-8a17-611096bfe0f8 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:24:31.899979 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-5b0434bb-3394-4f21-a47e-ea34f57cd38c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:24:31.908530 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-5b0434bb-3394-4f21-a47e-ea34f57cd38c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.091163 Oct 20 06:24:31.909331 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1025/2024] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:24:31 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:24:32.014051 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-ce9a75b3-6872-40de-8a17-611096bfe0f8 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:24:32.022285 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-ce9a75b3-6872-40de-8a17-611096bfe0f8 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.156706 Oct 20 06:24:32.023549 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1000/2025] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:24:31 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:24:32.996842 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-ea6d4e55-f218-4576-832c-415ae324a0e2 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:24:32.997468 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-ea6d4e55-f218-4576-832c-415ae324a0e2 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:24:33.003559 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ea6d4e55-f218-4576-832c-415ae324a0e2 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:24:33.004053 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ea6d4e55-f218-4576-832c-415ae324a0e2 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:24:33.004486 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ea6d4e55-f218-4576-832c-415ae324a0e2 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:24:33.005220 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ea6d4e55-f218-4576-832c-415ae324a0e2 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:24:33.005678 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ea6d4e55-f218-4576-832c-415ae324a0e2 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:24:33.006113 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ea6d4e55-f218-4576-832c-415ae324a0e2 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:24:33.046534 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-30866371-f87c-4ec6-aa48-abaa933e4bc1 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:24:33.047189 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-30866371-f87c-4ec6-aa48-abaa933e4bc1 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:24:33.054333 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-30866371-f87c-4ec6-aa48-abaa933e4bc1 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:24:33.054824 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-30866371-f87c-4ec6-aa48-abaa933e4bc1 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:24:33.055355 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-30866371-f87c-4ec6-aa48-abaa933e4bc1 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:24:33.056067 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-30866371-f87c-4ec6-aa48-abaa933e4bc1 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:24:33.056539 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-30866371-f87c-4ec6-aa48-abaa933e4bc1 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:24:33.056984 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-30866371-f87c-4ec6-aa48-abaa933e4bc1 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:24:33.071268 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-ea6d4e55-f218-4576-832c-415ae324a0e2 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:24:33.079949 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-ea6d4e55-f218-4576-832c-415ae324a0e2 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.153023 Oct 20 06:24:33.080587 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1026/2026] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:24:32 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:24:33.193806 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-30866371-f87c-4ec6-aa48-abaa933e4bc1 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:24:33.202172 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-30866371-f87c-4ec6-aa48-abaa933e4bc1 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.159441 Oct 20 06:24:33.202749 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1001/2027] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:24:33 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 06:24:34.102413 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-3d5940b0-1ef1-47e7-a488-1f9f63099990 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:24:34.103009 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-3d5940b0-1ef1-47e7-a488-1f9f63099990 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:24:34.109498 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-3d5940b0-1ef1-47e7-a488-1f9f63099990 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:24:34.109973 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-3d5940b0-1ef1-47e7-a488-1f9f63099990 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:24:34.110405 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-3d5940b0-1ef1-47e7-a488-1f9f63099990 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:24:34.111091 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-3d5940b0-1ef1-47e7-a488-1f9f63099990 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:24:34.111536 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-3d5940b0-1ef1-47e7-a488-1f9f63099990 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:24:34.111953 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-3d5940b0-1ef1-47e7-a488-1f9f63099990 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:24:34.174572 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-3d5940b0-1ef1-47e7-a488-1f9f63099990 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:24:34.182742 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-3d5940b0-1ef1-47e7-a488-1f9f63099990 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.084314 Oct 20 06:24:34.183302 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1027/2028] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:24:34 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:24:34.225704 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-644aed7b-7218-4e3f-a6a9-bc898f9dddcc tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:24:34.226430 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-644aed7b-7218-4e3f-a6a9-bc898f9dddcc tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:24:34.233024 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-644aed7b-7218-4e3f-a6a9-bc898f9dddcc tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:24:34.233593 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-644aed7b-7218-4e3f-a6a9-bc898f9dddcc tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:24:34.234101 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-644aed7b-7218-4e3f-a6a9-bc898f9dddcc tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:24:34.234895 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-644aed7b-7218-4e3f-a6a9-bc898f9dddcc tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:24:34.235350 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-644aed7b-7218-4e3f-a6a9-bc898f9dddcc tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:24:34.235775 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-644aed7b-7218-4e3f-a6a9-bc898f9dddcc tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:24:34.368396 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-644aed7b-7218-4e3f-a6a9-bc898f9dddcc tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:24:34.376876 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-644aed7b-7218-4e3f-a6a9-bc898f9dddcc tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.155102 Oct 20 06:24:34.377451 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1002/2029] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:24:34 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:24:35.206311 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-4128e402-170c-4c07-b551-4f078d0990fe tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:24:35.206962 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-4128e402-170c-4c07-b551-4f078d0990fe tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:24:35.214163 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4128e402-170c-4c07-b551-4f078d0990fe tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:24:35.214646 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4128e402-170c-4c07-b551-4f078d0990fe tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:24:35.215083 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4128e402-170c-4c07-b551-4f078d0990fe tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:24:35.215774 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4128e402-170c-4c07-b551-4f078d0990fe tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:24:35.216225 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4128e402-170c-4c07-b551-4f078d0990fe tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:24:35.216651 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4128e402-170c-4c07-b551-4f078d0990fe tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:24:35.281194 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-4128e402-170c-4c07-b551-4f078d0990fe tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:24:35.290728 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-4128e402-170c-4c07-b551-4f078d0990fe tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.088269 Oct 20 06:24:35.291304 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1028/2030] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:24:35 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:24:35.401325 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-078f6cca-c7a0-4bd4-9413-af44e5f48cb2 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:24:35.402050 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-078f6cca-c7a0-4bd4-9413-af44e5f48cb2 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:24:35.408376 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-078f6cca-c7a0-4bd4-9413-af44e5f48cb2 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:24:35.409124 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-078f6cca-c7a0-4bd4-9413-af44e5f48cb2 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:24:35.409761 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-078f6cca-c7a0-4bd4-9413-af44e5f48cb2 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:24:35.410651 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-078f6cca-c7a0-4bd4-9413-af44e5f48cb2 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:24:35.411283 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-078f6cca-c7a0-4bd4-9413-af44e5f48cb2 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:24:35.411879 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-078f6cca-c7a0-4bd4-9413-af44e5f48cb2 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:24:35.552116 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-078f6cca-c7a0-4bd4-9413-af44e5f48cb2 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:24:35.561316 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-078f6cca-c7a0-4bd4-9413-af44e5f48cb2 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.164715 Oct 20 06:24:35.562101 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1003/2031] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:24:35 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:24:36.313753 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-0fa11b0b-681f-48a0-9e76-4c752827f90f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:24:36.314802 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-0fa11b0b-681f-48a0-9e76-4c752827f90f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:24:36.322600 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-0fa11b0b-681f-48a0-9e76-4c752827f90f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:24:36.323151 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-0fa11b0b-681f-48a0-9e76-4c752827f90f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:24:36.323667 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-0fa11b0b-681f-48a0-9e76-4c752827f90f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:24:36.324482 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-0fa11b0b-681f-48a0-9e76-4c752827f90f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:24:36.325021 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-0fa11b0b-681f-48a0-9e76-4c752827f90f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:24:36.325520 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-0fa11b0b-681f-48a0-9e76-4c752827f90f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:24:36.393630 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-0fa11b0b-681f-48a0-9e76-4c752827f90f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:24:36.404303 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-0fa11b0b-681f-48a0-9e76-4c752827f90f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.094651 Oct 20 06:24:36.405068 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1029/2032] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:24:36 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:24:36.584991 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-316c4f4d-2026-469c-9f5e-6dbe9942aa2b tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:24:36.585932 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-316c4f4d-2026-469c-9f5e-6dbe9942aa2b tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:24:36.592668 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-316c4f4d-2026-469c-9f5e-6dbe9942aa2b tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:24:36.593181 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-316c4f4d-2026-469c-9f5e-6dbe9942aa2b tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:24:36.593644 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-316c4f4d-2026-469c-9f5e-6dbe9942aa2b tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:24:36.594403 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-316c4f4d-2026-469c-9f5e-6dbe9942aa2b tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:24:36.594883 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-316c4f4d-2026-469c-9f5e-6dbe9942aa2b tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:24:36.595353 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-316c4f4d-2026-469c-9f5e-6dbe9942aa2b tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:24:36.732272 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-316c4f4d-2026-469c-9f5e-6dbe9942aa2b tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:24:36.741380 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-316c4f4d-2026-469c-9f5e-6dbe9942aa2b tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.160225 Oct 20 06:24:36.750261 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1004/2033] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:24:36 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 06:24:37.427410 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-4088dd9b-afdc-4e8d-b6c0-c62e1c08251e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:24:37.428025 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-4088dd9b-afdc-4e8d-b6c0-c62e1c08251e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:24:37.437356 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4088dd9b-afdc-4e8d-b6c0-c62e1c08251e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:24:37.438146 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4088dd9b-afdc-4e8d-b6c0-c62e1c08251e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:24:37.438905 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4088dd9b-afdc-4e8d-b6c0-c62e1c08251e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:24:37.439621 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4088dd9b-afdc-4e8d-b6c0-c62e1c08251e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:24:37.440076 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4088dd9b-afdc-4e8d-b6c0-c62e1c08251e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:24:37.440505 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4088dd9b-afdc-4e8d-b6c0-c62e1c08251e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:24:37.504201 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-4088dd9b-afdc-4e8d-b6c0-c62e1c08251e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:24:37.514197 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-4088dd9b-afdc-4e8d-b6c0-c62e1c08251e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.090576 Oct 20 06:24:37.514787 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1030/2034] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:24:37 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:24:37.765481 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-0f00d66f-2dba-4242-98f2-3e6af5a748c8 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:24:37.766114 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-0f00d66f-2dba-4242-98f2-3e6af5a748c8 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:24:37.772508 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0f00d66f-2dba-4242-98f2-3e6af5a748c8 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:24:37.773208 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0f00d66f-2dba-4242-98f2-3e6af5a748c8 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:24:37.773645 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0f00d66f-2dba-4242-98f2-3e6af5a748c8 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:24:37.774355 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0f00d66f-2dba-4242-98f2-3e6af5a748c8 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:24:37.774823 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0f00d66f-2dba-4242-98f2-3e6af5a748c8 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:24:37.775250 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0f00d66f-2dba-4242-98f2-3e6af5a748c8 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:24:37.915249 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-0f00d66f-2dba-4242-98f2-3e6af5a748c8 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:24:37.924130 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-0f00d66f-2dba-4242-98f2-3e6af5a748c8 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.162406 Oct 20 06:24:37.924786 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1005/2035] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:24:37 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:24:38.537548 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-ccd21209-982b-4672-ad47-a9c624161587 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:24:38.538782 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-ccd21209-982b-4672-ad47-a9c624161587 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:24:38.545173 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ccd21209-982b-4672-ad47-a9c624161587 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:24:38.545655 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ccd21209-982b-4672-ad47-a9c624161587 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:24:38.546085 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ccd21209-982b-4672-ad47-a9c624161587 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:24:38.546778 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ccd21209-982b-4672-ad47-a9c624161587 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:24:38.547223 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ccd21209-982b-4672-ad47-a9c624161587 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:24:38.547639 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ccd21209-982b-4672-ad47-a9c624161587 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:24:38.608767 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-ccd21209-982b-4672-ad47-a9c624161587 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:24:38.617934 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-ccd21209-982b-4672-ad47-a9c624161587 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.084206 Oct 20 06:24:38.618510 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1031/2036] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:24:38 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:24:38.947362 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-c130ddd6-3902-4cd8-8976-27335e80a882 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:24:38.947973 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-c130ddd6-3902-4cd8-8976-27335e80a882 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:24:38.954412 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c130ddd6-3902-4cd8-8976-27335e80a882 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:24:38.954896 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c130ddd6-3902-4cd8-8976-27335e80a882 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:24:38.955336 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c130ddd6-3902-4cd8-8976-27335e80a882 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:24:38.956035 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c130ddd6-3902-4cd8-8976-27335e80a882 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:24:38.956512 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c130ddd6-3902-4cd8-8976-27335e80a882 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:24:38.956972 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c130ddd6-3902-4cd8-8976-27335e80a882 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:24:39.087214 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-c130ddd6-3902-4cd8-8976-27335e80a882 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:24:39.095477 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-c130ddd6-3902-4cd8-8976-27335e80a882 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.151995 Oct 20 06:24:39.096050 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1006/2037] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:24:38 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:24:39.641082 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-739940f4-1b64-409b-a802-a04efa539824 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:24:39.641707 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-739940f4-1b64-409b-a802-a04efa539824 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:24:39.649420 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-739940f4-1b64-409b-a802-a04efa539824 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:24:39.649909 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-739940f4-1b64-409b-a802-a04efa539824 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:24:39.650363 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-739940f4-1b64-409b-a802-a04efa539824 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:24:39.651056 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-739940f4-1b64-409b-a802-a04efa539824 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:24:39.651513 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-739940f4-1b64-409b-a802-a04efa539824 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:24:39.651929 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-739940f4-1b64-409b-a802-a04efa539824 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:24:39.718259 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-739940f4-1b64-409b-a802-a04efa539824 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:24:39.727290 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-739940f4-1b64-409b-a802-a04efa539824 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.090175 Oct 20 06:24:39.727859 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1032/2038] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:24:39 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:24:40.119141 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-ae9d3afd-978a-4d1c-86e0-bc84c519a271 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:24:40.119683 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-ae9d3afd-978a-4d1c-86e0-bc84c519a271 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:24:40.126066 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-ae9d3afd-978a-4d1c-86e0-bc84c519a271 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:24:40.126546 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-ae9d3afd-978a-4d1c-86e0-bc84c519a271 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:24:40.126976 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-ae9d3afd-978a-4d1c-86e0-bc84c519a271 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:24:40.127668 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-ae9d3afd-978a-4d1c-86e0-bc84c519a271 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:24:40.128116 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-ae9d3afd-978a-4d1c-86e0-bc84c519a271 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:24:40.128537 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-ae9d3afd-978a-4d1c-86e0-bc84c519a271 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:24:40.258115 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-ae9d3afd-978a-4d1c-86e0-bc84c519a271 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:24:40.266588 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-ae9d3afd-978a-4d1c-86e0-bc84c519a271 tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.151508 Oct 20 06:24:40.267146 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1007/2039] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:24:40 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:24:40.750346 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-4aeefd07-90f7-4941-b179-05b199f04c75 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:24:40.750903 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-4aeefd07-90f7-4941-b179-05b199f04c75 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:24:40.758425 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4aeefd07-90f7-4941-b179-05b199f04c75 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:24:40.758910 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4aeefd07-90f7-4941-b179-05b199f04c75 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:24:40.759614 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4aeefd07-90f7-4941-b179-05b199f04c75 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:24:40.760309 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4aeefd07-90f7-4941-b179-05b199f04c75 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:24:40.760786 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4aeefd07-90f7-4941-b179-05b199f04c75 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:24:40.761212 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4aeefd07-90f7-4941-b179-05b199f04c75 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:24:40.826728 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-4aeefd07-90f7-4941-b179-05b199f04c75 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:24:40.836369 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-4aeefd07-90f7-4941-b179-05b199f04c75 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.089446 Oct 20 06:24:40.836973 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1033/2040] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:24:40 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:24:41.290625 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-ddef8de6-d0d9-4062-960d-15ac2f9dc1be tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:24:41.291279 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-ddef8de6-d0d9-4062-960d-15ac2f9dc1be tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:24:41.297916 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-ddef8de6-d0d9-4062-960d-15ac2f9dc1be tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:24:41.298406 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-ddef8de6-d0d9-4062-960d-15ac2f9dc1be tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:24:41.298856 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-ddef8de6-d0d9-4062-960d-15ac2f9dc1be tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:24:41.299564 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-ddef8de6-d0d9-4062-960d-15ac2f9dc1be tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:24:41.300021 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-ddef8de6-d0d9-4062-960d-15ac2f9dc1be tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:24:41.300534 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-ddef8de6-d0d9-4062-960d-15ac2f9dc1be tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:24:41.436747 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-ddef8de6-d0d9-4062-960d-15ac2f9dc1be tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:24:41.446044 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-ddef8de6-d0d9-4062-960d-15ac2f9dc1be tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.159829 Oct 20 06:24:41.446607 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1008/2041] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:24:41 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:24:41.859474 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-ecc7eabb-c56f-4c3c-a2b7-f0f4e4971a17 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:24:41.860213 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-ecc7eabb-c56f-4c3c-a2b7-f0f4e4971a17 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:24:41.866939 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ecc7eabb-c56f-4c3c-a2b7-f0f4e4971a17 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:24:41.867424 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ecc7eabb-c56f-4c3c-a2b7-f0f4e4971a17 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:24:41.867865 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ecc7eabb-c56f-4c3c-a2b7-f0f4e4971a17 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:24:41.868570 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ecc7eabb-c56f-4c3c-a2b7-f0f4e4971a17 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:24:41.869067 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ecc7eabb-c56f-4c3c-a2b7-f0f4e4971a17 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:24:41.869495 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ecc7eabb-c56f-4c3c-a2b7-f0f4e4971a17 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:24:41.930663 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-ecc7eabb-c56f-4c3c-a2b7-f0f4e4971a17 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:24:41.938960 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-ecc7eabb-c56f-4c3c-a2b7-f0f4e4971a17 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.083402 Oct 20 06:24:41.939531 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1034/2042] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:24:41 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:24:42.469947 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-7e7a759b-574e-46f6-a5e1-103f09d9923c tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:24:42.470557 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-7e7a759b-574e-46f6-a5e1-103f09d9923c tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] [instance: 0247d13a-779d-4301-ba85-6cbcbf12252f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:24:42.477028 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7e7a759b-574e-46f6-a5e1-103f09d9923c tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:24:42.477503 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7e7a759b-574e-46f6-a5e1-103f09d9923c tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:24:42.477936 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7e7a759b-574e-46f6-a5e1-103f09d9923c tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:24:42.478623 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7e7a759b-574e-46f6-a5e1-103f09d9923c tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:24:42.479068 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7e7a759b-574e-46f6-a5e1-103f09d9923c tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:24:42.479486 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7e7a759b-574e-46f6-a5e1-103f09d9923c tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:24:42.607708 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-7e7a759b-574e-46f6-a5e1-103f09d9923c tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7935a2a80f054f699983e5e2f3e64a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de3d03dde2d4ef6a8b925a0a5391d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:24:42.616747 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-7e7a759b-574e-46f6-a5e1-103f09d9923c tempest-VolumesSnapshotTestJSON-1271861888 tempest-VolumesSnapshotTestJSON-1271861888-project] 10.222.0.20 "GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f" status: 200 len: 1560 microversion: 2.1 time: 0.149753 Oct 20 06:24:42.617319 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1009/2043] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:24:42 2022] GET /compute/v2.1/servers/0247d13a-779d-4301-ba85-6cbcbf12252f => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:24:42.962380 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-6fc1a53b-7fee-491e-b619-17f422b41e72 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:24:42.963103 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-6fc1a53b-7fee-491e-b619-17f422b41e72 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:24:42.969405 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-6fc1a53b-7fee-491e-b619-17f422b41e72 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:24:42.969887 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-6fc1a53b-7fee-491e-b619-17f422b41e72 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:24:42.970326 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-6fc1a53b-7fee-491e-b619-17f422b41e72 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:24:42.971027 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-6fc1a53b-7fee-491e-b619-17f422b41e72 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:24:42.971476 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-6fc1a53b-7fee-491e-b619-17f422b41e72 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:24:42.971896 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-6fc1a53b-7fee-491e-b619-17f422b41e72 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:24:43.035385 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-6fc1a53b-7fee-491e-b619-17f422b41e72 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:24:43.043880 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-6fc1a53b-7fee-491e-b619-17f422b41e72 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.086098 Oct 20 06:24:43.044449 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1035/2044] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:24:42 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:24:44.066927 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-6192cb54-44c3-4949-83e3-6ef645935b00 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:24:44.067574 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-6192cb54-44c3-4949-83e3-6ef645935b00 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:24:44.074142 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-6192cb54-44c3-4949-83e3-6ef645935b00 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:24:44.074628 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-6192cb54-44c3-4949-83e3-6ef645935b00 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:24:44.075063 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-6192cb54-44c3-4949-83e3-6ef645935b00 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:24:44.075757 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-6192cb54-44c3-4949-83e3-6ef645935b00 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:24:44.076210 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-6192cb54-44c3-4949-83e3-6ef645935b00 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:24:44.076634 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-6192cb54-44c3-4949-83e3-6ef645935b00 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:24:44.138698 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-6192cb54-44c3-4949-83e3-6ef645935b00 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:24:44.147522 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-6192cb54-44c3-4949-83e3-6ef645935b00 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.084022 Oct 20 06:24:44.148089 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1010/2045] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:24:44 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:24:45.170421 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-a006a348-47a3-4941-a13e-26d44db89a46 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:24:45.171030 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-a006a348-47a3-4941-a13e-26d44db89a46 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:24:45.177434 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a006a348-47a3-4941-a13e-26d44db89a46 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:24:45.177909 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a006a348-47a3-4941-a13e-26d44db89a46 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:24:45.178382 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a006a348-47a3-4941-a13e-26d44db89a46 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:24:45.179175 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a006a348-47a3-4941-a13e-26d44db89a46 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:24:45.179627 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a006a348-47a3-4941-a13e-26d44db89a46 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:24:45.180046 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a006a348-47a3-4941-a13e-26d44db89a46 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:24:45.242796 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-a006a348-47a3-4941-a13e-26d44db89a46 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:24:45.251254 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-a006a348-47a3-4941-a13e-26d44db89a46 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.084705 Oct 20 06:24:45.251836 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1036/2046] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:24:45 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:24:46.275126 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-3e5e5fd6-0b5e-4c18-8473-a3048a1de94f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:24:46.275644 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-3e5e5fd6-0b5e-4c18-8473-a3048a1de94f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:24:46.278220 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 20 06:24:46.278380 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: Thu Oct 20 06:24:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 (ip 10.222.0.20) !!! Oct 20 06:24:46.284651 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3e5e5fd6-0b5e-4c18-8473-a3048a1de94f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:24:46.285152 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3e5e5fd6-0b5e-4c18-8473-a3048a1de94f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:24:46.285584 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3e5e5fd6-0b5e-4c18-8473-a3048a1de94f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:24:46.286273 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3e5e5fd6-0b5e-4c18-8473-a3048a1de94f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:24:46.286720 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3e5e5fd6-0b5e-4c18-8473-a3048a1de94f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:24:46.287141 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3e5e5fd6-0b5e-4c18-8473-a3048a1de94f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:24:46.356739 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-3e5e5fd6-0b5e-4c18-8473-a3048a1de94f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:24:46.365331 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-3e5e5fd6-0b5e-4c18-8473-a3048a1de94f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.094667 Oct 20 06:24:46.365913 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1011/2047] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:24:46 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:24:47.388869 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-1aacdf49-3927-43a3-8986-d2ea89c717df tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:24:47.389520 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-1aacdf49-3927-43a3-8986-d2ea89c717df tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:24:47.396455 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1aacdf49-3927-43a3-8986-d2ea89c717df tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:24:47.397095 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1aacdf49-3927-43a3-8986-d2ea89c717df tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:24:47.397823 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1aacdf49-3927-43a3-8986-d2ea89c717df tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:24:47.398693 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1aacdf49-3927-43a3-8986-d2ea89c717df tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:24:47.399148 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1aacdf49-3927-43a3-8986-d2ea89c717df tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:24:47.399586 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1aacdf49-3927-43a3-8986-d2ea89c717df tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:24:47.471128 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-1aacdf49-3927-43a3-8986-d2ea89c717df tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:24:47.479952 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-1aacdf49-3927-43a3-8986-d2ea89c717df tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.095334 Oct 20 06:24:47.480526 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1037/2048] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:24:47 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:24:48.505989 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-c230e567-c868-45b4-b372-c4b7b782e89c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:24:48.507277 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-c230e567-c868-45b4-b372-c4b7b782e89c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:24:48.514215 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c230e567-c868-45b4-b372-c4b7b782e89c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:24:48.514699 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c230e567-c868-45b4-b372-c4b7b782e89c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:24:48.515140 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c230e567-c868-45b4-b372-c4b7b782e89c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:24:48.515839 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c230e567-c868-45b4-b372-c4b7b782e89c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:24:48.516286 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c230e567-c868-45b4-b372-c4b7b782e89c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:24:48.516741 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c230e567-c868-45b4-b372-c4b7b782e89c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:24:48.582942 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-c230e567-c868-45b4-b372-c4b7b782e89c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:24:48.591646 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-c230e567-c868-45b4-b372-c4b7b782e89c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.089453 Oct 20 06:24:48.592623 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1012/2049] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:24:48 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:24:49.615065 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-694b696a-892c-4d71-a455-a0458e796eee tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:24:49.615846 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-694b696a-892c-4d71-a455-a0458e796eee tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:24:49.617991 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 20 06:24:49.618114 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: Thu Oct 20 06:24:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 (ip 10.222.0.20) !!! Oct 20 06:24:49.619602 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 20 06:24:49.619733 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: Thu Oct 20 06:24:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 (ip 10.222.0.20) !!! Oct 20 06:24:49.636442 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-694b696a-892c-4d71-a455-a0458e796eee tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:24:49.636946 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-694b696a-892c-4d71-a455-a0458e796eee tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:24:49.637377 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-694b696a-892c-4d71-a455-a0458e796eee tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:24:49.638071 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-694b696a-892c-4d71-a455-a0458e796eee tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:24:49.638520 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-694b696a-892c-4d71-a455-a0458e796eee tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:24:49.638940 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-694b696a-892c-4d71-a455-a0458e796eee tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:24:49.703390 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-694b696a-892c-4d71-a455-a0458e796eee tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:24:49.711934 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-694b696a-892c-4d71-a455-a0458e796eee tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.100783 Oct 20 06:24:49.712502 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1038/2050] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:24:49 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:24:50.735318 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-3115683b-9458-4c94-9c01-4f60334914cd tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:24:50.735926 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-3115683b-9458-4c94-9c01-4f60334914cd tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:24:50.742641 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3115683b-9458-4c94-9c01-4f60334914cd tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:24:50.743116 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3115683b-9458-4c94-9c01-4f60334914cd tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:24:50.743838 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3115683b-9458-4c94-9c01-4f60334914cd tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:24:50.744534 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3115683b-9458-4c94-9c01-4f60334914cd tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:24:50.745008 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3115683b-9458-4c94-9c01-4f60334914cd tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:24:50.745430 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3115683b-9458-4c94-9c01-4f60334914cd tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:24:50.748049 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG dbcounter [-] [118860] Writing DB stats nova_cell1:SELECT=100 {{(pid=118860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:24:50.807935 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-3115683b-9458-4c94-9c01-4f60334914cd tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:24:50.816237 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-3115683b-9458-4c94-9c01-4f60334914cd tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.084743 Oct 20 06:24:50.816821 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1013/2051] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:24:50 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:24:51.839709 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-d651e3b7-a884-4d38-8b78-61c441887753 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:24:51.840301 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-d651e3b7-a884-4d38-8b78-61c441887753 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:24:51.846796 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d651e3b7-a884-4d38-8b78-61c441887753 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:24:51.847275 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d651e3b7-a884-4d38-8b78-61c441887753 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:24:51.847710 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d651e3b7-a884-4d38-8b78-61c441887753 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:24:51.848400 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d651e3b7-a884-4d38-8b78-61c441887753 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:24:51.848903 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d651e3b7-a884-4d38-8b78-61c441887753 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:24:51.849325 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d651e3b7-a884-4d38-8b78-61c441887753 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:24:51.911277 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-d651e3b7-a884-4d38-8b78-61c441887753 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:24:51.919978 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-d651e3b7-a884-4d38-8b78-61c441887753 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.084692 Oct 20 06:24:51.920552 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1039/2052] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:24:51 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:24:52.943472 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-fb1dfd91-abef-4702-a6fa-e3267f808ffe tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:24:52.944222 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-fb1dfd91-abef-4702-a6fa-e3267f808ffe tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:24:52.950671 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-fb1dfd91-abef-4702-a6fa-e3267f808ffe tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:24:52.951200 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-fb1dfd91-abef-4702-a6fa-e3267f808ffe tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:24:52.951645 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-fb1dfd91-abef-4702-a6fa-e3267f808ffe tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:24:52.952384 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-fb1dfd91-abef-4702-a6fa-e3267f808ffe tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:24:52.952873 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-fb1dfd91-abef-4702-a6fa-e3267f808ffe tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:24:52.953305 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-fb1dfd91-abef-4702-a6fa-e3267f808ffe tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:24:53.020029 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-fb1dfd91-abef-4702-a6fa-e3267f808ffe tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:24:53.029215 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-fb1dfd91-abef-4702-a6fa-e3267f808ffe tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.089633 Oct 20 06:24:53.030032 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1014/2053] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:24:52 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:24:54.052111 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-18887909-15c8-45b8-970e-01b5198a52e9 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:24:54.052659 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-18887909-15c8-45b8-970e-01b5198a52e9 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:24:54.059718 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-18887909-15c8-45b8-970e-01b5198a52e9 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:24:54.060199 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-18887909-15c8-45b8-970e-01b5198a52e9 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:24:54.060632 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-18887909-15c8-45b8-970e-01b5198a52e9 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:24:54.061354 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-18887909-15c8-45b8-970e-01b5198a52e9 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:24:54.061810 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-18887909-15c8-45b8-970e-01b5198a52e9 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:24:54.062228 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-18887909-15c8-45b8-970e-01b5198a52e9 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:24:54.064885 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG dbcounter [-] [118861] Writing DB stats nova_cell1:SELECT=100 {{(pid=118861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:24:54.125851 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-18887909-15c8-45b8-970e-01b5198a52e9 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:24:54.134212 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-18887909-15c8-45b8-970e-01b5198a52e9 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.085997 Oct 20 06:24:54.135038 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1040/2054] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:24:54 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:24:55.157766 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-9ca75404-0a3f-4a0c-899f-26e32195b553 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:24:55.158376 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-9ca75404-0a3f-4a0c-899f-26e32195b553 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:24:55.165874 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-9ca75404-0a3f-4a0c-899f-26e32195b553 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:24:55.166355 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-9ca75404-0a3f-4a0c-899f-26e32195b553 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:24:55.166792 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-9ca75404-0a3f-4a0c-899f-26e32195b553 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:24:55.167490 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-9ca75404-0a3f-4a0c-899f-26e32195b553 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:24:55.167943 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-9ca75404-0a3f-4a0c-899f-26e32195b553 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:24:55.168367 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-9ca75404-0a3f-4a0c-899f-26e32195b553 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:24:55.230743 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-9ca75404-0a3f-4a0c-899f-26e32195b553 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:24:55.239127 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-9ca75404-0a3f-4a0c-899f-26e32195b553 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.085251 Oct 20 06:24:55.239690 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1015/2055] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:24:55 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:24:56.262248 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-6ff3180b-47b2-4f5b-8601-554f5587ea46 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:24:56.262867 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-6ff3180b-47b2-4f5b-8601-554f5587ea46 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:24:56.269398 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-6ff3180b-47b2-4f5b-8601-554f5587ea46 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:24:56.269885 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-6ff3180b-47b2-4f5b-8601-554f5587ea46 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:24:56.270324 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-6ff3180b-47b2-4f5b-8601-554f5587ea46 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:24:56.271026 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-6ff3180b-47b2-4f5b-8601-554f5587ea46 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:24:56.271491 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-6ff3180b-47b2-4f5b-8601-554f5587ea46 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:24:56.271910 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-6ff3180b-47b2-4f5b-8601-554f5587ea46 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:24:56.337637 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-6ff3180b-47b2-4f5b-8601-554f5587ea46 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:24:56.345884 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-6ff3180b-47b2-4f5b-8601-554f5587ea46 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.087835 Oct 20 06:24:56.346451 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1041/2056] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:24:56 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:24:57.369752 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-618880c0-8bca-45a7-9112-3bd289a0c508 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:24:57.370475 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-618880c0-8bca-45a7-9112-3bd289a0c508 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:24:57.377287 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-618880c0-8bca-45a7-9112-3bd289a0c508 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:24:57.377771 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-618880c0-8bca-45a7-9112-3bd289a0c508 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:24:57.378200 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-618880c0-8bca-45a7-9112-3bd289a0c508 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:24:57.378895 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-618880c0-8bca-45a7-9112-3bd289a0c508 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:24:57.379347 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-618880c0-8bca-45a7-9112-3bd289a0c508 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:24:57.379765 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-618880c0-8bca-45a7-9112-3bd289a0c508 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:24:57.442995 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-618880c0-8bca-45a7-9112-3bd289a0c508 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:24:57.451507 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-618880c0-8bca-45a7-9112-3bd289a0c508 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.085758 Oct 20 06:24:57.452079 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1016/2057] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:24:57 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:24:58.475145 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-6d2b812f-aeac-4f07-bc4d-51a08622edc0 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:24:58.476256 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-6d2b812f-aeac-4f07-bc4d-51a08622edc0 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:24:58.483155 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-6d2b812f-aeac-4f07-bc4d-51a08622edc0 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:24:58.483652 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-6d2b812f-aeac-4f07-bc4d-51a08622edc0 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:24:58.484090 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-6d2b812f-aeac-4f07-bc4d-51a08622edc0 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:24:58.484881 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-6d2b812f-aeac-4f07-bc4d-51a08622edc0 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:24:58.485339 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-6d2b812f-aeac-4f07-bc4d-51a08622edc0 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:24:58.485772 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-6d2b812f-aeac-4f07-bc4d-51a08622edc0 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:24:58.550989 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-6d2b812f-aeac-4f07-bc4d-51a08622edc0 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:24:58.560685 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-6d2b812f-aeac-4f07-bc4d-51a08622edc0 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.089379 Oct 20 06:24:58.561448 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1042/2058] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:24:58 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 06:24:59.583803 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-377fbd99-00ee-4a14-bbff-1f6e5aa8505c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:24:59.584385 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-377fbd99-00ee-4a14-bbff-1f6e5aa8505c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:24:59.590871 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-377fbd99-00ee-4a14-bbff-1f6e5aa8505c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:24:59.591359 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-377fbd99-00ee-4a14-bbff-1f6e5aa8505c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:24:59.591797 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-377fbd99-00ee-4a14-bbff-1f6e5aa8505c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:24:59.592497 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-377fbd99-00ee-4a14-bbff-1f6e5aa8505c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:24:59.592981 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-377fbd99-00ee-4a14-bbff-1f6e5aa8505c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:24:59.593413 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-377fbd99-00ee-4a14-bbff-1f6e5aa8505c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:24:59.658422 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-377fbd99-00ee-4a14-bbff-1f6e5aa8505c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:24:59.667761 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-377fbd99-00ee-4a14-bbff-1f6e5aa8505c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.088020 Oct 20 06:24:59.668363 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1017/2059] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:24:59 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:25:00.691163 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-a2bc01f3-cc38-4031-a58d-d9d597fee237 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:25:00.691844 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-a2bc01f3-cc38-4031-a58d-d9d597fee237 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:25:00.698869 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a2bc01f3-cc38-4031-a58d-d9d597fee237 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:25:00.699345 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a2bc01f3-cc38-4031-a58d-d9d597fee237 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:25:00.699775 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a2bc01f3-cc38-4031-a58d-d9d597fee237 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:25:00.700469 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a2bc01f3-cc38-4031-a58d-d9d597fee237 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:25:00.701066 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a2bc01f3-cc38-4031-a58d-d9d597fee237 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:25:00.701488 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a2bc01f3-cc38-4031-a58d-d9d597fee237 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:25:00.763177 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-a2bc01f3-cc38-4031-a58d-d9d597fee237 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:25:00.771919 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-a2bc01f3-cc38-4031-a58d-d9d597fee237 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.084930 Oct 20 06:25:00.772489 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1043/2060] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:25:00 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:25:01.795553 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-157fd32d-d83c-4d53-a284-cbc7f8990d85 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:25:01.796209 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-157fd32d-d83c-4d53-a284-cbc7f8990d85 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:25:01.802748 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-157fd32d-d83c-4d53-a284-cbc7f8990d85 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:25:01.803228 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-157fd32d-d83c-4d53-a284-cbc7f8990d85 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:25:01.803659 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-157fd32d-d83c-4d53-a284-cbc7f8990d85 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:25:01.804577 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-157fd32d-d83c-4d53-a284-cbc7f8990d85 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:25:01.805089 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-157fd32d-d83c-4d53-a284-cbc7f8990d85 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:25:01.805540 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-157fd32d-d83c-4d53-a284-cbc7f8990d85 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:25:01.874361 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-157fd32d-d83c-4d53-a284-cbc7f8990d85 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:25:01.882850 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-157fd32d-d83c-4d53-a284-cbc7f8990d85 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.091180 Oct 20 06:25:01.883743 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1018/2061] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:25:01 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:25:02.907014 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-5935b478-62ac-428e-8437-5c5bf3d5ec40 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:25:02.907821 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-5935b478-62ac-428e-8437-5c5bf3d5ec40 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:25:02.909890 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG dbcounter [-] [118861] Writing DB stats nova_api:SELECT=40 {{(pid=118861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:25:02.915489 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5935b478-62ac-428e-8437-5c5bf3d5ec40 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:25:02.917035 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5935b478-62ac-428e-8437-5c5bf3d5ec40 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:25:02.917515 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5935b478-62ac-428e-8437-5c5bf3d5ec40 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:25:02.918376 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5935b478-62ac-428e-8437-5c5bf3d5ec40 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:25:02.918840 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5935b478-62ac-428e-8437-5c5bf3d5ec40 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:25:02.919266 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5935b478-62ac-428e-8437-5c5bf3d5ec40 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:25:02.986255 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-5935b478-62ac-428e-8437-5c5bf3d5ec40 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:25:02.994974 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-5935b478-62ac-428e-8437-5c5bf3d5ec40 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.092294 Oct 20 06:25:02.995761 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1044/2062] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:25:02 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:25:04.022001 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-3601ea24-b2af-4fed-8c87-4160d8de6723 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:25:04.022609 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-3601ea24-b2af-4fed-8c87-4160d8de6723 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:25:04.025013 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG dbcounter [-] [118860] Writing DB stats nova_api:SELECT=38 {{(pid=118860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:25:04.030250 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3601ea24-b2af-4fed-8c87-4160d8de6723 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:25:04.030736 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3601ea24-b2af-4fed-8c87-4160d8de6723 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:25:04.031177 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3601ea24-b2af-4fed-8c87-4160d8de6723 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:25:04.031882 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3601ea24-b2af-4fed-8c87-4160d8de6723 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:25:04.032339 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3601ea24-b2af-4fed-8c87-4160d8de6723 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:25:04.032795 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3601ea24-b2af-4fed-8c87-4160d8de6723 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:25:04.095655 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-3601ea24-b2af-4fed-8c87-4160d8de6723 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:25:04.104094 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-3601ea24-b2af-4fed-8c87-4160d8de6723 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.085943 Oct 20 06:25:04.104665 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1019/2063] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:25:04 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:25:05.127466 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-32f35c69-c01a-4b61-b209-fa1d1be73428 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:25:05.128217 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-32f35c69-c01a-4b61-b209-fa1d1be73428 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:25:05.135462 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-32f35c69-c01a-4b61-b209-fa1d1be73428 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:25:05.136246 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-32f35c69-c01a-4b61-b209-fa1d1be73428 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:25:05.136680 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-32f35c69-c01a-4b61-b209-fa1d1be73428 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:25:05.137402 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-32f35c69-c01a-4b61-b209-fa1d1be73428 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:25:05.137847 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-32f35c69-c01a-4b61-b209-fa1d1be73428 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:25:05.138415 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-32f35c69-c01a-4b61-b209-fa1d1be73428 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:25:05.205205 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-32f35c69-c01a-4b61-b209-fa1d1be73428 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:25:05.213451 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-32f35c69-c01a-4b61-b209-fa1d1be73428 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.089887 Oct 20 06:25:05.214023 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1045/2064] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:25:05 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:25:06.237301 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-0e7c96eb-680c-4df1-95fb-dfc4a2802431 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:25:06.237914 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-0e7c96eb-680c-4df1-95fb-dfc4a2802431 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:25:06.244727 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0e7c96eb-680c-4df1-95fb-dfc4a2802431 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:25:06.245199 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0e7c96eb-680c-4df1-95fb-dfc4a2802431 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:25:06.245632 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0e7c96eb-680c-4df1-95fb-dfc4a2802431 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:25:06.246328 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0e7c96eb-680c-4df1-95fb-dfc4a2802431 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:25:06.246806 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0e7c96eb-680c-4df1-95fb-dfc4a2802431 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:25:06.247219 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0e7c96eb-680c-4df1-95fb-dfc4a2802431 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:25:06.309223 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-0e7c96eb-680c-4df1-95fb-dfc4a2802431 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:25:06.318046 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-0e7c96eb-680c-4df1-95fb-dfc4a2802431 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.084645 Oct 20 06:25:06.318618 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1020/2065] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:25:06 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:25:07.341538 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-5e52d0b1-2aa0-4fd8-9e0b-24b7b4d5a7a4 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:25:07.342150 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-5e52d0b1-2aa0-4fd8-9e0b-24b7b4d5a7a4 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:25:07.348644 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5e52d0b1-2aa0-4fd8-9e0b-24b7b4d5a7a4 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:25:07.349161 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5e52d0b1-2aa0-4fd8-9e0b-24b7b4d5a7a4 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:25:07.349626 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5e52d0b1-2aa0-4fd8-9e0b-24b7b4d5a7a4 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:25:07.350322 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5e52d0b1-2aa0-4fd8-9e0b-24b7b4d5a7a4 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:25:07.350764 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5e52d0b1-2aa0-4fd8-9e0b-24b7b4d5a7a4 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:25:07.351682 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5e52d0b1-2aa0-4fd8-9e0b-24b7b4d5a7a4 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:25:07.414598 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-5e52d0b1-2aa0-4fd8-9e0b-24b7b4d5a7a4 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:25:07.422758 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-5e52d0b1-2aa0-4fd8-9e0b-24b7b4d5a7a4 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.085123 Oct 20 06:25:07.423320 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1046/2066] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:25:07 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:25:08.446315 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-27875a87-894f-453f-80c2-fdc05f312081 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:25:08.446948 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-27875a87-894f-453f-80c2-fdc05f312081 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:25:08.453495 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-27875a87-894f-453f-80c2-fdc05f312081 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:25:08.453973 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-27875a87-894f-453f-80c2-fdc05f312081 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:25:08.454406 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-27875a87-894f-453f-80c2-fdc05f312081 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:25:08.455092 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-27875a87-894f-453f-80c2-fdc05f312081 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:25:08.455539 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-27875a87-894f-453f-80c2-fdc05f312081 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:25:08.455961 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-27875a87-894f-453f-80c2-fdc05f312081 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:25:08.520488 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-27875a87-894f-453f-80c2-fdc05f312081 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:25:08.529436 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-27875a87-894f-453f-80c2-fdc05f312081 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.087135 Oct 20 06:25:08.529999 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1021/2067] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:25:08 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:25:09.552785 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-dbbd48d3-8f90-4a69-ac53-dffb2132a334 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:25:09.553407 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-dbbd48d3-8f90-4a69-ac53-dffb2132a334 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:25:09.561011 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-dbbd48d3-8f90-4a69-ac53-dffb2132a334 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:25:09.561436 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-dbbd48d3-8f90-4a69-ac53-dffb2132a334 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:25:09.561876 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-dbbd48d3-8f90-4a69-ac53-dffb2132a334 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:25:09.562586 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-dbbd48d3-8f90-4a69-ac53-dffb2132a334 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:25:09.563042 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-dbbd48d3-8f90-4a69-ac53-dffb2132a334 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:25:09.563472 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-dbbd48d3-8f90-4a69-ac53-dffb2132a334 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:25:09.627761 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-dbbd48d3-8f90-4a69-ac53-dffb2132a334 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:25:09.637793 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-dbbd48d3-8f90-4a69-ac53-dffb2132a334 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.088837 Oct 20 06:25:09.638391 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1047/2068] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:25:09 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:25:10.661051 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-06e476af-bff6-4108-92f7-624698af6482 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:25:10.661663 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-06e476af-bff6-4108-92f7-624698af6482 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:25:10.668112 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-06e476af-bff6-4108-92f7-624698af6482 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:25:10.668581 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-06e476af-bff6-4108-92f7-624698af6482 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:25:10.669052 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-06e476af-bff6-4108-92f7-624698af6482 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:25:10.669747 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-06e476af-bff6-4108-92f7-624698af6482 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:25:10.670198 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-06e476af-bff6-4108-92f7-624698af6482 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:25:10.670620 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-06e476af-bff6-4108-92f7-624698af6482 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:25:10.735502 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-06e476af-bff6-4108-92f7-624698af6482 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:25:10.744371 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-06e476af-bff6-4108-92f7-624698af6482 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.087151 Oct 20 06:25:10.744963 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1022/2069] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:25:10 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:25:11.767421 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-9ab72786-bcf6-4649-991b-0ce432ea524b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:25:11.768035 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-9ab72786-bcf6-4649-991b-0ce432ea524b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:25:11.775456 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-9ab72786-bcf6-4649-991b-0ce432ea524b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:25:11.775927 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-9ab72786-bcf6-4649-991b-0ce432ea524b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:25:11.776356 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-9ab72786-bcf6-4649-991b-0ce432ea524b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:25:11.777069 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-9ab72786-bcf6-4649-991b-0ce432ea524b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:25:11.777516 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-9ab72786-bcf6-4649-991b-0ce432ea524b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:25:11.777966 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-9ab72786-bcf6-4649-991b-0ce432ea524b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:25:11.839349 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-9ab72786-bcf6-4649-991b-0ce432ea524b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:25:11.847601 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-9ab72786-bcf6-4649-991b-0ce432ea524b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.084064 Oct 20 06:25:11.848159 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1048/2070] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:25:11 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:25:12.870526 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-d200ac97-1744-4434-a302-b60382851df7 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:25:12.871150 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-d200ac97-1744-4434-a302-b60382851df7 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:25:12.873574 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 20 06:25:12.873713 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: Thu Oct 20 06:25:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 (ip 10.222.0.20) !!! Oct 20 06:25:12.880218 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-d200ac97-1744-4434-a302-b60382851df7 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:25:12.880721 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-d200ac97-1744-4434-a302-b60382851df7 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:25:12.881164 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-d200ac97-1744-4434-a302-b60382851df7 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:25:12.881873 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-d200ac97-1744-4434-a302-b60382851df7 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:25:12.882324 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-d200ac97-1744-4434-a302-b60382851df7 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:25:12.882865 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-d200ac97-1744-4434-a302-b60382851df7 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:25:12.947780 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-d200ac97-1744-4434-a302-b60382851df7 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:25:12.956248 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-d200ac97-1744-4434-a302-b60382851df7 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.089641 Oct 20 06:25:12.956844 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1023/2071] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:25:12 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:25:13.980082 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-959fcb8b-2799-4f66-b9a2-943889eb4197 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:25:13.980709 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-959fcb8b-2799-4f66-b9a2-943889eb4197 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:25:13.987562 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-959fcb8b-2799-4f66-b9a2-943889eb4197 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:25:13.988049 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-959fcb8b-2799-4f66-b9a2-943889eb4197 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:25:13.988484 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-959fcb8b-2799-4f66-b9a2-943889eb4197 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:25:13.989206 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-959fcb8b-2799-4f66-b9a2-943889eb4197 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:25:13.989657 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-959fcb8b-2799-4f66-b9a2-943889eb4197 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:25:13.990082 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-959fcb8b-2799-4f66-b9a2-943889eb4197 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:25:14.054644 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-959fcb8b-2799-4f66-b9a2-943889eb4197 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:25:14.062956 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-959fcb8b-2799-4f66-b9a2-943889eb4197 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.087371 Oct 20 06:25:14.063518 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1049/2072] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:25:13 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:25:15.086529 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-cb139020-e58d-4fa4-a718-e7e34c7e55d4 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:25:15.087360 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-cb139020-e58d-4fa4-a718-e7e34c7e55d4 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:25:15.093779 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-cb139020-e58d-4fa4-a718-e7e34c7e55d4 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:25:15.094255 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-cb139020-e58d-4fa4-a718-e7e34c7e55d4 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:25:15.094710 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-cb139020-e58d-4fa4-a718-e7e34c7e55d4 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:25:15.095375 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-cb139020-e58d-4fa4-a718-e7e34c7e55d4 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:25:15.095822 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-cb139020-e58d-4fa4-a718-e7e34c7e55d4 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:25:15.096240 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-cb139020-e58d-4fa4-a718-e7e34c7e55d4 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:25:15.159919 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-cb139020-e58d-4fa4-a718-e7e34c7e55d4 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:25:15.169324 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-cb139020-e58d-4fa4-a718-e7e34c7e55d4 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.087210 Oct 20 06:25:15.169901 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1024/2073] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:25:15 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:25:16.191654 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-fccd41a1-91c5-40d1-8994-4a2615173fe9 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:25:16.192275 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-fccd41a1-91c5-40d1-8994-4a2615173fe9 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:25:16.201641 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-fccd41a1-91c5-40d1-8994-4a2615173fe9 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:25:16.202455 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-fccd41a1-91c5-40d1-8994-4a2615173fe9 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:25:16.203197 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-fccd41a1-91c5-40d1-8994-4a2615173fe9 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:25:16.204345 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-fccd41a1-91c5-40d1-8994-4a2615173fe9 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:25:16.205136 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-fccd41a1-91c5-40d1-8994-4a2615173fe9 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:25:16.205866 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-fccd41a1-91c5-40d1-8994-4a2615173fe9 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:25:16.283464 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-fccd41a1-91c5-40d1-8994-4a2615173fe9 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:25:16.293511 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-fccd41a1-91c5-40d1-8994-4a2615173fe9 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.105730 Oct 20 06:25:16.294104 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1050/2074] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:25:16 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:25:17.319387 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-82d22fa6-331e-45a1-b4fc-ef9573eb77a2 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:25:17.320505 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-82d22fa6-331e-45a1-b4fc-ef9573eb77a2 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:25:17.327497 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-82d22fa6-331e-45a1-b4fc-ef9573eb77a2 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:25:17.327979 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-82d22fa6-331e-45a1-b4fc-ef9573eb77a2 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:25:17.328412 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-82d22fa6-331e-45a1-b4fc-ef9573eb77a2 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:25:17.329144 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-82d22fa6-331e-45a1-b4fc-ef9573eb77a2 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:25:17.329593 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-82d22fa6-331e-45a1-b4fc-ef9573eb77a2 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:25:17.330011 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-82d22fa6-331e-45a1-b4fc-ef9573eb77a2 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:25:17.393979 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-82d22fa6-331e-45a1-b4fc-ef9573eb77a2 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:25:17.402378 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-82d22fa6-331e-45a1-b4fc-ef9573eb77a2 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.086859 Oct 20 06:25:17.403132 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1025/2075] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:25:17 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:25:18.425175 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-a71221c1-b496-4cc1-a603-b6ef57f98096 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:25:18.425789 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-a71221c1-b496-4cc1-a603-b6ef57f98096 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:25:18.433647 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a71221c1-b496-4cc1-a603-b6ef57f98096 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:25:18.434136 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a71221c1-b496-4cc1-a603-b6ef57f98096 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:25:18.434596 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a71221c1-b496-4cc1-a603-b6ef57f98096 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:25:18.435289 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a71221c1-b496-4cc1-a603-b6ef57f98096 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:25:18.435742 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a71221c1-b496-4cc1-a603-b6ef57f98096 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:25:18.436168 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a71221c1-b496-4cc1-a603-b6ef57f98096 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:25:18.505231 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-a71221c1-b496-4cc1-a603-b6ef57f98096 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:25:18.514574 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-a71221c1-b496-4cc1-a603-b6ef57f98096 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.093231 Oct 20 06:25:18.515142 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1051/2076] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:25:18 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:25:19.537207 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-73baffae-caa5-49ae-9e08-4bfa085b5b25 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:25:19.537746 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-73baffae-caa5-49ae-9e08-4bfa085b5b25 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:25:19.545090 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-73baffae-caa5-49ae-9e08-4bfa085b5b25 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:25:19.545581 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-73baffae-caa5-49ae-9e08-4bfa085b5b25 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:25:19.546026 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-73baffae-caa5-49ae-9e08-4bfa085b5b25 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:25:19.546736 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-73baffae-caa5-49ae-9e08-4bfa085b5b25 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:25:19.547191 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-73baffae-caa5-49ae-9e08-4bfa085b5b25 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:25:19.547621 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-73baffae-caa5-49ae-9e08-4bfa085b5b25 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:25:19.613090 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-73baffae-caa5-49ae-9e08-4bfa085b5b25 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:25:19.622203 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-73baffae-caa5-49ae-9e08-4bfa085b5b25 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.089060 Oct 20 06:25:19.622776 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1026/2077] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:25:19 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:25:20.645574 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-7a2d1311-725b-4110-b908-5d9b1570bdf5 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:25:20.646217 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-7a2d1311-725b-4110-b908-5d9b1570bdf5 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:25:20.654117 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7a2d1311-725b-4110-b908-5d9b1570bdf5 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:25:20.654601 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7a2d1311-725b-4110-b908-5d9b1570bdf5 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:25:20.655034 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7a2d1311-725b-4110-b908-5d9b1570bdf5 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:25:20.655734 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7a2d1311-725b-4110-b908-5d9b1570bdf5 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:25:20.656181 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7a2d1311-725b-4110-b908-5d9b1570bdf5 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:25:20.656600 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7a2d1311-725b-4110-b908-5d9b1570bdf5 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:25:20.720106 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-7a2d1311-725b-4110-b908-5d9b1570bdf5 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:25:20.729056 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-7a2d1311-725b-4110-b908-5d9b1570bdf5 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.087402 Oct 20 06:25:20.729614 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1052/2078] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:25:20 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:25:21.751663 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-77d271cc-ae45-41e5-ae54-b035eab83d01 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:25:21.752280 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-77d271cc-ae45-41e5-ae54-b035eab83d01 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:25:21.758802 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-77d271cc-ae45-41e5-ae54-b035eab83d01 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:25:21.759297 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-77d271cc-ae45-41e5-ae54-b035eab83d01 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:25:21.759993 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-77d271cc-ae45-41e5-ae54-b035eab83d01 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:25:21.760719 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-77d271cc-ae45-41e5-ae54-b035eab83d01 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:25:21.761180 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-77d271cc-ae45-41e5-ae54-b035eab83d01 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:25:21.761610 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-77d271cc-ae45-41e5-ae54-b035eab83d01 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:25:21.764194 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG dbcounter [-] [118860] Writing DB stats nova_cell1:SELECT=84 {{(pid=118860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:25:21.823555 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-77d271cc-ae45-41e5-ae54-b035eab83d01 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:25:21.832336 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-77d271cc-ae45-41e5-ae54-b035eab83d01 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.084742 Oct 20 06:25:21.832933 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1027/2079] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:25:21 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:25:22.854766 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-fd16defb-6c23-4e6c-a4a5-125995b7e500 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:25:22.855375 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-fd16defb-6c23-4e6c-a4a5-125995b7e500 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:25:22.861840 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-fd16defb-6c23-4e6c-a4a5-125995b7e500 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:25:22.862326 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-fd16defb-6c23-4e6c-a4a5-125995b7e500 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:25:22.862766 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-fd16defb-6c23-4e6c-a4a5-125995b7e500 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:25:22.863461 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-fd16defb-6c23-4e6c-a4a5-125995b7e500 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:25:22.863913 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-fd16defb-6c23-4e6c-a4a5-125995b7e500 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:25:22.864340 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-fd16defb-6c23-4e6c-a4a5-125995b7e500 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:25:22.931631 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-fd16defb-6c23-4e6c-a4a5-125995b7e500 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:25:22.939909 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-fd16defb-6c23-4e6c-a4a5-125995b7e500 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.089018 Oct 20 06:25:22.940478 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1053/2080] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:25:22 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:25:23.963504 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-d522ab61-cd3e-4ef9-9423-0648cb1d7faa tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:25:23.964124 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-d522ab61-cd3e-4ef9-9423-0648cb1d7faa tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:25:23.970651 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-d522ab61-cd3e-4ef9-9423-0648cb1d7faa tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:25:23.971136 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-d522ab61-cd3e-4ef9-9423-0648cb1d7faa tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:25:23.971597 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-d522ab61-cd3e-4ef9-9423-0648cb1d7faa tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:25:23.972285 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-d522ab61-cd3e-4ef9-9423-0648cb1d7faa tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:25:23.972780 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-d522ab61-cd3e-4ef9-9423-0648cb1d7faa tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:25:23.973206 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-d522ab61-cd3e-4ef9-9423-0648cb1d7faa tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:25:24.035166 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-d522ab61-cd3e-4ef9-9423-0648cb1d7faa tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:25:24.044199 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-d522ab61-cd3e-4ef9-9423-0648cb1d7faa tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.084698 Oct 20 06:25:24.044790 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1028/2081] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:25:23 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:25:25.067294 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-08c4f4af-70c7-45fe-9098-9ce5fd1edb79 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:25:25.067902 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-08c4f4af-70c7-45fe-9098-9ce5fd1edb79 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:25:25.074945 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-08c4f4af-70c7-45fe-9098-9ce5fd1edb79 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:25:25.075427 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-08c4f4af-70c7-45fe-9098-9ce5fd1edb79 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:25:25.075870 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-08c4f4af-70c7-45fe-9098-9ce5fd1edb79 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:25:25.076565 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-08c4f4af-70c7-45fe-9098-9ce5fd1edb79 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:25:25.077044 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-08c4f4af-70c7-45fe-9098-9ce5fd1edb79 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:25:25.077472 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-08c4f4af-70c7-45fe-9098-9ce5fd1edb79 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:25:25.080022 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG dbcounter [-] [118861] Writing DB stats nova_cell1:SELECT=84 {{(pid=118861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:25:25.140388 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-08c4f4af-70c7-45fe-9098-9ce5fd1edb79 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:25:25.148929 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-08c4f4af-70c7-45fe-9098-9ce5fd1edb79 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.085512 Oct 20 06:25:25.149500 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1054/2082] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:25:25 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:25:26.171349 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-db2df95b-24f0-419b-a66d-b17ede98e545 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:25:26.171992 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-db2df95b-24f0-419b-a66d-b17ede98e545 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:25:26.178418 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-db2df95b-24f0-419b-a66d-b17ede98e545 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:25:26.178891 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-db2df95b-24f0-419b-a66d-b17ede98e545 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:25:26.179510 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-db2df95b-24f0-419b-a66d-b17ede98e545 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:25:26.180202 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-db2df95b-24f0-419b-a66d-b17ede98e545 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:25:26.181287 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-db2df95b-24f0-419b-a66d-b17ede98e545 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:25:26.181717 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-db2df95b-24f0-419b-a66d-b17ede98e545 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:25:26.242521 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-db2df95b-24f0-419b-a66d-b17ede98e545 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:25:26.250715 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-db2df95b-24f0-419b-a66d-b17ede98e545 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.083169 Oct 20 06:25:26.251286 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1029/2083] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:25:26 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:25:27.275576 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-514dd085-2680-4204-b2f4-105605836fc3 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:25:27.276196 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-514dd085-2680-4204-b2f4-105605836fc3 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:25:27.282330 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-514dd085-2680-4204-b2f4-105605836fc3 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:25:27.282810 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-514dd085-2680-4204-b2f4-105605836fc3 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:25:27.283250 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-514dd085-2680-4204-b2f4-105605836fc3 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:25:27.283941 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-514dd085-2680-4204-b2f4-105605836fc3 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:25:27.284396 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-514dd085-2680-4204-b2f4-105605836fc3 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:25:27.284861 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-514dd085-2680-4204-b2f4-105605836fc3 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:25:27.347552 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-514dd085-2680-4204-b2f4-105605836fc3 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:25:27.356392 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-514dd085-2680-4204-b2f4-105605836fc3 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.085543 Oct 20 06:25:27.356993 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1055/2084] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:25:27 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:25:28.379893 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-cdf578d3-896b-46a7-ab60-78da1d05e748 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:25:28.380683 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-cdf578d3-896b-46a7-ab60-78da1d05e748 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:25:28.387631 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-cdf578d3-896b-46a7-ab60-78da1d05e748 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:25:28.388109 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-cdf578d3-896b-46a7-ab60-78da1d05e748 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:25:28.388544 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-cdf578d3-896b-46a7-ab60-78da1d05e748 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:25:28.389268 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-cdf578d3-896b-46a7-ab60-78da1d05e748 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:25:28.389720 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-cdf578d3-896b-46a7-ab60-78da1d05e748 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:25:28.390144 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-cdf578d3-896b-46a7-ab60-78da1d05e748 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:25:28.453778 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-cdf578d3-896b-46a7-ab60-78da1d05e748 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:25:28.462494 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-cdf578d3-896b-46a7-ab60-78da1d05e748 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.086571 Oct 20 06:25:28.463067 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1030/2085] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:25:28 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:25:29.486136 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-8a3d8211-2d6c-4c4f-8f0a-1ce5aec6032b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:25:29.486747 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-8a3d8211-2d6c-4c4f-8f0a-1ce5aec6032b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:25:29.493923 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-8a3d8211-2d6c-4c4f-8f0a-1ce5aec6032b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:25:29.494414 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-8a3d8211-2d6c-4c4f-8f0a-1ce5aec6032b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:25:29.494854 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-8a3d8211-2d6c-4c4f-8f0a-1ce5aec6032b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:25:29.495568 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-8a3d8211-2d6c-4c4f-8f0a-1ce5aec6032b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:25:29.496018 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-8a3d8211-2d6c-4c4f-8f0a-1ce5aec6032b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:25:29.496473 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-8a3d8211-2d6c-4c4f-8f0a-1ce5aec6032b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:25:29.561789 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-8a3d8211-2d6c-4c4f-8f0a-1ce5aec6032b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:25:29.570784 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-8a3d8211-2d6c-4c4f-8f0a-1ce5aec6032b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.088494 Oct 20 06:25:29.571388 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1056/2086] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:25:29 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:25:30.594131 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-c057b35f-78ed-4d62-bf70-b2d84b696d99 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:25:30.594740 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-c057b35f-78ed-4d62-bf70-b2d84b696d99 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:25:30.602480 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c057b35f-78ed-4d62-bf70-b2d84b696d99 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:25:30.602958 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c057b35f-78ed-4d62-bf70-b2d84b696d99 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:25:30.603433 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c057b35f-78ed-4d62-bf70-b2d84b696d99 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:25:30.604099 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c057b35f-78ed-4d62-bf70-b2d84b696d99 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:25:30.604566 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c057b35f-78ed-4d62-bf70-b2d84b696d99 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:25:30.605156 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c057b35f-78ed-4d62-bf70-b2d84b696d99 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:25:30.673567 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-c057b35f-78ed-4d62-bf70-b2d84b696d99 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:25:30.682027 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-c057b35f-78ed-4d62-bf70-b2d84b696d99 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.091783 Oct 20 06:25:30.682606 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1031/2087] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:25:30 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:25:31.705293 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-5b2ae1ae-4e16-4b9f-99ff-7c678ec64bed tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:25:31.705898 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-5b2ae1ae-4e16-4b9f-99ff-7c678ec64bed tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:25:31.714237 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5b2ae1ae-4e16-4b9f-99ff-7c678ec64bed tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:25:31.714717 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5b2ae1ae-4e16-4b9f-99ff-7c678ec64bed tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:25:31.715150 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5b2ae1ae-4e16-4b9f-99ff-7c678ec64bed tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:25:31.715858 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5b2ae1ae-4e16-4b9f-99ff-7c678ec64bed tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:25:31.716309 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5b2ae1ae-4e16-4b9f-99ff-7c678ec64bed tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:25:31.716763 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5b2ae1ae-4e16-4b9f-99ff-7c678ec64bed tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:25:31.782392 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-5b2ae1ae-4e16-4b9f-99ff-7c678ec64bed tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:25:31.791789 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-5b2ae1ae-4e16-4b9f-99ff-7c678ec64bed tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.090349 Oct 20 06:25:31.792361 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1057/2088] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:25:31 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:25:32.814533 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-2e8670c6-e24c-465b-828f-f40cfcd51d0a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:25:32.815146 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-2e8670c6-e24c-465b-828f-f40cfcd51d0a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:25:32.822228 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2e8670c6-e24c-465b-828f-f40cfcd51d0a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:25:32.822778 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2e8670c6-e24c-465b-828f-f40cfcd51d0a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:25:32.823220 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2e8670c6-e24c-465b-828f-f40cfcd51d0a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:25:32.823920 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2e8670c6-e24c-465b-828f-f40cfcd51d0a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:25:32.824376 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2e8670c6-e24c-465b-828f-f40cfcd51d0a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:25:32.824840 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2e8670c6-e24c-465b-828f-f40cfcd51d0a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:25:32.886462 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-2e8670c6-e24c-465b-828f-f40cfcd51d0a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:25:32.894780 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-2e8670c6-e24c-465b-828f-f40cfcd51d0a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.084120 Oct 20 06:25:32.895340 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1032/2089] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:25:32 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:25:33.917971 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-0bf6169b-a35a-4be1-a18a-e53e387b0a73 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:25:33.918596 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-0bf6169b-a35a-4be1-a18a-e53e387b0a73 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:25:33.921030 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG dbcounter [-] [118861] Writing DB stats nova_api:SELECT=28 {{(pid=118861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:25:33.926343 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-0bf6169b-a35a-4be1-a18a-e53e387b0a73 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:25:33.926833 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-0bf6169b-a35a-4be1-a18a-e53e387b0a73 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:25:33.927274 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-0bf6169b-a35a-4be1-a18a-e53e387b0a73 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:25:33.927980 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-0bf6169b-a35a-4be1-a18a-e53e387b0a73 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:25:33.928440 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-0bf6169b-a35a-4be1-a18a-e53e387b0a73 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:25:33.929507 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-0bf6169b-a35a-4be1-a18a-e53e387b0a73 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:25:33.995172 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-0bf6169b-a35a-4be1-a18a-e53e387b0a73 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:25:34.003693 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-0bf6169b-a35a-4be1-a18a-e53e387b0a73 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.089585 Oct 20 06:25:34.004263 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1058/2090] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:25:33 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:25:35.027998 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-21991052-89c8-4d0b-bcc0-e298035a61e1 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:25:35.028588 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-21991052-89c8-4d0b-bcc0-e298035a61e1 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:25:35.030890 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG dbcounter [-] [118860] Writing DB stats nova_api:SELECT=28 {{(pid=118860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:25:35.036126 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-21991052-89c8-4d0b-bcc0-e298035a61e1 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:25:35.036599 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-21991052-89c8-4d0b-bcc0-e298035a61e1 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:25:35.037061 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-21991052-89c8-4d0b-bcc0-e298035a61e1 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:25:35.037745 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-21991052-89c8-4d0b-bcc0-e298035a61e1 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:25:35.038261 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-21991052-89c8-4d0b-bcc0-e298035a61e1 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:25:35.038812 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-21991052-89c8-4d0b-bcc0-e298035a61e1 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:25:35.154665 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-21991052-89c8-4d0b-bcc0-e298035a61e1 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:25:35.162980 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-21991052-89c8-4d0b-bcc0-e298035a61e1 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.138826 Oct 20 06:25:35.163746 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1033/2091] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:25:35 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:25:36.185686 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-5a792c1d-ef3d-4808-a2d1-96194acc3a26 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:25:36.186305 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-5a792c1d-ef3d-4808-a2d1-96194acc3a26 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:25:36.192712 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5a792c1d-ef3d-4808-a2d1-96194acc3a26 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:25:36.193221 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5a792c1d-ef3d-4808-a2d1-96194acc3a26 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:25:36.193657 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5a792c1d-ef3d-4808-a2d1-96194acc3a26 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:25:36.194357 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5a792c1d-ef3d-4808-a2d1-96194acc3a26 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:25:36.195077 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5a792c1d-ef3d-4808-a2d1-96194acc3a26 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:25:36.195604 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5a792c1d-ef3d-4808-a2d1-96194acc3a26 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:25:36.257028 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-5a792c1d-ef3d-4808-a2d1-96194acc3a26 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:25:36.265940 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-5a792c1d-ef3d-4808-a2d1-96194acc3a26 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.084279 Oct 20 06:25:36.266502 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1059/2092] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:25:36 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:25:37.289496 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-72beac0f-cf0b-4004-bd74-d6cea7e0e3e1 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:25:37.290104 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-72beac0f-cf0b-4004-bd74-d6cea7e0e3e1 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:25:37.299783 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-72beac0f-cf0b-4004-bd74-d6cea7e0e3e1 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:25:37.299783 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-72beac0f-cf0b-4004-bd74-d6cea7e0e3e1 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:25:37.299783 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-72beac0f-cf0b-4004-bd74-d6cea7e0e3e1 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:25:37.299783 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-72beac0f-cf0b-4004-bd74-d6cea7e0e3e1 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:25:37.300268 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-72beac0f-cf0b-4004-bd74-d6cea7e0e3e1 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:25:37.300268 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-72beac0f-cf0b-4004-bd74-d6cea7e0e3e1 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:25:37.365740 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-72beac0f-cf0b-4004-bd74-d6cea7e0e3e1 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:25:37.374355 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-72beac0f-cf0b-4004-bd74-d6cea7e0e3e1 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.088793 Oct 20 06:25:37.374960 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1034/2093] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:25:37 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:25:38.398335 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-742c31cb-8916-4ff9-88f9-89c0e8548fa1 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:25:38.399102 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-742c31cb-8916-4ff9-88f9-89c0e8548fa1 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:25:38.405511 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-742c31cb-8916-4ff9-88f9-89c0e8548fa1 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:25:38.405993 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-742c31cb-8916-4ff9-88f9-89c0e8548fa1 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:25:38.406428 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-742c31cb-8916-4ff9-88f9-89c0e8548fa1 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:25:38.407145 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-742c31cb-8916-4ff9-88f9-89c0e8548fa1 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:25:38.407574 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-742c31cb-8916-4ff9-88f9-89c0e8548fa1 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:25:38.408008 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-742c31cb-8916-4ff9-88f9-89c0e8548fa1 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:25:38.471559 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-742c31cb-8916-4ff9-88f9-89c0e8548fa1 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:25:38.481221 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-742c31cb-8916-4ff9-88f9-89c0e8548fa1 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.087328 Oct 20 06:25:38.488731 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1060/2094] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:25:38 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:25:39.503905 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-f7424fcf-e86f-4a15-86af-028a7e660d36 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:25:39.504557 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-f7424fcf-e86f-4a15-86af-028a7e660d36 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:25:39.511890 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f7424fcf-e86f-4a15-86af-028a7e660d36 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:25:39.512528 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f7424fcf-e86f-4a15-86af-028a7e660d36 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:25:39.513112 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f7424fcf-e86f-4a15-86af-028a7e660d36 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:25:39.513837 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f7424fcf-e86f-4a15-86af-028a7e660d36 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:25:39.514521 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f7424fcf-e86f-4a15-86af-028a7e660d36 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:25:39.515066 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f7424fcf-e86f-4a15-86af-028a7e660d36 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:25:39.825184 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-f7424fcf-e86f-4a15-86af-028a7e660d36 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:25:39.833490 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-f7424fcf-e86f-4a15-86af-028a7e660d36 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.333432 Oct 20 06:25:39.834051 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1035/2095] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:25:39 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 06:25:40.857748 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-a4d36577-9670-46e3-83bc-a4a17a7b3539 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:25:40.858354 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-a4d36577-9670-46e3-83bc-a4a17a7b3539 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:25:40.864826 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a4d36577-9670-46e3-83bc-a4a17a7b3539 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:25:40.865304 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a4d36577-9670-46e3-83bc-a4a17a7b3539 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:25:40.865740 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a4d36577-9670-46e3-83bc-a4a17a7b3539 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:25:40.866567 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a4d36577-9670-46e3-83bc-a4a17a7b3539 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:25:40.867054 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a4d36577-9670-46e3-83bc-a4a17a7b3539 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:25:40.867478 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a4d36577-9670-46e3-83bc-a4a17a7b3539 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:25:40.938584 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-a4d36577-9670-46e3-83bc-a4a17a7b3539 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:25:40.948024 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-a4d36577-9670-46e3-83bc-a4a17a7b3539 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.094355 Oct 20 06:25:40.948638 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1061/2096] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:25:40 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:25:41.971326 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-98e0b2fb-e2da-4671-87f4-f1ebe525c933 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:25:41.971936 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-98e0b2fb-e2da-4671-87f4-f1ebe525c933 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:25:41.979934 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-98e0b2fb-e2da-4671-87f4-f1ebe525c933 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:25:41.980438 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-98e0b2fb-e2da-4671-87f4-f1ebe525c933 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:25:41.980921 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-98e0b2fb-e2da-4671-87f4-f1ebe525c933 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:25:41.981652 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-98e0b2fb-e2da-4671-87f4-f1ebe525c933 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:25:41.982175 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-98e0b2fb-e2da-4671-87f4-f1ebe525c933 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:25:41.982609 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-98e0b2fb-e2da-4671-87f4-f1ebe525c933 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:25:42.046973 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-98e0b2fb-e2da-4671-87f4-f1ebe525c933 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:25:42.056861 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-98e0b2fb-e2da-4671-87f4-f1ebe525c933 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.089335 Oct 20 06:25:42.057621 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1036/2097] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:25:41 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:25:43.081052 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-1ab42e84-ba26-4780-b645-18b60e069cb6 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:25:43.081644 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-1ab42e84-ba26-4780-b645-18b60e069cb6 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:25:43.089403 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1ab42e84-ba26-4780-b645-18b60e069cb6 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:25:43.089893 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1ab42e84-ba26-4780-b645-18b60e069cb6 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:25:43.090331 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1ab42e84-ba26-4780-b645-18b60e069cb6 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:25:43.091028 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1ab42e84-ba26-4780-b645-18b60e069cb6 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:25:43.091478 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1ab42e84-ba26-4780-b645-18b60e069cb6 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:25:43.091902 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1ab42e84-ba26-4780-b645-18b60e069cb6 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:25:43.154509 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-1ab42e84-ba26-4780-b645-18b60e069cb6 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:25:43.162975 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-1ab42e84-ba26-4780-b645-18b60e069cb6 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.085795 Oct 20 06:25:43.164183 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1062/2098] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:25:43 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:25:44.186985 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-3410798f-d222-4a56-a8c0-cb8c372fa83f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:25:44.187589 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-3410798f-d222-4a56-a8c0-cb8c372fa83f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:25:44.194637 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3410798f-d222-4a56-a8c0-cb8c372fa83f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:25:44.195121 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3410798f-d222-4a56-a8c0-cb8c372fa83f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:25:44.195546 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3410798f-d222-4a56-a8c0-cb8c372fa83f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:25:44.196229 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3410798f-d222-4a56-a8c0-cb8c372fa83f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:25:44.196676 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3410798f-d222-4a56-a8c0-cb8c372fa83f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:25:44.197119 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3410798f-d222-4a56-a8c0-cb8c372fa83f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:25:44.262363 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-3410798f-d222-4a56-a8c0-cb8c372fa83f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:25:44.270672 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-3410798f-d222-4a56-a8c0-cb8c372fa83f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.087642 Oct 20 06:25:44.271237 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1037/2099] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:25:44 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:25:45.294552 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-729d6d9c-5be8-4c50-85b5-4ea911460c3f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:25:45.295142 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-729d6d9c-5be8-4c50-85b5-4ea911460c3f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:25:45.301600 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-729d6d9c-5be8-4c50-85b5-4ea911460c3f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:25:45.301907 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-729d6d9c-5be8-4c50-85b5-4ea911460c3f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:25:45.302341 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-729d6d9c-5be8-4c50-85b5-4ea911460c3f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:25:45.303033 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-729d6d9c-5be8-4c50-85b5-4ea911460c3f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:25:45.305995 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-729d6d9c-5be8-4c50-85b5-4ea911460c3f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:25:45.305995 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-729d6d9c-5be8-4c50-85b5-4ea911460c3f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:25:45.365573 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-729d6d9c-5be8-4c50-85b5-4ea911460c3f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:25:45.374402 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-729d6d9c-5be8-4c50-85b5-4ea911460c3f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.083618 Oct 20 06:25:45.374923 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1063/2100] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:25:45 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:25:46.398584 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-82fb674d-6b62-4a0d-9c49-3cc4a3c30f12 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:25:46.399260 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-82fb674d-6b62-4a0d-9c49-3cc4a3c30f12 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:25:46.405852 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-82fb674d-6b62-4a0d-9c49-3cc4a3c30f12 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:25:46.406338 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-82fb674d-6b62-4a0d-9c49-3cc4a3c30f12 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:25:46.406782 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-82fb674d-6b62-4a0d-9c49-3cc4a3c30f12 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:25:46.407538 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-82fb674d-6b62-4a0d-9c49-3cc4a3c30f12 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:25:46.407990 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-82fb674d-6b62-4a0d-9c49-3cc4a3c30f12 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:25:46.408418 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-82fb674d-6b62-4a0d-9c49-3cc4a3c30f12 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:25:46.468760 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-82fb674d-6b62-4a0d-9c49-3cc4a3c30f12 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:25:46.477659 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-82fb674d-6b62-4a0d-9c49-3cc4a3c30f12 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.083498 Oct 20 06:25:46.478224 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1038/2101] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:25:46 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:25:47.501206 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-3e0d3263-9f72-48a1-8b06-a23a4fe0b632 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:25:47.501820 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-3e0d3263-9f72-48a1-8b06-a23a4fe0b632 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:25:47.508849 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-3e0d3263-9f72-48a1-8b06-a23a4fe0b632 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:25:47.509336 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-3e0d3263-9f72-48a1-8b06-a23a4fe0b632 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:25:47.510028 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-3e0d3263-9f72-48a1-8b06-a23a4fe0b632 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:25:47.510742 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-3e0d3263-9f72-48a1-8b06-a23a4fe0b632 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:25:47.511176 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-3e0d3263-9f72-48a1-8b06-a23a4fe0b632 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:25:47.511598 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-3e0d3263-9f72-48a1-8b06-a23a4fe0b632 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:25:47.575339 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-3e0d3263-9f72-48a1-8b06-a23a4fe0b632 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:25:47.583655 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-3e0d3263-9f72-48a1-8b06-a23a4fe0b632 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.086376 Oct 20 06:25:47.584224 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1064/2102] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:25:47 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:25:48.607577 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-8efae6ca-b9c2-46c5-8e53-b2e299fb7672 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:25:48.608116 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-8efae6ca-b9c2-46c5-8e53-b2e299fb7672 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:25:48.614655 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-8efae6ca-b9c2-46c5-8e53-b2e299fb7672 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:25:48.615135 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-8efae6ca-b9c2-46c5-8e53-b2e299fb7672 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:25:48.615571 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-8efae6ca-b9c2-46c5-8e53-b2e299fb7672 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:25:48.616919 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-8efae6ca-b9c2-46c5-8e53-b2e299fb7672 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:25:48.617432 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-8efae6ca-b9c2-46c5-8e53-b2e299fb7672 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:25:48.617865 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-8efae6ca-b9c2-46c5-8e53-b2e299fb7672 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:25:48.681704 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-8efae6ca-b9c2-46c5-8e53-b2e299fb7672 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:25:48.690037 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-8efae6ca-b9c2-46c5-8e53-b2e299fb7672 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.086533 Oct 20 06:25:48.690590 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1039/2103] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:25:48 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:25:49.713398 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-ebc6a484-7b85-480a-922b-af450068a158 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:25:49.714003 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-ebc6a484-7b85-480a-922b-af450068a158 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:25:49.721012 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ebc6a484-7b85-480a-922b-af450068a158 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:25:49.721514 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ebc6a484-7b85-480a-922b-af450068a158 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:25:49.721991 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ebc6a484-7b85-480a-922b-af450068a158 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:25:49.722703 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ebc6a484-7b85-480a-922b-af450068a158 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:25:49.723161 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ebc6a484-7b85-480a-922b-af450068a158 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:25:49.723590 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ebc6a484-7b85-480a-922b-af450068a158 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:25:49.794446 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-ebc6a484-7b85-480a-922b-af450068a158 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:25:49.802738 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-ebc6a484-7b85-480a-922b-af450068a158 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.094101 Oct 20 06:25:49.803828 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1065/2104] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:25:49 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:25:50.830763 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-15759f29-1bdf-4120-a22e-40427d5c41ab tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:25:50.831314 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-15759f29-1bdf-4120-a22e-40427d5c41ab tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:25:50.838256 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-15759f29-1bdf-4120-a22e-40427d5c41ab tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:25:50.838732 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-15759f29-1bdf-4120-a22e-40427d5c41ab tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:25:50.839157 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-15759f29-1bdf-4120-a22e-40427d5c41ab tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:25:50.839847 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-15759f29-1bdf-4120-a22e-40427d5c41ab tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:25:50.840293 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-15759f29-1bdf-4120-a22e-40427d5c41ab tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:25:50.840744 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-15759f29-1bdf-4120-a22e-40427d5c41ab tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:25:50.902692 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-15759f29-1bdf-4120-a22e-40427d5c41ab tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:25:50.911511 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-15759f29-1bdf-4120-a22e-40427d5c41ab tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.084583 Oct 20 06:25:50.912105 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1040/2105] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:25:50 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:25:51.934776 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-2251746b-be40-4844-8a4c-6fe68919afbc tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:25:51.935421 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-2251746b-be40-4844-8a4c-6fe68919afbc tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:25:51.942076 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-2251746b-be40-4844-8a4c-6fe68919afbc tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:25:51.942556 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-2251746b-be40-4844-8a4c-6fe68919afbc tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:25:51.942991 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-2251746b-be40-4844-8a4c-6fe68919afbc tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:25:51.943697 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-2251746b-be40-4844-8a4c-6fe68919afbc tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:25:51.944147 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-2251746b-be40-4844-8a4c-6fe68919afbc tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:25:51.945165 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-2251746b-be40-4844-8a4c-6fe68919afbc tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:25:52.008546 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-2251746b-be40-4844-8a4c-6fe68919afbc tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:25:52.017680 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-2251746b-be40-4844-8a4c-6fe68919afbc tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.086787 Oct 20 06:25:52.018256 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1066/2106] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:25:51 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:25:53.042070 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-66da4b87-cda2-424b-a4cb-ff492e23f2b5 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:25:53.042638 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-66da4b87-cda2-424b-a4cb-ff492e23f2b5 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:25:53.048524 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-66da4b87-cda2-424b-a4cb-ff492e23f2b5 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:25:53.049032 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-66da4b87-cda2-424b-a4cb-ff492e23f2b5 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:25:53.049468 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-66da4b87-cda2-424b-a4cb-ff492e23f2b5 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:25:53.050153 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-66da4b87-cda2-424b-a4cb-ff492e23f2b5 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:25:53.050603 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-66da4b87-cda2-424b-a4cb-ff492e23f2b5 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:25:53.051028 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-66da4b87-cda2-424b-a4cb-ff492e23f2b5 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:25:53.053776 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG dbcounter [-] [118860] Writing DB stats nova_cell1:SELECT=84 {{(pid=118860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:25:53.119162 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-66da4b87-cda2-424b-a4cb-ff492e23f2b5 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:25:53.127277 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-66da4b87-cda2-424b-a4cb-ff492e23f2b5 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.089538 Oct 20 06:25:53.127840 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1041/2107] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:25:53 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:25:54.152001 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-2fe88652-5bb5-4e33-bdd5-ca7488feebb3 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:25:54.152617 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-2fe88652-5bb5-4e33-bdd5-ca7488feebb3 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:25:54.159386 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-2fe88652-5bb5-4e33-bdd5-ca7488feebb3 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:25:54.159923 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-2fe88652-5bb5-4e33-bdd5-ca7488feebb3 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:25:54.160355 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-2fe88652-5bb5-4e33-bdd5-ca7488feebb3 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:25:54.161091 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-2fe88652-5bb5-4e33-bdd5-ca7488feebb3 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:25:54.161539 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-2fe88652-5bb5-4e33-bdd5-ca7488feebb3 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:25:54.161959 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-2fe88652-5bb5-4e33-bdd5-ca7488feebb3 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:25:54.223395 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-2fe88652-5bb5-4e33-bdd5-ca7488feebb3 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:25:54.232269 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-2fe88652-5bb5-4e33-bdd5-ca7488feebb3 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.084900 Oct 20 06:25:54.232869 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1067/2108] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:25:54 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:25:55.254718 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-bf295c9d-f3ff-45e5-b3ed-7d4609015236 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:25:55.255547 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-bf295c9d-f3ff-45e5-b3ed-7d4609015236 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:25:55.262509 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-bf295c9d-f3ff-45e5-b3ed-7d4609015236 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:25:55.262993 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-bf295c9d-f3ff-45e5-b3ed-7d4609015236 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:25:55.263434 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-bf295c9d-f3ff-45e5-b3ed-7d4609015236 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:25:55.264135 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-bf295c9d-f3ff-45e5-b3ed-7d4609015236 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:25:55.264591 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-bf295c9d-f3ff-45e5-b3ed-7d4609015236 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:25:55.265048 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-bf295c9d-f3ff-45e5-b3ed-7d4609015236 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:25:55.335487 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-bf295c9d-f3ff-45e5-b3ed-7d4609015236 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:25:55.343975 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-bf295c9d-f3ff-45e5-b3ed-7d4609015236 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.093143 Oct 20 06:25:55.344539 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1042/2109] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:25:55 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 06:25:56.367791 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-3267abfa-950f-4952-a723-851d9e13b9f8 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:25:56.368510 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-3267abfa-950f-4952-a723-851d9e13b9f8 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:25:56.374977 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-3267abfa-950f-4952-a723-851d9e13b9f8 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:25:56.375455 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-3267abfa-950f-4952-a723-851d9e13b9f8 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:25:56.375891 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-3267abfa-950f-4952-a723-851d9e13b9f8 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:25:56.376579 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-3267abfa-950f-4952-a723-851d9e13b9f8 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:25:56.377056 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-3267abfa-950f-4952-a723-851d9e13b9f8 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:25:56.377480 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-3267abfa-950f-4952-a723-851d9e13b9f8 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:25:56.379987 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG dbcounter [-] [118861] Writing DB stats nova_cell1:SELECT=84 {{(pid=118861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:25:56.440388 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-3267abfa-950f-4952-a723-851d9e13b9f8 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:25:56.449215 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-3267abfa-950f-4952-a723-851d9e13b9f8 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.085603 Oct 20 06:25:56.449788 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1068/2110] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:25:56 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:25:57.471465 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-2a3fdab9-d0c9-4e25-a5b6-44bb602dd26f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:25:57.472078 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-2a3fdab9-d0c9-4e25-a5b6-44bb602dd26f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:25:57.478707 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2a3fdab9-d0c9-4e25-a5b6-44bb602dd26f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:25:57.479183 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2a3fdab9-d0c9-4e25-a5b6-44bb602dd26f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:25:57.479621 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2a3fdab9-d0c9-4e25-a5b6-44bb602dd26f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:25:57.480314 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2a3fdab9-d0c9-4e25-a5b6-44bb602dd26f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:25:57.480791 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2a3fdab9-d0c9-4e25-a5b6-44bb602dd26f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:25:57.481254 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2a3fdab9-d0c9-4e25-a5b6-44bb602dd26f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:25:57.542934 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-2a3fdab9-d0c9-4e25-a5b6-44bb602dd26f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:25:57.551233 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-2a3fdab9-d0c9-4e25-a5b6-44bb602dd26f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.083606 Oct 20 06:25:57.551800 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1043/2111] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:25:57 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:25:58.574958 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-8287a405-7bee-4855-8fe4-c4e5f21fac07 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:25:58.575498 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-8287a405-7bee-4855-8fe4-c4e5f21fac07 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:25:58.581755 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-8287a405-7bee-4855-8fe4-c4e5f21fac07 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:25:58.582265 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-8287a405-7bee-4855-8fe4-c4e5f21fac07 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:25:58.582703 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-8287a405-7bee-4855-8fe4-c4e5f21fac07 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:25:58.583392 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-8287a405-7bee-4855-8fe4-c4e5f21fac07 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:25:58.583842 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-8287a405-7bee-4855-8fe4-c4e5f21fac07 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:25:58.584259 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-8287a405-7bee-4855-8fe4-c4e5f21fac07 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:25:58.651047 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-8287a405-7bee-4855-8fe4-c4e5f21fac07 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:25:58.659361 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-8287a405-7bee-4855-8fe4-c4e5f21fac07 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.088404 Oct 20 06:25:58.659924 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1069/2112] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:25:58 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:25:59.683616 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-4f0bce5c-8ef4-4507-b254-50d94b06a15d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:25:59.684215 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-4f0bce5c-8ef4-4507-b254-50d94b06a15d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:25:59.690363 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-4f0bce5c-8ef4-4507-b254-50d94b06a15d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:25:59.690851 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-4f0bce5c-8ef4-4507-b254-50d94b06a15d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:25:59.691288 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-4f0bce5c-8ef4-4507-b254-50d94b06a15d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:25:59.692022 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-4f0bce5c-8ef4-4507-b254-50d94b06a15d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:25:59.692493 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-4f0bce5c-8ef4-4507-b254-50d94b06a15d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:25:59.692950 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-4f0bce5c-8ef4-4507-b254-50d94b06a15d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:25:59.761533 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-4f0bce5c-8ef4-4507-b254-50d94b06a15d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:25:59.769856 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-4f0bce5c-8ef4-4507-b254-50d94b06a15d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.091498 Oct 20 06:25:59.770432 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1044/2113] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:25:59 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:26:00.793693 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-ab60c8fd-bd12-491e-9174-a4fd6bf88ded tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:26:00.794311 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-ab60c8fd-bd12-491e-9174-a4fd6bf88ded tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:26:00.800664 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ab60c8fd-bd12-491e-9174-a4fd6bf88ded tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:26:00.801175 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ab60c8fd-bd12-491e-9174-a4fd6bf88ded tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:26:00.801616 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ab60c8fd-bd12-491e-9174-a4fd6bf88ded tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:26:00.802306 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ab60c8fd-bd12-491e-9174-a4fd6bf88ded tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:26:00.802754 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ab60c8fd-bd12-491e-9174-a4fd6bf88ded tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:26:00.803177 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ab60c8fd-bd12-491e-9174-a4fd6bf88ded tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:26:00.865079 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-ab60c8fd-bd12-491e-9174-a4fd6bf88ded tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:26:00.873472 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-ab60c8fd-bd12-491e-9174-a4fd6bf88ded tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.083607 Oct 20 06:26:00.874037 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1070/2114] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:26:00 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:26:01.899498 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-abfbe7a0-d3f5-4654-8bf6-890e38d73795 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:26:01.900093 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-abfbe7a0-d3f5-4654-8bf6-890e38d73795 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:26:01.906480 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-abfbe7a0-d3f5-4654-8bf6-890e38d73795 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:26:01.906955 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-abfbe7a0-d3f5-4654-8bf6-890e38d73795 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:26:01.907388 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-abfbe7a0-d3f5-4654-8bf6-890e38d73795 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:26:01.908067 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-abfbe7a0-d3f5-4654-8bf6-890e38d73795 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:26:01.908519 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-abfbe7a0-d3f5-4654-8bf6-890e38d73795 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:26:01.908960 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-abfbe7a0-d3f5-4654-8bf6-890e38d73795 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:26:01.972555 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-abfbe7a0-d3f5-4654-8bf6-890e38d73795 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:26:01.981119 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-abfbe7a0-d3f5-4654-8bf6-890e38d73795 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.085953 Oct 20 06:26:01.981688 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1045/2115] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:26:01 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 06:26:03.003585 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-7c068b4f-b8ab-4fcf-ba7b-432972d12aa1 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:26:03.004288 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-7c068b4f-b8ab-4fcf-ba7b-432972d12aa1 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:26:03.011809 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7c068b4f-b8ab-4fcf-ba7b-432972d12aa1 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:26:03.012291 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7c068b4f-b8ab-4fcf-ba7b-432972d12aa1 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:26:03.012744 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7c068b4f-b8ab-4fcf-ba7b-432972d12aa1 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:26:03.013442 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7c068b4f-b8ab-4fcf-ba7b-432972d12aa1 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:26:03.013888 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7c068b4f-b8ab-4fcf-ba7b-432972d12aa1 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:26:03.014308 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7c068b4f-b8ab-4fcf-ba7b-432972d12aa1 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:26:03.081437 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-7c068b4f-b8ab-4fcf-ba7b-432972d12aa1 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:26:03.091035 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-7c068b4f-b8ab-4fcf-ba7b-432972d12aa1 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.091056 Oct 20 06:26:03.100174 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1071/2116] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:26:02 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:26:04.114563 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-0d3843c5-b68c-450d-871a-7751050d06f0 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:26:04.115187 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-0d3843c5-b68c-450d-871a-7751050d06f0 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:26:04.122292 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0d3843c5-b68c-450d-871a-7751050d06f0 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:26:04.122776 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0d3843c5-b68c-450d-871a-7751050d06f0 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:26:04.123218 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0d3843c5-b68c-450d-871a-7751050d06f0 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:26:04.123911 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0d3843c5-b68c-450d-871a-7751050d06f0 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:26:04.124367 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0d3843c5-b68c-450d-871a-7751050d06f0 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:26:04.124834 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0d3843c5-b68c-450d-871a-7751050d06f0 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:26:04.186449 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-0d3843c5-b68c-450d-871a-7751050d06f0 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:26:04.195571 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-0d3843c5-b68c-450d-871a-7751050d06f0 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.084801 Oct 20 06:26:04.196138 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1046/2117] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:26:04 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:26:05.219094 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-f8dddf87-bb1b-4956-b697-92222fa799b7 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:26:05.219719 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-f8dddf87-bb1b-4956-b697-92222fa799b7 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:26:05.222095 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG dbcounter [-] [118861] Writing DB stats nova_api:SELECT=28 {{(pid=118861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:26:05.228091 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f8dddf87-bb1b-4956-b697-92222fa799b7 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:26:05.228572 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f8dddf87-bb1b-4956-b697-92222fa799b7 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:26:05.229045 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f8dddf87-bb1b-4956-b697-92222fa799b7 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:26:05.229735 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f8dddf87-bb1b-4956-b697-92222fa799b7 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:26:05.230185 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f8dddf87-bb1b-4956-b697-92222fa799b7 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:26:05.230601 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f8dddf87-bb1b-4956-b697-92222fa799b7 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:26:05.294823 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-f8dddf87-bb1b-4956-b697-92222fa799b7 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:26:05.303506 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-f8dddf87-bb1b-4956-b697-92222fa799b7 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.088271 Oct 20 06:26:05.304291 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1072/2118] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:26:05 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:26:06.326290 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-75d92b75-9d49-489b-9b3b-10e5ef4f4a8d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:26:06.326971 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-75d92b75-9d49-489b-9b3b-10e5ef4f4a8d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:26:06.329295 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG dbcounter [-] [118860] Writing DB stats nova_api:SELECT=28 {{(pid=118860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:26:06.334739 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-75d92b75-9d49-489b-9b3b-10e5ef4f4a8d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:26:06.335346 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-75d92b75-9d49-489b-9b3b-10e5ef4f4a8d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:26:06.335792 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-75d92b75-9d49-489b-9b3b-10e5ef4f4a8d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:26:06.336501 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-75d92b75-9d49-489b-9b3b-10e5ef4f4a8d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:26:06.336983 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-75d92b75-9d49-489b-9b3b-10e5ef4f4a8d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:26:06.337420 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-75d92b75-9d49-489b-9b3b-10e5ef4f4a8d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:26:06.399603 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-75d92b75-9d49-489b-9b3b-10e5ef4f4a8d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:26:06.407914 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-75d92b75-9d49-489b-9b3b-10e5ef4f4a8d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.085558 Oct 20 06:26:06.408483 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1047/2119] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:26:06 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:26:07.430713 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-70dbc82e-553a-4d1c-bd3e-3740ae3d901a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:26:07.431361 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-70dbc82e-553a-4d1c-bd3e-3740ae3d901a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:26:07.437920 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-70dbc82e-553a-4d1c-bd3e-3740ae3d901a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:26:07.438401 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-70dbc82e-553a-4d1c-bd3e-3740ae3d901a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:26:07.438835 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-70dbc82e-553a-4d1c-bd3e-3740ae3d901a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:26:07.439537 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-70dbc82e-553a-4d1c-bd3e-3740ae3d901a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:26:07.439989 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-70dbc82e-553a-4d1c-bd3e-3740ae3d901a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:26:07.440414 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-70dbc82e-553a-4d1c-bd3e-3740ae3d901a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:26:07.505486 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-70dbc82e-553a-4d1c-bd3e-3740ae3d901a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:26:07.514564 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-70dbc82e-553a-4d1c-bd3e-3740ae3d901a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.088647 Oct 20 06:26:07.515148 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1073/2120] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:26:07 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:26:08.538495 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-fed91334-9a1c-472f-9d42-603cb01f6aed tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:26:08.540080 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-fed91334-9a1c-472f-9d42-603cb01f6aed tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:26:08.547172 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-fed91334-9a1c-472f-9d42-603cb01f6aed tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:26:08.547787 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-fed91334-9a1c-472f-9d42-603cb01f6aed tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:26:08.548352 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-fed91334-9a1c-472f-9d42-603cb01f6aed tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:26:08.549192 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-fed91334-9a1c-472f-9d42-603cb01f6aed tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:26:08.549746 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-fed91334-9a1c-472f-9d42-603cb01f6aed tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:26:08.550274 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-fed91334-9a1c-472f-9d42-603cb01f6aed tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:26:08.631257 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-645abc3d-4ec9-4eeb-8c79-22bce5a90f1b tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:26:08.631861 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-645abc3d-4ec9-4eeb-8c79-22bce5a90f1b tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] [instance: e8e2c461-4b15-42ea-bfc7-1daf1fe15f7f] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:26:08.633823 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-fed91334-9a1c-472f-9d42-603cb01f6aed tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:26:08.639054 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-645abc3d-4ec9-4eeb-8c79-22bce5a90f1b tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:26:08.639845 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-645abc3d-4ec9-4eeb-8c79-22bce5a90f1b tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:26:08.640534 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-645abc3d-4ec9-4eeb-8c79-22bce5a90f1b tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:26:08.641523 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-645abc3d-4ec9-4eeb-8c79-22bce5a90f1b tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:26:08.642202 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-645abc3d-4ec9-4eeb-8c79-22bce5a90f1b tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:26:08.642852 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-645abc3d-4ec9-4eeb-8c79-22bce5a90f1b tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:26:08.647910 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-fed91334-9a1c-472f-9d42-603cb01f6aed tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.113115 Oct 20 06:26:08.648556 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1048/2121] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:26:08 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:26:08.689356 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-645abc3d-4ec9-4eeb-8c79-22bce5a90f1b tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] [instance: e8e2c461-4b15-42ea-bfc7-1daf1fe15f7f] Going to try to terminate instance {{(pid=118861) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 20 06:26:08.788316 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-645abc3d-4ec9-4eeb-8c79-22bce5a90f1b tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] 10.222.0.20 "DELETE /compute/v2.1/servers/e8e2c461-4b15-42ea-bfc7-1daf1fe15f7f" status: 204 len: 0 microversion: 2.1 time: 0.159965 Oct 20 06:26:08.792529 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1074/2122] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 20 06:26:08 2022] DELETE /compute/v2.1/servers/e8e2c461-4b15-42ea-bfc7-1daf1fe15f7f => generated 0 bytes in 163 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 20 06:26:08.800547 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-0eaaa69d-447d-4f33-bcbb-fadde1e4709f tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:26:08.801314 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-0eaaa69d-447d-4f33-bcbb-fadde1e4709f tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] [instance: e8e2c461-4b15-42ea-bfc7-1daf1fe15f7f] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:26:08.808325 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0eaaa69d-447d-4f33-bcbb-fadde1e4709f tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:26:08.808848 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0eaaa69d-447d-4f33-bcbb-fadde1e4709f tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:26:08.809293 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0eaaa69d-447d-4f33-bcbb-fadde1e4709f tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:26:08.810006 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0eaaa69d-447d-4f33-bcbb-fadde1e4709f tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:26:08.810461 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0eaaa69d-447d-4f33-bcbb-fadde1e4709f tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:26:08.810893 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0eaaa69d-447d-4f33-bcbb-fadde1e4709f tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:26:08.980006 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-0eaaa69d-447d-4f33-bcbb-fadde1e4709f tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d4cbd2a2154e5d925462df7c77815a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0d80988ca941acb8ad4318338dfbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:26:08.987975 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-0eaaa69d-447d-4f33-bcbb-fadde1e4709f tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] 10.222.0.20 "GET /compute/v2.1/servers/e8e2c461-4b15-42ea-bfc7-1daf1fe15f7f" status: 200 len: 1508 microversion: 2.1 time: 0.193699 Oct 20 06:26:08.988631 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1049/2123] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:26:08 2022] GET /compute/v2.1/servers/e8e2c461-4b15-42ea-bfc7-1daf1fe15f7f => generated 1508 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 06:26:09.675105 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-f5919c3b-3421-4eae-92d0-e1d5c2fb6238 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:26:09.676080 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-f5919c3b-3421-4eae-92d0-e1d5c2fb6238 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:26:09.682630 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f5919c3b-3421-4eae-92d0-e1d5c2fb6238 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:26:09.683245 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f5919c3b-3421-4eae-92d0-e1d5c2fb6238 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:26:09.683809 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f5919c3b-3421-4eae-92d0-e1d5c2fb6238 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:26:09.684626 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f5919c3b-3421-4eae-92d0-e1d5c2fb6238 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:26:09.685207 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f5919c3b-3421-4eae-92d0-e1d5c2fb6238 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:26:09.685772 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f5919c3b-3421-4eae-92d0-e1d5c2fb6238 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:26:09.781665 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-f5919c3b-3421-4eae-92d0-e1d5c2fb6238 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:26:09.794177 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-f5919c3b-3421-4eae-92d0-e1d5c2fb6238 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.123209 Oct 20 06:26:09.809022 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1075/2124] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:26:09 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:26:09.939726 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [req-f8e84a72-9192-4b4d-b286-0401b265913c req-94cca0e2-aa21-44a1-b7e2-0d3650b2d2c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8e2c461-4b15-42ea-bfc7-1daf1fe15f7f", "name": "network-vif-deleted", "tag": "c9ce8d7f-24b9-4d6f-ac5d-3049f7eed554"}]} {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 06:26:09.950831 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [req-f8e84a72-9192-4b4d-b286-0401b265913c req-94cca0e2-aa21-44a1-b7e2-0d3650b2d2c9 service nova] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:26:09.951319 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [req-f8e84a72-9192-4b4d-b286-0401b265913c req-94cca0e2-aa21-44a1-b7e2-0d3650b2d2c9 service nova] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:26:09.951764 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [req-f8e84a72-9192-4b4d-b286-0401b265913c req-94cca0e2-aa21-44a1-b7e2-0d3650b2d2c9 service nova] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:26:09.964090 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.compute.server_external_events [req-f8e84a72-9192-4b4d-b286-0401b265913c req-94cca0e2-aa21-44a1-b7e2-0d3650b2d2c9 service nova] Creating event network-vif-deleted:c9ce8d7f-24b9-4d6f-ac5d-3049f7eed554 for instance e8e2c461-4b15-42ea-bfc7-1daf1fe15f7f on hv-cinder-86156 Oct 20 06:26:09.970697 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [req-f8e84a72-9192-4b4d-b286-0401b265913c req-94cca0e2-aa21-44a1-b7e2-0d3650b2d2c9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093941 Oct 20 06:26:09.971152 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1050/2125] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 20 06:26:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:26:10.011608 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-4014268c-96a3-46b7-86b9-7b382fc56843 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:26:10.012406 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-4014268c-96a3-46b7-86b9-7b382fc56843 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] [instance: e8e2c461-4b15-42ea-bfc7-1daf1fe15f7f] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:26:10.021004 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4014268c-96a3-46b7-86b9-7b382fc56843 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:26:10.021561 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4014268c-96a3-46b7-86b9-7b382fc56843 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:26:10.022728 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4014268c-96a3-46b7-86b9-7b382fc56843 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:26:10.023595 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4014268c-96a3-46b7-86b9-7b382fc56843 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:26:10.024115 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4014268c-96a3-46b7-86b9-7b382fc56843 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:26:10.024636 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4014268c-96a3-46b7-86b9-7b382fc56843 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:26:10.058102 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4014268c-96a3-46b7-86b9-7b382fc56843 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:26:10.058595 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4014268c-96a3-46b7-86b9-7b382fc56843 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:26:10.059034 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4014268c-96a3-46b7-86b9-7b382fc56843 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:26:10.059486 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.objects.instance [None req-4014268c-96a3-46b7-86b9-7b382fc56843 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lazy-loading 'fault' on Instance uuid e8e2c461-4b15-42ea-bfc7-1daf1fe15f7f {{(pid=118861) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 20 06:26:10.108373 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-4014268c-96a3-46b7-86b9-7b382fc56843 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d4cbd2a2154e5d925462df7c77815a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0d80988ca941acb8ad4318338dfbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:26:10.117121 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-4014268c-96a3-46b7-86b9-7b382fc56843 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] 10.222.0.20 "GET /compute/v2.1/servers/e8e2c461-4b15-42ea-bfc7-1daf1fe15f7f" status: 200 len: 1312 microversion: 2.1 time: 0.109499 Oct 20 06:26:10.129345 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1076/2126] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:26:10 2022] GET /compute/v2.1/servers/e8e2c461-4b15-42ea-bfc7-1daf1fe15f7f => generated 1312 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 06:26:10.820792 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-3fbd614a-c559-4ce8-b0eb-a8f9a068965f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:26:10.821416 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-3fbd614a-c559-4ce8-b0eb-a8f9a068965f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:26:10.827636 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3fbd614a-c559-4ce8-b0eb-a8f9a068965f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:26:10.828112 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3fbd614a-c559-4ce8-b0eb-a8f9a068965f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:26:10.828542 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3fbd614a-c559-4ce8-b0eb-a8f9a068965f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:26:10.829263 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3fbd614a-c559-4ce8-b0eb-a8f9a068965f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:26:10.829713 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3fbd614a-c559-4ce8-b0eb-a8f9a068965f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:26:10.830130 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3fbd614a-c559-4ce8-b0eb-a8f9a068965f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:26:10.898609 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-3fbd614a-c559-4ce8-b0eb-a8f9a068965f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:26:10.907041 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-3fbd614a-c559-4ce8-b0eb-a8f9a068965f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.091316 Oct 20 06:26:10.907716 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1051/2127] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:26:10 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:26:11.143362 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-bb4946f0-841f-45c8-9680-b83bdcfd300d tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:26:11.143993 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-bb4946f0-841f-45c8-9680-b83bdcfd300d tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] [instance: e8e2c461-4b15-42ea-bfc7-1daf1fe15f7f] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:26:11.150562 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-bb4946f0-841f-45c8-9680-b83bdcfd300d tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:26:11.151051 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-bb4946f0-841f-45c8-9680-b83bdcfd300d tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:26:11.151491 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-bb4946f0-841f-45c8-9680-b83bdcfd300d tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:26:11.152186 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-bb4946f0-841f-45c8-9680-b83bdcfd300d tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:26:11.152642 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-bb4946f0-841f-45c8-9680-b83bdcfd300d tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:26:11.153097 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-bb4946f0-841f-45c8-9680-b83bdcfd300d tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:26:11.167013 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.wsgi [None req-bb4946f0-841f-45c8-9680-b83bdcfd300d tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] HTTP exception thrown: Instance e8e2c461-4b15-42ea-bfc7-1daf1fe15f7f could not be found. Oct 20 06:26:11.168662 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-bb4946f0-841f-45c8-9680-b83bdcfd300d tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Request method failure captured: Oct 20 06:26:11.168662 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: request: GET /compute/v2.1/servers/e8e2c461-4b15-42ea-bfc7-1daf1fe15f7f HTTP/1.1 Oct 20 06:26:11.168662 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: Accept: application/json Oct 20 06:26:11.168662 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: Accept-Encoding: identity Oct 20 06:26:11.168662 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: Connection: close Oct 20 06:26:11.168662 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: Content-Length: 0 Oct 20 06:26:11.168662 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: Content-Type: application/json Oct 20 06:26:11.168662 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: Host: 10.222.0.20 Oct 20 06:26:11.168662 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: Openstack-System-Scope: None Oct 20 06:26:11.168662 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: User-Agent: python-urllib3/1.26.12 Oct 20 06:26:11.168662 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Auth-Token: gAAAAABjUOT2-FglyAobdOsIoXa2I6DRznal3Iq7fMTF8HI6G5YcCfomknnkPo7EFjjdZsTl7BVv0timK8MTu7wRa_roYL42t_YgASBwpM-lJk_PzcQvsocgThAGpTckdZz7QuynujWgj5fAj0dQo7xS5NqQC90KvEfG5PqmAbr7F9s3OXF4swA Oct 20 06:26:11.168662 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Domain-Id: None Oct 20 06:26:11.168662 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Domain-Name: None Oct 20 06:26:11.168662 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Identity-Status: Confirmed Oct 20 06:26:11.168662 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Is-Admin-Project: True Oct 20 06:26:11.168662 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Project-Domain-Id: default Oct 20 06:26:11.168662 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Project-Domain-Name: Default Oct 20 06:26:11.168662 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Project-Id: 9f0d80988ca941acb8ad4318338dfbea Oct 20 06:26:11.168662 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-647211481 Oct 20 06:26:11.168662 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Role: reader,member Oct 20 06:26:11.168662 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Roles: reader,member Oct 20 06:26:11.170204 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/9f0d80988ca941acb8ad4318338dfbea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_9f0d80988ca941acb8ad4318338dfbea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9f0d80988ca941acb8ad4318338dfbea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9f0d80988ca941acb8ad4318338dfbea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 20 06:26:11.170204 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Tenant: tempest-ServerRescueNegativeTestJSON-647211481 Oct 20 06:26:11.170204 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Tenant-Id: 9f0d80988ca941acb8ad4318338dfbea Oct 20 06:26:11.170204 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-647211481 Oct 20 06:26:11.170204 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-User: tempest-ServerRescueNegativeTestJSON-647211481-project Oct 20 06:26:11.170204 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-User-Domain-Id: default Oct 20 06:26:11.170204 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-User-Domain-Name: Default Oct 20 06:26:11.170204 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-User-Id: 57d4cbd2a2154e5d925462df7c77815a Oct 20 06:26:11.170204 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-User-Name: tempest-ServerRescueNegativeTestJSON-647211481-project Oct 20 06:26:11.170204 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: method: > Oct 20 06:26:11.170204 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: exception: Instance e8e2c461-4b15-42ea-bfc7-1daf1fe15f7f could not be found. Oct 20 06:26:11.170204 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: action_args: {'id': 'e8e2c461-4b15-42ea-bfc7-1daf1fe15f7f'} Oct 20 06:26:11.171082 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 20 06:26:11.171082 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 06:26:11.171082 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 20 06:26:11.171082 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 20 06:26:11.171082 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 20 06:26:11.171082 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 20 06:26:11.171082 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 20 06:26:11.171082 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 20 06:26:11.171082 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 20 06:26:11.171082 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 20 06:26:11.171082 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e8e2c461-4b15-42ea-bfc7-1daf1fe15f7f could not be found. Oct 20 06:26:11.171082 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi Oct 20 06:26:11.171082 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 06:26:11.171082 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi Oct 20 06:26:11.171082 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 06:26:11.171082 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 06:26:11.171082 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 06:26:11.171082 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 20 06:26:11.171082 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 20 06:26:11.171082 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 20 06:26:11.172545 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 20 06:26:11.172545 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 20 06:26:11.172545 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 20 06:26:11.172545 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 20 06:26:11.172545 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 20 06:26:11.172545 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 20 06:26:11.172545 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 20 06:26:11.172545 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e8e2c461-4b15-42ea-bfc7-1daf1fe15f7f could not be found. Oct 20 06:26:11.172545 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi Oct 20 06:26:11.172545 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 06:26:11.172545 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi Oct 20 06:26:11.172545 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 06:26:11.172545 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 06:26:11.172545 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 06:26:11.172545 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 20 06:26:11.172545 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 20 06:26:11.172545 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e8e2c461-4b15-42ea-bfc7-1daf1fe15f7f could not be found. Oct 20 06:26:11.172545 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi Oct 20 06:26:11.173898 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-bb4946f0-841f-45c8-9680-b83bdcfd300d tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Returning 404 to user: Instance e8e2c461-4b15-42ea-bfc7-1daf1fe15f7f could not be found. {{(pid=118861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 20 06:26:11.173898 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-bb4946f0-841f-45c8-9680-b83bdcfd300d tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] 10.222.0.20 "GET /compute/v2.1/servers/e8e2c461-4b15-42ea-bfc7-1daf1fe15f7f" status: 404 len: 111 microversion: 2.1 time: 0.030621 Oct 20 06:26:11.173898 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1077/2128] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:26:11 2022] GET /compute/v2.1/servers/e8e2c461-4b15-42ea-bfc7-1daf1fe15f7f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 20 06:26:11.179330 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-19709f04-62b9-4b4f-a9db-57d2e29a88fc tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:26:11.179881 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-19709f04-62b9-4b4f-a9db-57d2e29a88fc tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] [instance: d38a019f-4bfc-4845-900b-a9e4e6397373] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:26:11.185802 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-19709f04-62b9-4b4f-a9db-57d2e29a88fc tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:26:11.186289 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-19709f04-62b9-4b4f-a9db-57d2e29a88fc tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:26:11.186732 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-19709f04-62b9-4b4f-a9db-57d2e29a88fc tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:26:11.187432 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-19709f04-62b9-4b4f-a9db-57d2e29a88fc tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:26:11.187886 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-19709f04-62b9-4b4f-a9db-57d2e29a88fc tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:26:11.188315 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-19709f04-62b9-4b4f-a9db-57d2e29a88fc tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:26:11.214775 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-19709f04-62b9-4b4f-a9db-57d2e29a88fc tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] [instance: d38a019f-4bfc-4845-900b-a9e4e6397373] Going to try to terminate instance {{(pid=118860) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 20 06:26:11.292902 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-19709f04-62b9-4b4f-a9db-57d2e29a88fc tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] 10.222.0.20 "DELETE /compute/v2.1/servers/d38a019f-4bfc-4845-900b-a9e4e6397373" status: 204 len: 0 microversion: 2.1 time: 0.117826 Oct 20 06:26:11.293954 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1052/2129] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 20 06:26:11 2022] DELETE /compute/v2.1/servers/d38a019f-4bfc-4845-900b-a9e4e6397373 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 20 06:26:11.302463 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-55438f08-8a1d-47a8-b2bc-c0a1055d1a74 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:26:11.303905 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-55438f08-8a1d-47a8-b2bc-c0a1055d1a74 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] [instance: d38a019f-4bfc-4845-900b-a9e4e6397373] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:26:11.311089 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-55438f08-8a1d-47a8-b2bc-c0a1055d1a74 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:26:11.311584 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-55438f08-8a1d-47a8-b2bc-c0a1055d1a74 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:26:11.312024 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-55438f08-8a1d-47a8-b2bc-c0a1055d1a74 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:26:11.312785 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-55438f08-8a1d-47a8-b2bc-c0a1055d1a74 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:26:11.313244 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-55438f08-8a1d-47a8-b2bc-c0a1055d1a74 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:26:11.313675 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-55438f08-8a1d-47a8-b2bc-c0a1055d1a74 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:26:11.453527 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-55438f08-8a1d-47a8-b2bc-c0a1055d1a74 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d4cbd2a2154e5d925462df7c77815a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0d80988ca941acb8ad4318338dfbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:26:11.462026 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-55438f08-8a1d-47a8-b2bc-c0a1055d1a74 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] 10.222.0.20 "GET /compute/v2.1/servers/d38a019f-4bfc-4845-900b-a9e4e6397373" status: 200 len: 1522 microversion: 2.1 time: 0.163475 Oct 20 06:26:11.462586 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1078/2130] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:26:11 2022] GET /compute/v2.1/servers/d38a019f-4bfc-4845-900b-a9e4e6397373 => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:26:11.931225 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-0ec6e787-4746-4f96-8322-f4e2c0966857 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:26:11.932231 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-0ec6e787-4746-4f96-8322-f4e2c0966857 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:26:11.938820 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0ec6e787-4746-4f96-8322-f4e2c0966857 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:26:11.939559 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0ec6e787-4746-4f96-8322-f4e2c0966857 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:26:11.940184 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0ec6e787-4746-4f96-8322-f4e2c0966857 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:26:11.940925 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0ec6e787-4746-4f96-8322-f4e2c0966857 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:26:11.941561 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0ec6e787-4746-4f96-8322-f4e2c0966857 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:26:11.942140 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0ec6e787-4746-4f96-8322-f4e2c0966857 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:26:12.014124 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-0ec6e787-4746-4f96-8322-f4e2c0966857 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:26:12.024212 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-0ec6e787-4746-4f96-8322-f4e2c0966857 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.097768 Oct 20 06:26:12.025084 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1053/2131] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:26:11 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:26:12.351974 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [req-ede7eb62-220d-4101-8feb-b47e277d0fb7 req-303f31e3-9d52-4f2f-9b5a-a334471dfe63 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d38a019f-4bfc-4845-900b-a9e4e6397373", "name": "network-vif-deleted", "tag": "96706f05-eb97-4530-8210-9800d1f1d106"}]} {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 06:26:12.364823 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [req-ede7eb62-220d-4101-8feb-b47e277d0fb7 req-303f31e3-9d52-4f2f-9b5a-a334471dfe63 service nova] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:26:12.366745 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [req-ede7eb62-220d-4101-8feb-b47e277d0fb7 req-303f31e3-9d52-4f2f-9b5a-a334471dfe63 service nova] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:26:12.367715 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [req-ede7eb62-220d-4101-8feb-b47e277d0fb7 req-303f31e3-9d52-4f2f-9b5a-a334471dfe63 service nova] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:26:12.379890 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.compute.server_external_events [req-ede7eb62-220d-4101-8feb-b47e277d0fb7 req-303f31e3-9d52-4f2f-9b5a-a334471dfe63 service nova] Creating event network-vif-deleted:96706f05-eb97-4530-8210-9800d1f1d106 for instance d38a019f-4bfc-4845-900b-a9e4e6397373 on hv-cinder-86156 Oct 20 06:26:12.387264 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [req-ede7eb62-220d-4101-8feb-b47e277d0fb7 req-303f31e3-9d52-4f2f-9b5a-a334471dfe63 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039139 Oct 20 06:26:12.387980 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1079/2132] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 20 06:26:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:26:12.486187 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-c324cddd-2004-4fe0-a9eb-953d6217d16e tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:26:12.486911 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-c324cddd-2004-4fe0-a9eb-953d6217d16e tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] [instance: d38a019f-4bfc-4845-900b-a9e4e6397373] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:26:12.494923 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c324cddd-2004-4fe0-a9eb-953d6217d16e tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:26:12.495505 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c324cddd-2004-4fe0-a9eb-953d6217d16e tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:26:12.496092 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c324cddd-2004-4fe0-a9eb-953d6217d16e tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:26:12.496940 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c324cddd-2004-4fe0-a9eb-953d6217d16e tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:26:12.497540 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c324cddd-2004-4fe0-a9eb-953d6217d16e tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:26:12.498070 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c324cddd-2004-4fe0-a9eb-953d6217d16e tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:26:12.531782 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c324cddd-2004-4fe0-a9eb-953d6217d16e tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:26:12.532266 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c324cddd-2004-4fe0-a9eb-953d6217d16e tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:26:12.532710 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c324cddd-2004-4fe0-a9eb-953d6217d16e tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:26:12.533155 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.objects.instance [None req-c324cddd-2004-4fe0-a9eb-953d6217d16e tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lazy-loading 'fault' on Instance uuid d38a019f-4bfc-4845-900b-a9e4e6397373 {{(pid=118860) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 20 06:26:12.578321 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-c324cddd-2004-4fe0-a9eb-953d6217d16e tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57d4cbd2a2154e5d925462df7c77815a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0d80988ca941acb8ad4318338dfbea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:26:12.586567 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-c324cddd-2004-4fe0-a9eb-953d6217d16e tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] 10.222.0.20 "GET /compute/v2.1/servers/d38a019f-4bfc-4845-900b-a9e4e6397373" status: 200 len: 1312 microversion: 2.1 time: 0.104538 Oct 20 06:26:12.587332 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1054/2133] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:26:12 2022] GET /compute/v2.1/servers/d38a019f-4bfc-4845-900b-a9e4e6397373 => generated 1312 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:26:13.049603 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-2369f690-aa7c-4359-a009-85c9182c8927 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:26:13.050706 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-2369f690-aa7c-4359-a009-85c9182c8927 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:26:13.058569 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-2369f690-aa7c-4359-a009-85c9182c8927 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:26:13.059204 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-2369f690-aa7c-4359-a009-85c9182c8927 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:26:13.059747 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-2369f690-aa7c-4359-a009-85c9182c8927 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:26:13.060734 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-2369f690-aa7c-4359-a009-85c9182c8927 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:26:13.061309 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-2369f690-aa7c-4359-a009-85c9182c8927 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:26:13.061833 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-2369f690-aa7c-4359-a009-85c9182c8927 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:26:13.127314 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-2369f690-aa7c-4359-a009-85c9182c8927 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:26:13.136618 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-2369f690-aa7c-4359-a009-85c9182c8927 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.091256 Oct 20 06:26:13.137208 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1080/2134] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:26:13 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:26:13.610050 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-3e2743f0-fad3-45e1-aafc-9cd7346580c9 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:26:13.610588 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-3e2743f0-fad3-45e1-aafc-9cd7346580c9 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] [instance: d38a019f-4bfc-4845-900b-a9e4e6397373] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:26:13.617533 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3e2743f0-fad3-45e1-aafc-9cd7346580c9 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:26:13.618019 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3e2743f0-fad3-45e1-aafc-9cd7346580c9 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:26:13.618452 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3e2743f0-fad3-45e1-aafc-9cd7346580c9 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:26:13.619140 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3e2743f0-fad3-45e1-aafc-9cd7346580c9 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:26:13.619586 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3e2743f0-fad3-45e1-aafc-9cd7346580c9 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:26:13.620008 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3e2743f0-fad3-45e1-aafc-9cd7346580c9 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:26:13.633974 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.wsgi [None req-3e2743f0-fad3-45e1-aafc-9cd7346580c9 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] HTTP exception thrown: Instance d38a019f-4bfc-4845-900b-a9e4e6397373 could not be found. Oct 20 06:26:13.635863 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-3e2743f0-fad3-45e1-aafc-9cd7346580c9 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Request method failure captured: Oct 20 06:26:13.635863 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: request: GET /compute/v2.1/servers/d38a019f-4bfc-4845-900b-a9e4e6397373 HTTP/1.1 Oct 20 06:26:13.635863 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: Accept: application/json Oct 20 06:26:13.635863 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: Accept-Encoding: identity Oct 20 06:26:13.635863 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: Connection: close Oct 20 06:26:13.635863 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: Content-Length: 0 Oct 20 06:26:13.635863 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: Content-Type: application/json Oct 20 06:26:13.635863 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: Host: 10.222.0.20 Oct 20 06:26:13.635863 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: Openstack-System-Scope: None Oct 20 06:26:13.635863 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: User-Agent: python-urllib3/1.26.12 Oct 20 06:26:13.635863 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Auth-Token: gAAAAABjUOT2-FglyAobdOsIoXa2I6DRznal3Iq7fMTF8HI6G5YcCfomknnkPo7EFjjdZsTl7BVv0timK8MTu7wRa_roYL42t_YgASBwpM-lJk_PzcQvsocgThAGpTckdZz7QuynujWgj5fAj0dQo7xS5NqQC90KvEfG5PqmAbr7F9s3OXF4swA Oct 20 06:26:13.635863 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Domain-Id: None Oct 20 06:26:13.635863 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Domain-Name: None Oct 20 06:26:13.635863 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Identity-Status: Confirmed Oct 20 06:26:13.635863 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Is-Admin-Project: True Oct 20 06:26:13.635863 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Project-Domain-Id: default Oct 20 06:26:13.635863 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Project-Domain-Name: Default Oct 20 06:26:13.635863 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Project-Id: 9f0d80988ca941acb8ad4318338dfbea Oct 20 06:26:13.635863 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-647211481 Oct 20 06:26:13.635863 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Role: reader,member Oct 20 06:26:13.635863 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Roles: reader,member Oct 20 06:26:13.637645 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/9f0d80988ca941acb8ad4318338dfbea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_9f0d80988ca941acb8ad4318338dfbea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9f0d80988ca941acb8ad4318338dfbea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9f0d80988ca941acb8ad4318338dfbea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 20 06:26:13.637645 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Tenant: tempest-ServerRescueNegativeTestJSON-647211481 Oct 20 06:26:13.637645 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Tenant-Id: 9f0d80988ca941acb8ad4318338dfbea Oct 20 06:26:13.637645 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-647211481 Oct 20 06:26:13.637645 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-User: tempest-ServerRescueNegativeTestJSON-647211481-project Oct 20 06:26:13.637645 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-User-Domain-Id: default Oct 20 06:26:13.637645 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-User-Domain-Name: Default Oct 20 06:26:13.637645 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-User-Id: 57d4cbd2a2154e5d925462df7c77815a Oct 20 06:26:13.637645 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-User-Name: tempest-ServerRescueNegativeTestJSON-647211481-project Oct 20 06:26:13.637645 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: method: > Oct 20 06:26:13.637645 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: exception: Instance d38a019f-4bfc-4845-900b-a9e4e6397373 could not be found. Oct 20 06:26:13.637645 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: action_args: {'id': 'd38a019f-4bfc-4845-900b-a9e4e6397373'} Oct 20 06:26:13.643253 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 20 06:26:13.643253 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 06:26:13.643253 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 20 06:26:13.643253 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 20 06:26:13.643253 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 20 06:26:13.643253 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 20 06:26:13.643253 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 20 06:26:13.643253 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 20 06:26:13.643253 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 20 06:26:13.643253 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 20 06:26:13.643253 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d38a019f-4bfc-4845-900b-a9e4e6397373 could not be found. Oct 20 06:26:13.643253 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi Oct 20 06:26:13.643253 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 06:26:13.643253 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi Oct 20 06:26:13.643253 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 06:26:13.643253 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 06:26:13.643253 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 06:26:13.643253 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 20 06:26:13.643253 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 20 06:26:13.643253 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 20 06:26:13.645073 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 20 06:26:13.645073 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 20 06:26:13.645073 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 20 06:26:13.645073 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 20 06:26:13.645073 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 20 06:26:13.645073 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 20 06:26:13.645073 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 20 06:26:13.645073 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d38a019f-4bfc-4845-900b-a9e4e6397373 could not be found. Oct 20 06:26:13.645073 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi Oct 20 06:26:13.645073 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 06:26:13.645073 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi Oct 20 06:26:13.645073 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 06:26:13.645073 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 06:26:13.645073 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 06:26:13.645073 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 20 06:26:13.645073 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 20 06:26:13.645073 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d38a019f-4bfc-4845-900b-a9e4e6397373 could not be found. Oct 20 06:26:13.645073 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi Oct 20 06:26:13.646585 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-3e2743f0-fad3-45e1-aafc-9cd7346580c9 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] Returning 404 to user: Instance d38a019f-4bfc-4845-900b-a9e4e6397373 could not be found. {{(pid=118860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 20 06:26:13.646585 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-3e2743f0-fad3-45e1-aafc-9cd7346580c9 tempest-ServerRescueNegativeTestJSON-647211481 tempest-ServerRescueNegativeTestJSON-647211481-project] 10.222.0.20 "GET /compute/v2.1/servers/d38a019f-4bfc-4845-900b-a9e4e6397373" status: 404 len: 111 microversion: 2.1 time: 0.031142 Oct 20 06:26:13.646585 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1055/2135] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:26:13 2022] GET /compute/v2.1/servers/d38a019f-4bfc-4845-900b-a9e4e6397373 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 20 06:26:14.159724 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-18750b67-c26a-4612-a4be-ee84b51566d1 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:26:14.160934 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-18750b67-c26a-4612-a4be-ee84b51566d1 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:26:14.167854 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-18750b67-c26a-4612-a4be-ee84b51566d1 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:26:14.168335 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-18750b67-c26a-4612-a4be-ee84b51566d1 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:26:14.168791 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-18750b67-c26a-4612-a4be-ee84b51566d1 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:26:14.169541 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-18750b67-c26a-4612-a4be-ee84b51566d1 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:26:14.169935 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-18750b67-c26a-4612-a4be-ee84b51566d1 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:26:14.170354 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-18750b67-c26a-4612-a4be-ee84b51566d1 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:26:14.262720 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-18750b67-c26a-4612-a4be-ee84b51566d1 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:26:14.270988 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-18750b67-c26a-4612-a4be-ee84b51566d1 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.115344 Oct 20 06:26:14.271627 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1081/2136] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:26:14 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:26:15.295167 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-41487798-6b0b-4940-9739-75c81779b5a4 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:26:15.296577 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-41487798-6b0b-4940-9739-75c81779b5a4 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:26:15.305924 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-41487798-6b0b-4940-9739-75c81779b5a4 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:26:15.307357 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-41487798-6b0b-4940-9739-75c81779b5a4 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:26:15.308052 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-41487798-6b0b-4940-9739-75c81779b5a4 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:26:15.309049 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-41487798-6b0b-4940-9739-75c81779b5a4 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:26:15.310797 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-41487798-6b0b-4940-9739-75c81779b5a4 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:26:15.311258 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-41487798-6b0b-4940-9739-75c81779b5a4 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:26:15.386763 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-41487798-6b0b-4940-9739-75c81779b5a4 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:26:15.398350 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-41487798-6b0b-4940-9739-75c81779b5a4 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.107342 Oct 20 06:26:15.399569 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1056/2137] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:26:15 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:26:16.421605 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-78f13d46-dc62-4d81-b79c-0dee3bed1431 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:26:16.422357 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-78f13d46-dc62-4d81-b79c-0dee3bed1431 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:26:16.431881 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-78f13d46-dc62-4d81-b79c-0dee3bed1431 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:26:16.432473 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-78f13d46-dc62-4d81-b79c-0dee3bed1431 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:26:16.433193 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-78f13d46-dc62-4d81-b79c-0dee3bed1431 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:26:16.434005 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-78f13d46-dc62-4d81-b79c-0dee3bed1431 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:26:16.434689 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-78f13d46-dc62-4d81-b79c-0dee3bed1431 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:26:16.435500 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-78f13d46-dc62-4d81-b79c-0dee3bed1431 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:26:16.517376 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-78f13d46-dc62-4d81-b79c-0dee3bed1431 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:26:16.527235 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-78f13d46-dc62-4d81-b79c-0dee3bed1431 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.109505 Oct 20 06:26:16.528201 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1082/2138] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:26:16 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:26:17.554795 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-70f663f4-b244-4371-8663-d0dd0c654522 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:26:17.555402 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-70f663f4-b244-4371-8663-d0dd0c654522 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:26:17.564632 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-70f663f4-b244-4371-8663-d0dd0c654522 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:26:17.565177 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-70f663f4-b244-4371-8663-d0dd0c654522 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:26:17.565642 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-70f663f4-b244-4371-8663-d0dd0c654522 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:26:17.566354 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-70f663f4-b244-4371-8663-d0dd0c654522 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:26:17.566920 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-70f663f4-b244-4371-8663-d0dd0c654522 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:26:17.567243 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-70f663f4-b244-4371-8663-d0dd0c654522 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:26:17.571751 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG dbcounter [-] [118860] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:26:17.651722 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-70f663f4-b244-4371-8663-d0dd0c654522 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:26:17.672042 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-70f663f4-b244-4371-8663-d0dd0c654522 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.121153 Oct 20 06:26:17.673667 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1057/2139] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:26:17 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:26:18.674075 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-a1a42923-1894-4876-8327-cc10e385ffc5 tempest-VolumesGetTestJSON-1863538337 tempest-VolumesGetTestJSON-1863538337-project] Action: 'create', calling method: .version_select at 0x7fbe4e3f6ca0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-50737888", "metadata": {"Type": "work"}}} {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 06:26:18.699291 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-12b2f9ca-5dc2-4a79-b79f-4eecc17efde8 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:26:18.699939 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-12b2f9ca-5dc2-4a79-b79f-4eecc17efde8 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:26:18.706451 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-12b2f9ca-5dc2-4a79-b79f-4eecc17efde8 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:26:18.706934 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-12b2f9ca-5dc2-4a79-b79f-4eecc17efde8 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:26:18.707376 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-12b2f9ca-5dc2-4a79-b79f-4eecc17efde8 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:26:18.708071 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-12b2f9ca-5dc2-4a79-b79f-4eecc17efde8 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:26:18.708523 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-12b2f9ca-5dc2-4a79-b79f-4eecc17efde8 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:26:18.709102 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-12b2f9ca-5dc2-4a79-b79f-4eecc17efde8 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:26:18.773623 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-12b2f9ca-5dc2-4a79-b79f-4eecc17efde8 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:26:18.781992 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-12b2f9ca-5dc2-4a79-b79f-4eecc17efde8 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.086730 Oct 20 06:26:18.782567 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1058/2140] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:26:18 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 06:26:19.805695 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-859d68a6-4df3-4136-8906-6ec529d499ed tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:26:19.806410 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-859d68a6-4df3-4136-8906-6ec529d499ed tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:26:19.812834 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-859d68a6-4df3-4136-8906-6ec529d499ed tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:26:19.813317 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-859d68a6-4df3-4136-8906-6ec529d499ed tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:26:19.813757 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-859d68a6-4df3-4136-8906-6ec529d499ed tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:26:19.814445 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-859d68a6-4df3-4136-8906-6ec529d499ed tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:26:19.814896 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-859d68a6-4df3-4136-8906-6ec529d499ed tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:26:19.815323 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-859d68a6-4df3-4136-8906-6ec529d499ed tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:26:19.876482 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-859d68a6-4df3-4136-8906-6ec529d499ed tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:26:19.885100 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-859d68a6-4df3-4136-8906-6ec529d499ed tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.083489 Oct 20 06:26:19.885668 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1059/2141] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:26:19 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 06:26:20.907861 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-4a44647f-067d-420c-ba5d-3ade2384da3c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:26:20.908557 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-4a44647f-067d-420c-ba5d-3ade2384da3c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:26:20.915130 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-4a44647f-067d-420c-ba5d-3ade2384da3c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:26:20.915614 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-4a44647f-067d-420c-ba5d-3ade2384da3c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:26:20.916049 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-4a44647f-067d-420c-ba5d-3ade2384da3c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:26:20.916763 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-4a44647f-067d-420c-ba5d-3ade2384da3c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:26:20.917216 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-4a44647f-067d-420c-ba5d-3ade2384da3c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:26:20.917676 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-4a44647f-067d-420c-ba5d-3ade2384da3c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:26:20.979503 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-4a44647f-067d-420c-ba5d-3ade2384da3c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:26:20.987797 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-4a44647f-067d-420c-ba5d-3ade2384da3c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.084245 Oct 20 06:26:20.988363 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1060/2142] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:26:20 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 06:26:22.011484 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-b4b5fc31-2af8-45c7-af40-a1e31f0fcb7b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:26:22.012193 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-b4b5fc31-2af8-45c7-af40-a1e31f0fcb7b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:26:22.018745 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b4b5fc31-2af8-45c7-af40-a1e31f0fcb7b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:26:22.019230 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b4b5fc31-2af8-45c7-af40-a1e31f0fcb7b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:26:22.019670 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b4b5fc31-2af8-45c7-af40-a1e31f0fcb7b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:26:22.020377 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b4b5fc31-2af8-45c7-af40-a1e31f0fcb7b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:26:22.020864 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b4b5fc31-2af8-45c7-af40-a1e31f0fcb7b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:26:22.021298 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b4b5fc31-2af8-45c7-af40-a1e31f0fcb7b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:26:22.087247 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-b4b5fc31-2af8-45c7-af40-a1e31f0fcb7b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:26:22.096819 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-b4b5fc31-2af8-45c7-af40-a1e31f0fcb7b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.089499 Oct 20 06:26:22.097488 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1061/2143] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:26:22 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 06:26:23.121835 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-eec5c84f-0b79-418e-bbb3-7a684193f5d6 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:26:23.122457 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-eec5c84f-0b79-418e-bbb3-7a684193f5d6 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:26:23.129075 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-eec5c84f-0b79-418e-bbb3-7a684193f5d6 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:26:23.129560 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-eec5c84f-0b79-418e-bbb3-7a684193f5d6 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:26:23.130022 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-eec5c84f-0b79-418e-bbb3-7a684193f5d6 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:26:23.131317 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-eec5c84f-0b79-418e-bbb3-7a684193f5d6 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:26:23.132025 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-eec5c84f-0b79-418e-bbb3-7a684193f5d6 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:26:23.132390 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-eec5c84f-0b79-418e-bbb3-7a684193f5d6 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:26:23.193896 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-eec5c84f-0b79-418e-bbb3-7a684193f5d6 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:26:23.202261 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-eec5c84f-0b79-418e-bbb3-7a684193f5d6 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.084442 Oct 20 06:26:23.202824 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1062/2144] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:26:23 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 06:26:24.225394 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-42ea06bd-cc9e-4b3b-ad61-42dc17b721c5 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:26:24.226125 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-42ea06bd-cc9e-4b3b-ad61-42dc17b721c5 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:26:24.232655 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-42ea06bd-cc9e-4b3b-ad61-42dc17b721c5 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:26:24.233157 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-42ea06bd-cc9e-4b3b-ad61-42dc17b721c5 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:26:24.233590 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-42ea06bd-cc9e-4b3b-ad61-42dc17b721c5 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:26:24.234280 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-42ea06bd-cc9e-4b3b-ad61-42dc17b721c5 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:26:24.234728 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-42ea06bd-cc9e-4b3b-ad61-42dc17b721c5 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:26:24.235149 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-42ea06bd-cc9e-4b3b-ad61-42dc17b721c5 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:26:24.298576 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-42ea06bd-cc9e-4b3b-ad61-42dc17b721c5 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:26:24.308393 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-42ea06bd-cc9e-4b3b-ad61-42dc17b721c5 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.086911 Oct 20 06:26:24.309009 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1063/2145] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:26:24 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 06:26:25.331419 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-11262ee9-cda7-4102-9e1a-d02a95d2e557 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:26:25.332077 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-11262ee9-cda7-4102-9e1a-d02a95d2e557 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:26:25.338674 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-11262ee9-cda7-4102-9e1a-d02a95d2e557 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:26:25.339153 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-11262ee9-cda7-4102-9e1a-d02a95d2e557 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:26:25.339591 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-11262ee9-cda7-4102-9e1a-d02a95d2e557 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:26:25.340286 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-11262ee9-cda7-4102-9e1a-d02a95d2e557 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:26:25.340765 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-11262ee9-cda7-4102-9e1a-d02a95d2e557 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:26:25.341206 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-11262ee9-cda7-4102-9e1a-d02a95d2e557 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:26:25.403418 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-11262ee9-cda7-4102-9e1a-d02a95d2e557 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:26:25.411722 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-11262ee9-cda7-4102-9e1a-d02a95d2e557 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.084160 Oct 20 06:26:25.413178 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1064/2146] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:26:25 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 06:26:26.429930 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG dbcounter [-] [118861] Writing DB stats nova_api:SELECT=28,nova_api:UPDATE=1 {{(pid=118861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:26:26.435934 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-40272fd1-c98d-400a-b7c2-f80a23da9244 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:26:26.436678 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-40272fd1-c98d-400a-b7c2-f80a23da9244 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:26:26.444161 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-40272fd1-c98d-400a-b7c2-f80a23da9244 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:26:26.444628 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-40272fd1-c98d-400a-b7c2-f80a23da9244 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:26:26.445094 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-40272fd1-c98d-400a-b7c2-f80a23da9244 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:26:26.445827 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-40272fd1-c98d-400a-b7c2-f80a23da9244 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:26:26.446309 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-40272fd1-c98d-400a-b7c2-f80a23da9244 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:26:26.446736 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-40272fd1-c98d-400a-b7c2-f80a23da9244 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:26:26.514625 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-40272fd1-c98d-400a-b7c2-f80a23da9244 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:26:26.521565 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG dbcounter [-] [118861] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:26:26.524092 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-40272fd1-c98d-400a-b7c2-f80a23da9244 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.092332 Oct 20 06:26:26.524872 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1065/2147] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:26:26 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:26:27.546850 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-421c8d58-8197-477a-ae62-92d8795281c4 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:26:27.547486 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-421c8d58-8197-477a-ae62-92d8795281c4 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:26:27.553840 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-421c8d58-8197-477a-ae62-92d8795281c4 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:26:27.554251 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-421c8d58-8197-477a-ae62-92d8795281c4 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:26:27.554714 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-421c8d58-8197-477a-ae62-92d8795281c4 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:26:27.555400 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-421c8d58-8197-477a-ae62-92d8795281c4 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:26:27.555849 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-421c8d58-8197-477a-ae62-92d8795281c4 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:26:27.556266 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-421c8d58-8197-477a-ae62-92d8795281c4 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:26:27.617921 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-421c8d58-8197-477a-ae62-92d8795281c4 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:26:27.626203 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-421c8d58-8197-477a-ae62-92d8795281c4 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.083272 Oct 20 06:26:27.626766 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1066/2148] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:26:27 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 06:26:28.650083 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-b09b8fba-5283-4b9a-be8a-f15486282676 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:26:28.650785 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-b09b8fba-5283-4b9a-be8a-f15486282676 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:26:28.657162 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b09b8fba-5283-4b9a-be8a-f15486282676 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:26:28.657638 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b09b8fba-5283-4b9a-be8a-f15486282676 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:26:28.658069 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b09b8fba-5283-4b9a-be8a-f15486282676 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:26:28.658762 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b09b8fba-5283-4b9a-be8a-f15486282676 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:26:28.659204 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b09b8fba-5283-4b9a-be8a-f15486282676 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:26:28.659620 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b09b8fba-5283-4b9a-be8a-f15486282676 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:26:28.721555 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-b09b8fba-5283-4b9a-be8a-f15486282676 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:26:28.730657 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-b09b8fba-5283-4b9a-be8a-f15486282676 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.084867 Oct 20 06:26:28.731230 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1067/2149] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:26:28 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 06:26:29.753728 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-113d82d3-045c-4668-8763-1bce89a336f1 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:26:29.754476 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-113d82d3-045c-4668-8763-1bce89a336f1 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:26:29.761912 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-113d82d3-045c-4668-8763-1bce89a336f1 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:26:29.762396 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-113d82d3-045c-4668-8763-1bce89a336f1 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:26:29.762839 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-113d82d3-045c-4668-8763-1bce89a336f1 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:26:29.763560 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-113d82d3-045c-4668-8763-1bce89a336f1 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:26:29.764012 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-113d82d3-045c-4668-8763-1bce89a336f1 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:26:29.764439 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-113d82d3-045c-4668-8763-1bce89a336f1 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:26:29.825676 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-113d82d3-045c-4668-8763-1bce89a336f1 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:26:29.834077 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-113d82d3-045c-4668-8763-1bce89a336f1 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.084171 Oct 20 06:26:29.834651 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1068/2150] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:26:29 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 06:26:30.856937 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-463248aa-2f6c-49d3-809c-41f3756e9408 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:26:30.857591 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-463248aa-2f6c-49d3-809c-41f3756e9408 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:26:30.859496 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 20 06:26:30.859723 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: Thu Oct 20 06:26:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 (ip 10.222.0.20) !!! Oct 20 06:26:30.867316 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-463248aa-2f6c-49d3-809c-41f3756e9408 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:26:30.867804 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-463248aa-2f6c-49d3-809c-41f3756e9408 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:26:30.868278 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-463248aa-2f6c-49d3-809c-41f3756e9408 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:26:30.869012 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-463248aa-2f6c-49d3-809c-41f3756e9408 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:26:30.869483 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-463248aa-2f6c-49d3-809c-41f3756e9408 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:26:30.869910 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-463248aa-2f6c-49d3-809c-41f3756e9408 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:26:30.936620 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-463248aa-2f6c-49d3-809c-41f3756e9408 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:26:30.945097 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-463248aa-2f6c-49d3-809c-41f3756e9408 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.092021 Oct 20 06:26:30.945666 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1069/2151] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:26:30 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 06:26:31.967566 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-f6cdcb19-7b47-4fb4-a067-6bb89d4d9e1e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:26:31.968283 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-f6cdcb19-7b47-4fb4-a067-6bb89d4d9e1e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:26:31.975250 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f6cdcb19-7b47-4fb4-a067-6bb89d4d9e1e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:26:31.975730 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f6cdcb19-7b47-4fb4-a067-6bb89d4d9e1e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:26:31.976165 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f6cdcb19-7b47-4fb4-a067-6bb89d4d9e1e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:26:31.976903 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f6cdcb19-7b47-4fb4-a067-6bb89d4d9e1e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:26:31.977358 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f6cdcb19-7b47-4fb4-a067-6bb89d4d9e1e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:26:31.977784 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f6cdcb19-7b47-4fb4-a067-6bb89d4d9e1e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:26:32.041649 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-f6cdcb19-7b47-4fb4-a067-6bb89d4d9e1e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:26:32.049971 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-f6cdcb19-7b47-4fb4-a067-6bb89d4d9e1e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.086341 Oct 20 06:26:32.050543 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1070/2152] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:26:31 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 06:26:33.073015 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-ef25ef7c-ee95-445b-87bf-18462c964434 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:26:33.073723 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-ef25ef7c-ee95-445b-87bf-18462c964434 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:26:33.079968 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-ef25ef7c-ee95-445b-87bf-18462c964434 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:26:33.080463 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-ef25ef7c-ee95-445b-87bf-18462c964434 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:26:33.080941 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-ef25ef7c-ee95-445b-87bf-18462c964434 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:26:33.081637 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-ef25ef7c-ee95-445b-87bf-18462c964434 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:26:33.082095 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-ef25ef7c-ee95-445b-87bf-18462c964434 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:26:33.082525 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-ef25ef7c-ee95-445b-87bf-18462c964434 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:26:33.147640 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-ef25ef7c-ee95-445b-87bf-18462c964434 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:26:33.155997 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-ef25ef7c-ee95-445b-87bf-18462c964434 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.086895 Oct 20 06:26:33.156554 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1071/2153] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:26:33 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 06:26:34.179941 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-68a50543-734d-453f-9792-aef7a8b1b1ba tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:26:34.180792 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-68a50543-734d-453f-9792-aef7a8b1b1ba tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:26:34.187360 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-68a50543-734d-453f-9792-aef7a8b1b1ba tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:26:34.187848 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-68a50543-734d-453f-9792-aef7a8b1b1ba tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:26:34.188287 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-68a50543-734d-453f-9792-aef7a8b1b1ba tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:26:34.189016 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-68a50543-734d-453f-9792-aef7a8b1b1ba tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:26:34.189467 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-68a50543-734d-453f-9792-aef7a8b1b1ba tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:26:34.189890 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-68a50543-734d-453f-9792-aef7a8b1b1ba tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:26:34.255662 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-68a50543-734d-453f-9792-aef7a8b1b1ba tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:26:34.265288 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-68a50543-734d-453f-9792-aef7a8b1b1ba tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 200 len: 1372 microversion: 2.1 time: 0.089563 Oct 20 06:26:34.265874 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1072/2154] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:26:34 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 1372 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 06:26:34.289906 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-f6d55eed-a9a5-491e-b85e-36778172c941 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '.version_select at 0x7fbe4e2e9700>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:26:34.315384 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-f6d55eed-a9a5-491e-b85e-36778172c941 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-259144965" status: 202 len: 0 microversion: 2.1 time: 0.029312 Oct 20 06:26:34.315979 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1073/2155] 10.222.0.20 () {58 vars in 1218 bytes} [Thu Oct 20 06:26:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-259144965 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 20 06:26:35.096185 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-2c101900-3b29-4167-9e01-4b2becc9eb4b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Action: 'create', calling method: .version_select at 0x7fbe4ac48ee0>, body: {"keypair": {"name": "tempest-keypair-314386252", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJWNcterFqOsAfs3jgg+VWu5Ff4uQxOU4iSazsdNYT1SMMv1SG109k+Zm9KQJ3pdcnp98LgT1L7S3iJBB+ZQWViJpR4ojnW0WK74nryPlGCs1xJnbLMa9F0oAI+6DhIDtw=="}} {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 06:26:35.112829 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.quota [None req-2c101900-3b29-4167-9e01-4b2becc9eb4b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Getting quotas for project b90087118fe040389f291d846461c0a7. Resources: {'key_pairs'} {{(pid=118860) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 20 06:26:35.117858 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.quota [None req-2c101900-3b29-4167-9e01-4b2becc9eb4b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Getting quotas for user 2c6be23065c643939055a3de375187d5 and project b90087118fe040389f291d846461c0a7. Resources: {'key_pairs'} {{(pid=118860) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 20 06:26:35.142903 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-2c101900-3b29-4167-9e01-4b2becc9eb4b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.050693 Oct 20 06:26:35.143512 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1074/2156] 10.222.0.20 () {60 vars in 1159 bytes} [Thu Oct 20 06:26:35 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 20 06:26:36.313089 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-c27230be-94d9-4eee-bea5-8e7bb4bc878d tempest-TestShelveInstance-1797429796 tempest-TestShelveInstance-1797429796-project] Calling method '.version_select at 0x7fbe4ad62820>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:26:36.343501 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG dbcounter [-] [118860] Writing DB stats nova_api:SELECT=73,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=118860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:26:36.385711 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-c27230be-94d9-4eee-bea5-8e7bb4bc878d tempest-TestShelveInstance-1797429796 tempest-TestShelveInstance-1797429796-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1313377453" status: 202 len: 0 microversion: 2.1 time: 0.080471 Oct 20 06:26:36.387904 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1075/2157] 10.222.0.20 () {58 vars in 1254 bytes} [Thu Oct 20 06:26:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1313377453 => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 20 06:26:36.560387 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-8284e228-abca-49b2-90ce-54b7ceb26b0c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-201959682", "imageRef": "9fcec276-734d-41d9-905b-10d2bbcbfba5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "25101033-a54e-4dc6-a6b0-89acf3ee0337"}], "security_groups": [{"name": "tempest-securitygroup--563823778"}], "key_name": "tempest-keypair-314386252", "user_data": "}} {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 06:26:36.699926 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.network.neutron [None req-8284e228-abca-49b2-90ce-54b7ceb26b0c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] validate_networks() for [('25101033-a54e-4dc6-a6b0-89acf3ee0337', None, None, None, None, None)] {{(pid=118860) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 20 06:26:37.184802 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.virt.hardware [None req-8284e228-abca-49b2-90ce-54b7ceb26b0c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Flavor limits 0:0:0 {{(pid=118860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 20 06:26:37.185318 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.virt.hardware [None req-8284e228-abca-49b2-90ce-54b7ceb26b0c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Image limits 0:0:0 {{(pid=118860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 20 06:26:37.186395 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.virt.hardware [None req-8284e228-abca-49b2-90ce-54b7ceb26b0c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Flavor pref 0:0:0 {{(pid=118860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 20 06:26:37.186879 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.virt.hardware [None req-8284e228-abca-49b2-90ce-54b7ceb26b0c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Image pref 0:0:0 {{(pid=118860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 20 06:26:37.187373 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.virt.hardware [None req-8284e228-abca-49b2-90ce-54b7ceb26b0c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 20 06:26:37.198544 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-8284e228-abca-49b2-90ce-54b7ceb26b0c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:26:37.199489 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-8284e228-abca-49b2-90ce-54b7ceb26b0c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:26:37.199998 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-8284e228-abca-49b2-90ce-54b7ceb26b0c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:26:37.200840 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-8284e228-abca-49b2-90ce-54b7ceb26b0c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:26:37.201385 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-8284e228-abca-49b2-90ce-54b7ceb26b0c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:26:37.201812 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-8284e228-abca-49b2-90ce-54b7ceb26b0c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:26:37.220556 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.quota [None req-8284e228-abca-49b2-90ce-54b7ceb26b0c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Getting quotas for project b90087118fe040389f291d846461c0a7. Resources: {'cores', 'ram', 'instances'} {{(pid=118860) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 20 06:26:37.224937 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.quota [None req-8284e228-abca-49b2-90ce-54b7ceb26b0c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Getting quotas for user 2c6be23065c643939055a3de375187d5 and project b90087118fe040389f291d846461c0a7. Resources: {'cores', 'ram', 'instances'} {{(pid=118860) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 20 06:26:37.239407 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-8284e228-abca-49b2-90ce-54b7ceb26b0c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Going to run 1 instances... {{(pid=118860) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 20 06:26:37.242760 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-8284e228-abca-49b2-90ce-54b7ceb26b0c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: 52c09583-1827-45d5-ac39-7d02ea4b658a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9fcec276-734d-41d9-905b-10d2bbcbfba5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118860) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 20 06:26:37.295296 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-8284e228-abca-49b2-90ce-54b7ceb26b0c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.739294 Oct 20 06:26:37.296629 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1076/2158] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Oct 20 06:26:36 2022] POST /compute/v2.1/servers => generated 401 bytes in 741 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 20 06:26:37.309399 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-d0c7ea68-50be-4394-bd98-68fc79b4a308 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:26:37.310394 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-d0c7ea68-50be-4394-bd98-68fc79b4a308 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: 52c09583-1827-45d5-ac39-7d02ea4b658a] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:26:37.405179 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-d0c7ea68-50be-4394-bd98-68fc79b4a308 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:26:37.412194 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-d0c7ea68-50be-4394-bd98-68fc79b4a308 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/52c09583-1827-45d5-ac39-7d02ea4b658a" status: 200 len: 1240 microversion: 2.1 time: 0.108121 Oct 20 06:26:37.412774 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1077/2159] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:26:37 2022] GET /compute/v2.1/servers/52c09583-1827-45d5-ac39-7d02ea4b658a => generated 1240 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:26:38.435752 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-2f68b6a7-194f-4d00-ab91-b26edaa02a89 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:26:38.437196 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-2f68b6a7-194f-4d00-ab91-b26edaa02a89 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: 52c09583-1827-45d5-ac39-7d02ea4b658a] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:26:38.449086 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2f68b6a7-194f-4d00-ab91-b26edaa02a89 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:26:38.451080 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2f68b6a7-194f-4d00-ab91-b26edaa02a89 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:26:38.452244 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2f68b6a7-194f-4d00-ab91-b26edaa02a89 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:26:38.453809 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2f68b6a7-194f-4d00-ab91-b26edaa02a89 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:26:38.454531 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2f68b6a7-194f-4d00-ab91-b26edaa02a89 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:26:38.455222 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2f68b6a7-194f-4d00-ab91-b26edaa02a89 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:26:38.475278 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG dbcounter [-] [118860] Writing DB stats nova_cell1:SELECT=100 {{(pid=118860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:26:38.600342 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-2f68b6a7-194f-4d00-ab91-b26edaa02a89 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:26:38.610817 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-2f68b6a7-194f-4d00-ab91-b26edaa02a89 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/52c09583-1827-45d5-ac39-7d02ea4b658a" status: 200 len: 1292 microversion: 2.1 time: 0.178927 Oct 20 06:26:38.617410 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1078/2160] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:26:38 2022] GET /compute/v2.1/servers/52c09583-1827-45d5-ac39-7d02ea4b658a => generated 1292 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:26:39.640370 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-19e2d717-71eb-47ab-94c8-c234df700a51 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:26:39.641992 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-19e2d717-71eb-47ab-94c8-c234df700a51 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: 52c09583-1827-45d5-ac39-7d02ea4b658a] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:26:39.651698 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-19e2d717-71eb-47ab-94c8-c234df700a51 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:26:39.652732 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-19e2d717-71eb-47ab-94c8-c234df700a51 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:26:39.653422 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-19e2d717-71eb-47ab-94c8-c234df700a51 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:26:39.654529 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-19e2d717-71eb-47ab-94c8-c234df700a51 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:26:39.655246 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-19e2d717-71eb-47ab-94c8-c234df700a51 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:26:39.656165 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-19e2d717-71eb-47ab-94c8-c234df700a51 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:26:40.079098 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-19e2d717-71eb-47ab-94c8-c234df700a51 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:26:40.090802 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-19e2d717-71eb-47ab-94c8-c234df700a51 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/52c09583-1827-45d5-ac39-7d02ea4b658a" status: 200 len: 1298 microversion: 2.1 time: 0.457570 Oct 20 06:26:40.092252 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1079/2161] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:26:39 2022] GET /compute/v2.1/servers/52c09583-1827-45d5-ac39-7d02ea4b658a => generated 1298 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 06:26:41.115503 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-2b303dbb-32b3-445e-8e2d-8a096ac89461 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:26:41.116150 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-2b303dbb-32b3-445e-8e2d-8a096ac89461 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: 52c09583-1827-45d5-ac39-7d02ea4b658a] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:26:41.124928 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2b303dbb-32b3-445e-8e2d-8a096ac89461 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:26:41.125955 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2b303dbb-32b3-445e-8e2d-8a096ac89461 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:26:41.126421 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2b303dbb-32b3-445e-8e2d-8a096ac89461 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:26:41.127661 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2b303dbb-32b3-445e-8e2d-8a096ac89461 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:26:41.128346 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2b303dbb-32b3-445e-8e2d-8a096ac89461 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:26:41.129012 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2b303dbb-32b3-445e-8e2d-8a096ac89461 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:26:41.424066 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-2b303dbb-32b3-445e-8e2d-8a096ac89461 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:26:41.436176 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-2b303dbb-32b3-445e-8e2d-8a096ac89461 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/52c09583-1827-45d5-ac39-7d02ea4b658a" status: 200 len: 1365 microversion: 2.1 time: 0.324504 Oct 20 06:26:41.437043 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1080/2162] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:26:41 2022] GET /compute/v2.1/servers/52c09583-1827-45d5-ac39-7d02ea4b658a => generated 1365 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 06:26:41.442631 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [req-d746de54-4e11-4674-80cf-ff5bebd89e98 req-86cf6df0-2122-4da8-8883-8e63575946b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "52c09583-1827-45d5-ac39-7d02ea4b658a", "tag": "8bc1d538-8258-452a-9497-f1c7e5377c12"}]} {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 06:26:41.455668 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [req-d746de54-4e11-4674-80cf-ff5bebd89e98 req-86cf6df0-2122-4da8-8883-8e63575946b0 service nova] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:26:41.457144 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [req-d746de54-4e11-4674-80cf-ff5bebd89e98 req-86cf6df0-2122-4da8-8883-8e63575946b0 service nova] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:26:41.457803 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [req-d746de54-4e11-4674-80cf-ff5bebd89e98 req-86cf6df0-2122-4da8-8883-8e63575946b0 service nova] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:26:41.482934 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.compute.server_external_events [req-d746de54-4e11-4674-80cf-ff5bebd89e98 req-86cf6df0-2122-4da8-8883-8e63575946b0 service nova] Creating event network-changed:8bc1d538-8258-452a-9497-f1c7e5377c12 for instance 52c09583-1827-45d5-ac39-7d02ea4b658a on hv-cinder-86156 Oct 20 06:26:41.488218 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [req-d746de54-4e11-4674-80cf-ff5bebd89e98 req-86cf6df0-2122-4da8-8883-8e63575946b0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049784 Oct 20 06:26:41.489467 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1081/2163] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 20 06:26:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:26:42.481827 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-4b1dfd3b-c133-4950-a110-3b0a3c999c39 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:26:42.482472 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-4b1dfd3b-c133-4950-a110-3b0a3c999c39 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: 52c09583-1827-45d5-ac39-7d02ea4b658a] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:26:42.490308 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-4b1dfd3b-c133-4950-a110-3b0a3c999c39 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:26:42.491582 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-4b1dfd3b-c133-4950-a110-3b0a3c999c39 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:26:42.493507 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-4b1dfd3b-c133-4950-a110-3b0a3c999c39 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:26:42.494620 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-4b1dfd3b-c133-4950-a110-3b0a3c999c39 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:26:42.497078 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-4b1dfd3b-c133-4950-a110-3b0a3c999c39 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:26:42.498258 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-4b1dfd3b-c133-4950-a110-3b0a3c999c39 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:26:42.951413 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-4b1dfd3b-c133-4950-a110-3b0a3c999c39 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:26:42.961025 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-4b1dfd3b-c133-4950-a110-3b0a3c999c39 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/52c09583-1827-45d5-ac39-7d02ea4b658a" status: 200 len: 1365 microversion: 2.1 time: 0.494833 Oct 20 06:26:42.976720 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1082/2164] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:26:42 2022] GET /compute/v2.1/servers/52c09583-1827-45d5-ac39-7d02ea4b658a => generated 1365 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:26:43.987797 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-815802ad-f507-48e2-a912-862c373947e5 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:26:43.989203 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-815802ad-f507-48e2-a912-862c373947e5 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: 52c09583-1827-45d5-ac39-7d02ea4b658a] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:26:44.004580 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-815802ad-f507-48e2-a912-862c373947e5 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:26:44.005652 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-815802ad-f507-48e2-a912-862c373947e5 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:26:44.006330 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-815802ad-f507-48e2-a912-862c373947e5 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:26:44.007296 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-815802ad-f507-48e2-a912-862c373947e5 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:26:44.008064 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-815802ad-f507-48e2-a912-862c373947e5 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:26:44.008720 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-815802ad-f507-48e2-a912-862c373947e5 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:26:44.236907 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-815802ad-f507-48e2-a912-862c373947e5 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:26:44.247586 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-815802ad-f507-48e2-a912-862c373947e5 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/52c09583-1827-45d5-ac39-7d02ea4b658a" status: 200 len: 1365 microversion: 2.1 time: 0.264572 Oct 20 06:26:44.264013 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1083/2165] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:26:43 2022] GET /compute/v2.1/servers/52c09583-1827-45d5-ac39-7d02ea4b658a => generated 1365 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:26:45.270597 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-c6ad1374-ec45-4b23-acc2-6ae9b8905cdf tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:26:45.271211 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-c6ad1374-ec45-4b23-acc2-6ae9b8905cdf tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: 52c09583-1827-45d5-ac39-7d02ea4b658a] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:26:45.278524 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c6ad1374-ec45-4b23-acc2-6ae9b8905cdf tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:26:45.280774 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c6ad1374-ec45-4b23-acc2-6ae9b8905cdf tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:26:45.281218 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c6ad1374-ec45-4b23-acc2-6ae9b8905cdf tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:26:45.281941 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c6ad1374-ec45-4b23-acc2-6ae9b8905cdf tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:26:45.282439 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c6ad1374-ec45-4b23-acc2-6ae9b8905cdf tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:26:45.287087 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c6ad1374-ec45-4b23-acc2-6ae9b8905cdf tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:26:45.532148 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-c6ad1374-ec45-4b23-acc2-6ae9b8905cdf tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:26:45.548100 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-c6ad1374-ec45-4b23-acc2-6ae9b8905cdf tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/52c09583-1827-45d5-ac39-7d02ea4b658a" status: 200 len: 1365 microversion: 2.1 time: 0.280848 Oct 20 06:26:45.560717 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1084/2166] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:26:45 2022] GET /compute/v2.1/servers/52c09583-1827-45d5-ac39-7d02ea4b658a => generated 1365 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:26:46.573571 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-39efdd0c-e36b-4b03-bbac-524c7d90d308 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:26:46.574878 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-39efdd0c-e36b-4b03-bbac-524c7d90d308 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: 52c09583-1827-45d5-ac39-7d02ea4b658a] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:26:46.581961 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-39efdd0c-e36b-4b03-bbac-524c7d90d308 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:26:46.582476 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-39efdd0c-e36b-4b03-bbac-524c7d90d308 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:26:46.582913 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-39efdd0c-e36b-4b03-bbac-524c7d90d308 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:26:46.583799 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-39efdd0c-e36b-4b03-bbac-524c7d90d308 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:26:46.585068 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-39efdd0c-e36b-4b03-bbac-524c7d90d308 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:26:46.585916 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-39efdd0c-e36b-4b03-bbac-524c7d90d308 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:26:46.739462 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-39efdd0c-e36b-4b03-bbac-524c7d90d308 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:26:46.749996 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-39efdd0c-e36b-4b03-bbac-524c7d90d308 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/52c09583-1827-45d5-ac39-7d02ea4b658a" status: 200 len: 1365 microversion: 2.1 time: 0.182476 Oct 20 06:26:46.750901 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1085/2167] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:26:46 2022] GET /compute/v2.1/servers/52c09583-1827-45d5-ac39-7d02ea4b658a => generated 1365 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 06:26:47.212583 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG dbcounter [-] [118860] Writing DB stats nova_cell0:SELECT=2 {{(pid=118860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:26:47.365242 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [req-eedd26a2-41f7-4497-b211-d8bb0c5d4038 req-dd4cf5b5-dde3-41a8-8912-19aac88aded9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52c09583-1827-45d5-ac39-7d02ea4b658a", "name": "network-vif-plugged", "status": "completed", "tag": "8bc1d538-8258-452a-9497-f1c7e5377c12"}]} {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 06:26:47.378465 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [req-eedd26a2-41f7-4497-b211-d8bb0c5d4038 req-dd4cf5b5-dde3-41a8-8912-19aac88aded9 service nova] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:26:47.379388 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [req-eedd26a2-41f7-4497-b211-d8bb0c5d4038 req-dd4cf5b5-dde3-41a8-8912-19aac88aded9 service nova] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:26:47.380165 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [req-eedd26a2-41f7-4497-b211-d8bb0c5d4038 req-dd4cf5b5-dde3-41a8-8912-19aac88aded9 service nova] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:26:47.393917 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.compute.server_external_events [req-eedd26a2-41f7-4497-b211-d8bb0c5d4038 req-dd4cf5b5-dde3-41a8-8912-19aac88aded9 service nova] Creating event network-vif-plugged:8bc1d538-8258-452a-9497-f1c7e5377c12 for instance 52c09583-1827-45d5-ac39-7d02ea4b658a on hv-cinder-86156 Oct 20 06:26:47.400905 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [req-eedd26a2-41f7-4497-b211-d8bb0c5d4038 req-dd4cf5b5-dde3-41a8-8912-19aac88aded9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.272231 Oct 20 06:26:47.401837 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1086/2168] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 20 06:26:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:26:47.776010 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-26c9d244-6af5-47c1-9ad7-1b5ffe497e99 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:26:47.776833 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-26c9d244-6af5-47c1-9ad7-1b5ffe497e99 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: 52c09583-1827-45d5-ac39-7d02ea4b658a] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:26:47.783456 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG dbcounter [-] [118860] Writing DB stats nova_cell0:SELECT=12 {{(pid=118860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:26:47.786126 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-26c9d244-6af5-47c1-9ad7-1b5ffe497e99 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:26:47.787516 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-26c9d244-6af5-47c1-9ad7-1b5ffe497e99 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:26:47.789049 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-26c9d244-6af5-47c1-9ad7-1b5ffe497e99 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:26:47.790112 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-26c9d244-6af5-47c1-9ad7-1b5ffe497e99 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:26:47.790805 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-26c9d244-6af5-47c1-9ad7-1b5ffe497e99 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:26:47.791405 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-26c9d244-6af5-47c1-9ad7-1b5ffe497e99 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:26:47.965991 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-26c9d244-6af5-47c1-9ad7-1b5ffe497e99 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:26:47.976532 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-26c9d244-6af5-47c1-9ad7-1b5ffe497e99 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/52c09583-1827-45d5-ac39-7d02ea4b658a" status: 200 len: 1365 microversion: 2.1 time: 0.205600 Oct 20 06:26:47.978627 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1087/2169] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:26:47 2022] GET /compute/v2.1/servers/52c09583-1827-45d5-ac39-7d02ea4b658a => generated 1365 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 06:26:49.002336 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-3e51bce1-ddb5-4177-b50a-c76dcde4bcea tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:26:49.003857 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-3e51bce1-ddb5-4177-b50a-c76dcde4bcea tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: 52c09583-1827-45d5-ac39-7d02ea4b658a] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:26:49.044507 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3e51bce1-ddb5-4177-b50a-c76dcde4bcea tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:26:49.045451 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3e51bce1-ddb5-4177-b50a-c76dcde4bcea tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:26:49.045889 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3e51bce1-ddb5-4177-b50a-c76dcde4bcea tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:26:49.046621 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3e51bce1-ddb5-4177-b50a-c76dcde4bcea tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:26:49.047067 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3e51bce1-ddb5-4177-b50a-c76dcde4bcea tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:26:49.048418 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3e51bce1-ddb5-4177-b50a-c76dcde4bcea tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:26:49.245501 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-3e51bce1-ddb5-4177-b50a-c76dcde4bcea tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:26:49.267569 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-3e51bce1-ddb5-4177-b50a-c76dcde4bcea tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/52c09583-1827-45d5-ac39-7d02ea4b658a" status: 200 len: 1365 microversion: 2.1 time: 0.269010 Oct 20 06:26:49.287293 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1088/2170] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:26:48 2022] GET /compute/v2.1/servers/52c09583-1827-45d5-ac39-7d02ea4b658a => generated 1365 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:26:50.291173 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-2c90b3ba-1cc3-4e7c-b1c4-8ed8af0535b3 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:26:50.292554 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-2c90b3ba-1cc3-4e7c-b1c4-8ed8af0535b3 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: 52c09583-1827-45d5-ac39-7d02ea4b658a] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:26:50.309811 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2c90b3ba-1cc3-4e7c-b1c4-8ed8af0535b3 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:26:50.310623 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2c90b3ba-1cc3-4e7c-b1c4-8ed8af0535b3 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:26:50.311563 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2c90b3ba-1cc3-4e7c-b1c4-8ed8af0535b3 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:26:50.314872 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2c90b3ba-1cc3-4e7c-b1c4-8ed8af0535b3 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:26:50.315579 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2c90b3ba-1cc3-4e7c-b1c4-8ed8af0535b3 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:26:50.317097 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2c90b3ba-1cc3-4e7c-b1c4-8ed8af0535b3 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:26:50.614108 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-2c90b3ba-1cc3-4e7c-b1c4-8ed8af0535b3 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:26:50.626190 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-2c90b3ba-1cc3-4e7c-b1c4-8ed8af0535b3 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/52c09583-1827-45d5-ac39-7d02ea4b658a" status: 200 len: 1556 microversion: 2.1 time: 0.339559 Oct 20 06:26:50.626797 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1089/2171] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:26:50 2022] GET /compute/v2.1/servers/52c09583-1827-45d5-ac39-7d02ea4b658a => generated 1556 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:26:50.652342 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-a1a7659d-482d-4f55-aa1b-d403f88eada0 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:26:50.652779 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-a1a7659d-482d-4f55-aa1b-d403f88eada0 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: 52c09583-1827-45d5-ac39-7d02ea4b658a] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:26:50.664213 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a1a7659d-482d-4f55-aa1b-d403f88eada0 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:26:50.664777 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a1a7659d-482d-4f55-aa1b-d403f88eada0 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:26:50.665242 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a1a7659d-482d-4f55-aa1b-d403f88eada0 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:26:50.665980 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a1a7659d-482d-4f55-aa1b-d403f88eada0 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:26:50.666519 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a1a7659d-482d-4f55-aa1b-d403f88eada0 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:26:50.666950 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a1a7659d-482d-4f55-aa1b-d403f88eada0 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:26:50.891037 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-a1a7659d-482d-4f55-aa1b-d403f88eada0 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/52c09583-1827-45d5-ac39-7d02ea4b658a/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.239739 Oct 20 06:26:50.893372 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1090/2172] 10.222.0.20 () {58 vars in 1275 bytes} [Thu Oct 20 06:26:50 2022] GET /compute/v2.1/servers/52c09583-1827-45d5-ac39-7d02ea4b658a/os-interface => generated 285 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 20 06:26:53.018755 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [req-99df13b1-8895-41d2-a664-b5eb063c6fbf req-da98055c-55e9-40ac-bcff-66cd4481bee5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "52c09583-1827-45d5-ac39-7d02ea4b658a", "tag": "8bc1d538-8258-452a-9497-f1c7e5377c12"}]} {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 06:26:53.031286 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [req-99df13b1-8895-41d2-a664-b5eb063c6fbf req-da98055c-55e9-40ac-bcff-66cd4481bee5 service nova] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:26:53.032337 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [req-99df13b1-8895-41d2-a664-b5eb063c6fbf req-da98055c-55e9-40ac-bcff-66cd4481bee5 service nova] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:26:53.033542 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [req-99df13b1-8895-41d2-a664-b5eb063c6fbf req-da98055c-55e9-40ac-bcff-66cd4481bee5 service nova] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:26:53.050554 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.compute.server_external_events [req-99df13b1-8895-41d2-a664-b5eb063c6fbf req-da98055c-55e9-40ac-bcff-66cd4481bee5 service nova] Creating event network-changed:8bc1d538-8258-452a-9497-f1c7e5377c12 for instance 52c09583-1827-45d5-ac39-7d02ea4b658a on hv-cinder-86156 Oct 20 06:26:53.059206 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [req-99df13b1-8895-41d2-a664-b5eb063c6fbf req-da98055c-55e9-40ac-bcff-66cd4481bee5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.261081 Oct 20 06:26:53.071428 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1091/2173] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 20 06:26:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 20 06:26:59.460207 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-7289652a-670f-42c0-b04f-6fffacc9578e tempest-TestVolumeBootPattern-1359286708 tempest-TestVolumeBootPattern-1359286708-project] Action: 'create', calling method: .version_select at 0x7fbe4ad32ee0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-951758028", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH6wcEvkLyJmF0dLWYbd0r3FTNx5K4nygU+JIZVuShiCOWKV1TtlpCV4pUn80OGggeOhSMqxFyKnKjZiogpHoOy9Y8c7FhjTMaT1RaGywYrdsSW0qjr2FcBrl7nU9xoi7w=="}} {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 06:26:59.480349 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.quota [None req-7289652a-670f-42c0-b04f-6fffacc9578e tempest-TestVolumeBootPattern-1359286708 tempest-TestVolumeBootPattern-1359286708-project] Getting quotas for project db144186ebfa49c185816e5c986b6098. Resources: {'key_pairs'} {{(pid=118860) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 20 06:26:59.484968 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.quota [None req-7289652a-670f-42c0-b04f-6fffacc9578e tempest-TestVolumeBootPattern-1359286708 tempest-TestVolumeBootPattern-1359286708-project] Getting quotas for user 34992b551ea54a1fbe128e287e014847 and project db144186ebfa49c185816e5c986b6098. Resources: {'key_pairs'} {{(pid=118860) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 20 06:26:59.514030 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-7289652a-670f-42c0-b04f-6fffacc9578e tempest-TestVolumeBootPattern-1359286708 tempest-TestVolumeBootPattern-1359286708-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.249043 Oct 20 06:26:59.514810 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1092/2174] 10.222.0.20 () {60 vars in 1159 bytes} [Thu Oct 20 06:26:59 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:27:27.607617 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG dbcounter [-] [118860] Writing DB stats nova_cell1:SELECT=67 {{(pid=118860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:27:27.608489 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG dbcounter [-] [118860] Writing DB stats nova_cell0:SELECT=4 {{(pid=118860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:27:27.609312 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG dbcounter [-] [118860] Writing DB stats nova_api:SELECT=60,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=118860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:27:27.613261 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-f321e3ea-5503-4c2b-af64-39fb171eb197 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:27:27.613858 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-f321e3ea-5503-4c2b-af64-39fb171eb197 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: 52c09583-1827-45d5-ac39-7d02ea4b658a] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:27:27.623513 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f321e3ea-5503-4c2b-af64-39fb171eb197 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:27:27.623997 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f321e3ea-5503-4c2b-af64-39fb171eb197 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:27:27.624436 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f321e3ea-5503-4c2b-af64-39fb171eb197 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:27:27.625164 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f321e3ea-5503-4c2b-af64-39fb171eb197 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:27:27.625618 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f321e3ea-5503-4c2b-af64-39fb171eb197 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:27:27.626050 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f321e3ea-5503-4c2b-af64-39fb171eb197 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:27:27.650645 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-f321e3ea-5503-4c2b-af64-39fb171eb197 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/52c09583-1827-45d5-ac39-7d02ea4b658a/ips" status: 200 len: 151 microversion: 2.1 time: 0.044246 Oct 20 06:27:27.651437 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1093/2175] 10.222.0.20 () {58 vars in 1248 bytes} [Thu Oct 20 06:27:27 2022] GET /compute/v2.1/servers/52c09583-1827-45d5-ac39-7d02ea4b658a/ips => generated 151 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 20 06:28:00.762179 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-3080b951-18a7-4a5d-acbb-44d1b4cb8e3d tempest-TestVolumeBootPattern-1359286708 tempest-TestVolumeBootPattern-1359286708-project] Calling method '.version_select at 0x7fbe4e3e74c0>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:28:00.773079 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG dbcounter [-] [118860] Writing DB stats nova_api:SELECT=2 {{(pid=118860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:28:00.773778 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG dbcounter [-] [118860] Writing DB stats nova_cell1:SELECT=4 {{(pid=118860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:28:00.798510 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-3080b951-18a7-4a5d-acbb-44d1b4cb8e3d tempest-TestVolumeBootPattern-1359286708 tempest-TestVolumeBootPattern-1359286708-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-951758028" status: 202 len: 0 microversion: 2.1 time: 0.041505 Oct 20 06:28:00.799401 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1094/2176] 10.222.0.20 () {58 vars in 1260 bytes} [Thu Oct 20 06:28:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-951758028 => generated 0 bytes in 43 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 20 06:28:08.983549 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-a1a42923-1894-4876-8327-cc10e385ffc5 tempest-VolumesGetTestJSON-1863538337 tempest-VolumesGetTestJSON-1863538337-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 200 len: 351 microversion: 2.1 time: 110.446642 Oct 20 06:28:08.986384 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1083/2177] 10.222.0.20 () {60 vars in 1156 bytes} [Thu Oct 20 06:26:18 2022] POST /compute/v2.1/os-volumes => generated 351 bytes in 110450 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 20 06:28:10.178679 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-3d968223-6abf-417f-a675-81bb7f4652dc tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:28:10.180361 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-3d968223-6abf-417f-a675-81bb7f4652dc tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:28:10.197567 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3d968223-6abf-417f-a675-81bb7f4652dc tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:28:10.198056 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3d968223-6abf-417f-a675-81bb7f4652dc tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:28:10.198684 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3d968223-6abf-417f-a675-81bb7f4652dc tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:28:10.200054 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3d968223-6abf-417f-a675-81bb7f4652dc tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:28:10.200449 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3d968223-6abf-417f-a675-81bb7f4652dc tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:28:10.201081 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3d968223-6abf-417f-a675-81bb7f4652dc tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:28:10.232272 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-3d968223-6abf-417f-a675-81bb7f4652dc tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Going to try to terminate instance {{(pid=118860) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 20 06:28:10.333295 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-3d968223-6abf-417f-a675-81bb7f4652dc tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "DELETE /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 204 len: 0 microversion: 2.1 time: 0.158174 Oct 20 06:28:10.335818 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1095/2178] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 20 06:28:10 2022] DELETE /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 20 06:28:10.343742 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 20 06:28:10.344316 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: Thu Oct 20 06:28:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 (ip 10.222.0.20) !!! Oct 20 06:28:10.345635 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 20 06:28:10.345796 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: Thu Oct 20 06:28:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 (ip 10.222.0.20) !!! Oct 20 06:28:10.351646 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-b6381b32-4bd3-4f4e-8ff9-958ca531065c tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:28:10.352254 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-b6381b32-4bd3-4f4e-8ff9-958ca531065c tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:28:10.361339 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b6381b32-4bd3-4f4e-8ff9-958ca531065c tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:28:10.361831 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b6381b32-4bd3-4f4e-8ff9-958ca531065c tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:28:10.362267 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b6381b32-4bd3-4f4e-8ff9-958ca531065c tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:28:10.362998 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b6381b32-4bd3-4f4e-8ff9-958ca531065c tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:28:10.363481 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b6381b32-4bd3-4f4e-8ff9-958ca531065c tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:28:10.363904 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b6381b32-4bd3-4f4e-8ff9-958ca531065c tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:28:10.565679 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-b6381b32-4bd3-4f4e-8ff9-958ca531065c tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:28:10.576145 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-b6381b32-4bd3-4f4e-8ff9-958ca531065c tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1718 microversion: 2.1 time: 0.236547 Oct 20 06:28:10.577139 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1084/2179] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:28:10 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1718 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:28:11.602802 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-27017a38-f9a0-432b-9ca4-8cc0273313d9 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:28:11.603528 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-27017a38-f9a0-432b-9ca4-8cc0273313d9 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:28:11.610879 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-27017a38-f9a0-432b-9ca4-8cc0273313d9 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:28:11.611364 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-27017a38-f9a0-432b-9ca4-8cc0273313d9 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:28:11.611945 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-27017a38-f9a0-432b-9ca4-8cc0273313d9 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:28:11.612810 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-27017a38-f9a0-432b-9ca4-8cc0273313d9 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:28:11.613251 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-27017a38-f9a0-432b-9ca4-8cc0273313d9 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:28:11.613676 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-27017a38-f9a0-432b-9ca4-8cc0273313d9 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:28:11.749443 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-27017a38-f9a0-432b-9ca4-8cc0273313d9 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:28:11.757870 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-27017a38-f9a0-432b-9ca4-8cc0273313d9 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1718 microversion: 2.1 time: 0.159496 Oct 20 06:28:11.758438 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1096/2180] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:28:11 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1718 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:28:12.783311 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-c2b72f6e-946f-4570-ae51-9b4d3109af69 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:28:12.783926 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-c2b72f6e-946f-4570-ae51-9b4d3109af69 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:28:12.791110 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c2b72f6e-946f-4570-ae51-9b4d3109af69 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:28:12.791601 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c2b72f6e-946f-4570-ae51-9b4d3109af69 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:28:12.792042 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c2b72f6e-946f-4570-ae51-9b4d3109af69 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:28:12.792763 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c2b72f6e-946f-4570-ae51-9b4d3109af69 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:28:12.793221 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c2b72f6e-946f-4570-ae51-9b4d3109af69 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:28:12.793654 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c2b72f6e-946f-4570-ae51-9b4d3109af69 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:28:12.930391 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-c2b72f6e-946f-4570-ae51-9b4d3109af69 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:28:12.939601 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-c2b72f6e-946f-4570-ae51-9b4d3109af69 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1718 microversion: 2.1 time: 0.160131 Oct 20 06:28:12.940175 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1085/2181] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:28:12 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1718 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:28:13.964593 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-18c71fb9-c6a2-4e8a-80be-d37027906e36 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:28:13.965293 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-18c71fb9-c6a2-4e8a-80be-d37027906e36 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:28:13.971833 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-18c71fb9-c6a2-4e8a-80be-d37027906e36 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:28:13.972317 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-18c71fb9-c6a2-4e8a-80be-d37027906e36 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:28:13.972801 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-18c71fb9-c6a2-4e8a-80be-d37027906e36 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:28:13.973502 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-18c71fb9-c6a2-4e8a-80be-d37027906e36 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:28:13.973957 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-18c71fb9-c6a2-4e8a-80be-d37027906e36 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:28:13.974382 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-18c71fb9-c6a2-4e8a-80be-d37027906e36 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:28:14.116556 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-18c71fb9-c6a2-4e8a-80be-d37027906e36 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:28:14.125287 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-18c71fb9-c6a2-4e8a-80be-d37027906e36 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1718 microversion: 2.1 time: 0.165632 Oct 20 06:28:14.125853 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1097/2182] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:28:13 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1718 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:28:15.151410 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-c14a3cbb-12d5-41c8-94c7-9d9d776e7dfb tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:28:15.152194 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-c14a3cbb-12d5-41c8-94c7-9d9d776e7dfb tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:28:15.159044 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c14a3cbb-12d5-41c8-94c7-9d9d776e7dfb tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:28:15.159784 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c14a3cbb-12d5-41c8-94c7-9d9d776e7dfb tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:28:15.160211 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c14a3cbb-12d5-41c8-94c7-9d9d776e7dfb tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:28:15.160950 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c14a3cbb-12d5-41c8-94c7-9d9d776e7dfb tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:28:15.161400 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c14a3cbb-12d5-41c8-94c7-9d9d776e7dfb tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:28:15.161818 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c14a3cbb-12d5-41c8-94c7-9d9d776e7dfb tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:28:15.299754 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-c14a3cbb-12d5-41c8-94c7-9d9d776e7dfb tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:28:15.309137 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-c14a3cbb-12d5-41c8-94c7-9d9d776e7dfb tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1718 microversion: 2.1 time: 0.161869 Oct 20 06:28:15.309713 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1086/2183] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:28:15 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1718 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:28:16.333117 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-50e48309-9a00-4bb7-9d28-da1b57bc37c6 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:28:16.333732 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-50e48309-9a00-4bb7-9d28-da1b57bc37c6 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:28:16.341037 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-50e48309-9a00-4bb7-9d28-da1b57bc37c6 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:28:16.341525 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-50e48309-9a00-4bb7-9d28-da1b57bc37c6 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:28:16.341977 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-50e48309-9a00-4bb7-9d28-da1b57bc37c6 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:28:16.342667 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-50e48309-9a00-4bb7-9d28-da1b57bc37c6 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:28:16.343124 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-50e48309-9a00-4bb7-9d28-da1b57bc37c6 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:28:16.343553 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-50e48309-9a00-4bb7-9d28-da1b57bc37c6 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:28:16.481822 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-50e48309-9a00-4bb7-9d28-da1b57bc37c6 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:28:16.490186 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-50e48309-9a00-4bb7-9d28-da1b57bc37c6 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1718 microversion: 2.1 time: 0.161029 Oct 20 06:28:16.490743 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1098/2184] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:28:16 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1718 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:28:17.515955 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-69d2b2f3-0fc4-448d-a9fb-c15e1bf59971 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:28:17.516575 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-69d2b2f3-0fc4-448d-a9fb-c15e1bf59971 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:28:17.523353 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-69d2b2f3-0fc4-448d-a9fb-c15e1bf59971 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:28:17.523840 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-69d2b2f3-0fc4-448d-a9fb-c15e1bf59971 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:28:17.524278 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-69d2b2f3-0fc4-448d-a9fb-c15e1bf59971 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:28:17.525009 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-69d2b2f3-0fc4-448d-a9fb-c15e1bf59971 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:28:17.525462 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-69d2b2f3-0fc4-448d-a9fb-c15e1bf59971 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:28:17.525887 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-69d2b2f3-0fc4-448d-a9fb-c15e1bf59971 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:28:17.660591 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-69d2b2f3-0fc4-448d-a9fb-c15e1bf59971 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:28:17.670167 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-69d2b2f3-0fc4-448d-a9fb-c15e1bf59971 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1718 microversion: 2.1 time: 0.159464 Oct 20 06:28:17.670764 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1087/2185] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:28:17 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1718 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:28:18.694290 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-42fab0f2-6d73-4c3e-a654-172e65b7e6c4 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:28:18.694889 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-42fab0f2-6d73-4c3e-a654-172e65b7e6c4 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:28:18.702039 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-42fab0f2-6d73-4c3e-a654-172e65b7e6c4 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:28:18.702540 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-42fab0f2-6d73-4c3e-a654-172e65b7e6c4 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:28:18.702969 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-42fab0f2-6d73-4c3e-a654-172e65b7e6c4 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:28:18.703749 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-42fab0f2-6d73-4c3e-a654-172e65b7e6c4 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:28:18.704199 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-42fab0f2-6d73-4c3e-a654-172e65b7e6c4 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:28:18.704627 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-42fab0f2-6d73-4c3e-a654-172e65b7e6c4 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:28:18.840780 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-42fab0f2-6d73-4c3e-a654-172e65b7e6c4 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:28:18.849100 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-42fab0f2-6d73-4c3e-a654-172e65b7e6c4 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1718 microversion: 2.1 time: 0.158682 Oct 20 06:28:18.849659 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1099/2186] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:28:18 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1718 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:28:19.873582 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-1bfabf5c-6ce1-4500-84b9-5bdb1259a66d tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:28:19.874190 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-1bfabf5c-6ce1-4500-84b9-5bdb1259a66d tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:28:19.881118 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1bfabf5c-6ce1-4500-84b9-5bdb1259a66d tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:28:19.881615 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1bfabf5c-6ce1-4500-84b9-5bdb1259a66d tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:28:19.882055 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1bfabf5c-6ce1-4500-84b9-5bdb1259a66d tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:28:19.882761 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1bfabf5c-6ce1-4500-84b9-5bdb1259a66d tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:28:19.883251 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1bfabf5c-6ce1-4500-84b9-5bdb1259a66d tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:28:19.883709 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1bfabf5c-6ce1-4500-84b9-5bdb1259a66d tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:28:20.031659 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-1bfabf5c-6ce1-4500-84b9-5bdb1259a66d tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:28:20.039849 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-1bfabf5c-6ce1-4500-84b9-5bdb1259a66d tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1718 microversion: 2.1 time: 0.170504 Oct 20 06:28:20.040413 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1088/2187] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:28:19 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1718 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:28:21.063858 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-3f0a5004-2e35-4aa9-96bc-4e7367eebe12 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:28:21.064484 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-3f0a5004-2e35-4aa9-96bc-4e7367eebe12 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:28:21.070688 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3f0a5004-2e35-4aa9-96bc-4e7367eebe12 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:28:21.071107 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3f0a5004-2e35-4aa9-96bc-4e7367eebe12 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:28:21.071537 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3f0a5004-2e35-4aa9-96bc-4e7367eebe12 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:28:21.072219 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3f0a5004-2e35-4aa9-96bc-4e7367eebe12 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:28:21.072721 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3f0a5004-2e35-4aa9-96bc-4e7367eebe12 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:28:21.073231 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3f0a5004-2e35-4aa9-96bc-4e7367eebe12 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:28:21.207121 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-3f0a5004-2e35-4aa9-96bc-4e7367eebe12 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:28:21.215882 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-3f0a5004-2e35-4aa9-96bc-4e7367eebe12 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1718 microversion: 2.1 time: 0.155976 Oct 20 06:28:21.216441 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1100/2188] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:28:21 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1718 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:28:22.239390 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-717df2cc-1b6b-4831-a9a0-51ea1d1a8d1a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:28:22.239986 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-717df2cc-1b6b-4831-a9a0-51ea1d1a8d1a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:28:22.246504 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-717df2cc-1b6b-4831-a9a0-51ea1d1a8d1a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:28:22.246979 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-717df2cc-1b6b-4831-a9a0-51ea1d1a8d1a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:28:22.247414 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-717df2cc-1b6b-4831-a9a0-51ea1d1a8d1a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:28:22.248100 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-717df2cc-1b6b-4831-a9a0-51ea1d1a8d1a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:28:22.248549 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-717df2cc-1b6b-4831-a9a0-51ea1d1a8d1a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:28:22.248997 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-717df2cc-1b6b-4831-a9a0-51ea1d1a8d1a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:28:22.378080 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-717df2cc-1b6b-4831-a9a0-51ea1d1a8d1a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:28:22.387327 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-717df2cc-1b6b-4831-a9a0-51ea1d1a8d1a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1718 microversion: 2.1 time: 0.151783 Oct 20 06:28:22.387892 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1089/2189] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:28:22 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1718 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:28:23.411124 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-5bf622f6-9d8b-4b3b-b5a9-8bc761e82ad5 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:28:23.411735 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-5bf622f6-9d8b-4b3b-b5a9-8bc761e82ad5 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:28:23.418209 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5bf622f6-9d8b-4b3b-b5a9-8bc761e82ad5 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:28:23.418686 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5bf622f6-9d8b-4b3b-b5a9-8bc761e82ad5 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:28:23.419119 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5bf622f6-9d8b-4b3b-b5a9-8bc761e82ad5 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:28:23.419795 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5bf622f6-9d8b-4b3b-b5a9-8bc761e82ad5 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:28:23.420272 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5bf622f6-9d8b-4b3b-b5a9-8bc761e82ad5 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:28:23.420710 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5bf622f6-9d8b-4b3b-b5a9-8bc761e82ad5 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:28:23.551098 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-5bf622f6-9d8b-4b3b-b5a9-8bc761e82ad5 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:28:23.560382 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-5bf622f6-9d8b-4b3b-b5a9-8bc761e82ad5 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1718 microversion: 2.1 time: 0.153327 Oct 20 06:28:23.560906 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1101/2190] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:28:23 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1718 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:28:24.583496 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-a91dbed9-ddd9-4ce4-a0a6-5568879b2d51 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:28:24.584113 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-a91dbed9-ddd9-4ce4-a0a6-5568879b2d51 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:28:24.591113 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a91dbed9-ddd9-4ce4-a0a6-5568879b2d51 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:28:24.591597 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a91dbed9-ddd9-4ce4-a0a6-5568879b2d51 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:28:24.592035 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a91dbed9-ddd9-4ce4-a0a6-5568879b2d51 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:28:24.592848 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a91dbed9-ddd9-4ce4-a0a6-5568879b2d51 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:28:24.593306 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a91dbed9-ddd9-4ce4-a0a6-5568879b2d51 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:28:24.593742 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a91dbed9-ddd9-4ce4-a0a6-5568879b2d51 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:28:24.720385 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-a91dbed9-ddd9-4ce4-a0a6-5568879b2d51 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:28:24.728656 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-a91dbed9-ddd9-4ce4-a0a6-5568879b2d51 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1718 microversion: 2.1 time: 0.149099 Oct 20 06:28:24.729939 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1090/2191] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:28:24 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1718 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:28:25.752643 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-1ea196a6-2789-4ed8-93ff-3ff93d9991e8 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:28:25.753280 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-1ea196a6-2789-4ed8-93ff-3ff93d9991e8 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:28:25.759890 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1ea196a6-2789-4ed8-93ff-3ff93d9991e8 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:28:25.761448 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1ea196a6-2789-4ed8-93ff-3ff93d9991e8 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:28:25.761898 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1ea196a6-2789-4ed8-93ff-3ff93d9991e8 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:28:25.762596 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1ea196a6-2789-4ed8-93ff-3ff93d9991e8 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:28:25.763054 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1ea196a6-2789-4ed8-93ff-3ff93d9991e8 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:28:25.763482 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1ea196a6-2789-4ed8-93ff-3ff93d9991e8 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:28:25.895168 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-1ea196a6-2789-4ed8-93ff-3ff93d9991e8 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:28:25.904954 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-1ea196a6-2789-4ed8-93ff-3ff93d9991e8 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1718 microversion: 2.1 time: 0.156160 Oct 20 06:28:25.905799 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1102/2192] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:28:25 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1718 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:28:26.928598 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-1b5fd82b-39f5-4639-9276-54c18cc7d28d tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:28:26.929219 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-1b5fd82b-39f5-4639-9276-54c18cc7d28d tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:28:26.936147 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1b5fd82b-39f5-4639-9276-54c18cc7d28d tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:28:26.936615 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1b5fd82b-39f5-4639-9276-54c18cc7d28d tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:28:26.937076 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1b5fd82b-39f5-4639-9276-54c18cc7d28d tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:28:26.937757 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1b5fd82b-39f5-4639-9276-54c18cc7d28d tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:28:26.938203 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1b5fd82b-39f5-4639-9276-54c18cc7d28d tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:28:26.938625 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1b5fd82b-39f5-4639-9276-54c18cc7d28d tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:28:27.070701 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-1b5fd82b-39f5-4639-9276-54c18cc7d28d tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:28:27.079925 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-1b5fd82b-39f5-4639-9276-54c18cc7d28d tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1718 microversion: 2.1 time: 0.155063 Oct 20 06:28:27.080743 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1091/2193] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:28:26 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1718 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:28:28.103278 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-260dc198-5816-4f03-9cd1-dd243dc21537 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:28:28.104780 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-260dc198-5816-4f03-9cd1-dd243dc21537 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:28:28.111287 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-260dc198-5816-4f03-9cd1-dd243dc21537 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:28:28.111898 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-260dc198-5816-4f03-9cd1-dd243dc21537 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:28:28.112216 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-260dc198-5816-4f03-9cd1-dd243dc21537 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:28:28.112936 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-260dc198-5816-4f03-9cd1-dd243dc21537 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:28:28.113391 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-260dc198-5816-4f03-9cd1-dd243dc21537 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:28:28.113821 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-260dc198-5816-4f03-9cd1-dd243dc21537 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:28:28.242983 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-260dc198-5816-4f03-9cd1-dd243dc21537 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:28:28.251884 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-260dc198-5816-4f03-9cd1-dd243dc21537 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1718 microversion: 2.1 time: 0.152473 Oct 20 06:28:28.252459 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1103/2194] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:28:28 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1718 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:28:29.276360 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-97bd9bf0-1e4e-4fae-ba3f-eb151e33e4e1 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:28:29.277037 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-97bd9bf0-1e4e-4fae-ba3f-eb151e33e4e1 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:28:29.283567 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-97bd9bf0-1e4e-4fae-ba3f-eb151e33e4e1 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:28:29.284049 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-97bd9bf0-1e4e-4fae-ba3f-eb151e33e4e1 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:28:29.284487 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-97bd9bf0-1e4e-4fae-ba3f-eb151e33e4e1 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:28:29.285216 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-97bd9bf0-1e4e-4fae-ba3f-eb151e33e4e1 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:28:29.285667 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-97bd9bf0-1e4e-4fae-ba3f-eb151e33e4e1 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:28:29.286095 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-97bd9bf0-1e4e-4fae-ba3f-eb151e33e4e1 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:28:29.418863 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-97bd9bf0-1e4e-4fae-ba3f-eb151e33e4e1 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:28:29.427144 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-97bd9bf0-1e4e-4fae-ba3f-eb151e33e4e1 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1718 microversion: 2.1 time: 0.155182 Oct 20 06:28:29.427712 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1092/2195] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:28:29 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1718 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:28:30.450514 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-1acbbf22-658e-416a-a283-0a0efdc6aade tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:28:30.451127 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-1acbbf22-658e-416a-a283-0a0efdc6aade tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:28:30.457729 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1acbbf22-658e-416a-a283-0a0efdc6aade tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:28:30.458219 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1acbbf22-658e-416a-a283-0a0efdc6aade tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:28:30.458661 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1acbbf22-658e-416a-a283-0a0efdc6aade tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:28:30.459369 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1acbbf22-658e-416a-a283-0a0efdc6aade tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:28:30.459826 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1acbbf22-658e-416a-a283-0a0efdc6aade tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:28:30.460259 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1acbbf22-658e-416a-a283-0a0efdc6aade tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:28:30.592369 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-1acbbf22-658e-416a-a283-0a0efdc6aade tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:28:30.600985 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-1acbbf22-658e-416a-a283-0a0efdc6aade tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1718 microversion: 2.1 time: 0.154301 Oct 20 06:28:30.616716 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1104/2196] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:28:30 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1718 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:28:31.626297 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-e8311487-c7a8-40aa-aacc-c0fafce9b7d0 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:28:31.626859 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-e8311487-c7a8-40aa-aacc-c0fafce9b7d0 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:28:31.628825 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 20 06:28:31.628980 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: Thu Oct 20 06:28:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 (ip 10.222.0.20) !!! Oct 20 06:28:31.635723 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e8311487-c7a8-40aa-aacc-c0fafce9b7d0 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:28:31.636212 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e8311487-c7a8-40aa-aacc-c0fafce9b7d0 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:28:31.636649 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e8311487-c7a8-40aa-aacc-c0fafce9b7d0 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:28:31.637403 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e8311487-c7a8-40aa-aacc-c0fafce9b7d0 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:28:31.637861 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e8311487-c7a8-40aa-aacc-c0fafce9b7d0 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:28:31.638289 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e8311487-c7a8-40aa-aacc-c0fafce9b7d0 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:28:31.776604 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-e8311487-c7a8-40aa-aacc-c0fafce9b7d0 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:28:31.784929 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-e8311487-c7a8-40aa-aacc-c0fafce9b7d0 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1718 microversion: 2.1 time: 0.162547 Oct 20 06:28:31.785512 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1093/2197] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:28:31 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1718 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:28:32.807796 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-f448ac82-b80e-4288-bb76-e3443ab71541 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:28:32.808500 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-f448ac82-b80e-4288-bb76-e3443ab71541 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:28:32.811094 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG dbcounter [-] [118860] Writing DB stats nova_api:SELECT=29,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=118860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:28:32.816523 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f448ac82-b80e-4288-bb76-e3443ab71541 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:28:32.817043 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f448ac82-b80e-4288-bb76-e3443ab71541 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:28:32.817480 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f448ac82-b80e-4288-bb76-e3443ab71541 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:28:32.818188 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f448ac82-b80e-4288-bb76-e3443ab71541 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:28:32.818644 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f448ac82-b80e-4288-bb76-e3443ab71541 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:28:32.819073 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f448ac82-b80e-4288-bb76-e3443ab71541 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:28:32.823397 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG dbcounter [-] [118860] Writing DB stats nova_cell1:SELECT=69,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:28:32.956661 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-f448ac82-b80e-4288-bb76-e3443ab71541 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:28:32.965143 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-f448ac82-b80e-4288-bb76-e3443ab71541 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1718 microversion: 2.1 time: 0.161551 Oct 20 06:28:32.965719 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1105/2198] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:28:32 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1718 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:28:33.988636 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-5d26e060-d313-4ba6-bb90-cc5d903d098d tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:28:33.989318 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-5d26e060-d313-4ba6-bb90-cc5d903d098d tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:28:33.996526 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5d26e060-d313-4ba6-bb90-cc5d903d098d tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:28:33.997044 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5d26e060-d313-4ba6-bb90-cc5d903d098d tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:28:33.997485 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5d26e060-d313-4ba6-bb90-cc5d903d098d tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:28:33.998184 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5d26e060-d313-4ba6-bb90-cc5d903d098d tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:28:33.998646 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5d26e060-d313-4ba6-bb90-cc5d903d098d tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:28:33.999071 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5d26e060-d313-4ba6-bb90-cc5d903d098d tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:28:34.127814 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-5d26e060-d313-4ba6-bb90-cc5d903d098d tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:28:34.137399 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-5d26e060-d313-4ba6-bb90-cc5d903d098d tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1718 microversion: 2.1 time: 0.152617 Oct 20 06:28:34.137994 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1094/2199] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:28:33 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1718 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:28:35.160838 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-e3a5616b-9336-41ca-84c8-a7ac9ee007a5 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:28:35.161446 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-e3a5616b-9336-41ca-84c8-a7ac9ee007a5 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:28:35.167938 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e3a5616b-9336-41ca-84c8-a7ac9ee007a5 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:28:35.168474 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e3a5616b-9336-41ca-84c8-a7ac9ee007a5 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:28:35.168933 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e3a5616b-9336-41ca-84c8-a7ac9ee007a5 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:28:35.169622 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e3a5616b-9336-41ca-84c8-a7ac9ee007a5 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:28:35.170069 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e3a5616b-9336-41ca-84c8-a7ac9ee007a5 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:28:35.170491 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e3a5616b-9336-41ca-84c8-a7ac9ee007a5 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:28:35.298775 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-e3a5616b-9336-41ca-84c8-a7ac9ee007a5 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:28:35.307891 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-e3a5616b-9336-41ca-84c8-a7ac9ee007a5 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1718 microversion: 2.1 time: 0.150237 Oct 20 06:28:35.308536 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1106/2200] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:28:35 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1718 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:28:36.331573 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-693ba7dd-37f3-4af8-9bbe-240f5e47e99a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:28:36.332486 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-693ba7dd-37f3-4af8-9bbe-240f5e47e99a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:28:36.339353 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-693ba7dd-37f3-4af8-9bbe-240f5e47e99a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:28:36.339834 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-693ba7dd-37f3-4af8-9bbe-240f5e47e99a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:28:36.340265 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-693ba7dd-37f3-4af8-9bbe-240f5e47e99a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:28:36.340984 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-693ba7dd-37f3-4af8-9bbe-240f5e47e99a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:28:36.341447 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-693ba7dd-37f3-4af8-9bbe-240f5e47e99a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:28:36.341866 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-693ba7dd-37f3-4af8-9bbe-240f5e47e99a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:28:36.473486 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-693ba7dd-37f3-4af8-9bbe-240f5e47e99a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:28:36.482270 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-693ba7dd-37f3-4af8-9bbe-240f5e47e99a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1718 microversion: 2.1 time: 0.154553 Oct 20 06:28:36.482841 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1095/2201] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:28:36 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1718 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:28:37.178418 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-5083eb36-cb36-434a-b83f-77cebc0fba4d tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:28:37.178902 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-5083eb36-cb36-434a-b83f-77cebc0fba4d tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: a8c74b2c-bf36-4b49-8855-9eb732003e66] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:28:37.185489 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5083eb36-cb36-434a-b83f-77cebc0fba4d tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:28:37.185924 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5083eb36-cb36-434a-b83f-77cebc0fba4d tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:28:37.186356 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5083eb36-cb36-434a-b83f-77cebc0fba4d tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:28:37.187100 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5083eb36-cb36-434a-b83f-77cebc0fba4d tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:28:37.187608 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5083eb36-cb36-434a-b83f-77cebc0fba4d tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:28:37.188038 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5083eb36-cb36-434a-b83f-77cebc0fba4d tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:28:37.202131 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.wsgi [None req-5083eb36-cb36-434a-b83f-77cebc0fba4d tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] HTTP exception thrown: Instance a8c74b2c-bf36-4b49-8855-9eb732003e66 could not be found. Oct 20 06:28:37.203786 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-5083eb36-cb36-434a-b83f-77cebc0fba4d tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Request method failure captured: Oct 20 06:28:37.203786 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: request: DELETE /compute/v2.1/servers/a8c74b2c-bf36-4b49-8855-9eb732003e66 HTTP/1.1 Oct 20 06:28:37.203786 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: Accept: application/json Oct 20 06:28:37.203786 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: Accept-Encoding: identity Oct 20 06:28:37.203786 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: Connection: close Oct 20 06:28:37.203786 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: Content-Length: 0 Oct 20 06:28:37.203786 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: Content-Type: application/json Oct 20 06:28:37.203786 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: Host: 10.222.0.20 Oct 20 06:28:37.203786 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: Openstack-System-Scope: None Oct 20 06:28:37.203786 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: User-Agent: python-urllib3/1.26.12 Oct 20 06:28:37.203786 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Auth-Token: gAAAAABjUOT4WE-GeZ9nIY9RvQJPLx5cfKBHzS8w2P3ohAEeWZ7MhC3JV8mQEPTHfIaK5zuvYmNfTMyv3TZQQoGbyre2yxtMqG3RrbumkPK47M1IYrJzUzzgVth48PWOx3W0AtdNXY07UuKLEobMmvxQ_9GrsNYkeXVZIvq9kqYpG7ipSg6jPmI Oct 20 06:28:37.203786 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Domain-Id: None Oct 20 06:28:37.203786 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Domain-Name: None Oct 20 06:28:37.203786 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Identity-Status: Confirmed Oct 20 06:28:37.203786 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Is-Admin-Project: True Oct 20 06:28:37.203786 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Openstack-Nova-Api-Version: 2.20 Oct 20 06:28:37.203786 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Project-Domain-Id: default Oct 20 06:28:37.203786 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Project-Domain-Name: Default Oct 20 06:28:37.203786 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Project-Id: 66a33a727f9c40b99fb14bd2e0fc5090 Oct 20 06:28:37.203786 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1640997354 Oct 20 06:28:37.203786 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Role: reader,member Oct 20 06:28:37.203786 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Roles: reader,member Oct 20 06:28:37.205749 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/66a33a727f9c40b99fb14bd2e0fc5090"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_66a33a727f9c40b99fb14bd2e0fc5090"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/66a33a727f9c40b99fb14bd2e0fc5090"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/66a33a727f9c40b99fb14bd2e0fc5090"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 20 06:28:37.205749 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1640997354 Oct 20 06:28:37.205749 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Tenant-Id: 66a33a727f9c40b99fb14bd2e0fc5090 Oct 20 06:28:37.205749 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1640997354 Oct 20 06:28:37.205749 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-User: tempest-AttachVolumeShelveTestJSON-1640997354-project Oct 20 06:28:37.205749 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-User-Domain-Id: default Oct 20 06:28:37.205749 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-User-Domain-Name: Default Oct 20 06:28:37.205749 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-User-Id: db34ffc8f90247daac1548bbb421b015 Oct 20 06:28:37.205749 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1640997354-project Oct 20 06:28:37.205749 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: method: > Oct 20 06:28:37.205749 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: exception: Instance a8c74b2c-bf36-4b49-8855-9eb732003e66 could not be found. Oct 20 06:28:37.205749 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: action_args: {'id': 'a8c74b2c-bf36-4b49-8855-9eb732003e66'} Oct 20 06:28:37.206777 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 20 06:28:37.206777 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 06:28:37.206777 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 20 06:28:37.206777 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 20 06:28:37.206777 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 20 06:28:37.206777 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 20 06:28:37.206777 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 20 06:28:37.206777 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 20 06:28:37.206777 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 20 06:28:37.206777 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 20 06:28:37.206777 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a8c74b2c-bf36-4b49-8855-9eb732003e66 could not be found. Oct 20 06:28:37.206777 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi Oct 20 06:28:37.206777 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 06:28:37.206777 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi Oct 20 06:28:37.206777 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 06:28:37.206777 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 06:28:37.206777 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 06:28:37.206777 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 20 06:28:37.206777 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 20 06:28:37.206777 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 20 06:28:37.208402 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 20 06:28:37.208402 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 20 06:28:37.208402 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 20 06:28:37.208402 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 20 06:28:37.208402 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 20 06:28:37.208402 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 20 06:28:37.208402 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 20 06:28:37.208402 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 20 06:28:37.208402 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 20 06:28:37.208402 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a8c74b2c-bf36-4b49-8855-9eb732003e66 could not be found. Oct 20 06:28:37.208402 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi Oct 20 06:28:37.208402 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 06:28:37.208402 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi Oct 20 06:28:37.208402 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 06:28:37.208402 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 06:28:37.208402 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 06:28:37.208402 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 20 06:28:37.208402 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 20 06:28:37.208402 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a8c74b2c-bf36-4b49-8855-9eb732003e66 could not be found. Oct 20 06:28:37.208402 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi Oct 20 06:28:37.210186 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-5083eb36-cb36-434a-b83f-77cebc0fba4d tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Returning 404 to user: Instance a8c74b2c-bf36-4b49-8855-9eb732003e66 could not be found. {{(pid=118860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 20 06:28:37.210186 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-5083eb36-cb36-434a-b83f-77cebc0fba4d tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "DELETE /compute/v2.1/servers/a8c74b2c-bf36-4b49-8855-9eb732003e66" status: 404 len: 111 microversion: 2.20 time: 0.030749 Oct 20 06:28:37.210186 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1107/2202] 10.222.0.20 () {60 vars in 1280 bytes} [Thu Oct 20 06:28:37 2022] DELETE /compute/v2.1/servers/a8c74b2c-bf36-4b49-8855-9eb732003e66 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 20 06:28:37.216208 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-6d80ea8b-22e4-4bb1-9701-cb5936ad64b5 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:28:37.217081 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-6d80ea8b-22e4-4bb1-9701-cb5936ad64b5 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: a8c74b2c-bf36-4b49-8855-9eb732003e66] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:28:37.218993 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG dbcounter [-] [118861] Writing DB stats nova_api:SELECT=25 {{(pid=118861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:28:37.224467 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-6d80ea8b-22e4-4bb1-9701-cb5936ad64b5 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:28:37.225030 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-6d80ea8b-22e4-4bb1-9701-cb5936ad64b5 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:28:37.225470 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-6d80ea8b-22e4-4bb1-9701-cb5936ad64b5 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:28:37.226168 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-6d80ea8b-22e4-4bb1-9701-cb5936ad64b5 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:28:37.226615 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-6d80ea8b-22e4-4bb1-9701-cb5936ad64b5 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:28:37.227229 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-6d80ea8b-22e4-4bb1-9701-cb5936ad64b5 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:28:37.232983 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG dbcounter [-] [118861] Writing DB stats nova_cell1:SELECT=73 {{(pid=118861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:28:37.248504 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.wsgi [None req-6d80ea8b-22e4-4bb1-9701-cb5936ad64b5 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] HTTP exception thrown: Instance a8c74b2c-bf36-4b49-8855-9eb732003e66 could not be found. Oct 20 06:28:37.250227 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-6d80ea8b-22e4-4bb1-9701-cb5936ad64b5 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Request method failure captured: Oct 20 06:28:37.250227 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: request: GET /compute/v2.1/servers/a8c74b2c-bf36-4b49-8855-9eb732003e66 HTTP/1.1 Oct 20 06:28:37.250227 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: Accept: application/json Oct 20 06:28:37.250227 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: Accept-Encoding: identity Oct 20 06:28:37.250227 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: Connection: close Oct 20 06:28:37.250227 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: Content-Length: 0 Oct 20 06:28:37.250227 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: Content-Type: application/json Oct 20 06:28:37.250227 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: Host: 10.222.0.20 Oct 20 06:28:37.250227 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: Openstack-System-Scope: None Oct 20 06:28:37.250227 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: User-Agent: python-urllib3/1.26.12 Oct 20 06:28:37.250227 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Auth-Token: gAAAAABjUOT4WE-GeZ9nIY9RvQJPLx5cfKBHzS8w2P3ohAEeWZ7MhC3JV8mQEPTHfIaK5zuvYmNfTMyv3TZQQoGbyre2yxtMqG3RrbumkPK47M1IYrJzUzzgVth48PWOx3W0AtdNXY07UuKLEobMmvxQ_9GrsNYkeXVZIvq9kqYpG7ipSg6jPmI Oct 20 06:28:37.250227 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Domain-Id: None Oct 20 06:28:37.250227 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Domain-Name: None Oct 20 06:28:37.250227 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Identity-Status: Confirmed Oct 20 06:28:37.250227 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Is-Admin-Project: True Oct 20 06:28:37.250227 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Openstack-Nova-Api-Version: 2.20 Oct 20 06:28:37.250227 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Project-Domain-Id: default Oct 20 06:28:37.250227 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Project-Domain-Name: Default Oct 20 06:28:37.250227 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Project-Id: 66a33a727f9c40b99fb14bd2e0fc5090 Oct 20 06:28:37.250227 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1640997354 Oct 20 06:28:37.250227 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Role: reader,member Oct 20 06:28:37.250227 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Roles: reader,member Oct 20 06:28:37.252087 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/66a33a727f9c40b99fb14bd2e0fc5090"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_66a33a727f9c40b99fb14bd2e0fc5090"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/66a33a727f9c40b99fb14bd2e0fc5090"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/66a33a727f9c40b99fb14bd2e0fc5090"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 20 06:28:37.252087 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1640997354 Oct 20 06:28:37.252087 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Tenant-Id: 66a33a727f9c40b99fb14bd2e0fc5090 Oct 20 06:28:37.252087 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1640997354 Oct 20 06:28:37.252087 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-User: tempest-AttachVolumeShelveTestJSON-1640997354-project Oct 20 06:28:37.252087 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-User-Domain-Id: default Oct 20 06:28:37.252087 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-User-Domain-Name: Default Oct 20 06:28:37.252087 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-User-Id: db34ffc8f90247daac1548bbb421b015 Oct 20 06:28:37.252087 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1640997354-project Oct 20 06:28:37.252087 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: method: > Oct 20 06:28:37.252087 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: exception: Instance a8c74b2c-bf36-4b49-8855-9eb732003e66 could not be found. Oct 20 06:28:37.252087 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: action_args: {'id': 'a8c74b2c-bf36-4b49-8855-9eb732003e66'} Oct 20 06:28:37.253174 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 20 06:28:37.253174 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 06:28:37.253174 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 20 06:28:37.253174 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 20 06:28:37.253174 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 20 06:28:37.253174 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 20 06:28:37.253174 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 20 06:28:37.253174 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 20 06:28:37.253174 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 20 06:28:37.253174 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 20 06:28:37.253174 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a8c74b2c-bf36-4b49-8855-9eb732003e66 could not be found. Oct 20 06:28:37.253174 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi Oct 20 06:28:37.253174 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 06:28:37.253174 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi Oct 20 06:28:37.253174 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 06:28:37.253174 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 06:28:37.253174 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 06:28:37.253174 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 20 06:28:37.253174 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 20 06:28:37.253174 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 20 06:28:37.254856 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 20 06:28:37.254856 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 20 06:28:37.254856 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 20 06:28:37.254856 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 20 06:28:37.254856 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 20 06:28:37.254856 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 20 06:28:37.254856 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 20 06:28:37.254856 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a8c74b2c-bf36-4b49-8855-9eb732003e66 could not be found. Oct 20 06:28:37.254856 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi Oct 20 06:28:37.254856 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 06:28:37.254856 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi Oct 20 06:28:37.254856 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 06:28:37.254856 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 06:28:37.254856 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 06:28:37.254856 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 20 06:28:37.254856 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 20 06:28:37.254856 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a8c74b2c-bf36-4b49-8855-9eb732003e66 could not be found. Oct 20 06:28:37.254856 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi Oct 20 06:28:37.256317 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-6d80ea8b-22e4-4bb1-9701-cb5936ad64b5 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Returning 404 to user: Instance a8c74b2c-bf36-4b49-8855-9eb732003e66 could not be found. {{(pid=118861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 20 06:28:37.256317 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-6d80ea8b-22e4-4bb1-9701-cb5936ad64b5 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/a8c74b2c-bf36-4b49-8855-9eb732003e66" status: 404 len: 111 microversion: 2.20 time: 0.040079 Oct 20 06:28:37.256317 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1096/2203] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:28:37 2022] GET /compute/v2.1/servers/a8c74b2c-bf36-4b49-8855-9eb732003e66 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 20 06:28:37.505747 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-532515ad-f51a-4828-b516-b82b6443aa98 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:28:37.506465 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-532515ad-f51a-4828-b516-b82b6443aa98 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:28:37.513551 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-532515ad-f51a-4828-b516-b82b6443aa98 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:28:37.514038 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-532515ad-f51a-4828-b516-b82b6443aa98 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:28:37.514476 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-532515ad-f51a-4828-b516-b82b6443aa98 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:28:37.515168 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-532515ad-f51a-4828-b516-b82b6443aa98 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:28:37.515624 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-532515ad-f51a-4828-b516-b82b6443aa98 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:28:37.516051 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-532515ad-f51a-4828-b516-b82b6443aa98 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:28:37.652302 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-532515ad-f51a-4828-b516-b82b6443aa98 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:28:37.660644 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-532515ad-f51a-4828-b516-b82b6443aa98 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1718 microversion: 2.1 time: 0.158618 Oct 20 06:28:37.661234 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1108/2204] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:28:37 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1718 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:28:38.683956 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-09e858e7-644e-49e6-ba7c-c5fb2140a276 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:28:38.684648 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-09e858e7-644e-49e6-ba7c-c5fb2140a276 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:28:38.691169 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-09e858e7-644e-49e6-ba7c-c5fb2140a276 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:28:38.691654 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-09e858e7-644e-49e6-ba7c-c5fb2140a276 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:28:38.692086 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-09e858e7-644e-49e6-ba7c-c5fb2140a276 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:28:38.692793 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-09e858e7-644e-49e6-ba7c-c5fb2140a276 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:28:38.693241 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-09e858e7-644e-49e6-ba7c-c5fb2140a276 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:28:38.694059 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-09e858e7-644e-49e6-ba7c-c5fb2140a276 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:28:38.830561 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-09e858e7-644e-49e6-ba7c-c5fb2140a276 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:28:38.838849 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-09e858e7-644e-49e6-ba7c-c5fb2140a276 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1718 microversion: 2.1 time: 0.158908 Oct 20 06:28:38.839642 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1097/2205] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:28:38 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1718 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:28:39.863477 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-03d0078c-f839-4dab-bf66-46f0d44105f9 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:28:39.864209 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-03d0078c-f839-4dab-bf66-46f0d44105f9 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:28:39.870635 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-03d0078c-f839-4dab-bf66-46f0d44105f9 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:28:39.871115 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-03d0078c-f839-4dab-bf66-46f0d44105f9 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:28:39.871546 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-03d0078c-f839-4dab-bf66-46f0d44105f9 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:28:39.872231 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-03d0078c-f839-4dab-bf66-46f0d44105f9 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:28:39.872676 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-03d0078c-f839-4dab-bf66-46f0d44105f9 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:28:39.873128 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-03d0078c-f839-4dab-bf66-46f0d44105f9 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:28:40.001979 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-03d0078c-f839-4dab-bf66-46f0d44105f9 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:28:40.010370 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-03d0078c-f839-4dab-bf66-46f0d44105f9 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1718 microversion: 2.1 time: 0.150801 Oct 20 06:28:40.011431 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1109/2206] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:28:39 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1718 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:28:41.034020 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-c65c34d5-a56b-4b7e-97a9-0c686b988dcf tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:28:41.034623 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-c65c34d5-a56b-4b7e-97a9-0c686b988dcf tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:28:41.041390 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c65c34d5-a56b-4b7e-97a9-0c686b988dcf tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:28:41.041881 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c65c34d5-a56b-4b7e-97a9-0c686b988dcf tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:28:41.042324 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c65c34d5-a56b-4b7e-97a9-0c686b988dcf tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:28:41.043034 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c65c34d5-a56b-4b7e-97a9-0c686b988dcf tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:28:41.043490 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c65c34d5-a56b-4b7e-97a9-0c686b988dcf tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:28:41.043918 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c65c34d5-a56b-4b7e-97a9-0c686b988dcf tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:28:41.173727 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-c65c34d5-a56b-4b7e-97a9-0c686b988dcf tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:28:41.182105 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-c65c34d5-a56b-4b7e-97a9-0c686b988dcf tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1718 microversion: 2.1 time: 0.152016 Oct 20 06:28:41.183511 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1098/2207] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:28:41 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1718 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:28:42.205848 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-99b4deac-995d-45f7-b075-df65611b8749 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:28:42.206486 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-99b4deac-995d-45f7-b075-df65611b8749 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:28:42.212925 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-99b4deac-995d-45f7-b075-df65611b8749 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:28:42.213410 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-99b4deac-995d-45f7-b075-df65611b8749 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:28:42.213842 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-99b4deac-995d-45f7-b075-df65611b8749 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:28:42.215191 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-99b4deac-995d-45f7-b075-df65611b8749 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:28:42.215637 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-99b4deac-995d-45f7-b075-df65611b8749 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:28:42.216057 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-99b4deac-995d-45f7-b075-df65611b8749 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:28:42.350239 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-99b4deac-995d-45f7-b075-df65611b8749 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:28:42.358977 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-99b4deac-995d-45f7-b075-df65611b8749 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1718 microversion: 2.1 time: 0.157307 Oct 20 06:28:42.359545 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1110/2208] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:28:42 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1718 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:28:43.383001 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-e7f2f99d-6fcd-4bf7-93ee-0d2aed035224 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:28:43.383619 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-e7f2f99d-6fcd-4bf7-93ee-0d2aed035224 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:28:43.391214 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e7f2f99d-6fcd-4bf7-93ee-0d2aed035224 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:28:43.391701 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e7f2f99d-6fcd-4bf7-93ee-0d2aed035224 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:28:43.392146 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e7f2f99d-6fcd-4bf7-93ee-0d2aed035224 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:28:43.392878 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e7f2f99d-6fcd-4bf7-93ee-0d2aed035224 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:28:43.393367 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e7f2f99d-6fcd-4bf7-93ee-0d2aed035224 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:28:43.393797 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e7f2f99d-6fcd-4bf7-93ee-0d2aed035224 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:28:43.688241 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-e7f2f99d-6fcd-4bf7-93ee-0d2aed035224 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:28:43.696551 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-e7f2f99d-6fcd-4bf7-93ee-0d2aed035224 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1718 microversion: 2.1 time: 0.317482 Oct 20 06:28:43.697150 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1099/2209] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:28:43 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1718 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:28:44.721001 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-4aa76678-540c-4c2c-9568-3842234e96b0 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:28:44.721617 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-4aa76678-540c-4c2c-9568-3842234e96b0 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:28:44.728075 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-4aa76678-540c-4c2c-9568-3842234e96b0 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:28:44.728573 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-4aa76678-540c-4c2c-9568-3842234e96b0 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:28:44.729049 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-4aa76678-540c-4c2c-9568-3842234e96b0 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:28:44.729750 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-4aa76678-540c-4c2c-9568-3842234e96b0 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:28:44.730305 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-4aa76678-540c-4c2c-9568-3842234e96b0 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:28:44.731024 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-4aa76678-540c-4c2c-9568-3842234e96b0 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:28:44.860549 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-4aa76678-540c-4c2c-9568-3842234e96b0 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:28:44.869149 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-4aa76678-540c-4c2c-9568-3842234e96b0 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1718 microversion: 2.1 time: 0.152046 Oct 20 06:28:44.869718 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1111/2210] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:28:44 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1718 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:28:45.893154 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-07bf30ec-55d2-4324-966a-03e5ffef1a59 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:28:45.893878 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-07bf30ec-55d2-4324-966a-03e5ffef1a59 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:28:45.900235 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-07bf30ec-55d2-4324-966a-03e5ffef1a59 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:28:45.900732 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-07bf30ec-55d2-4324-966a-03e5ffef1a59 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:28:45.901167 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-07bf30ec-55d2-4324-966a-03e5ffef1a59 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:28:45.902416 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-07bf30ec-55d2-4324-966a-03e5ffef1a59 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:28:45.902860 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-07bf30ec-55d2-4324-966a-03e5ffef1a59 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:28:45.903285 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-07bf30ec-55d2-4324-966a-03e5ffef1a59 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:28:46.032223 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-07bf30ec-55d2-4324-966a-03e5ffef1a59 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:28:46.040628 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-07bf30ec-55d2-4324-966a-03e5ffef1a59 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1718 microversion: 2.1 time: 0.151255 Oct 20 06:28:46.041235 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1100/2211] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:28:45 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1718 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:28:47.063923 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-24d2a8c9-2e83-427b-9f4a-09cf6426b799 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:28:47.064546 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-24d2a8c9-2e83-427b-9f4a-09cf6426b799 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:28:47.071030 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-24d2a8c9-2e83-427b-9f4a-09cf6426b799 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:28:47.071506 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-24d2a8c9-2e83-427b-9f4a-09cf6426b799 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:28:47.071944 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-24d2a8c9-2e83-427b-9f4a-09cf6426b799 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:28:47.072626 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-24d2a8c9-2e83-427b-9f4a-09cf6426b799 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:28:47.073234 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-24d2a8c9-2e83-427b-9f4a-09cf6426b799 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:28:47.074238 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-24d2a8c9-2e83-427b-9f4a-09cf6426b799 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:28:47.205582 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-24d2a8c9-2e83-427b-9f4a-09cf6426b799 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:28:47.215534 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-24d2a8c9-2e83-427b-9f4a-09cf6426b799 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1718 microversion: 2.1 time: 0.155359 Oct 20 06:28:47.216114 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1112/2212] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:28:47 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1718 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:28:48.239321 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-a453f356-4669-4f42-9365-03e8c29b2903 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:28:48.239907 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-a453f356-4669-4f42-9365-03e8c29b2903 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:28:48.246962 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a453f356-4669-4f42-9365-03e8c29b2903 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:28:48.247439 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a453f356-4669-4f42-9365-03e8c29b2903 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:28:48.247868 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a453f356-4669-4f42-9365-03e8c29b2903 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:28:48.248552 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a453f356-4669-4f42-9365-03e8c29b2903 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:28:48.249020 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a453f356-4669-4f42-9365-03e8c29b2903 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:28:48.249442 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a453f356-4669-4f42-9365-03e8c29b2903 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:28:48.393355 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-a453f356-4669-4f42-9365-03e8c29b2903 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:28:48.402187 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-a453f356-4669-4f42-9365-03e8c29b2903 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1718 microversion: 2.1 time: 0.166618 Oct 20 06:28:48.413001 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1101/2213] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:28:48 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1718 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:28:49.427063 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-eb02d6d6-8d75-4ad7-a16c-f966658bf126 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:28:49.427661 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-eb02d6d6-8d75-4ad7-a16c-f966658bf126 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:28:49.435504 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-eb02d6d6-8d75-4ad7-a16c-f966658bf126 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:28:49.435901 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-eb02d6d6-8d75-4ad7-a16c-f966658bf126 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:28:49.436342 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-eb02d6d6-8d75-4ad7-a16c-f966658bf126 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:28:49.437094 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-eb02d6d6-8d75-4ad7-a16c-f966658bf126 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:28:49.437549 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-eb02d6d6-8d75-4ad7-a16c-f966658bf126 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:28:49.437981 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-eb02d6d6-8d75-4ad7-a16c-f966658bf126 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:28:49.572919 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-eb02d6d6-8d75-4ad7-a16c-f966658bf126 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:28:49.582551 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-eb02d6d6-8d75-4ad7-a16c-f966658bf126 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1718 microversion: 2.1 time: 0.159283 Oct 20 06:28:49.583128 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1113/2214] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:28:49 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1718 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:28:50.607591 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-43582fc2-99ef-429f-93b6-a5b4dd06d76a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:28:50.608201 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-43582fc2-99ef-429f-93b6-a5b4dd06d76a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:28:50.616259 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-43582fc2-99ef-429f-93b6-a5b4dd06d76a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:28:50.617672 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-43582fc2-99ef-429f-93b6-a5b4dd06d76a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:28:50.618318 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-43582fc2-99ef-429f-93b6-a5b4dd06d76a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:28:50.619294 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-43582fc2-99ef-429f-93b6-a5b4dd06d76a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:28:50.621828 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-43582fc2-99ef-429f-93b6-a5b4dd06d76a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:28:50.623121 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-43582fc2-99ef-429f-93b6-a5b4dd06d76a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:28:50.757874 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-43582fc2-99ef-429f-93b6-a5b4dd06d76a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:28:50.766876 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-43582fc2-99ef-429f-93b6-a5b4dd06d76a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1718 microversion: 2.1 time: 0.164505 Oct 20 06:28:50.767436 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1102/2215] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:28:50 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1718 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 06:28:51.791189 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-4f5e95ff-d93f-4da0-9039-52bd63f94a61 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:28:51.792373 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-4f5e95ff-d93f-4da0-9039-52bd63f94a61 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:28:51.798524 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-4f5e95ff-d93f-4da0-9039-52bd63f94a61 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:28:51.799013 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-4f5e95ff-d93f-4da0-9039-52bd63f94a61 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:28:51.799460 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-4f5e95ff-d93f-4da0-9039-52bd63f94a61 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:28:51.800153 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-4f5e95ff-d93f-4da0-9039-52bd63f94a61 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:28:51.800752 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-4f5e95ff-d93f-4da0-9039-52bd63f94a61 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:28:51.801189 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-4f5e95ff-d93f-4da0-9039-52bd63f94a61 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:28:51.928452 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-4f5e95ff-d93f-4da0-9039-52bd63f94a61 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:28:51.936827 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-4f5e95ff-d93f-4da0-9039-52bd63f94a61 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1718 microversion: 2.1 time: 0.149473 Oct 20 06:28:51.937393 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1114/2216] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:28:51 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1718 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:28:52.960985 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-adaa3106-0760-41b8-8e8e-4c28c4e4e580 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:28:52.961667 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-adaa3106-0760-41b8-8e8e-4c28c4e4e580 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:28:52.968717 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-adaa3106-0760-41b8-8e8e-4c28c4e4e580 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:28:52.969236 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-adaa3106-0760-41b8-8e8e-4c28c4e4e580 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:28:52.969658 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-adaa3106-0760-41b8-8e8e-4c28c4e4e580 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:28:52.970350 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-adaa3106-0760-41b8-8e8e-4c28c4e4e580 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:28:52.970798 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-adaa3106-0760-41b8-8e8e-4c28c4e4e580 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:28:52.971230 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-adaa3106-0760-41b8-8e8e-4c28c4e4e580 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:28:53.106270 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-adaa3106-0760-41b8-8e8e-4c28c4e4e580 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:28:53.114763 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-adaa3106-0760-41b8-8e8e-4c28c4e4e580 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1718 microversion: 2.1 time: 0.157745 Oct 20 06:28:53.115319 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1103/2217] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:28:52 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1718 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:28:54.140624 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-2bb35744-52a4-4e65-942c-62c73e1f6fa9 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:28:54.141331 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-2bb35744-52a4-4e65-942c-62c73e1f6fa9 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:28:54.147689 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2bb35744-52a4-4e65-942c-62c73e1f6fa9 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:28:54.148171 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2bb35744-52a4-4e65-942c-62c73e1f6fa9 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:28:54.148606 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2bb35744-52a4-4e65-942c-62c73e1f6fa9 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:28:54.149320 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2bb35744-52a4-4e65-942c-62c73e1f6fa9 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:28:54.149769 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2bb35744-52a4-4e65-942c-62c73e1f6fa9 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:28:54.150186 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2bb35744-52a4-4e65-942c-62c73e1f6fa9 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:28:54.528395 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-2bb35744-52a4-4e65-942c-62c73e1f6fa9 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:28:54.538354 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-2bb35744-52a4-4e65-942c-62c73e1f6fa9 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1718 microversion: 2.1 time: 0.402534 Oct 20 06:28:54.544745 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1115/2218] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:28:54 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1718 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:28:55.562968 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-d88d3c9c-dd7a-411a-86e2-7eff745569b8 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:28:55.563526 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-d88d3c9c-dd7a-411a-86e2-7eff745569b8 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:28:55.570259 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d88d3c9c-dd7a-411a-86e2-7eff745569b8 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:28:55.570741 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d88d3c9c-dd7a-411a-86e2-7eff745569b8 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:28:55.571177 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d88d3c9c-dd7a-411a-86e2-7eff745569b8 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:28:55.571877 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d88d3c9c-dd7a-411a-86e2-7eff745569b8 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:28:55.572325 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d88d3c9c-dd7a-411a-86e2-7eff745569b8 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:28:55.573403 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d88d3c9c-dd7a-411a-86e2-7eff745569b8 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:28:55.709861 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-d88d3c9c-dd7a-411a-86e2-7eff745569b8 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:28:55.718219 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-d88d3c9c-dd7a-411a-86e2-7eff745569b8 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1718 microversion: 2.1 time: 0.159174 Oct 20 06:28:55.718794 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1104/2219] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:28:55 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1718 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:28:56.742673 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-f1a1d2cc-5bb2-462c-93f2-c5b98221ee69 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:28:56.744306 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-f1a1d2cc-5bb2-462c-93f2-c5b98221ee69 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:28:56.751235 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f1a1d2cc-5bb2-462c-93f2-c5b98221ee69 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:28:56.751731 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f1a1d2cc-5bb2-462c-93f2-c5b98221ee69 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:28:56.752168 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f1a1d2cc-5bb2-462c-93f2-c5b98221ee69 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:28:56.752896 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f1a1d2cc-5bb2-462c-93f2-c5b98221ee69 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:28:56.753351 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f1a1d2cc-5bb2-462c-93f2-c5b98221ee69 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:28:56.753776 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f1a1d2cc-5bb2-462c-93f2-c5b98221ee69 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:28:56.906728 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-f1a1d2cc-5bb2-462c-93f2-c5b98221ee69 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:28:56.915055 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-f1a1d2cc-5bb2-462c-93f2-c5b98221ee69 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1718 microversion: 2.1 time: 0.176248 Oct 20 06:28:56.915624 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1116/2220] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:28:56 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1718 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:28:57.939117 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-5b795a26-b64e-4bc3-ab0b-b6e5300cb3c6 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:28:57.939717 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-5b795a26-b64e-4bc3-ab0b-b6e5300cb3c6 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:28:57.945700 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5b795a26-b64e-4bc3-ab0b-b6e5300cb3c6 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:28:57.946182 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5b795a26-b64e-4bc3-ab0b-b6e5300cb3c6 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:28:57.946621 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5b795a26-b64e-4bc3-ab0b-b6e5300cb3c6 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:28:57.947311 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5b795a26-b64e-4bc3-ab0b-b6e5300cb3c6 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:28:57.948271 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5b795a26-b64e-4bc3-ab0b-b6e5300cb3c6 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:28:57.948764 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5b795a26-b64e-4bc3-ab0b-b6e5300cb3c6 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:28:58.076975 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-5b795a26-b64e-4bc3-ab0b-b6e5300cb3c6 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:28:58.085290 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-5b795a26-b64e-4bc3-ab0b-b6e5300cb3c6 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1718 microversion: 2.1 time: 0.150222 Oct 20 06:28:58.085888 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1105/2221] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:28:57 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1718 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:28:59.109877 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-9570b7ac-a18d-4b8e-bbb5-7e0908f0d03c tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:28:59.110517 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-9570b7ac-a18d-4b8e-bbb5-7e0908f0d03c tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:28:59.117072 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-9570b7ac-a18d-4b8e-bbb5-7e0908f0d03c tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:28:59.117551 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-9570b7ac-a18d-4b8e-bbb5-7e0908f0d03c tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:28:59.117985 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-9570b7ac-a18d-4b8e-bbb5-7e0908f0d03c tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:28:59.118673 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-9570b7ac-a18d-4b8e-bbb5-7e0908f0d03c tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:28:59.119126 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-9570b7ac-a18d-4b8e-bbb5-7e0908f0d03c tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:28:59.119549 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-9570b7ac-a18d-4b8e-bbb5-7e0908f0d03c tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:28:59.257393 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-9570b7ac-a18d-4b8e-bbb5-7e0908f0d03c tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:28:59.267281 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-9570b7ac-a18d-4b8e-bbb5-7e0908f0d03c tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1718 microversion: 2.1 time: 0.161190 Oct 20 06:28:59.268076 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1117/2222] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:28:59 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1718 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 06:29:00.290855 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-09ddf55f-71bd-4e8f-ab74-d8ddd92d8715 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:29:00.291483 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-09ddf55f-71bd-4e8f-ab74-d8ddd92d8715 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:29:00.298942 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-09ddf55f-71bd-4e8f-ab74-d8ddd92d8715 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:29:00.299576 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-09ddf55f-71bd-4e8f-ab74-d8ddd92d8715 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:29:00.300021 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-09ddf55f-71bd-4e8f-ab74-d8ddd92d8715 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:29:00.300841 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-09ddf55f-71bd-4e8f-ab74-d8ddd92d8715 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:29:00.301304 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-09ddf55f-71bd-4e8f-ab74-d8ddd92d8715 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:29:00.301740 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-09ddf55f-71bd-4e8f-ab74-d8ddd92d8715 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:29:00.441841 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-09ddf55f-71bd-4e8f-ab74-d8ddd92d8715 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:29:00.450311 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-09ddf55f-71bd-4e8f-ab74-d8ddd92d8715 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1718 microversion: 2.1 time: 0.163285 Oct 20 06:29:00.451119 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1106/2223] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:29:00 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1718 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:29:01.473265 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-7ee1b0b3-8f81-47ee-9474-0d7c33de2a0d tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:29:01.473873 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-7ee1b0b3-8f81-47ee-9474-0d7c33de2a0d tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:29:01.480550 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7ee1b0b3-8f81-47ee-9474-0d7c33de2a0d tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:29:01.481058 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7ee1b0b3-8f81-47ee-9474-0d7c33de2a0d tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:29:01.481502 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7ee1b0b3-8f81-47ee-9474-0d7c33de2a0d tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:29:01.482209 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7ee1b0b3-8f81-47ee-9474-0d7c33de2a0d tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:29:01.482653 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7ee1b0b3-8f81-47ee-9474-0d7c33de2a0d tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:29:01.483072 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7ee1b0b3-8f81-47ee-9474-0d7c33de2a0d tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:29:01.612776 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-7ee1b0b3-8f81-47ee-9474-0d7c33de2a0d tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:29:01.621434 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-7ee1b0b3-8f81-47ee-9474-0d7c33de2a0d tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1718 microversion: 2.1 time: 0.152004 Oct 20 06:29:01.621999 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1118/2224] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:29:01 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1718 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:29:02.645931 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-d63f3412-6bff-4a73-99a5-9e9dcb512d0b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:29:02.646538 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-d63f3412-6bff-4a73-99a5-9e9dcb512d0b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:29:02.653888 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d63f3412-6bff-4a73-99a5-9e9dcb512d0b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:29:02.654372 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d63f3412-6bff-4a73-99a5-9e9dcb512d0b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:29:02.654803 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d63f3412-6bff-4a73-99a5-9e9dcb512d0b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:29:02.655491 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d63f3412-6bff-4a73-99a5-9e9dcb512d0b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:29:02.655941 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d63f3412-6bff-4a73-99a5-9e9dcb512d0b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:29:02.656361 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d63f3412-6bff-4a73-99a5-9e9dcb512d0b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:29:02.937812 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-d63f3412-6bff-4a73-99a5-9e9dcb512d0b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:29:02.946021 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-d63f3412-6bff-4a73-99a5-9e9dcb512d0b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1718 microversion: 2.1 time: 0.303982 Oct 20 06:29:02.946580 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1107/2225] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:29:02 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1718 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:29:03.969513 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-b6f3c71f-1d34-47c3-b014-ebc9e7c319e2 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:29:03.970160 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-b6f3c71f-1d34-47c3-b014-ebc9e7c319e2 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:29:03.972503 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG dbcounter [-] [118860] Writing DB stats nova_api:SELECT=28 {{(pid=118860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:29:03.977834 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b6f3c71f-1d34-47c3-b014-ebc9e7c319e2 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:29:03.978327 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b6f3c71f-1d34-47c3-b014-ebc9e7c319e2 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:29:03.978766 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b6f3c71f-1d34-47c3-b014-ebc9e7c319e2 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:29:03.979469 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b6f3c71f-1d34-47c3-b014-ebc9e7c319e2 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:29:03.979929 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b6f3c71f-1d34-47c3-b014-ebc9e7c319e2 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:29:03.980355 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b6f3c71f-1d34-47c3-b014-ebc9e7c319e2 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:29:03.983298 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG dbcounter [-] [118860] Writing DB stats nova_cell1:SELECT=80 {{(pid=118860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:29:04.119920 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-b6f3c71f-1d34-47c3-b014-ebc9e7c319e2 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:29:04.128992 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-b6f3c71f-1d34-47c3-b014-ebc9e7c319e2 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1718 microversion: 2.1 time: 0.163314 Oct 20 06:29:04.129572 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1119/2226] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:29:03 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1718 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:29:05.153285 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-1f52e4b7-5ae6-4991-a8e1-ddb78305a383 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:29:05.153903 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-1f52e4b7-5ae6-4991-a8e1-ddb78305a383 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:29:05.161324 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1f52e4b7-5ae6-4991-a8e1-ddb78305a383 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:29:05.161813 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1f52e4b7-5ae6-4991-a8e1-ddb78305a383 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:29:05.162256 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1f52e4b7-5ae6-4991-a8e1-ddb78305a383 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:29:05.162970 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1f52e4b7-5ae6-4991-a8e1-ddb78305a383 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:29:05.163431 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1f52e4b7-5ae6-4991-a8e1-ddb78305a383 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:29:05.163852 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1f52e4b7-5ae6-4991-a8e1-ddb78305a383 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:29:05.291860 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-1f52e4b7-5ae6-4991-a8e1-ddb78305a383 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:29:05.302698 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-1f52e4b7-5ae6-4991-a8e1-ddb78305a383 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1718 microversion: 2.1 time: 0.153306 Oct 20 06:29:05.316716 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1108/2227] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:29:05 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1718 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:29:06.326632 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-3df8e017-dd6d-4db5-beea-49258dc34733 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:29:06.327394 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-3df8e017-dd6d-4db5-beea-49258dc34733 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:29:06.333990 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3df8e017-dd6d-4db5-beea-49258dc34733 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:29:06.334470 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3df8e017-dd6d-4db5-beea-49258dc34733 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:29:06.334901 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3df8e017-dd6d-4db5-beea-49258dc34733 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:29:06.335593 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3df8e017-dd6d-4db5-beea-49258dc34733 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:29:06.336040 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3df8e017-dd6d-4db5-beea-49258dc34733 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:29:06.336462 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3df8e017-dd6d-4db5-beea-49258dc34733 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:29:06.467616 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-3df8e017-dd6d-4db5-beea-49258dc34733 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:29:06.476146 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-3df8e017-dd6d-4db5-beea-49258dc34733 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1718 microversion: 2.1 time: 0.154175 Oct 20 06:29:06.476731 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1120/2228] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:29:06 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1718 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 06:29:07.499000 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-ac4d6cfb-f300-4211-93f1-05bd9b8827ca tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:29:07.501578 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-ac4d6cfb-f300-4211-93f1-05bd9b8827ca tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:29:07.502064 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG dbcounter [-] [118861] Writing DB stats nova_api:SELECT=26 {{(pid=118861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:29:07.508268 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ac4d6cfb-f300-4211-93f1-05bd9b8827ca tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:29:07.508806 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ac4d6cfb-f300-4211-93f1-05bd9b8827ca tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:29:07.509253 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ac4d6cfb-f300-4211-93f1-05bd9b8827ca tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:29:07.510219 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ac4d6cfb-f300-4211-93f1-05bd9b8827ca tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:29:07.511272 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ac4d6cfb-f300-4211-93f1-05bd9b8827ca tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:29:07.511706 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ac4d6cfb-f300-4211-93f1-05bd9b8827ca tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:29:07.514793 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG dbcounter [-] [118861] Writing DB stats nova_cell1:SELECT=74 {{(pid=118861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:29:07.646638 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-ac4d6cfb-f300-4211-93f1-05bd9b8827ca tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:29:07.654952 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-ac4d6cfb-f300-4211-93f1-05bd9b8827ca tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1718 microversion: 2.1 time: 0.160457 Oct 20 06:29:07.655513 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1109/2229] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:29:07 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1718 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:29:08.679867 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-c39919c4-2b40-4d6a-82a0-49663f57d347 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:29:08.680517 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-c39919c4-2b40-4d6a-82a0-49663f57d347 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:29:08.688054 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c39919c4-2b40-4d6a-82a0-49663f57d347 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:29:08.688537 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c39919c4-2b40-4d6a-82a0-49663f57d347 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:29:08.688998 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c39919c4-2b40-4d6a-82a0-49663f57d347 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:29:08.689806 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c39919c4-2b40-4d6a-82a0-49663f57d347 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:29:08.690260 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c39919c4-2b40-4d6a-82a0-49663f57d347 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:29:08.690680 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c39919c4-2b40-4d6a-82a0-49663f57d347 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:29:08.822394 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-c39919c4-2b40-4d6a-82a0-49663f57d347 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:29:08.830796 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-c39919c4-2b40-4d6a-82a0-49663f57d347 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1718 microversion: 2.1 time: 0.155126 Oct 20 06:29:08.831363 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1121/2230] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:29:08 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1718 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:29:09.855545 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-d151e532-c87f-4f66-8785-2c40792b2784 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:29:09.856331 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-d151e532-c87f-4f66-8785-2c40792b2784 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:29:09.863147 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d151e532-c87f-4f66-8785-2c40792b2784 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:29:09.863640 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d151e532-c87f-4f66-8785-2c40792b2784 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:29:09.864091 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d151e532-c87f-4f66-8785-2c40792b2784 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:29:09.864835 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d151e532-c87f-4f66-8785-2c40792b2784 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:29:09.865285 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d151e532-c87f-4f66-8785-2c40792b2784 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:29:09.865714 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d151e532-c87f-4f66-8785-2c40792b2784 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:29:09.998461 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-d151e532-c87f-4f66-8785-2c40792b2784 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:29:10.006948 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-d151e532-c87f-4f66-8785-2c40792b2784 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1718 microversion: 2.1 time: 0.155913 Oct 20 06:29:10.007517 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1110/2231] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:29:09 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1718 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:29:11.031345 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-73d8329f-93c6-4902-bf34-419b9bfaf13d tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:29:11.031970 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-73d8329f-93c6-4902-bf34-419b9bfaf13d tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:29:11.038993 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-73d8329f-93c6-4902-bf34-419b9bfaf13d tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:29:11.039481 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-73d8329f-93c6-4902-bf34-419b9bfaf13d tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:29:11.039918 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-73d8329f-93c6-4902-bf34-419b9bfaf13d tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:29:11.040620 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-73d8329f-93c6-4902-bf34-419b9bfaf13d tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:29:11.041103 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-73d8329f-93c6-4902-bf34-419b9bfaf13d tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:29:11.041534 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-73d8329f-93c6-4902-bf34-419b9bfaf13d tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:29:11.175077 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-73d8329f-93c6-4902-bf34-419b9bfaf13d tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:29:11.184020 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-73d8329f-93c6-4902-bf34-419b9bfaf13d tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1718 microversion: 2.1 time: 0.157222 Oct 20 06:29:11.184611 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1122/2232] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:29:11 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1718 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:29:12.207458 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-4ad7f31a-0851-4db1-aadb-49bfffe87259 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:29:12.208370 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-4ad7f31a-0851-4db1-aadb-49bfffe87259 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:29:12.215784 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4ad7f31a-0851-4db1-aadb-49bfffe87259 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:29:12.216268 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4ad7f31a-0851-4db1-aadb-49bfffe87259 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:29:12.216727 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4ad7f31a-0851-4db1-aadb-49bfffe87259 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:29:12.217445 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4ad7f31a-0851-4db1-aadb-49bfffe87259 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:29:12.217906 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4ad7f31a-0851-4db1-aadb-49bfffe87259 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:29:12.218366 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4ad7f31a-0851-4db1-aadb-49bfffe87259 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:29:12.353005 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-4ad7f31a-0851-4db1-aadb-49bfffe87259 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:29:12.361956 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-4ad7f31a-0851-4db1-aadb-49bfffe87259 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1718 microversion: 2.1 time: 0.158360 Oct 20 06:29:12.362729 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1111/2233] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:29:12 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1718 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:29:13.385855 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-7f958846-08b9-4229-8c01-39a15c33ac8c tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:29:13.386455 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-7f958846-08b9-4229-8c01-39a15c33ac8c tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:29:13.392948 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7f958846-08b9-4229-8c01-39a15c33ac8c tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:29:13.393562 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7f958846-08b9-4229-8c01-39a15c33ac8c tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:29:13.394001 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7f958846-08b9-4229-8c01-39a15c33ac8c tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:29:13.394682 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7f958846-08b9-4229-8c01-39a15c33ac8c tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:29:13.395130 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7f958846-08b9-4229-8c01-39a15c33ac8c tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:29:13.395550 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7f958846-08b9-4229-8c01-39a15c33ac8c tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:29:13.523471 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-7f958846-08b9-4229-8c01-39a15c33ac8c tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:29:13.532166 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-7f958846-08b9-4229-8c01-39a15c33ac8c tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1718 microversion: 2.1 time: 0.150492 Oct 20 06:29:13.532752 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1123/2234] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:29:13 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1718 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:29:14.555472 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-6a3b43be-122e-4103-b04f-b951ddc47049 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:29:14.556170 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-6a3b43be-122e-4103-b04f-b951ddc47049 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:29:14.562726 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-6a3b43be-122e-4103-b04f-b951ddc47049 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:29:14.563210 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-6a3b43be-122e-4103-b04f-b951ddc47049 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:29:14.563649 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-6a3b43be-122e-4103-b04f-b951ddc47049 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:29:14.564345 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-6a3b43be-122e-4103-b04f-b951ddc47049 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:29:14.564822 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-6a3b43be-122e-4103-b04f-b951ddc47049 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:29:14.565248 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-6a3b43be-122e-4103-b04f-b951ddc47049 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:29:14.695859 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-6a3b43be-122e-4103-b04f-b951ddc47049 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:29:14.704918 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-6a3b43be-122e-4103-b04f-b951ddc47049 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1718 microversion: 2.1 time: 0.153306 Oct 20 06:29:14.705573 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1112/2235] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:29:14 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1718 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:29:15.729018 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-c0e5b52a-f60d-4128-a763-be639beef149 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:29:15.730000 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-c0e5b52a-f60d-4128-a763-be639beef149 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:29:15.736525 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c0e5b52a-f60d-4128-a763-be639beef149 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:29:15.737069 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c0e5b52a-f60d-4128-a763-be639beef149 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:29:15.737537 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c0e5b52a-f60d-4128-a763-be639beef149 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:29:15.738225 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c0e5b52a-f60d-4128-a763-be639beef149 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:29:15.738674 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c0e5b52a-f60d-4128-a763-be639beef149 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:29:15.739094 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c0e5b52a-f60d-4128-a763-be639beef149 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:29:15.873758 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-c0e5b52a-f60d-4128-a763-be639beef149 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:29:15.882038 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-c0e5b52a-f60d-4128-a763-be639beef149 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1718 microversion: 2.1 time: 0.156924 Oct 20 06:29:15.882600 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1124/2236] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:29:15 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1718 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:29:16.906294 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-002cb5aa-7b56-41a1-8767-0d3a84e10ce3 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:29:16.907068 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-002cb5aa-7b56-41a1-8767-0d3a84e10ce3 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:29:16.913640 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-002cb5aa-7b56-41a1-8767-0d3a84e10ce3 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:29:16.914122 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-002cb5aa-7b56-41a1-8767-0d3a84e10ce3 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:29:16.914561 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-002cb5aa-7b56-41a1-8767-0d3a84e10ce3 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:29:16.915255 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-002cb5aa-7b56-41a1-8767-0d3a84e10ce3 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:29:16.915707 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-002cb5aa-7b56-41a1-8767-0d3a84e10ce3 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:29:16.916136 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-002cb5aa-7b56-41a1-8767-0d3a84e10ce3 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:29:17.053042 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-002cb5aa-7b56-41a1-8767-0d3a84e10ce3 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:29:17.061789 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-002cb5aa-7b56-41a1-8767-0d3a84e10ce3 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1718 microversion: 2.1 time: 0.159611 Oct 20 06:29:17.062353 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1113/2237] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:29:16 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1718 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:29:18.085050 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-302102b6-31df-4e5e-84d9-38e3d7c4d1ea tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:29:18.085589 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-302102b6-31df-4e5e-84d9-38e3d7c4d1ea tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:29:18.092742 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-302102b6-31df-4e5e-84d9-38e3d7c4d1ea tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:29:18.093359 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-302102b6-31df-4e5e-84d9-38e3d7c4d1ea tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:29:18.093812 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-302102b6-31df-4e5e-84d9-38e3d7c4d1ea tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:29:18.094538 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-302102b6-31df-4e5e-84d9-38e3d7c4d1ea tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:29:18.095000 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-302102b6-31df-4e5e-84d9-38e3d7c4d1ea tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:29:18.095426 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-302102b6-31df-4e5e-84d9-38e3d7c4d1ea tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:29:18.226335 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-302102b6-31df-4e5e-84d9-38e3d7c4d1ea tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:29:18.234855 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-302102b6-31df-4e5e-84d9-38e3d7c4d1ea tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1718 microversion: 2.1 time: 0.153861 Oct 20 06:29:18.235426 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1125/2238] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:29:18 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1718 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:29:19.258820 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-326966a5-1a9d-4641-9c87-b04e27c9de79 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:29:19.259823 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-326966a5-1a9d-4641-9c87-b04e27c9de79 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:29:19.270255 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-326966a5-1a9d-4641-9c87-b04e27c9de79 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:29:19.270750 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-326966a5-1a9d-4641-9c87-b04e27c9de79 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:29:19.271185 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-326966a5-1a9d-4641-9c87-b04e27c9de79 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:29:19.271898 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-326966a5-1a9d-4641-9c87-b04e27c9de79 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:29:19.272350 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-326966a5-1a9d-4641-9c87-b04e27c9de79 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:29:19.272843 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-326966a5-1a9d-4641-9c87-b04e27c9de79 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:29:19.431776 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-326966a5-1a9d-4641-9c87-b04e27c9de79 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:29:19.442152 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-326966a5-1a9d-4641-9c87-b04e27c9de79 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1718 microversion: 2.1 time: 0.187848 Oct 20 06:29:19.442772 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1114/2239] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:29:19 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1718 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:29:20.466601 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-fbba7022-50ee-41f1-8c28-1a0e40f4ff22 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:29:20.467215 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-fbba7022-50ee-41f1-8c28-1a0e40f4ff22 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:29:20.473638 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-fbba7022-50ee-41f1-8c28-1a0e40f4ff22 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:29:20.474127 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-fbba7022-50ee-41f1-8c28-1a0e40f4ff22 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:29:20.474570 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-fbba7022-50ee-41f1-8c28-1a0e40f4ff22 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:29:20.475263 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-fbba7022-50ee-41f1-8c28-1a0e40f4ff22 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:29:20.475727 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-fbba7022-50ee-41f1-8c28-1a0e40f4ff22 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:29:20.476158 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-fbba7022-50ee-41f1-8c28-1a0e40f4ff22 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:29:20.644060 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-fbba7022-50ee-41f1-8c28-1a0e40f4ff22 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:29:20.652784 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-fbba7022-50ee-41f1-8c28-1a0e40f4ff22 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1718 microversion: 2.1 time: 0.190475 Oct 20 06:29:20.653550 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1126/2240] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:29:20 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1718 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:29:21.675920 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-a0af1153-8312-4acd-a78b-66f38dd8e089 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:29:21.676878 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-a0af1153-8312-4acd-a78b-66f38dd8e089 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:29:21.684271 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a0af1153-8312-4acd-a78b-66f38dd8e089 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:29:21.684772 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a0af1153-8312-4acd-a78b-66f38dd8e089 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:29:21.685210 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a0af1153-8312-4acd-a78b-66f38dd8e089 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:29:21.685904 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a0af1153-8312-4acd-a78b-66f38dd8e089 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:29:21.686353 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a0af1153-8312-4acd-a78b-66f38dd8e089 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:29:21.686778 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a0af1153-8312-4acd-a78b-66f38dd8e089 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:29:21.822177 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-a0af1153-8312-4acd-a78b-66f38dd8e089 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:29:21.831771 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-a0af1153-8312-4acd-a78b-66f38dd8e089 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1718 microversion: 2.1 time: 0.159650 Oct 20 06:29:21.843480 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1115/2241] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:29:21 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1718 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:29:22.857723 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-df6c57e9-a419-4c28-a790-e54afc06b626 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:29:22.858261 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-df6c57e9-a419-4c28-a790-e54afc06b626 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:29:22.864315 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-df6c57e9-a419-4c28-a790-e54afc06b626 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:29:22.864837 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-df6c57e9-a419-4c28-a790-e54afc06b626 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:29:22.865281 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-df6c57e9-a419-4c28-a790-e54afc06b626 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:29:22.865977 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-df6c57e9-a419-4c28-a790-e54afc06b626 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:29:22.866437 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-df6c57e9-a419-4c28-a790-e54afc06b626 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:29:22.866868 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-df6c57e9-a419-4c28-a790-e54afc06b626 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:29:22.998367 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-df6c57e9-a419-4c28-a790-e54afc06b626 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:29:23.006728 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-df6c57e9-a419-4c28-a790-e54afc06b626 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1718 microversion: 2.1 time: 0.153380 Oct 20 06:29:23.007284 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1127/2242] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:29:22 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1718 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:29:24.032493 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-6866319f-1a9c-434f-800d-ce31f521a648 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:29:24.033124 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-6866319f-1a9c-434f-800d-ce31f521a648 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:29:24.039549 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-6866319f-1a9c-434f-800d-ce31f521a648 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:29:24.040034 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-6866319f-1a9c-434f-800d-ce31f521a648 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:29:24.040469 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-6866319f-1a9c-434f-800d-ce31f521a648 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:29:24.041185 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-6866319f-1a9c-434f-800d-ce31f521a648 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:29:24.042684 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-6866319f-1a9c-434f-800d-ce31f521a648 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:29:24.042684 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-6866319f-1a9c-434f-800d-ce31f521a648 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:29:24.178552 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-6866319f-1a9c-434f-800d-ce31f521a648 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:29:24.187091 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-6866319f-1a9c-434f-800d-ce31f521a648 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1718 microversion: 2.1 time: 0.159833 Oct 20 06:29:24.187599 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1116/2243] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:29:24 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1718 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:29:25.210509 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-4bdf55a3-4d92-47af-aa53-9cb41d55dc22 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:29:25.211117 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-4bdf55a3-4d92-47af-aa53-9cb41d55dc22 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:29:25.218172 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-4bdf55a3-4d92-47af-aa53-9cb41d55dc22 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:29:25.218650 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-4bdf55a3-4d92-47af-aa53-9cb41d55dc22 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:29:25.219088 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-4bdf55a3-4d92-47af-aa53-9cb41d55dc22 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:29:25.219784 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-4bdf55a3-4d92-47af-aa53-9cb41d55dc22 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:29:25.220236 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-4bdf55a3-4d92-47af-aa53-9cb41d55dc22 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:29:25.220660 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-4bdf55a3-4d92-47af-aa53-9cb41d55dc22 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:29:25.350391 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-4bdf55a3-4d92-47af-aa53-9cb41d55dc22 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:29:25.358711 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-4bdf55a3-4d92-47af-aa53-9cb41d55dc22 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1718 microversion: 2.1 time: 0.152024 Oct 20 06:29:25.359271 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1128/2244] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:29:25 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1718 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:29:26.382522 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-09b9b129-65f5-4f38-bca3-002c808c8c8e tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:29:26.383127 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-09b9b129-65f5-4f38-bca3-002c808c8c8e tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:29:26.390420 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-09b9b129-65f5-4f38-bca3-002c808c8c8e tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:29:26.390895 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-09b9b129-65f5-4f38-bca3-002c808c8c8e tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:29:26.391325 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-09b9b129-65f5-4f38-bca3-002c808c8c8e tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:29:26.392010 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-09b9b129-65f5-4f38-bca3-002c808c8c8e tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:29:26.392480 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-09b9b129-65f5-4f38-bca3-002c808c8c8e tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:29:26.392926 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-09b9b129-65f5-4f38-bca3-002c808c8c8e tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:29:26.522412 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-09b9b129-65f5-4f38-bca3-002c808c8c8e tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:29:26.531059 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-09b9b129-65f5-4f38-bca3-002c808c8c8e tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1718 microversion: 2.1 time: 0.152406 Oct 20 06:29:26.531625 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1117/2245] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:29:26 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1718 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:29:27.555381 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-3d8151dc-1a84-499e-b1ed-92398835d982 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:29:27.556038 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-3d8151dc-1a84-499e-b1ed-92398835d982 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:29:27.562600 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3d8151dc-1a84-499e-b1ed-92398835d982 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:29:27.563087 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3d8151dc-1a84-499e-b1ed-92398835d982 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:29:27.563529 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3d8151dc-1a84-499e-b1ed-92398835d982 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:29:27.564223 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3d8151dc-1a84-499e-b1ed-92398835d982 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:29:27.564675 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3d8151dc-1a84-499e-b1ed-92398835d982 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:29:27.565128 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3d8151dc-1a84-499e-b1ed-92398835d982 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:29:27.697578 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-3d8151dc-1a84-499e-b1ed-92398835d982 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:29:27.706102 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-3d8151dc-1a84-499e-b1ed-92398835d982 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1718 microversion: 2.1 time: 0.154531 Oct 20 06:29:27.706679 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1129/2246] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:29:27 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1718 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:29:28.730743 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-b895ff23-5b49-4459-b5f8-4e02d70bb4e4 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:29:28.731363 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-b895ff23-5b49-4459-b5f8-4e02d70bb4e4 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:29:28.738001 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b895ff23-5b49-4459-b5f8-4e02d70bb4e4 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:29:28.738500 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b895ff23-5b49-4459-b5f8-4e02d70bb4e4 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:29:28.738946 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b895ff23-5b49-4459-b5f8-4e02d70bb4e4 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:29:28.739664 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b895ff23-5b49-4459-b5f8-4e02d70bb4e4 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:29:28.740131 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b895ff23-5b49-4459-b5f8-4e02d70bb4e4 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:29:28.740560 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b895ff23-5b49-4459-b5f8-4e02d70bb4e4 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:29:28.876115 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-b895ff23-5b49-4459-b5f8-4e02d70bb4e4 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:29:28.884306 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-b895ff23-5b49-4459-b5f8-4e02d70bb4e4 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1718 microversion: 2.1 time: 0.158226 Oct 20 06:29:28.885158 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1118/2247] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:29:28 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1718 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:29:29.907808 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-2abd2537-73d7-46c4-a27b-b9b8e4c9809b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:29:29.908434 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-2abd2537-73d7-46c4-a27b-b9b8e4c9809b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:29:29.914843 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2abd2537-73d7-46c4-a27b-b9b8e4c9809b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:29:29.915321 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2abd2537-73d7-46c4-a27b-b9b8e4c9809b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:29:29.915760 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2abd2537-73d7-46c4-a27b-b9b8e4c9809b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:29:29.916476 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2abd2537-73d7-46c4-a27b-b9b8e4c9809b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:29:29.917056 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2abd2537-73d7-46c4-a27b-b9b8e4c9809b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:29:29.917445 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2abd2537-73d7-46c4-a27b-b9b8e4c9809b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:29:30.048635 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-2abd2537-73d7-46c4-a27b-b9b8e4c9809b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:29:30.057788 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-2abd2537-73d7-46c4-a27b-b9b8e4c9809b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1718 microversion: 2.1 time: 0.153463 Oct 20 06:29:30.058364 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1130/2248] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:29:29 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1718 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:29:31.079887 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-2b0079f2-7343-488d-94bc-45d3b581317c tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:29:31.080608 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-2b0079f2-7343-488d-94bc-45d3b581317c tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:29:31.086990 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-2b0079f2-7343-488d-94bc-45d3b581317c tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:29:31.087466 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-2b0079f2-7343-488d-94bc-45d3b581317c tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:29:31.087898 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-2b0079f2-7343-488d-94bc-45d3b581317c tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:29:31.088640 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-2b0079f2-7343-488d-94bc-45d3b581317c tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:29:31.089118 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-2b0079f2-7343-488d-94bc-45d3b581317c tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:29:31.089535 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-2b0079f2-7343-488d-94bc-45d3b581317c tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:29:31.220339 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-2b0079f2-7343-488d-94bc-45d3b581317c tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:29:31.228598 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-2b0079f2-7343-488d-94bc-45d3b581317c tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1718 microversion: 2.1 time: 0.152533 Oct 20 06:29:31.229833 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1119/2249] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:29:31 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1718 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:29:32.252552 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-0cb9d3b2-a2f5-4d29-b731-ef6caae6bf5a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:29:32.253298 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-0cb9d3b2-a2f5-4d29-b731-ef6caae6bf5a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:29:32.260109 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0cb9d3b2-a2f5-4d29-b731-ef6caae6bf5a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:29:32.260802 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0cb9d3b2-a2f5-4d29-b731-ef6caae6bf5a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:29:32.261250 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0cb9d3b2-a2f5-4d29-b731-ef6caae6bf5a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:29:32.261950 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0cb9d3b2-a2f5-4d29-b731-ef6caae6bf5a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:29:32.262408 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0cb9d3b2-a2f5-4d29-b731-ef6caae6bf5a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:29:32.262838 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0cb9d3b2-a2f5-4d29-b731-ef6caae6bf5a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:29:32.397808 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-0cb9d3b2-a2f5-4d29-b731-ef6caae6bf5a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:29:32.406756 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-0cb9d3b2-a2f5-4d29-b731-ef6caae6bf5a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1718 microversion: 2.1 time: 0.158091 Oct 20 06:29:32.407322 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1131/2250] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:29:32 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1718 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:29:33.430911 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-ef3e77be-a94e-4a80-b0f3-27ab65132c26 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:29:33.431487 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-ef3e77be-a94e-4a80-b0f3-27ab65132c26 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:29:33.437850 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ef3e77be-a94e-4a80-b0f3-27ab65132c26 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:29:33.438332 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ef3e77be-a94e-4a80-b0f3-27ab65132c26 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:29:33.438795 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ef3e77be-a94e-4a80-b0f3-27ab65132c26 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:29:33.439487 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ef3e77be-a94e-4a80-b0f3-27ab65132c26 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:29:33.439949 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ef3e77be-a94e-4a80-b0f3-27ab65132c26 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:29:33.440378 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ef3e77be-a94e-4a80-b0f3-27ab65132c26 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:29:33.572348 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-ef3e77be-a94e-4a80-b0f3-27ab65132c26 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:29:33.580756 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-ef3e77be-a94e-4a80-b0f3-27ab65132c26 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1718 microversion: 2.1 time: 0.153764 Oct 20 06:29:33.581316 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1120/2251] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:29:33 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1718 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 06:29:34.603705 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-3640a2f2-ba1f-40a9-8021-a7d25b20f025 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:29:34.604342 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-3640a2f2-ba1f-40a9-8021-a7d25b20f025 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:29:34.607044 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG dbcounter [-] [118860] Writing DB stats nova_api:SELECT=26 {{(pid=118860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:29:34.613031 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3640a2f2-ba1f-40a9-8021-a7d25b20f025 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:29:34.613530 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3640a2f2-ba1f-40a9-8021-a7d25b20f025 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:29:34.613973 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3640a2f2-ba1f-40a9-8021-a7d25b20f025 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:29:34.614680 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3640a2f2-ba1f-40a9-8021-a7d25b20f025 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:29:34.615136 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3640a2f2-ba1f-40a9-8021-a7d25b20f025 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:29:34.615564 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3640a2f2-ba1f-40a9-8021-a7d25b20f025 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:29:34.618427 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG dbcounter [-] [118860] Writing DB stats nova_cell1:SELECT=78 {{(pid=118860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:29:34.748379 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-3640a2f2-ba1f-40a9-8021-a7d25b20f025 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:29:34.757705 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-3640a2f2-ba1f-40a9-8021-a7d25b20f025 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1718 microversion: 2.1 time: 0.157929 Oct 20 06:29:34.758380 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1132/2252] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:29:34 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1718 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:29:35.784221 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-82c6fa06-91d7-4e1d-b2a4-a75742a2e4ff tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:29:35.784891 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-82c6fa06-91d7-4e1d-b2a4-a75742a2e4ff tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:29:35.791431 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-82c6fa06-91d7-4e1d-b2a4-a75742a2e4ff tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:29:35.791912 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-82c6fa06-91d7-4e1d-b2a4-a75742a2e4ff tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:29:35.792343 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-82c6fa06-91d7-4e1d-b2a4-a75742a2e4ff tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:29:35.793754 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-82c6fa06-91d7-4e1d-b2a4-a75742a2e4ff tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:29:35.794304 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-82c6fa06-91d7-4e1d-b2a4-a75742a2e4ff tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:29:35.794724 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-82c6fa06-91d7-4e1d-b2a4-a75742a2e4ff tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:29:35.932014 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-82c6fa06-91d7-4e1d-b2a4-a75742a2e4ff tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:29:35.940689 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-82c6fa06-91d7-4e1d-b2a4-a75742a2e4ff tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1718 microversion: 2.1 time: 0.160331 Oct 20 06:29:35.941283 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1121/2253] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:29:35 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1718 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:29:36.966238 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-326002f2-7f7e-4b91-8e33-a252df357a61 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:29:36.966852 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-326002f2-7f7e-4b91-8e33-a252df357a61 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:29:36.973531 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-326002f2-7f7e-4b91-8e33-a252df357a61 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:29:36.974021 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-326002f2-7f7e-4b91-8e33-a252df357a61 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:29:36.974462 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-326002f2-7f7e-4b91-8e33-a252df357a61 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:29:36.975159 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-326002f2-7f7e-4b91-8e33-a252df357a61 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:29:36.975643 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-326002f2-7f7e-4b91-8e33-a252df357a61 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:29:36.976074 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-326002f2-7f7e-4b91-8e33-a252df357a61 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:29:37.107651 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-326002f2-7f7e-4b91-8e33-a252df357a61 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:29:37.116222 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-326002f2-7f7e-4b91-8e33-a252df357a61 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1718 microversion: 2.1 time: 0.154378 Oct 20 06:29:37.131819 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1133/2254] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:29:36 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1718 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:29:38.140049 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-9608480e-8f02-4eae-a590-7e76229982f4 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:29:38.140830 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-9608480e-8f02-4eae-a590-7e76229982f4 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:29:38.143454 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG dbcounter [-] [118861] Writing DB stats nova_api:SELECT=26 {{(pid=118861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:29:38.148917 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-9608480e-8f02-4eae-a590-7e76229982f4 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:29:38.149427 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-9608480e-8f02-4eae-a590-7e76229982f4 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:29:38.149860 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-9608480e-8f02-4eae-a590-7e76229982f4 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:29:38.150550 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-9608480e-8f02-4eae-a590-7e76229982f4 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:29:38.150996 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-9608480e-8f02-4eae-a590-7e76229982f4 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:29:38.151424 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-9608480e-8f02-4eae-a590-7e76229982f4 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:29:38.154711 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG dbcounter [-] [118861] Writing DB stats nova_cell1:SELECT=78 {{(pid=118861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:29:38.282510 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-9608480e-8f02-4eae-a590-7e76229982f4 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:29:38.290763 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-9608480e-8f02-4eae-a590-7e76229982f4 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1718 microversion: 2.1 time: 0.154980 Oct 20 06:29:38.291325 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1122/2255] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:29:38 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1718 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:29:39.316254 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-c6a52f96-8ccb-4910-924a-c22381b6cdfa tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:29:39.316894 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-c6a52f96-8ccb-4910-924a-c22381b6cdfa tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:29:39.323399 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c6a52f96-8ccb-4910-924a-c22381b6cdfa tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:29:39.323879 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c6a52f96-8ccb-4910-924a-c22381b6cdfa tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:29:39.324318 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c6a52f96-8ccb-4910-924a-c22381b6cdfa tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:29:39.325097 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c6a52f96-8ccb-4910-924a-c22381b6cdfa tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:29:39.325554 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c6a52f96-8ccb-4910-924a-c22381b6cdfa tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:29:39.325982 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c6a52f96-8ccb-4910-924a-c22381b6cdfa tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:29:39.453546 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-c6a52f96-8ccb-4910-924a-c22381b6cdfa tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:29:39.461733 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-c6a52f96-8ccb-4910-924a-c22381b6cdfa tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1718 microversion: 2.1 time: 0.149435 Oct 20 06:29:39.462299 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1134/2256] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:29:39 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1718 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:29:40.484525 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-1ff798ff-5470-4e71-88fa-4278f21a555e tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:29:40.485185 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-1ff798ff-5470-4e71-88fa-4278f21a555e tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:29:40.491642 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1ff798ff-5470-4e71-88fa-4278f21a555e tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:29:40.492138 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1ff798ff-5470-4e71-88fa-4278f21a555e tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:29:40.492568 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1ff798ff-5470-4e71-88fa-4278f21a555e tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:29:40.493283 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1ff798ff-5470-4e71-88fa-4278f21a555e tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:29:40.493733 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1ff798ff-5470-4e71-88fa-4278f21a555e tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:29:40.494157 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1ff798ff-5470-4e71-88fa-4278f21a555e tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:29:40.639998 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-1ff798ff-5470-4e71-88fa-4278f21a555e tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:29:40.648283 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-1ff798ff-5470-4e71-88fa-4278f21a555e tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1718 microversion: 2.1 time: 0.167676 Oct 20 06:29:40.649120 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1123/2257] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:29:40 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1718 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:29:41.671994 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-ed7fb913-651d-42b3-ae28-e18a3c5bb070 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:29:41.672687 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-ed7fb913-651d-42b3-ae28-e18a3c5bb070 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:29:41.679185 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-ed7fb913-651d-42b3-ae28-e18a3c5bb070 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:29:41.679674 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-ed7fb913-651d-42b3-ae28-e18a3c5bb070 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:29:41.680110 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-ed7fb913-651d-42b3-ae28-e18a3c5bb070 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:29:41.680828 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-ed7fb913-651d-42b3-ae28-e18a3c5bb070 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:29:41.681283 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-ed7fb913-651d-42b3-ae28-e18a3c5bb070 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:29:41.681710 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-ed7fb913-651d-42b3-ae28-e18a3c5bb070 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:29:41.811224 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-ed7fb913-651d-42b3-ae28-e18a3c5bb070 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:29:41.819600 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-ed7fb913-651d-42b3-ae28-e18a3c5bb070 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1718 microversion: 2.1 time: 0.151790 Oct 20 06:29:41.820171 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1135/2258] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:29:41 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1718 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:29:42.845986 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-6ae3e11a-eb50-47c4-9fe2-eefc11267175 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:29:42.846602 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-6ae3e11a-eb50-47c4-9fe2-eefc11267175 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:29:42.853149 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-6ae3e11a-eb50-47c4-9fe2-eefc11267175 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:29:42.853632 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-6ae3e11a-eb50-47c4-9fe2-eefc11267175 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:29:42.854069 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-6ae3e11a-eb50-47c4-9fe2-eefc11267175 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:29:42.854764 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-6ae3e11a-eb50-47c4-9fe2-eefc11267175 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:29:42.855217 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-6ae3e11a-eb50-47c4-9fe2-eefc11267175 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:29:42.855644 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-6ae3e11a-eb50-47c4-9fe2-eefc11267175 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:29:42.985533 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-6ae3e11a-eb50-47c4-9fe2-eefc11267175 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:29:42.994020 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-6ae3e11a-eb50-47c4-9fe2-eefc11267175 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1718 microversion: 2.1 time: 0.151857 Oct 20 06:29:42.994602 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1124/2259] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:29:42 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1718 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 06:29:44.018448 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-72bcbd44-c095-4ef6-a153-5506b7d0f048 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:29:44.019043 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-72bcbd44-c095-4ef6-a153-5506b7d0f048 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:29:44.025544 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-72bcbd44-c095-4ef6-a153-5506b7d0f048 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:29:44.026028 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-72bcbd44-c095-4ef6-a153-5506b7d0f048 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:29:44.026468 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-72bcbd44-c095-4ef6-a153-5506b7d0f048 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:29:44.027158 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-72bcbd44-c095-4ef6-a153-5506b7d0f048 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:29:44.027674 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-72bcbd44-c095-4ef6-a153-5506b7d0f048 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:29:44.028182 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-72bcbd44-c095-4ef6-a153-5506b7d0f048 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:29:44.162546 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-72bcbd44-c095-4ef6-a153-5506b7d0f048 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:29:44.171611 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-72bcbd44-c095-4ef6-a153-5506b7d0f048 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1718 microversion: 2.1 time: 0.157017 Oct 20 06:29:44.172180 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1136/2260] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:29:44 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1718 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:29:45.194892 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-6aa39990-eb01-4fcb-8370-f8ff1cf65013 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:29:45.195579 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-6aa39990-eb01-4fcb-8370-f8ff1cf65013 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:29:45.202099 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-6aa39990-eb01-4fcb-8370-f8ff1cf65013 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:29:45.202570 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-6aa39990-eb01-4fcb-8370-f8ff1cf65013 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:29:45.203002 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-6aa39990-eb01-4fcb-8370-f8ff1cf65013 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:29:45.203683 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-6aa39990-eb01-4fcb-8370-f8ff1cf65013 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:29:45.204127 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-6aa39990-eb01-4fcb-8370-f8ff1cf65013 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:29:45.204543 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-6aa39990-eb01-4fcb-8370-f8ff1cf65013 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:29:45.344569 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-6aa39990-eb01-4fcb-8370-f8ff1cf65013 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:29:45.353220 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-6aa39990-eb01-4fcb-8370-f8ff1cf65013 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1718 microversion: 2.1 time: 0.162057 Oct 20 06:29:45.353806 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1125/2261] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:29:45 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1718 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:29:46.378124 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-9c8b48b1-de69-4b24-a8ad-b3c816539b14 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:29:46.378769 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-9c8b48b1-de69-4b24-a8ad-b3c816539b14 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:29:46.385608 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-9c8b48b1-de69-4b24-a8ad-b3c816539b14 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:29:46.386087 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-9c8b48b1-de69-4b24-a8ad-b3c816539b14 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:29:46.386523 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-9c8b48b1-de69-4b24-a8ad-b3c816539b14 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:29:46.388345 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-9c8b48b1-de69-4b24-a8ad-b3c816539b14 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:29:46.388841 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-9c8b48b1-de69-4b24-a8ad-b3c816539b14 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:29:46.389282 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-9c8b48b1-de69-4b24-a8ad-b3c816539b14 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:29:46.525756 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-9c8b48b1-de69-4b24-a8ad-b3c816539b14 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:29:46.534151 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-9c8b48b1-de69-4b24-a8ad-b3c816539b14 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1718 microversion: 2.1 time: 0.159892 Oct 20 06:29:46.534719 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1137/2262] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:29:46 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1718 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:29:47.557662 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-46a3c57c-bd1f-4dd5-a8cf-9f68ca73b2dd tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:29:47.558196 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-46a3c57c-bd1f-4dd5-a8cf-9f68ca73b2dd tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:29:47.565455 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-46a3c57c-bd1f-4dd5-a8cf-9f68ca73b2dd tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:29:47.565926 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-46a3c57c-bd1f-4dd5-a8cf-9f68ca73b2dd tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:29:47.566358 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-46a3c57c-bd1f-4dd5-a8cf-9f68ca73b2dd tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:29:47.567049 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-46a3c57c-bd1f-4dd5-a8cf-9f68ca73b2dd tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:29:47.567496 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-46a3c57c-bd1f-4dd5-a8cf-9f68ca73b2dd tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:29:47.567916 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-46a3c57c-bd1f-4dd5-a8cf-9f68ca73b2dd tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:29:47.697877 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-46a3c57c-bd1f-4dd5-a8cf-9f68ca73b2dd tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:29:47.708554 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-46a3c57c-bd1f-4dd5-a8cf-9f68ca73b2dd tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1718 microversion: 2.1 time: 0.154775 Oct 20 06:29:47.709152 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1126/2263] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:29:47 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1718 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 06:29:48.736095 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-570a95a0-2d09-46f3-b104-136d274d038c tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:29:48.736798 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-570a95a0-2d09-46f3-b104-136d274d038c tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:29:48.743197 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-570a95a0-2d09-46f3-b104-136d274d038c tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:29:48.743678 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-570a95a0-2d09-46f3-b104-136d274d038c tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:29:48.744118 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-570a95a0-2d09-46f3-b104-136d274d038c tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:29:48.744834 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-570a95a0-2d09-46f3-b104-136d274d038c tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:29:48.745294 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-570a95a0-2d09-46f3-b104-136d274d038c tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:29:48.745717 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-570a95a0-2d09-46f3-b104-136d274d038c tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:29:48.881598 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-570a95a0-2d09-46f3-b104-136d274d038c tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:29:48.890099 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-570a95a0-2d09-46f3-b104-136d274d038c tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1718 microversion: 2.1 time: 0.157869 Oct 20 06:29:48.890666 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1138/2264] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:29:48 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1718 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:29:49.913487 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-284bd740-b8ab-4a1a-b3af-b5af63feba83 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:29:49.914127 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-284bd740-b8ab-4a1a-b3af-b5af63feba83 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:29:49.920621 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-284bd740-b8ab-4a1a-b3af-b5af63feba83 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:29:49.921147 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-284bd740-b8ab-4a1a-b3af-b5af63feba83 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:29:49.921587 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-284bd740-b8ab-4a1a-b3af-b5af63feba83 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:29:49.922287 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-284bd740-b8ab-4a1a-b3af-b5af63feba83 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:29:49.922739 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-284bd740-b8ab-4a1a-b3af-b5af63feba83 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:29:49.923163 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-284bd740-b8ab-4a1a-b3af-b5af63feba83 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:29:50.052482 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-284bd740-b8ab-4a1a-b3af-b5af63feba83 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:29:50.061487 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-284bd740-b8ab-4a1a-b3af-b5af63feba83 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1718 microversion: 2.1 time: 0.151857 Oct 20 06:29:50.062694 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1127/2265] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:29:49 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1718 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:29:51.084977 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-97b66a0e-b82e-47fc-9684-79a6a9074aa8 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:29:51.085563 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-97b66a0e-b82e-47fc-9684-79a6a9074aa8 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:29:51.092517 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-97b66a0e-b82e-47fc-9684-79a6a9074aa8 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:29:51.093044 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-97b66a0e-b82e-47fc-9684-79a6a9074aa8 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:29:51.093467 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-97b66a0e-b82e-47fc-9684-79a6a9074aa8 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:29:51.094154 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-97b66a0e-b82e-47fc-9684-79a6a9074aa8 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:29:51.094606 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-97b66a0e-b82e-47fc-9684-79a6a9074aa8 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:29:51.095025 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-97b66a0e-b82e-47fc-9684-79a6a9074aa8 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:29:51.225310 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-97b66a0e-b82e-47fc-9684-79a6a9074aa8 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:29:51.234200 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-97b66a0e-b82e-47fc-9684-79a6a9074aa8 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1718 microversion: 2.1 time: 0.153251 Oct 20 06:29:51.234762 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1139/2266] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:29:51 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1718 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:29:52.257696 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-eb8bd036-8baf-41b3-a15f-4c55053398f3 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:29:52.258298 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-eb8bd036-8baf-41b3-a15f-4c55053398f3 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:29:52.265589 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-eb8bd036-8baf-41b3-a15f-4c55053398f3 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:29:52.266076 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-eb8bd036-8baf-41b3-a15f-4c55053398f3 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:29:52.266513 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-eb8bd036-8baf-41b3-a15f-4c55053398f3 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:29:52.267204 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-eb8bd036-8baf-41b3-a15f-4c55053398f3 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:29:52.267655 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-eb8bd036-8baf-41b3-a15f-4c55053398f3 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:29:52.268076 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-eb8bd036-8baf-41b3-a15f-4c55053398f3 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:29:52.399827 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-eb8bd036-8baf-41b3-a15f-4c55053398f3 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:29:52.408824 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-eb8bd036-8baf-41b3-a15f-4c55053398f3 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1718 microversion: 2.1 time: 0.154974 Oct 20 06:29:52.409394 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1128/2267] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:29:52 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1718 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:29:53.431739 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-914b9915-29ef-4a02-b853-0989c0a71864 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:29:53.432345 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-914b9915-29ef-4a02-b853-0989c0a71864 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:29:53.434560 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 20 06:29:53.434709 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: Thu Oct 20 06:29:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 (ip 10.222.0.20) !!! Oct 20 06:29:53.440788 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-914b9915-29ef-4a02-b853-0989c0a71864 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:29:53.441201 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-914b9915-29ef-4a02-b853-0989c0a71864 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:29:53.441630 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-914b9915-29ef-4a02-b853-0989c0a71864 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:29:53.442311 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-914b9915-29ef-4a02-b853-0989c0a71864 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:29:53.442758 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-914b9915-29ef-4a02-b853-0989c0a71864 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:29:53.443179 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-914b9915-29ef-4a02-b853-0989c0a71864 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:29:53.576531 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-914b9915-29ef-4a02-b853-0989c0a71864 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:29:53.584831 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-914b9915-29ef-4a02-b853-0989c0a71864 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1718 microversion: 2.1 time: 0.156921 Oct 20 06:29:53.585492 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1140/2268] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:29:53 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1718 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:29:54.609538 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-8db64d2a-15e2-4082-9f33-2b52b7132503 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:29:54.610062 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-8db64d2a-15e2-4082-9f33-2b52b7132503 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:29:54.616453 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-8db64d2a-15e2-4082-9f33-2b52b7132503 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:29:54.616974 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-8db64d2a-15e2-4082-9f33-2b52b7132503 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:29:54.617416 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-8db64d2a-15e2-4082-9f33-2b52b7132503 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:29:54.618104 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-8db64d2a-15e2-4082-9f33-2b52b7132503 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:29:54.618560 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-8db64d2a-15e2-4082-9f33-2b52b7132503 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:29:54.619021 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-8db64d2a-15e2-4082-9f33-2b52b7132503 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:29:54.752562 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-8db64d2a-15e2-4082-9f33-2b52b7132503 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:29:54.760999 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-8db64d2a-15e2-4082-9f33-2b52b7132503 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1718 microversion: 2.1 time: 0.155613 Oct 20 06:29:54.761577 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1129/2269] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:29:54 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1718 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:29:55.785353 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-fe9fa91a-335e-4268-a5bc-c8a9daad4abd tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:29:55.786598 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-fe9fa91a-335e-4268-a5bc-c8a9daad4abd tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:29:55.793521 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-fe9fa91a-335e-4268-a5bc-c8a9daad4abd tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:29:55.794072 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-fe9fa91a-335e-4268-a5bc-c8a9daad4abd tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:29:55.794518 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-fe9fa91a-335e-4268-a5bc-c8a9daad4abd tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:29:55.795229 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-fe9fa91a-335e-4268-a5bc-c8a9daad4abd tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:29:55.795683 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-fe9fa91a-335e-4268-a5bc-c8a9daad4abd tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:29:55.796115 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-fe9fa91a-335e-4268-a5bc-c8a9daad4abd tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:29:55.931703 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-fe9fa91a-335e-4268-a5bc-c8a9daad4abd tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:29:55.940487 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-fe9fa91a-335e-4268-a5bc-c8a9daad4abd tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1718 microversion: 2.1 time: 0.158934 Oct 20 06:29:55.941074 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1141/2270] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:29:55 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1718 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:29:56.963670 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-607558d0-4b9b-4c72-8c24-b7d59041f0a9 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:29:56.964284 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-607558d0-4b9b-4c72-8c24-b7d59041f0a9 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:29:56.971597 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-607558d0-4b9b-4c72-8c24-b7d59041f0a9 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:29:56.972086 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-607558d0-4b9b-4c72-8c24-b7d59041f0a9 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:29:56.972529 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-607558d0-4b9b-4c72-8c24-b7d59041f0a9 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:29:56.973267 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-607558d0-4b9b-4c72-8c24-b7d59041f0a9 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:29:56.973724 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-607558d0-4b9b-4c72-8c24-b7d59041f0a9 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:29:56.974154 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-607558d0-4b9b-4c72-8c24-b7d59041f0a9 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:29:57.109893 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-607558d0-4b9b-4c72-8c24-b7d59041f0a9 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:29:57.118706 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-607558d0-4b9b-4c72-8c24-b7d59041f0a9 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1718 microversion: 2.1 time: 0.158816 Oct 20 06:29:57.119586 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1130/2271] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:29:56 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1718 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:29:58.144073 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-bb489d1d-ca3b-43f1-adf7-ea2c3c11ccf8 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:29:58.145813 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-bb489d1d-ca3b-43f1-adf7-ea2c3c11ccf8 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:29:58.153017 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-bb489d1d-ca3b-43f1-adf7-ea2c3c11ccf8 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:29:58.153524 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-bb489d1d-ca3b-43f1-adf7-ea2c3c11ccf8 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:29:58.153968 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-bb489d1d-ca3b-43f1-adf7-ea2c3c11ccf8 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:29:58.154685 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-bb489d1d-ca3b-43f1-adf7-ea2c3c11ccf8 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:29:58.155144 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-bb489d1d-ca3b-43f1-adf7-ea2c3c11ccf8 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:29:58.155756 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-bb489d1d-ca3b-43f1-adf7-ea2c3c11ccf8 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:29:58.362843 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-bb489d1d-ca3b-43f1-adf7-ea2c3c11ccf8 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:29:58.371840 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-bb489d1d-ca3b-43f1-adf7-ea2c3c11ccf8 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1718 microversion: 2.1 time: 0.232306 Oct 20 06:29:58.372873 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1142/2272] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:29:58 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1718 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:29:59.396190 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-bfb1c546-adbc-4886-b22b-673515403495 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:29:59.396829 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-bfb1c546-adbc-4886-b22b-673515403495 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:29:59.404023 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-bfb1c546-adbc-4886-b22b-673515403495 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:29:59.404529 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-bfb1c546-adbc-4886-b22b-673515403495 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:29:59.404983 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-bfb1c546-adbc-4886-b22b-673515403495 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:29:59.405682 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-bfb1c546-adbc-4886-b22b-673515403495 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:29:59.406162 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-bfb1c546-adbc-4886-b22b-673515403495 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:29:59.406580 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-bfb1c546-adbc-4886-b22b-673515403495 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:29:59.535931 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-bfb1c546-adbc-4886-b22b-673515403495 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:29:59.544238 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-bfb1c546-adbc-4886-b22b-673515403495 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1718 microversion: 2.1 time: 0.152069 Oct 20 06:29:59.545114 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1131/2273] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:29:59 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1718 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:30:00.567612 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-ac2f4b84-50b0-4a5b-97e8-e472917813e3 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:30:00.568197 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-ac2f4b84-50b0-4a5b-97e8-e472917813e3 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:30:00.574734 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-ac2f4b84-50b0-4a5b-97e8-e472917813e3 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:30:00.575226 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-ac2f4b84-50b0-4a5b-97e8-e472917813e3 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:30:00.575668 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-ac2f4b84-50b0-4a5b-97e8-e472917813e3 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:30:00.576371 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-ac2f4b84-50b0-4a5b-97e8-e472917813e3 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:30:00.576855 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-ac2f4b84-50b0-4a5b-97e8-e472917813e3 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:30:00.577284 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-ac2f4b84-50b0-4a5b-97e8-e472917813e3 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:30:00.731436 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-ac2f4b84-50b0-4a5b-97e8-e472917813e3 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:30:00.739701 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-ac2f4b84-50b0-4a5b-97e8-e472917813e3 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1718 microversion: 2.1 time: 0.176085 Oct 20 06:30:00.740253 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1143/2274] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:30:00 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1718 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:30:01.764374 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-7bcaaed5-3414-4b58-9049-870e6a10a9d3 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:30:01.765139 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-7bcaaed5-3414-4b58-9049-870e6a10a9d3 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:30:01.771649 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7bcaaed5-3414-4b58-9049-870e6a10a9d3 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:30:01.772141 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7bcaaed5-3414-4b58-9049-870e6a10a9d3 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:30:01.772585 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7bcaaed5-3414-4b58-9049-870e6a10a9d3 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:30:01.773320 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7bcaaed5-3414-4b58-9049-870e6a10a9d3 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:30:01.773777 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7bcaaed5-3414-4b58-9049-870e6a10a9d3 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:30:01.774204 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7bcaaed5-3414-4b58-9049-870e6a10a9d3 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:30:01.903850 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-7bcaaed5-3414-4b58-9049-870e6a10a9d3 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:30:01.912499 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-7bcaaed5-3414-4b58-9049-870e6a10a9d3 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1718 microversion: 2.1 time: 0.152782 Oct 20 06:30:01.913111 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1132/2275] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:30:01 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1718 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:30:02.936322 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-99bd458c-c780-47c5-8075-d87a95064a0a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:30:02.936977 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-99bd458c-c780-47c5-8075-d87a95064a0a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:30:02.943362 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-99bd458c-c780-47c5-8075-d87a95064a0a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:30:02.943841 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-99bd458c-c780-47c5-8075-d87a95064a0a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:30:02.944275 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-99bd458c-c780-47c5-8075-d87a95064a0a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:30:02.944982 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-99bd458c-c780-47c5-8075-d87a95064a0a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:30:02.945430 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-99bd458c-c780-47c5-8075-d87a95064a0a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:30:02.945851 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-99bd458c-c780-47c5-8075-d87a95064a0a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:30:03.073060 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-99bd458c-c780-47c5-8075-d87a95064a0a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:30:03.082204 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-99bd458c-c780-47c5-8075-d87a95064a0a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1718 microversion: 2.1 time: 0.150219 Oct 20 06:30:03.082774 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1144/2276] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:30:02 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1718 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:30:04.106023 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-941c2c9b-0a23-4d7f-85b3-e0fed953823a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:30:04.107107 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-941c2c9b-0a23-4d7f-85b3-e0fed953823a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:30:04.113699 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-941c2c9b-0a23-4d7f-85b3-e0fed953823a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:30:04.114185 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-941c2c9b-0a23-4d7f-85b3-e0fed953823a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:30:04.114627 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-941c2c9b-0a23-4d7f-85b3-e0fed953823a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:30:04.115320 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-941c2c9b-0a23-4d7f-85b3-e0fed953823a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:30:04.115828 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-941c2c9b-0a23-4d7f-85b3-e0fed953823a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:30:04.116256 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-941c2c9b-0a23-4d7f-85b3-e0fed953823a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:30:04.252604 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-941c2c9b-0a23-4d7f-85b3-e0fed953823a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:30:04.261290 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-941c2c9b-0a23-4d7f-85b3-e0fed953823a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1718 microversion: 2.1 time: 0.159778 Oct 20 06:30:04.261903 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1133/2277] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:30:04 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1718 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:30:05.285012 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-72ebce2b-763b-49f8-abe5-8ee057b0dd65 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:30:05.285627 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-72ebce2b-763b-49f8-abe5-8ee057b0dd65 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:30:05.287912 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG dbcounter [-] [118860] Writing DB stats nova_api:SELECT=26 {{(pid=118860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:30:05.293374 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-72ebce2b-763b-49f8-abe5-8ee057b0dd65 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:30:05.293877 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-72ebce2b-763b-49f8-abe5-8ee057b0dd65 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:30:05.294317 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-72ebce2b-763b-49f8-abe5-8ee057b0dd65 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:30:05.295011 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-72ebce2b-763b-49f8-abe5-8ee057b0dd65 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:30:05.295474 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-72ebce2b-763b-49f8-abe5-8ee057b0dd65 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:30:05.295901 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-72ebce2b-763b-49f8-abe5-8ee057b0dd65 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:30:05.298704 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG dbcounter [-] [118860] Writing DB stats nova_cell1:SELECT=78 {{(pid=118860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:30:05.427939 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-72ebce2b-763b-49f8-abe5-8ee057b0dd65 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:30:05.436845 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-72ebce2b-763b-49f8-abe5-8ee057b0dd65 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1718 microversion: 2.1 time: 0.155754 Oct 20 06:30:05.437409 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1145/2278] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:30:05 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1718 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:30:06.459819 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-6136c10f-bccb-4440-bde2-90f20273f527 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:30:06.460433 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-6136c10f-bccb-4440-bde2-90f20273f527 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:30:06.467301 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-6136c10f-bccb-4440-bde2-90f20273f527 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:30:06.467781 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-6136c10f-bccb-4440-bde2-90f20273f527 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:30:06.468219 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-6136c10f-bccb-4440-bde2-90f20273f527 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:30:06.468933 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-6136c10f-bccb-4440-bde2-90f20273f527 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:30:06.469383 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-6136c10f-bccb-4440-bde2-90f20273f527 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:30:06.469805 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-6136c10f-bccb-4440-bde2-90f20273f527 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:30:06.601144 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-6136c10f-bccb-4440-bde2-90f20273f527 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:30:06.611439 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-6136c10f-bccb-4440-bde2-90f20273f527 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1718 microversion: 2.1 time: 0.155350 Oct 20 06:30:06.612045 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1134/2279] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:30:06 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1718 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:30:07.635930 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-1f12652b-fdc0-406d-822e-4f056585ec7b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:30:07.636544 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-1f12652b-fdc0-406d-822e-4f056585ec7b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:30:07.643388 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1f12652b-fdc0-406d-822e-4f056585ec7b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:30:07.643871 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1f12652b-fdc0-406d-822e-4f056585ec7b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:30:07.644303 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1f12652b-fdc0-406d-822e-4f056585ec7b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:30:07.645034 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1f12652b-fdc0-406d-822e-4f056585ec7b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:30:07.645480 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1f12652b-fdc0-406d-822e-4f056585ec7b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:30:07.645902 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1f12652b-fdc0-406d-822e-4f056585ec7b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:30:07.781333 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-1f12652b-fdc0-406d-822e-4f056585ec7b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:30:07.789717 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-1f12652b-fdc0-406d-822e-4f056585ec7b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1718 microversion: 2.1 time: 0.157966 Oct 20 06:30:07.790275 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1146/2280] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:30:07 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1718 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:30:08.813159 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-b512bbd0-8263-438d-9155-380151b2de73 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:30:08.813757 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-b512bbd0-8263-438d-9155-380151b2de73 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:30:08.816033 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG dbcounter [-] [118861] Writing DB stats nova_api:SELECT=26 {{(pid=118861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:30:08.821218 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b512bbd0-8263-438d-9155-380151b2de73 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:30:08.821701 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b512bbd0-8263-438d-9155-380151b2de73 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:30:08.822135 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b512bbd0-8263-438d-9155-380151b2de73 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:30:08.822827 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b512bbd0-8263-438d-9155-380151b2de73 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:30:08.823275 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b512bbd0-8263-438d-9155-380151b2de73 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:30:08.823692 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b512bbd0-8263-438d-9155-380151b2de73 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:30:08.826541 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG dbcounter [-] [118861] Writing DB stats nova_cell1:SELECT=78 {{(pid=118861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:30:08.956773 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-b512bbd0-8263-438d-9155-380151b2de73 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:30:08.965652 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-b512bbd0-8263-438d-9155-380151b2de73 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1718 microversion: 2.1 time: 0.155699 Oct 20 06:30:08.966378 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1135/2281] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:30:08 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1718 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:30:09.989232 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-36109342-acec-4965-82ce-8ccef4c03bbf tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:30:09.989754 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-36109342-acec-4965-82ce-8ccef4c03bbf tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:30:09.996948 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-36109342-acec-4965-82ce-8ccef4c03bbf tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:30:09.997427 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-36109342-acec-4965-82ce-8ccef4c03bbf tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:30:09.997865 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-36109342-acec-4965-82ce-8ccef4c03bbf tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:30:09.998553 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-36109342-acec-4965-82ce-8ccef4c03bbf tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:30:09.998998 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-36109342-acec-4965-82ce-8ccef4c03bbf tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:30:09.999418 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-36109342-acec-4965-82ce-8ccef4c03bbf tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:30:10.141293 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-36109342-acec-4965-82ce-8ccef4c03bbf tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:30:10.158219 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-36109342-acec-4965-82ce-8ccef4c03bbf tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1718 microversion: 2.1 time: 0.172852 Oct 20 06:30:10.159026 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1147/2282] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:30:09 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1718 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:30:11.182340 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-e44dab4d-f5b5-4f2f-b756-01501c03e187 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:30:11.183987 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-e44dab4d-f5b5-4f2f-b756-01501c03e187 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:30:11.190747 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e44dab4d-f5b5-4f2f-b756-01501c03e187 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:30:11.191237 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e44dab4d-f5b5-4f2f-b756-01501c03e187 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:30:11.191714 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e44dab4d-f5b5-4f2f-b756-01501c03e187 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:30:11.192447 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e44dab4d-f5b5-4f2f-b756-01501c03e187 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:30:11.192970 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e44dab4d-f5b5-4f2f-b756-01501c03e187 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:30:11.193410 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e44dab4d-f5b5-4f2f-b756-01501c03e187 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:30:11.336171 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-e44dab4d-f5b5-4f2f-b756-01501c03e187 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:30:11.346536 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-e44dab4d-f5b5-4f2f-b756-01501c03e187 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1718 microversion: 2.1 time: 0.168237 Oct 20 06:30:11.347471 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1136/2283] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:30:11 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1718 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:30:12.107425 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [req-bb1bff2c-3b9f-4501-987b-897b219a276c req-f723c0e5-0498-4501-a303-e64e096980d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42fc4539-f891-4ab5-b30a-4bfe5033db86", "name": "network-vif-deleted", "tag": "ee7bae4d-a4a0-4251-a372-fbe0545d8c6e"}]} {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 06:30:12.142331 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [req-bb1bff2c-3b9f-4501-987b-897b219a276c req-f723c0e5-0498-4501-a303-e64e096980d6 service nova] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:30:12.143333 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [req-bb1bff2c-3b9f-4501-987b-897b219a276c req-f723c0e5-0498-4501-a303-e64e096980d6 service nova] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:30:12.144108 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [req-bb1bff2c-3b9f-4501-987b-897b219a276c req-f723c0e5-0498-4501-a303-e64e096980d6 service nova] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:30:12.164394 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.compute.server_external_events [req-bb1bff2c-3b9f-4501-987b-897b219a276c req-f723c0e5-0498-4501-a303-e64e096980d6 service nova] Creating event network-vif-deleted:ee7bae4d-a4a0-4251-a372-fbe0545d8c6e for instance 42fc4539-f891-4ab5-b30a-4bfe5033db86 on hv-cinder-86156 Oct 20 06:30:12.171416 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [req-bb1bff2c-3b9f-4501-987b-897b219a276c req-f723c0e5-0498-4501-a303-e64e096980d6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068691 Oct 20 06:30:12.172126 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1148/2284] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 20 06:30:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:30:12.370451 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-66fdb3d0-7a59-4bd2-ad47-f343e1e78444 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:30:12.372777 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-66fdb3d0-7a59-4bd2-ad47-f343e1e78444 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:30:12.379958 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-66fdb3d0-7a59-4bd2-ad47-f343e1e78444 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:30:12.380506 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-66fdb3d0-7a59-4bd2-ad47-f343e1e78444 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:30:12.381213 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-66fdb3d0-7a59-4bd2-ad47-f343e1e78444 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:30:12.381983 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-66fdb3d0-7a59-4bd2-ad47-f343e1e78444 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:30:12.382434 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-66fdb3d0-7a59-4bd2-ad47-f343e1e78444 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:30:12.382852 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-66fdb3d0-7a59-4bd2-ad47-f343e1e78444 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:30:12.446033 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-66fdb3d0-7a59-4bd2-ad47-f343e1e78444 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:30:12.455043 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-66fdb3d0-7a59-4bd2-ad47-f343e1e78444 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1367 microversion: 2.1 time: 0.089148 Oct 20 06:30:12.455912 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1137/2285] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:30:12 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1367 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:30:13.478506 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-cfa96cf0-b190-40d6-9249-76671df3143b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:30:13.479212 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-cfa96cf0-b190-40d6-9249-76671df3143b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:30:13.486539 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-cfa96cf0-b190-40d6-9249-76671df3143b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:30:13.487028 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-cfa96cf0-b190-40d6-9249-76671df3143b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:30:13.487465 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-cfa96cf0-b190-40d6-9249-76671df3143b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:30:13.488159 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-cfa96cf0-b190-40d6-9249-76671df3143b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:30:13.488617 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-cfa96cf0-b190-40d6-9249-76671df3143b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:30:13.489082 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-cfa96cf0-b190-40d6-9249-76671df3143b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:30:13.555361 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-cfa96cf0-b190-40d6-9249-76671df3143b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:30:13.564379 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-cfa96cf0-b190-40d6-9249-76671df3143b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1367 microversion: 2.1 time: 0.090055 Oct 20 06:30:13.564910 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1149/2286] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:30:13 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1367 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:30:14.587512 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-be5825f3-5156-4815-b769-2a8d8485d2db tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:30:14.588079 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-be5825f3-5156-4815-b769-2a8d8485d2db tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:30:14.594715 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-be5825f3-5156-4815-b769-2a8d8485d2db tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:30:14.595203 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-be5825f3-5156-4815-b769-2a8d8485d2db tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:30:14.595641 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-be5825f3-5156-4815-b769-2a8d8485d2db tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:30:14.596337 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-be5825f3-5156-4815-b769-2a8d8485d2db tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:30:14.596830 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-be5825f3-5156-4815-b769-2a8d8485d2db tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:30:14.597261 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-be5825f3-5156-4815-b769-2a8d8485d2db tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:30:14.664053 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-be5825f3-5156-4815-b769-2a8d8485d2db tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:30:14.672904 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-be5825f3-5156-4815-b769-2a8d8485d2db tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1367 microversion: 2.1 time: 0.089295 Oct 20 06:30:14.673475 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1138/2287] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:30:14 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1367 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:30:15.696941 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-5dedbc81-6ec5-4eac-b24c-21ebe2f61377 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:30:15.697548 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-5dedbc81-6ec5-4eac-b24c-21ebe2f61377 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:30:15.704338 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5dedbc81-6ec5-4eac-b24c-21ebe2f61377 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:30:15.704892 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5dedbc81-6ec5-4eac-b24c-21ebe2f61377 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:30:15.705335 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5dedbc81-6ec5-4eac-b24c-21ebe2f61377 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:30:15.706027 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5dedbc81-6ec5-4eac-b24c-21ebe2f61377 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:30:15.706480 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5dedbc81-6ec5-4eac-b24c-21ebe2f61377 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:30:15.706907 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5dedbc81-6ec5-4eac-b24c-21ebe2f61377 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:30:15.780976 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-5dedbc81-6ec5-4eac-b24c-21ebe2f61377 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:30:15.790322 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-5dedbc81-6ec5-4eac-b24c-21ebe2f61377 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1367 microversion: 2.1 time: 0.097295 Oct 20 06:30:15.791501 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1150/2288] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:30:15 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1367 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:30:16.814183 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-0ac52690-259e-4122-9e2e-239faf43c46a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:30:16.814827 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-0ac52690-259e-4122-9e2e-239faf43c46a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:30:16.821314 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-0ac52690-259e-4122-9e2e-239faf43c46a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:30:16.821794 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-0ac52690-259e-4122-9e2e-239faf43c46a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:30:16.822242 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-0ac52690-259e-4122-9e2e-239faf43c46a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:30:16.822935 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-0ac52690-259e-4122-9e2e-239faf43c46a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:30:16.823388 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-0ac52690-259e-4122-9e2e-239faf43c46a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:30:16.824341 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-0ac52690-259e-4122-9e2e-239faf43c46a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:30:16.894334 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-0ac52690-259e-4122-9e2e-239faf43c46a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:30:16.903399 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-0ac52690-259e-4122-9e2e-239faf43c46a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1367 microversion: 2.1 time: 0.093094 Oct 20 06:30:16.903956 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1139/2289] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:30:16 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1367 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:30:17.926839 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-0b6f6e7e-ab16-46f5-9006-6f7b7ec30079 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:30:17.927551 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-0b6f6e7e-ab16-46f5-9006-6f7b7ec30079 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:30:17.934594 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0b6f6e7e-ab16-46f5-9006-6f7b7ec30079 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:30:17.935070 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0b6f6e7e-ab16-46f5-9006-6f7b7ec30079 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:30:17.935500 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0b6f6e7e-ab16-46f5-9006-6f7b7ec30079 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:30:17.936183 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0b6f6e7e-ab16-46f5-9006-6f7b7ec30079 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:30:17.936629 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0b6f6e7e-ab16-46f5-9006-6f7b7ec30079 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:30:17.937108 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0b6f6e7e-ab16-46f5-9006-6f7b7ec30079 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:30:17.999914 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-0b6f6e7e-ab16-46f5-9006-6f7b7ec30079 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:30:18.009700 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-0b6f6e7e-ab16-46f5-9006-6f7b7ec30079 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1367 microversion: 2.1 time: 0.086714 Oct 20 06:30:18.010304 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1151/2290] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:30:17 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1367 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:30:19.033823 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-ed44ad4b-c129-4be3-a7a8-a20aa409b7d4 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:30:19.034379 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-ed44ad4b-c129-4be3-a7a8-a20aa409b7d4 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:30:19.040757 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ed44ad4b-c129-4be3-a7a8-a20aa409b7d4 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:30:19.041244 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ed44ad4b-c129-4be3-a7a8-a20aa409b7d4 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:30:19.041680 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ed44ad4b-c129-4be3-a7a8-a20aa409b7d4 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:30:19.042369 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ed44ad4b-c129-4be3-a7a8-a20aa409b7d4 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:30:19.043621 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ed44ad4b-c129-4be3-a7a8-a20aa409b7d4 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:30:19.044374 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ed44ad4b-c129-4be3-a7a8-a20aa409b7d4 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:30:19.107372 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-ed44ad4b-c129-4be3-a7a8-a20aa409b7d4 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:30:19.115592 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-ed44ad4b-c129-4be3-a7a8-a20aa409b7d4 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1367 microversion: 2.1 time: 0.085750 Oct 20 06:30:19.116136 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1140/2291] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:30:19 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1367 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:30:20.139671 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-05740703-c186-4fee-903c-f7c21864ab83 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:30:20.140285 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-05740703-c186-4fee-903c-f7c21864ab83 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:30:20.147263 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-05740703-c186-4fee-903c-f7c21864ab83 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:30:20.147744 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-05740703-c186-4fee-903c-f7c21864ab83 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:30:20.148178 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-05740703-c186-4fee-903c-f7c21864ab83 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:30:20.148912 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-05740703-c186-4fee-903c-f7c21864ab83 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:30:20.149367 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-05740703-c186-4fee-903c-f7c21864ab83 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:30:20.149791 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-05740703-c186-4fee-903c-f7c21864ab83 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:30:20.217002 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-05740703-c186-4fee-903c-f7c21864ab83 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:30:20.225509 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-05740703-c186-4fee-903c-f7c21864ab83 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1367 microversion: 2.1 time: 0.089844 Oct 20 06:30:20.226092 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1152/2292] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:30:20 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1367 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:30:21.254218 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-223d1ab3-90ff-4fbe-8950-945a78f641fe tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:30:21.254821 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-223d1ab3-90ff-4fbe-8950-945a78f641fe tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:30:21.262260 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-223d1ab3-90ff-4fbe-8950-945a78f641fe tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:30:21.262734 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-223d1ab3-90ff-4fbe-8950-945a78f641fe tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:30:21.263163 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-223d1ab3-90ff-4fbe-8950-945a78f641fe tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:30:21.263850 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-223d1ab3-90ff-4fbe-8950-945a78f641fe tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:30:21.264297 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-223d1ab3-90ff-4fbe-8950-945a78f641fe tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:30:21.264739 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-223d1ab3-90ff-4fbe-8950-945a78f641fe tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:30:21.328297 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-223d1ab3-90ff-4fbe-8950-945a78f641fe tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:30:21.336742 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-223d1ab3-90ff-4fbe-8950-945a78f641fe tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1367 microversion: 2.1 time: 0.086410 Oct 20 06:30:21.337408 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1141/2293] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:30:21 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1367 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:30:22.359673 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-a4ae1e4c-355f-4a28-a346-6c14d1dd0d33 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:30:22.360318 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-a4ae1e4c-355f-4a28-a346-6c14d1dd0d33 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:30:22.366839 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a4ae1e4c-355f-4a28-a346-6c14d1dd0d33 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:30:22.367322 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a4ae1e4c-355f-4a28-a346-6c14d1dd0d33 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:30:22.367764 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a4ae1e4c-355f-4a28-a346-6c14d1dd0d33 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:30:22.368455 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a4ae1e4c-355f-4a28-a346-6c14d1dd0d33 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:30:22.368939 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a4ae1e4c-355f-4a28-a346-6c14d1dd0d33 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:30:22.369372 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a4ae1e4c-355f-4a28-a346-6c14d1dd0d33 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:30:22.434675 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-a4ae1e4c-355f-4a28-a346-6c14d1dd0d33 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:30:22.442883 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-a4ae1e4c-355f-4a28-a346-6c14d1dd0d33 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1367 microversion: 2.1 time: 0.087132 Oct 20 06:30:22.443448 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1153/2294] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:30:22 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1367 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:30:23.467011 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-7b0f283b-3c6f-400d-ae5d-4f6a30c78605 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:30:23.467657 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-7b0f283b-3c6f-400d-ae5d-4f6a30c78605 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:30:23.474101 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7b0f283b-3c6f-400d-ae5d-4f6a30c78605 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:30:23.474585 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7b0f283b-3c6f-400d-ae5d-4f6a30c78605 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:30:23.475028 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7b0f283b-3c6f-400d-ae5d-4f6a30c78605 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:30:23.475717 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7b0f283b-3c6f-400d-ae5d-4f6a30c78605 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:30:23.476172 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7b0f283b-3c6f-400d-ae5d-4f6a30c78605 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:30:23.476608 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7b0f283b-3c6f-400d-ae5d-4f6a30c78605 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:30:23.538295 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-7b0f283b-3c6f-400d-ae5d-4f6a30c78605 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:30:23.547160 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-7b0f283b-3c6f-400d-ae5d-4f6a30c78605 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1367 microversion: 2.1 time: 0.084659 Oct 20 06:30:23.547736 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1142/2295] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:30:23 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1367 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:30:24.569741 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-a51632ca-ee1a-48ba-93a7-73d3d3a19f17 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:30:24.570364 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-a51632ca-ee1a-48ba-93a7-73d3d3a19f17 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:30:24.576774 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a51632ca-ee1a-48ba-93a7-73d3d3a19f17 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:30:24.577222 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a51632ca-ee1a-48ba-93a7-73d3d3a19f17 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:30:24.577653 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a51632ca-ee1a-48ba-93a7-73d3d3a19f17 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:30:24.578334 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a51632ca-ee1a-48ba-93a7-73d3d3a19f17 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:30:24.578781 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a51632ca-ee1a-48ba-93a7-73d3d3a19f17 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:30:24.579200 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a51632ca-ee1a-48ba-93a7-73d3d3a19f17 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:30:24.641638 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-a51632ca-ee1a-48ba-93a7-73d3d3a19f17 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:30:24.649821 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-a51632ca-ee1a-48ba-93a7-73d3d3a19f17 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1367 microversion: 2.1 time: 0.084062 Oct 20 06:30:24.650749 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1154/2296] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:30:24 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1367 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:30:25.674044 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-8517edab-baa7-4a8d-be85-9f785174adb2 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:30:25.674653 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-8517edab-baa7-4a8d-be85-9f785174adb2 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:30:25.681169 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-8517edab-baa7-4a8d-be85-9f785174adb2 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:30:25.681646 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-8517edab-baa7-4a8d-be85-9f785174adb2 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:30:25.682082 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-8517edab-baa7-4a8d-be85-9f785174adb2 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:30:25.682823 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-8517edab-baa7-4a8d-be85-9f785174adb2 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:30:25.683773 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-8517edab-baa7-4a8d-be85-9f785174adb2 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:30:25.684192 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-8517edab-baa7-4a8d-be85-9f785174adb2 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:30:25.749762 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-8517edab-baa7-4a8d-be85-9f785174adb2 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:30:25.758258 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-8517edab-baa7-4a8d-be85-9f785174adb2 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1367 microversion: 2.1 time: 0.088070 Oct 20 06:30:25.758814 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1143/2297] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:30:25 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1367 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:30:26.782328 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-023a1f71-317e-4a05-8ebd-7ac422c90971 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:30:26.782995 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-023a1f71-317e-4a05-8ebd-7ac422c90971 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:30:26.789590 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-023a1f71-317e-4a05-8ebd-7ac422c90971 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:30:26.790075 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-023a1f71-317e-4a05-8ebd-7ac422c90971 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:30:26.790660 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-023a1f71-317e-4a05-8ebd-7ac422c90971 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:30:26.791233 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-023a1f71-317e-4a05-8ebd-7ac422c90971 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:30:26.791690 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-023a1f71-317e-4a05-8ebd-7ac422c90971 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:30:26.792740 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-023a1f71-317e-4a05-8ebd-7ac422c90971 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:30:26.856188 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-023a1f71-317e-4a05-8ebd-7ac422c90971 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:30:26.864917 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-023a1f71-317e-4a05-8ebd-7ac422c90971 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1367 microversion: 2.1 time: 0.086347 Oct 20 06:30:26.865500 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1155/2298] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:30:26 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1367 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:30:27.888570 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-5a2526a0-f5dc-486c-9018-4e2dcf38d180 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:30:27.889201 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-5a2526a0-f5dc-486c-9018-4e2dcf38d180 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:30:27.895392 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5a2526a0-f5dc-486c-9018-4e2dcf38d180 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:30:27.895877 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5a2526a0-f5dc-486c-9018-4e2dcf38d180 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:30:27.896314 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5a2526a0-f5dc-486c-9018-4e2dcf38d180 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:30:27.897074 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5a2526a0-f5dc-486c-9018-4e2dcf38d180 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:30:27.897531 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5a2526a0-f5dc-486c-9018-4e2dcf38d180 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:30:27.898210 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5a2526a0-f5dc-486c-9018-4e2dcf38d180 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:30:27.960561 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-5a2526a0-f5dc-486c-9018-4e2dcf38d180 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:30:27.969727 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-5a2526a0-f5dc-486c-9018-4e2dcf38d180 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1367 microversion: 2.1 time: 0.086144 Oct 20 06:30:27.970289 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1144/2299] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:30:27 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1367 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:30:28.992755 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-3a7dc8f9-2c98-4e09-ae3f-96e2c6f8a683 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:30:28.993291 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-3a7dc8f9-2c98-4e09-ae3f-96e2c6f8a683 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:30:29.000344 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3a7dc8f9-2c98-4e09-ae3f-96e2c6f8a683 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:30:29.000859 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3a7dc8f9-2c98-4e09-ae3f-96e2c6f8a683 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:30:29.001299 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3a7dc8f9-2c98-4e09-ae3f-96e2c6f8a683 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:30:29.001988 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3a7dc8f9-2c98-4e09-ae3f-96e2c6f8a683 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:30:29.002442 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3a7dc8f9-2c98-4e09-ae3f-96e2c6f8a683 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:30:29.002874 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3a7dc8f9-2c98-4e09-ae3f-96e2c6f8a683 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:30:29.064744 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-3a7dc8f9-2c98-4e09-ae3f-96e2c6f8a683 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:30:29.073186 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-3a7dc8f9-2c98-4e09-ae3f-96e2c6f8a683 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1367 microversion: 2.1 time: 0.084295 Oct 20 06:30:29.074230 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1156/2300] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:30:28 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1367 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:30:30.097554 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-3efb93ce-0df4-478f-a38b-4a2e05870849 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:30:30.098123 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-3efb93ce-0df4-478f-a38b-4a2e05870849 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:30:30.105190 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-3efb93ce-0df4-478f-a38b-4a2e05870849 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:30:30.105661 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-3efb93ce-0df4-478f-a38b-4a2e05870849 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:30:30.106096 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-3efb93ce-0df4-478f-a38b-4a2e05870849 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:30:30.106796 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-3efb93ce-0df4-478f-a38b-4a2e05870849 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:30:30.107247 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-3efb93ce-0df4-478f-a38b-4a2e05870849 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:30:30.107669 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-3efb93ce-0df4-478f-a38b-4a2e05870849 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:30:30.172308 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-3efb93ce-0df4-478f-a38b-4a2e05870849 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:30:30.180667 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-3efb93ce-0df4-478f-a38b-4a2e05870849 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1367 microversion: 2.1 time: 0.087142 Oct 20 06:30:30.181266 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1145/2301] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:30:30 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1367 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:30:31.203708 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-ba2a565c-dd53-476e-99b7-202aae1ffce6 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:30:31.204384 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-ba2a565c-dd53-476e-99b7-202aae1ffce6 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:30:31.211484 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-ba2a565c-dd53-476e-99b7-202aae1ffce6 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:30:31.212360 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-ba2a565c-dd53-476e-99b7-202aae1ffce6 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:30:31.212921 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-ba2a565c-dd53-476e-99b7-202aae1ffce6 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:30:31.213635 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-ba2a565c-dd53-476e-99b7-202aae1ffce6 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:30:31.214711 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-ba2a565c-dd53-476e-99b7-202aae1ffce6 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:30:31.215150 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-ba2a565c-dd53-476e-99b7-202aae1ffce6 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:30:31.284666 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-ba2a565c-dd53-476e-99b7-202aae1ffce6 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:30:31.293659 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-ba2a565c-dd53-476e-99b7-202aae1ffce6 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1367 microversion: 2.1 time: 0.093731 Oct 20 06:30:31.298103 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1157/2302] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:30:31 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1367 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:30:32.317658 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-858add06-9dce-4867-b018-d1390c4ad8b0 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:30:32.318288 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-858add06-9dce-4867-b018-d1390c4ad8b0 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:30:32.325692 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-858add06-9dce-4867-b018-d1390c4ad8b0 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:30:32.326193 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-858add06-9dce-4867-b018-d1390c4ad8b0 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:30:32.326632 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-858add06-9dce-4867-b018-d1390c4ad8b0 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:30:32.327573 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-858add06-9dce-4867-b018-d1390c4ad8b0 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:30:32.328034 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-858add06-9dce-4867-b018-d1390c4ad8b0 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:30:32.328520 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-858add06-9dce-4867-b018-d1390c4ad8b0 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:30:32.402534 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-858add06-9dce-4867-b018-d1390c4ad8b0 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:30:32.411302 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-858add06-9dce-4867-b018-d1390c4ad8b0 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1367 microversion: 2.1 time: 0.097414 Oct 20 06:30:32.412097 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1146/2303] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:30:32 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1367 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:30:33.436043 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-1365afc4-2d50-488a-9282-9e775dacfca9 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:30:33.436780 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-1365afc4-2d50-488a-9282-9e775dacfca9 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:30:33.443784 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1365afc4-2d50-488a-9282-9e775dacfca9 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:30:33.444656 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1365afc4-2d50-488a-9282-9e775dacfca9 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:30:33.445169 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1365afc4-2d50-488a-9282-9e775dacfca9 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:30:33.445925 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1365afc4-2d50-488a-9282-9e775dacfca9 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:30:33.446373 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1365afc4-2d50-488a-9282-9e775dacfca9 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:30:33.446803 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1365afc4-2d50-488a-9282-9e775dacfca9 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:30:33.512208 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-1365afc4-2d50-488a-9282-9e775dacfca9 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:30:33.520507 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-1365afc4-2d50-488a-9282-9e775dacfca9 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1367 microversion: 2.1 time: 0.089583 Oct 20 06:30:33.521332 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1158/2304] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:30:33 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1367 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:30:34.543572 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-b2936e7a-7188-4e46-afaa-07a6238edcff tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:30:34.544843 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-b2936e7a-7188-4e46-afaa-07a6238edcff tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:30:34.551558 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b2936e7a-7188-4e46-afaa-07a6238edcff tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:30:34.552046 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b2936e7a-7188-4e46-afaa-07a6238edcff tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:30:34.552487 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b2936e7a-7188-4e46-afaa-07a6238edcff tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:30:34.553221 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b2936e7a-7188-4e46-afaa-07a6238edcff tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:30:34.553676 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b2936e7a-7188-4e46-afaa-07a6238edcff tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:30:34.554690 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b2936e7a-7188-4e46-afaa-07a6238edcff tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:30:34.639629 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-b2936e7a-7188-4e46-afaa-07a6238edcff tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:30:34.648898 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-b2936e7a-7188-4e46-afaa-07a6238edcff tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1367 microversion: 2.1 time: 0.109249 Oct 20 06:30:34.649476 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1147/2305] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:30:34 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1367 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:30:35.672244 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-a5229640-3e73-45cc-a071-3ff9b6350df4 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:30:35.672885 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-a5229640-3e73-45cc-a071-3ff9b6350df4 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:30:35.675331 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG dbcounter [-] [118860] Writing DB stats nova_api:SELECT=28 {{(pid=118860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:30:35.681575 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a5229640-3e73-45cc-a071-3ff9b6350df4 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:30:35.682094 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a5229640-3e73-45cc-a071-3ff9b6350df4 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:30:35.683091 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a5229640-3e73-45cc-a071-3ff9b6350df4 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:30:35.683795 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a5229640-3e73-45cc-a071-3ff9b6350df4 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:30:35.684254 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a5229640-3e73-45cc-a071-3ff9b6350df4 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:30:35.685374 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a5229640-3e73-45cc-a071-3ff9b6350df4 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:30:35.688743 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG dbcounter [-] [118860] Writing DB stats nova_cell1:SELECT=80 {{(pid=118860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:30:35.811269 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-a5229640-3e73-45cc-a071-3ff9b6350df4 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:30:35.820009 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-a5229640-3e73-45cc-a071-3ff9b6350df4 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1367 microversion: 2.1 time: 0.151868 Oct 20 06:30:35.820818 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1159/2306] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:30:35 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:30:36.843657 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-79a2543d-cf69-4cec-a12e-92b3f8db5da3 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:30:36.844258 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-79a2543d-cf69-4cec-a12e-92b3f8db5da3 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:30:36.852886 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-79a2543d-cf69-4cec-a12e-92b3f8db5da3 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:30:36.853368 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-79a2543d-cf69-4cec-a12e-92b3f8db5da3 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:30:36.853799 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-79a2543d-cf69-4cec-a12e-92b3f8db5da3 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:30:36.854548 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-79a2543d-cf69-4cec-a12e-92b3f8db5da3 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:30:36.854967 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-79a2543d-cf69-4cec-a12e-92b3f8db5da3 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:30:36.855487 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-79a2543d-cf69-4cec-a12e-92b3f8db5da3 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:30:36.929163 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-79a2543d-cf69-4cec-a12e-92b3f8db5da3 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:30:36.938781 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-79a2543d-cf69-4cec-a12e-92b3f8db5da3 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1367 microversion: 2.1 time: 0.099726 Oct 20 06:30:36.939879 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1148/2307] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:30:36 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1367 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:30:37.962889 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-5c773147-a754-4a70-80b9-47cd90b01813 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:30:37.964752 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-5c773147-a754-4a70-80b9-47cd90b01813 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:30:37.971758 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5c773147-a754-4a70-80b9-47cd90b01813 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:30:37.972555 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5c773147-a754-4a70-80b9-47cd90b01813 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:30:37.973289 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5c773147-a754-4a70-80b9-47cd90b01813 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:30:37.974417 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5c773147-a754-4a70-80b9-47cd90b01813 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:30:37.975128 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5c773147-a754-4a70-80b9-47cd90b01813 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:30:37.975788 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5c773147-a754-4a70-80b9-47cd90b01813 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:30:38.053250 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-5c773147-a754-4a70-80b9-47cd90b01813 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:30:38.062934 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-5c773147-a754-4a70-80b9-47cd90b01813 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1367 microversion: 2.1 time: 0.104020 Oct 20 06:30:38.065268 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1160/2308] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:30:37 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1367 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:30:39.089480 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-fe04578e-7ad7-4ea6-b898-7ded7e359ac3 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:30:39.090108 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-fe04578e-7ad7-4ea6-b898-7ded7e359ac3 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:30:39.092290 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG dbcounter [-] [118861] Writing DB stats nova_api:SELECT=28 {{(pid=118861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:30:39.097355 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-fe04578e-7ad7-4ea6-b898-7ded7e359ac3 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:30:39.097839 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-fe04578e-7ad7-4ea6-b898-7ded7e359ac3 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:30:39.098270 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-fe04578e-7ad7-4ea6-b898-7ded7e359ac3 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:30:39.099003 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-fe04578e-7ad7-4ea6-b898-7ded7e359ac3 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:30:39.099521 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-fe04578e-7ad7-4ea6-b898-7ded7e359ac3 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:30:39.100140 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-fe04578e-7ad7-4ea6-b898-7ded7e359ac3 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:30:39.104427 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG dbcounter [-] [118861] Writing DB stats nova_cell1:SELECT=84 {{(pid=118861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:30:39.162469 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-fe04578e-7ad7-4ea6-b898-7ded7e359ac3 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:30:39.171292 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-fe04578e-7ad7-4ea6-b898-7ded7e359ac3 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1367 microversion: 2.1 time: 0.086557 Oct 20 06:30:39.171845 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1149/2309] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:30:39 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1367 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:30:40.194884 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-391f97cd-7425-4529-a95d-d70cb6bafc1f tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:30:40.195501 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-391f97cd-7425-4529-a95d-d70cb6bafc1f tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:30:40.202631 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-391f97cd-7425-4529-a95d-d70cb6bafc1f tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:30:40.203123 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-391f97cd-7425-4529-a95d-d70cb6bafc1f tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:30:40.203562 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-391f97cd-7425-4529-a95d-d70cb6bafc1f tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:30:40.204258 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-391f97cd-7425-4529-a95d-d70cb6bafc1f tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:30:40.204761 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-391f97cd-7425-4529-a95d-d70cb6bafc1f tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:30:40.205253 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-391f97cd-7425-4529-a95d-d70cb6bafc1f tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:30:40.275404 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-391f97cd-7425-4529-a95d-d70cb6bafc1f tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:30:40.286810 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-391f97cd-7425-4529-a95d-d70cb6bafc1f tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1367 microversion: 2.1 time: 0.095838 Oct 20 06:30:40.287593 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1161/2310] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:30:40 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1367 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:30:41.311241 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-0fae55c4-404e-4aea-92fe-e88e55c267aa tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:30:41.311873 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-0fae55c4-404e-4aea-92fe-e88e55c267aa tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:30:41.318277 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-0fae55c4-404e-4aea-92fe-e88e55c267aa tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:30:41.318756 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-0fae55c4-404e-4aea-92fe-e88e55c267aa tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:30:41.319183 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-0fae55c4-404e-4aea-92fe-e88e55c267aa tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:30:41.319865 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-0fae55c4-404e-4aea-92fe-e88e55c267aa tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:30:41.320311 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-0fae55c4-404e-4aea-92fe-e88e55c267aa tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:30:41.320772 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-0fae55c4-404e-4aea-92fe-e88e55c267aa tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:30:41.381682 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-0fae55c4-404e-4aea-92fe-e88e55c267aa tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:30:41.390933 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-0fae55c4-404e-4aea-92fe-e88e55c267aa tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1367 microversion: 2.1 time: 0.083716 Oct 20 06:30:41.391493 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1150/2311] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:30:41 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1367 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:30:42.415002 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-04913610-d5c4-4e13-97a6-48481e9f893a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:30:42.415623 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-04913610-d5c4-4e13-97a6-48481e9f893a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:30:42.422859 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-04913610-d5c4-4e13-97a6-48481e9f893a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:30:42.423350 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-04913610-d5c4-4e13-97a6-48481e9f893a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:30:42.423799 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-04913610-d5c4-4e13-97a6-48481e9f893a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:30:42.424489 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-04913610-d5c4-4e13-97a6-48481e9f893a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:30:42.425031 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-04913610-d5c4-4e13-97a6-48481e9f893a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:30:42.425466 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-04913610-d5c4-4e13-97a6-48481e9f893a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:30:42.496975 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-04913610-d5c4-4e13-97a6-48481e9f893a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:30:42.505855 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-04913610-d5c4-4e13-97a6-48481e9f893a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1367 microversion: 2.1 time: 0.095082 Oct 20 06:30:42.506429 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1162/2312] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:30:42 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1367 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:30:43.528762 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-9b2d4b3c-d00e-426b-9f31-d20f0ee4b865 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:30:43.529395 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-9b2d4b3c-d00e-426b-9f31-d20f0ee4b865 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:30:43.535978 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-9b2d4b3c-d00e-426b-9f31-d20f0ee4b865 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:30:43.536465 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-9b2d4b3c-d00e-426b-9f31-d20f0ee4b865 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:30:43.536947 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-9b2d4b3c-d00e-426b-9f31-d20f0ee4b865 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:30:43.537659 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-9b2d4b3c-d00e-426b-9f31-d20f0ee4b865 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:30:43.538112 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-9b2d4b3c-d00e-426b-9f31-d20f0ee4b865 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:30:43.538538 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-9b2d4b3c-d00e-426b-9f31-d20f0ee4b865 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:30:43.603367 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-9b2d4b3c-d00e-426b-9f31-d20f0ee4b865 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:30:43.612919 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-9b2d4b3c-d00e-426b-9f31-d20f0ee4b865 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1367 microversion: 2.1 time: 0.088082 Oct 20 06:30:43.613491 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1151/2313] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:30:43 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1367 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:30:44.636350 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-7b631afd-72d0-4b56-a260-dc0d3a5e82e4 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:30:44.637001 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-7b631afd-72d0-4b56-a260-dc0d3a5e82e4 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:30:44.643568 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7b631afd-72d0-4b56-a260-dc0d3a5e82e4 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:30:44.644047 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7b631afd-72d0-4b56-a260-dc0d3a5e82e4 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:30:44.644628 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7b631afd-72d0-4b56-a260-dc0d3a5e82e4 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:30:44.645224 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7b631afd-72d0-4b56-a260-dc0d3a5e82e4 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:30:44.645669 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7b631afd-72d0-4b56-a260-dc0d3a5e82e4 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:30:44.646088 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7b631afd-72d0-4b56-a260-dc0d3a5e82e4 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:30:44.710101 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-7b631afd-72d0-4b56-a260-dc0d3a5e82e4 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:30:44.719227 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-7b631afd-72d0-4b56-a260-dc0d3a5e82e4 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1367 microversion: 2.1 time: 0.087545 Oct 20 06:30:44.720009 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1163/2314] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:30:44 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1367 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:30:45.742102 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-249588a3-335d-488c-ba20-932e3e74b9d8 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:30:45.742717 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-249588a3-335d-488c-ba20-932e3e74b9d8 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:30:45.749867 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-249588a3-335d-488c-ba20-932e3e74b9d8 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:30:45.750347 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-249588a3-335d-488c-ba20-932e3e74b9d8 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:30:45.750788 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-249588a3-335d-488c-ba20-932e3e74b9d8 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:30:45.751479 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-249588a3-335d-488c-ba20-932e3e74b9d8 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:30:45.751929 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-249588a3-335d-488c-ba20-932e3e74b9d8 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:30:45.752354 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-249588a3-335d-488c-ba20-932e3e74b9d8 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:30:45.815662 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-249588a3-335d-488c-ba20-932e3e74b9d8 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:30:45.825048 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-249588a3-335d-488c-ba20-932e3e74b9d8 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1367 microversion: 2.1 time: 0.086756 Oct 20 06:30:45.825834 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1152/2315] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:30:45 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1367 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:30:46.848183 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-de656ce7-facd-46b5-a714-4922de979070 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:30:46.848826 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-de656ce7-facd-46b5-a714-4922de979070 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:30:46.856244 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-de656ce7-facd-46b5-a714-4922de979070 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:30:46.856745 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-de656ce7-facd-46b5-a714-4922de979070 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:30:46.857178 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-de656ce7-facd-46b5-a714-4922de979070 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:30:46.857876 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-de656ce7-facd-46b5-a714-4922de979070 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:30:46.858323 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-de656ce7-facd-46b5-a714-4922de979070 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:30:46.858743 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-de656ce7-facd-46b5-a714-4922de979070 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:30:46.921802 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-de656ce7-facd-46b5-a714-4922de979070 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:30:46.930122 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-de656ce7-facd-46b5-a714-4922de979070 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1367 microversion: 2.1 time: 0.085831 Oct 20 06:30:46.930696 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1164/2316] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:30:46 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1367 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:30:47.953724 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-bac2e0ca-b8ef-40e5-a012-77e8dc53a6e6 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:30:47.954330 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-bac2e0ca-b8ef-40e5-a012-77e8dc53a6e6 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:30:47.961102 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-bac2e0ca-b8ef-40e5-a012-77e8dc53a6e6 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:30:47.961588 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-bac2e0ca-b8ef-40e5-a012-77e8dc53a6e6 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:30:47.962026 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-bac2e0ca-b8ef-40e5-a012-77e8dc53a6e6 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:30:47.962724 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-bac2e0ca-b8ef-40e5-a012-77e8dc53a6e6 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:30:47.963185 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-bac2e0ca-b8ef-40e5-a012-77e8dc53a6e6 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:30:47.963605 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-bac2e0ca-b8ef-40e5-a012-77e8dc53a6e6 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:30:48.029812 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-bac2e0ca-b8ef-40e5-a012-77e8dc53a6e6 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:30:48.038307 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-bac2e0ca-b8ef-40e5-a012-77e8dc53a6e6 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1367 microversion: 2.1 time: 0.088516 Oct 20 06:30:48.038868 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1153/2317] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:30:47 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1367 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:30:49.062006 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-2db9e514-c924-43be-86ea-9584ad4f8364 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:30:49.062653 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-2db9e514-c924-43be-86ea-9584ad4f8364 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:30:49.069382 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2db9e514-c924-43be-86ea-9584ad4f8364 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:30:49.069869 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2db9e514-c924-43be-86ea-9584ad4f8364 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:30:49.070310 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2db9e514-c924-43be-86ea-9584ad4f8364 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:30:49.071005 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2db9e514-c924-43be-86ea-9584ad4f8364 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:30:49.071676 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2db9e514-c924-43be-86ea-9584ad4f8364 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:30:49.071882 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2db9e514-c924-43be-86ea-9584ad4f8364 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:30:49.140133 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-2db9e514-c924-43be-86ea-9584ad4f8364 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:30:49.149310 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-2db9e514-c924-43be-86ea-9584ad4f8364 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1367 microversion: 2.1 time: 0.091571 Oct 20 06:30:49.152902 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1165/2318] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:30:49 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1367 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:30:50.172853 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-d96ed32f-9171-4609-abd7-60deb4ea51a4 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:30:50.173473 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-d96ed32f-9171-4609-abd7-60deb4ea51a4 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:30:50.179821 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d96ed32f-9171-4609-abd7-60deb4ea51a4 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:30:50.180339 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d96ed32f-9171-4609-abd7-60deb4ea51a4 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:30:50.180805 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d96ed32f-9171-4609-abd7-60deb4ea51a4 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:30:50.181498 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d96ed32f-9171-4609-abd7-60deb4ea51a4 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:30:50.181962 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d96ed32f-9171-4609-abd7-60deb4ea51a4 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:30:50.182882 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d96ed32f-9171-4609-abd7-60deb4ea51a4 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:30:50.244231 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-d96ed32f-9171-4609-abd7-60deb4ea51a4 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:30:50.253023 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-d96ed32f-9171-4609-abd7-60deb4ea51a4 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1367 microversion: 2.1 time: 0.084022 Oct 20 06:30:50.253599 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1154/2319] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:30:50 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1367 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:30:51.276888 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-f49d50b7-598f-4fa1-8591-491661eae761 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:30:51.277625 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-f49d50b7-598f-4fa1-8591-491661eae761 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:30:51.284057 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f49d50b7-598f-4fa1-8591-491661eae761 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:30:51.284539 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f49d50b7-598f-4fa1-8591-491661eae761 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:30:51.285027 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f49d50b7-598f-4fa1-8591-491661eae761 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:30:51.285703 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f49d50b7-598f-4fa1-8591-491661eae761 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:30:51.286156 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f49d50b7-598f-4fa1-8591-491661eae761 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:30:51.286579 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f49d50b7-598f-4fa1-8591-491661eae761 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:30:51.347284 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-f49d50b7-598f-4fa1-8591-491661eae761 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:30:51.355394 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-f49d50b7-598f-4fa1-8591-491661eae761 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1367 microversion: 2.1 time: 0.082987 Oct 20 06:30:51.355948 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1166/2320] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:30:51 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1367 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:30:52.378442 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-8fc0455e-89b8-4ad9-9fc9-1b86109853c2 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:30:52.379057 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-8fc0455e-89b8-4ad9-9fc9-1b86109853c2 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:30:52.386208 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-8fc0455e-89b8-4ad9-9fc9-1b86109853c2 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:30:52.386686 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-8fc0455e-89b8-4ad9-9fc9-1b86109853c2 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:30:52.387127 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-8fc0455e-89b8-4ad9-9fc9-1b86109853c2 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:30:52.387807 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-8fc0455e-89b8-4ad9-9fc9-1b86109853c2 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:30:52.388260 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-8fc0455e-89b8-4ad9-9fc9-1b86109853c2 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:30:52.388686 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-8fc0455e-89b8-4ad9-9fc9-1b86109853c2 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:30:52.453223 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-8fc0455e-89b8-4ad9-9fc9-1b86109853c2 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:30:52.461310 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-8fc0455e-89b8-4ad9-9fc9-1b86109853c2 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1367 microversion: 2.1 time: 0.086758 Oct 20 06:30:52.461876 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1155/2321] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:30:52 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1367 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:30:53.485522 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-0243d3aa-3273-436a-8d54-26953220e343 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:30:53.486117 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-0243d3aa-3273-436a-8d54-26953220e343 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:30:53.492592 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0243d3aa-3273-436a-8d54-26953220e343 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:30:53.493110 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0243d3aa-3273-436a-8d54-26953220e343 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:30:53.493551 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0243d3aa-3273-436a-8d54-26953220e343 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:30:53.494242 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0243d3aa-3273-436a-8d54-26953220e343 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:30:53.494706 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0243d3aa-3273-436a-8d54-26953220e343 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:30:53.495741 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0243d3aa-3273-436a-8d54-26953220e343 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:30:53.558044 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-0243d3aa-3273-436a-8d54-26953220e343 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:30:53.567275 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-0243d3aa-3273-436a-8d54-26953220e343 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1367 microversion: 2.1 time: 0.085575 Oct 20 06:30:53.567842 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1167/2322] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:30:53 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1367 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:30:54.591046 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-54993460-00c0-41e5-85d6-601a050bd70b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:30:54.591609 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-54993460-00c0-41e5-85d6-601a050bd70b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:30:54.598047 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-54993460-00c0-41e5-85d6-601a050bd70b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:30:54.598559 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-54993460-00c0-41e5-85d6-601a050bd70b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:30:54.598998 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-54993460-00c0-41e5-85d6-601a050bd70b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:30:54.599688 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-54993460-00c0-41e5-85d6-601a050bd70b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:30:54.600137 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-54993460-00c0-41e5-85d6-601a050bd70b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:30:54.600556 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-54993460-00c0-41e5-85d6-601a050bd70b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:30:54.662199 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-54993460-00c0-41e5-85d6-601a050bd70b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:30:54.671615 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-54993460-00c0-41e5-85d6-601a050bd70b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1367 microversion: 2.1 time: 0.085033 Oct 20 06:30:54.672194 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1156/2323] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:30:54 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1367 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:30:55.694116 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-727f0912-9bb3-47ad-8764-69006d663021 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:30:55.694720 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-727f0912-9bb3-47ad-8764-69006d663021 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:30:55.701902 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-727f0912-9bb3-47ad-8764-69006d663021 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:30:55.702386 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-727f0912-9bb3-47ad-8764-69006d663021 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:30:55.702844 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-727f0912-9bb3-47ad-8764-69006d663021 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:30:55.703527 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-727f0912-9bb3-47ad-8764-69006d663021 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:30:55.703979 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-727f0912-9bb3-47ad-8764-69006d663021 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:30:55.704399 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-727f0912-9bb3-47ad-8764-69006d663021 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:30:55.764975 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-727f0912-9bb3-47ad-8764-69006d663021 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:30:55.773199 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-727f0912-9bb3-47ad-8764-69006d663021 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1367 microversion: 2.1 time: 0.082906 Oct 20 06:30:55.773767 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1168/2324] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:30:55 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1367 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:30:56.797194 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-e42718aa-9a58-4f78-9101-29f1aaab1bfc tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:30:56.797846 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-e42718aa-9a58-4f78-9101-29f1aaab1bfc tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:30:56.804894 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e42718aa-9a58-4f78-9101-29f1aaab1bfc tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:30:56.805386 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e42718aa-9a58-4f78-9101-29f1aaab1bfc tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:30:56.805823 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e42718aa-9a58-4f78-9101-29f1aaab1bfc tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:30:56.806545 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e42718aa-9a58-4f78-9101-29f1aaab1bfc tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:30:56.806998 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e42718aa-9a58-4f78-9101-29f1aaab1bfc tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:30:56.807508 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e42718aa-9a58-4f78-9101-29f1aaab1bfc tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:30:56.873938 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-e42718aa-9a58-4f78-9101-29f1aaab1bfc tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:30:56.882257 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-e42718aa-9a58-4f78-9101-29f1aaab1bfc tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1367 microversion: 2.1 time: 0.089129 Oct 20 06:30:56.882822 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1157/2325] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:30:56 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1367 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:30:57.906395 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-6344cda7-73f4-4a6f-8624-01e7d0ebc778 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:30:57.907240 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-6344cda7-73f4-4a6f-8624-01e7d0ebc778 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:30:57.913775 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-6344cda7-73f4-4a6f-8624-01e7d0ebc778 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:30:57.914360 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-6344cda7-73f4-4a6f-8624-01e7d0ebc778 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:30:57.914887 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-6344cda7-73f4-4a6f-8624-01e7d0ebc778 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:30:57.915668 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-6344cda7-73f4-4a6f-8624-01e7d0ebc778 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:30:57.916202 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-6344cda7-73f4-4a6f-8624-01e7d0ebc778 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:30:57.917215 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-6344cda7-73f4-4a6f-8624-01e7d0ebc778 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:30:58.023371 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-6344cda7-73f4-4a6f-8624-01e7d0ebc778 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:30:58.032145 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-6344cda7-73f4-4a6f-8624-01e7d0ebc778 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1367 microversion: 2.1 time: 0.130511 Oct 20 06:30:58.033081 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1169/2326] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:30:57 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1367 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:30:59.055670 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-e0a3e39f-7851-42e2-8b15-7850507d7c6d tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:30:59.056282 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-e0a3e39f-7851-42e2-8b15-7850507d7c6d tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:30:59.063129 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e0a3e39f-7851-42e2-8b15-7850507d7c6d tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:30:59.063615 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e0a3e39f-7851-42e2-8b15-7850507d7c6d tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:30:59.064054 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e0a3e39f-7851-42e2-8b15-7850507d7c6d tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:30:59.064777 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e0a3e39f-7851-42e2-8b15-7850507d7c6d tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:30:59.065235 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e0a3e39f-7851-42e2-8b15-7850507d7c6d tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:30:59.065660 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e0a3e39f-7851-42e2-8b15-7850507d7c6d tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:30:59.126898 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-e0a3e39f-7851-42e2-8b15-7850507d7c6d tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:30:59.135439 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-e0a3e39f-7851-42e2-8b15-7850507d7c6d tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1367 microversion: 2.1 time: 0.083616 Oct 20 06:30:59.136071 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1158/2327] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:30:59 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1367 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:31:00.158943 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-163d4ede-5693-4973-884a-c35448ba8db6 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:31:00.159553 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-163d4ede-5693-4973-884a-c35448ba8db6 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:31:00.166071 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-163d4ede-5693-4973-884a-c35448ba8db6 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:31:00.167603 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-163d4ede-5693-4973-884a-c35448ba8db6 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:31:00.168054 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-163d4ede-5693-4973-884a-c35448ba8db6 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:31:00.168788 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-163d4ede-5693-4973-884a-c35448ba8db6 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:31:00.169248 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-163d4ede-5693-4973-884a-c35448ba8db6 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:31:00.169671 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-163d4ede-5693-4973-884a-c35448ba8db6 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:31:00.232588 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-163d4ede-5693-4973-884a-c35448ba8db6 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:31:00.241050 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-163d4ede-5693-4973-884a-c35448ba8db6 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1367 microversion: 2.1 time: 0.085902 Oct 20 06:31:00.241818 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1170/2328] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:31:00 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1367 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:31:01.266147 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-8eb130c5-af87-48e9-9648-4ddc4ee61967 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:31:01.266765 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-8eb130c5-af87-48e9-9648-4ddc4ee61967 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:31:01.273365 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-8eb130c5-af87-48e9-9648-4ddc4ee61967 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:31:01.273851 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-8eb130c5-af87-48e9-9648-4ddc4ee61967 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:31:01.274289 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-8eb130c5-af87-48e9-9648-4ddc4ee61967 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:31:01.274983 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-8eb130c5-af87-48e9-9648-4ddc4ee61967 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:31:01.275435 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-8eb130c5-af87-48e9-9648-4ddc4ee61967 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:31:01.276411 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-8eb130c5-af87-48e9-9648-4ddc4ee61967 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:31:01.341886 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-8eb130c5-af87-48e9-9648-4ddc4ee61967 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:31:01.350293 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-8eb130c5-af87-48e9-9648-4ddc4ee61967 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1367 microversion: 2.1 time: 0.088086 Oct 20 06:31:01.350873 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1159/2329] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:31:01 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1367 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:31:02.373376 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-42f118a5-1e9f-45f9-ba62-bb25c4483d53 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:31:02.374047 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-42f118a5-1e9f-45f9-ba62-bb25c4483d53 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:31:02.380500 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-42f118a5-1e9f-45f9-ba62-bb25c4483d53 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:31:02.381010 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-42f118a5-1e9f-45f9-ba62-bb25c4483d53 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:31:02.381445 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-42f118a5-1e9f-45f9-ba62-bb25c4483d53 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:31:02.382128 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-42f118a5-1e9f-45f9-ba62-bb25c4483d53 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:31:02.382579 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-42f118a5-1e9f-45f9-ba62-bb25c4483d53 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:31:02.382997 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-42f118a5-1e9f-45f9-ba62-bb25c4483d53 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:31:02.444457 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-42f118a5-1e9f-45f9-ba62-bb25c4483d53 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:31:02.453504 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-42f118a5-1e9f-45f9-ba62-bb25c4483d53 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1367 microversion: 2.1 time: 0.084075 Oct 20 06:31:02.454070 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1171/2330] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:31:02 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1367 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:31:03.476721 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-159f6793-d3b0-4310-91ad-43b1679e9c42 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:31:03.477344 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-159f6793-d3b0-4310-91ad-43b1679e9c42 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:31:03.484037 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-159f6793-d3b0-4310-91ad-43b1679e9c42 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:31:03.484523 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-159f6793-d3b0-4310-91ad-43b1679e9c42 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:31:03.484993 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-159f6793-d3b0-4310-91ad-43b1679e9c42 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:31:03.485687 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-159f6793-d3b0-4310-91ad-43b1679e9c42 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:31:03.486135 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-159f6793-d3b0-4310-91ad-43b1679e9c42 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:31:03.486559 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-159f6793-d3b0-4310-91ad-43b1679e9c42 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:31:03.550741 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-159f6793-d3b0-4310-91ad-43b1679e9c42 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:31:03.559670 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-159f6793-d3b0-4310-91ad-43b1679e9c42 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1367 microversion: 2.1 time: 0.086775 Oct 20 06:31:03.560158 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1160/2331] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:31:03 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1367 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:31:04.582291 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-7bac1240-c4ad-4265-9108-6652c7128a0f tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:31:04.582821 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-7bac1240-c4ad-4265-9108-6652c7128a0f tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:31:04.589411 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7bac1240-c4ad-4265-9108-6652c7128a0f tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:31:04.589897 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7bac1240-c4ad-4265-9108-6652c7128a0f tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:31:04.590339 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7bac1240-c4ad-4265-9108-6652c7128a0f tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:31:04.591035 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7bac1240-c4ad-4265-9108-6652c7128a0f tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:31:04.591487 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7bac1240-c4ad-4265-9108-6652c7128a0f tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:31:04.591911 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7bac1240-c4ad-4265-9108-6652c7128a0f tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:31:04.658484 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-7bac1240-c4ad-4265-9108-6652c7128a0f tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:31:04.667357 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-7bac1240-c4ad-4265-9108-6652c7128a0f tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1367 microversion: 2.1 time: 0.088983 Oct 20 06:31:04.668260 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1172/2332] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:31:04 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1367 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:31:05.691374 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-66bae8c2-a2cd-406d-84b6-9384958753a5 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:31:05.692095 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-66bae8c2-a2cd-406d-84b6-9384958753a5 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:31:05.699236 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-66bae8c2-a2cd-406d-84b6-9384958753a5 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:31:05.699926 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-66bae8c2-a2cd-406d-84b6-9384958753a5 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:31:05.700432 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-66bae8c2-a2cd-406d-84b6-9384958753a5 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:31:05.701238 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-66bae8c2-a2cd-406d-84b6-9384958753a5 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:31:05.701771 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-66bae8c2-a2cd-406d-84b6-9384958753a5 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:31:05.702261 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-66bae8c2-a2cd-406d-84b6-9384958753a5 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:31:05.764800 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-66bae8c2-a2cd-406d-84b6-9384958753a5 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:31:05.773153 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-66bae8c2-a2cd-406d-84b6-9384958753a5 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1367 microversion: 2.1 time: 0.085633 Oct 20 06:31:05.773798 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1161/2333] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:31:05 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1367 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:31:06.796953 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-a576eb87-007c-4f45-bd45-8ba843a14521 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:31:06.797570 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-a576eb87-007c-4f45-bd45-8ba843a14521 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:31:06.799875 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG dbcounter [-] [118860] Writing DB stats nova_api:SELECT=28 {{(pid=118860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:31:06.805446 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a576eb87-007c-4f45-bd45-8ba843a14521 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:31:06.805933 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a576eb87-007c-4f45-bd45-8ba843a14521 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:31:06.806371 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a576eb87-007c-4f45-bd45-8ba843a14521 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:31:06.807288 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a576eb87-007c-4f45-bd45-8ba843a14521 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:31:06.810979 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a576eb87-007c-4f45-bd45-8ba843a14521 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:31:06.810979 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a576eb87-007c-4f45-bd45-8ba843a14521 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:31:06.811375 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG dbcounter [-] [118860] Writing DB stats nova_cell1:SELECT=84 {{(pid=118860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:31:06.877471 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-a576eb87-007c-4f45-bd45-8ba843a14521 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:31:06.886802 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-a576eb87-007c-4f45-bd45-8ba843a14521 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1367 microversion: 2.1 time: 0.093723 Oct 20 06:31:06.891763 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1173/2334] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:31:06 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1367 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:31:07.910363 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-ea3e6b97-b517-443b-99e5-94762eaa8374 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:31:07.910982 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-ea3e6b97-b517-443b-99e5-94762eaa8374 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:31:07.917520 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ea3e6b97-b517-443b-99e5-94762eaa8374 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:31:07.918009 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ea3e6b97-b517-443b-99e5-94762eaa8374 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:31:07.918448 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ea3e6b97-b517-443b-99e5-94762eaa8374 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:31:07.919148 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ea3e6b97-b517-443b-99e5-94762eaa8374 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:31:07.919630 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ea3e6b97-b517-443b-99e5-94762eaa8374 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:31:07.920058 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ea3e6b97-b517-443b-99e5-94762eaa8374 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:31:07.984815 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-ea3e6b97-b517-443b-99e5-94762eaa8374 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:31:07.993243 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-ea3e6b97-b517-443b-99e5-94762eaa8374 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1367 microversion: 2.1 time: 0.086739 Oct 20 06:31:07.993820 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1162/2335] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:31:07 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1367 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:31:09.135282 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-0456cd6a-e5ca-4f34-abab-6b31e62ae0a1 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:31:09.136835 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-0456cd6a-e5ca-4f34-abab-6b31e62ae0a1 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:31:09.143015 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0456cd6a-e5ca-4f34-abab-6b31e62ae0a1 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:31:09.143496 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0456cd6a-e5ca-4f34-abab-6b31e62ae0a1 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:31:09.143928 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0456cd6a-e5ca-4f34-abab-6b31e62ae0a1 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:31:09.144614 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0456cd6a-e5ca-4f34-abab-6b31e62ae0a1 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:31:09.145091 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0456cd6a-e5ca-4f34-abab-6b31e62ae0a1 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:31:09.145509 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0456cd6a-e5ca-4f34-abab-6b31e62ae0a1 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:31:09.207381 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-0456cd6a-e5ca-4f34-abab-6b31e62ae0a1 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:31:09.215655 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-0456cd6a-e5ca-4f34-abab-6b31e62ae0a1 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1367 microversion: 2.1 time: 0.201637 Oct 20 06:31:09.216452 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1174/2336] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:31:09 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1367 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:31:10.239371 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-a1fce560-0667-45d5-a713-c1aa258694cc tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:31:10.239955 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-a1fce560-0667-45d5-a713-c1aa258694cc tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:31:10.242389 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG dbcounter [-] [118861] Writing DB stats nova_api:SELECT=28 {{(pid=118861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:31:10.248385 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a1fce560-0667-45d5-a713-c1aa258694cc tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:31:10.248896 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a1fce560-0667-45d5-a713-c1aa258694cc tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:31:10.249339 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a1fce560-0667-45d5-a713-c1aa258694cc tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:31:10.250029 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a1fce560-0667-45d5-a713-c1aa258694cc tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:31:10.250475 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a1fce560-0667-45d5-a713-c1aa258694cc tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:31:10.250896 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a1fce560-0667-45d5-a713-c1aa258694cc tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:31:10.253773 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG dbcounter [-] [118861] Writing DB stats nova_cell1:SELECT=84 {{(pid=118861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:31:10.317582 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-a1fce560-0667-45d5-a713-c1aa258694cc tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:31:10.326632 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-a1fce560-0667-45d5-a713-c1aa258694cc tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1367 microversion: 2.1 time: 0.091097 Oct 20 06:31:10.327198 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1163/2337] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:31:10 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1367 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:31:11.350067 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-d81a9d5a-c38d-4796-b173-bfa40ead77ca tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:31:11.350671 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-d81a9d5a-c38d-4796-b173-bfa40ead77ca tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:31:11.357138 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-d81a9d5a-c38d-4796-b173-bfa40ead77ca tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:31:11.357620 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-d81a9d5a-c38d-4796-b173-bfa40ead77ca tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:31:11.358079 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-d81a9d5a-c38d-4796-b173-bfa40ead77ca tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:31:11.358760 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-d81a9d5a-c38d-4796-b173-bfa40ead77ca tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:31:11.359206 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-d81a9d5a-c38d-4796-b173-bfa40ead77ca tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:31:11.359625 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-d81a9d5a-c38d-4796-b173-bfa40ead77ca tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:31:11.422784 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-d81a9d5a-c38d-4796-b173-bfa40ead77ca tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:31:11.430940 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-d81a9d5a-c38d-4796-b173-bfa40ead77ca tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1367 microversion: 2.1 time: 0.084720 Oct 20 06:31:11.431494 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1175/2338] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:31:11 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1367 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:31:12.454755 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-1cb58a13-e8b0-42f9-9d2d-cb5d5a8796b9 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:31:12.455855 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-1cb58a13-e8b0-42f9-9d2d-cb5d5a8796b9 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:31:12.462331 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1cb58a13-e8b0-42f9-9d2d-cb5d5a8796b9 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:31:12.462813 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1cb58a13-e8b0-42f9-9d2d-cb5d5a8796b9 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:31:12.463251 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1cb58a13-e8b0-42f9-9d2d-cb5d5a8796b9 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:31:12.463953 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1cb58a13-e8b0-42f9-9d2d-cb5d5a8796b9 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:31:12.464515 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1cb58a13-e8b0-42f9-9d2d-cb5d5a8796b9 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:31:12.464843 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1cb58a13-e8b0-42f9-9d2d-cb5d5a8796b9 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:31:12.526860 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-1cb58a13-e8b0-42f9-9d2d-cb5d5a8796b9 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:31:12.535133 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-1cb58a13-e8b0-42f9-9d2d-cb5d5a8796b9 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1367 microversion: 2.1 time: 0.084320 Oct 20 06:31:12.535693 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1164/2339] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:31:12 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1367 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:31:13.560144 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-a8d273f6-3bcd-4e0e-82c0-39f50b55aab2 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:31:13.560753 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-a8d273f6-3bcd-4e0e-82c0-39f50b55aab2 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:31:13.567092 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a8d273f6-3bcd-4e0e-82c0-39f50b55aab2 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:31:13.567571 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a8d273f6-3bcd-4e0e-82c0-39f50b55aab2 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:31:13.568007 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a8d273f6-3bcd-4e0e-82c0-39f50b55aab2 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:31:13.568688 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a8d273f6-3bcd-4e0e-82c0-39f50b55aab2 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:31:13.569154 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a8d273f6-3bcd-4e0e-82c0-39f50b55aab2 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:31:13.569575 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a8d273f6-3bcd-4e0e-82c0-39f50b55aab2 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:31:13.635634 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-a8d273f6-3bcd-4e0e-82c0-39f50b55aab2 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:31:13.644193 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-a8d273f6-3bcd-4e0e-82c0-39f50b55aab2 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1367 microversion: 2.1 time: 0.088716 Oct 20 06:31:13.644828 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1176/2340] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:31:13 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1367 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:31:14.668074 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-bc24f000-5415-4b6f-aeb2-844e8fb0a35a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:31:14.668826 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-bc24f000-5415-4b6f-aeb2-844e8fb0a35a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:31:14.675504 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-bc24f000-5415-4b6f-aeb2-844e8fb0a35a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:31:14.675976 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-bc24f000-5415-4b6f-aeb2-844e8fb0a35a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:31:14.676529 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-bc24f000-5415-4b6f-aeb2-844e8fb0a35a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:31:14.677257 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-bc24f000-5415-4b6f-aeb2-844e8fb0a35a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:31:14.677706 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-bc24f000-5415-4b6f-aeb2-844e8fb0a35a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:31:14.678123 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-bc24f000-5415-4b6f-aeb2-844e8fb0a35a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:31:14.740507 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-bc24f000-5415-4b6f-aeb2-844e8fb0a35a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:31:14.748961 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-bc24f000-5415-4b6f-aeb2-844e8fb0a35a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1367 microversion: 2.1 time: 0.085331 Oct 20 06:31:14.749517 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1165/2341] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:31:14 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1367 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:31:15.772539 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-2ab4fa58-abae-4805-942d-3ac67fbb4b19 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:31:15.773172 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-2ab4fa58-abae-4805-942d-3ac67fbb4b19 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:31:15.780153 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2ab4fa58-abae-4805-942d-3ac67fbb4b19 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:31:15.780649 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2ab4fa58-abae-4805-942d-3ac67fbb4b19 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:31:15.781120 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2ab4fa58-abae-4805-942d-3ac67fbb4b19 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:31:15.781830 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2ab4fa58-abae-4805-942d-3ac67fbb4b19 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:31:15.782293 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2ab4fa58-abae-4805-942d-3ac67fbb4b19 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:31:15.782722 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2ab4fa58-abae-4805-942d-3ac67fbb4b19 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:31:15.844387 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-2ab4fa58-abae-4805-942d-3ac67fbb4b19 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:31:15.852521 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-2ab4fa58-abae-4805-942d-3ac67fbb4b19 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1367 microversion: 2.1 time: 0.083957 Oct 20 06:31:15.853355 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1177/2342] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:31:15 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1367 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:31:16.876269 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-56aab844-18f4-4629-93de-9241615e8a96 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:31:16.876939 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-56aab844-18f4-4629-93de-9241615e8a96 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:31:16.883260 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-56aab844-18f4-4629-93de-9241615e8a96 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:31:16.883734 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-56aab844-18f4-4629-93de-9241615e8a96 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:31:16.884420 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-56aab844-18f4-4629-93de-9241615e8a96 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:31:16.885126 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-56aab844-18f4-4629-93de-9241615e8a96 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:31:16.885803 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-56aab844-18f4-4629-93de-9241615e8a96 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:31:16.886228 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-56aab844-18f4-4629-93de-9241615e8a96 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:31:16.951135 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-56aab844-18f4-4629-93de-9241615e8a96 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:31:16.960089 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-56aab844-18f4-4629-93de-9241615e8a96 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1367 microversion: 2.1 time: 0.087863 Oct 20 06:31:16.960678 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1166/2343] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:31:16 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1367 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:31:17.984404 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-5e5b1ea5-b137-478c-a87c-58a7b649dccd tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:31:17.985049 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-5e5b1ea5-b137-478c-a87c-58a7b649dccd tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:31:17.991518 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5e5b1ea5-b137-478c-a87c-58a7b649dccd tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:31:17.992008 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5e5b1ea5-b137-478c-a87c-58a7b649dccd tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:31:17.992449 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5e5b1ea5-b137-478c-a87c-58a7b649dccd tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:31:17.993227 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5e5b1ea5-b137-478c-a87c-58a7b649dccd tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:31:17.993688 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5e5b1ea5-b137-478c-a87c-58a7b649dccd tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:31:17.994118 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5e5b1ea5-b137-478c-a87c-58a7b649dccd tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:31:18.059370 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-5e5b1ea5-b137-478c-a87c-58a7b649dccd tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:31:18.067690 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-5e5b1ea5-b137-478c-a87c-58a7b649dccd tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1367 microversion: 2.1 time: 0.087329 Oct 20 06:31:18.068264 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1178/2344] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:31:17 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1367 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:31:19.091857 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-846e87b8-8c1b-4c44-a055-4b6b07c1059b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:31:19.092431 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-846e87b8-8c1b-4c44-a055-4b6b07c1059b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:31:19.098891 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-846e87b8-8c1b-4c44-a055-4b6b07c1059b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:31:19.099367 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-846e87b8-8c1b-4c44-a055-4b6b07c1059b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:31:19.099798 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-846e87b8-8c1b-4c44-a055-4b6b07c1059b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:31:19.100476 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-846e87b8-8c1b-4c44-a055-4b6b07c1059b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:31:19.100951 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-846e87b8-8c1b-4c44-a055-4b6b07c1059b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:31:19.101370 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-846e87b8-8c1b-4c44-a055-4b6b07c1059b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:31:19.165359 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-846e87b8-8c1b-4c44-a055-4b6b07c1059b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:31:19.174057 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-846e87b8-8c1b-4c44-a055-4b6b07c1059b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1367 microversion: 2.1 time: 0.086846 Oct 20 06:31:19.174877 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1167/2345] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:31:19 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1367 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:31:20.197388 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-d7d609f4-3952-4290-b0ad-3b44405bd321 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:31:20.198726 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-d7d609f4-3952-4290-b0ad-3b44405bd321 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:31:20.204950 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-d7d609f4-3952-4290-b0ad-3b44405bd321 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:31:20.205429 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-d7d609f4-3952-4290-b0ad-3b44405bd321 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:31:20.205860 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-d7d609f4-3952-4290-b0ad-3b44405bd321 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:31:20.206544 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-d7d609f4-3952-4290-b0ad-3b44405bd321 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:31:20.206993 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-d7d609f4-3952-4290-b0ad-3b44405bd321 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:31:20.207415 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-d7d609f4-3952-4290-b0ad-3b44405bd321 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:31:20.269021 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-d7d609f4-3952-4290-b0ad-3b44405bd321 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:31:20.277291 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-d7d609f4-3952-4290-b0ad-3b44405bd321 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1367 microversion: 2.1 time: 0.083683 Oct 20 06:31:20.277846 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1179/2346] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:31:20 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1367 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:31:21.299925 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-530c17a4-571c-45eb-b68e-f15cec3673aa tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:31:21.301317 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-530c17a4-571c-45eb-b68e-f15cec3673aa tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:31:21.308392 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-530c17a4-571c-45eb-b68e-f15cec3673aa tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:31:21.308918 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-530c17a4-571c-45eb-b68e-f15cec3673aa tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:31:21.309349 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-530c17a4-571c-45eb-b68e-f15cec3673aa tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:31:21.310105 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-530c17a4-571c-45eb-b68e-f15cec3673aa tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:31:21.312479 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-530c17a4-571c-45eb-b68e-f15cec3673aa tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:31:21.314063 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-530c17a4-571c-45eb-b68e-f15cec3673aa tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:31:21.387357 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-530c17a4-571c-45eb-b68e-f15cec3673aa tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:31:21.397932 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-530c17a4-571c-45eb-b68e-f15cec3673aa tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1367 microversion: 2.1 time: 0.101878 Oct 20 06:31:21.404849 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1168/2347] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:31:21 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1367 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:31:22.427569 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-0071fbfa-0469-4613-80ce-9d9b13f23e25 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:31:22.428296 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-0071fbfa-0469-4613-80ce-9d9b13f23e25 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:31:22.435012 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0071fbfa-0469-4613-80ce-9d9b13f23e25 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:31:22.435496 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0071fbfa-0469-4613-80ce-9d9b13f23e25 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:31:22.435938 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0071fbfa-0469-4613-80ce-9d9b13f23e25 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:31:22.436645 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0071fbfa-0469-4613-80ce-9d9b13f23e25 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:31:22.437109 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0071fbfa-0469-4613-80ce-9d9b13f23e25 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:31:22.437535 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0071fbfa-0469-4613-80ce-9d9b13f23e25 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:31:22.502310 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-0071fbfa-0469-4613-80ce-9d9b13f23e25 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:31:22.510849 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-0071fbfa-0469-4613-80ce-9d9b13f23e25 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1367 microversion: 2.1 time: 0.087150 Oct 20 06:31:22.511412 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1180/2348] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:31:22 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1367 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:31:23.534496 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-92de2071-3372-4213-a98f-14580955792f tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:31:23.535112 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-92de2071-3372-4213-a98f-14580955792f tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:31:23.541648 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-92de2071-3372-4213-a98f-14580955792f tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:31:23.542206 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-92de2071-3372-4213-a98f-14580955792f tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:31:23.542623 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-92de2071-3372-4213-a98f-14580955792f tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:31:23.543296 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-92de2071-3372-4213-a98f-14580955792f tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:31:23.543749 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-92de2071-3372-4213-a98f-14580955792f tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:31:23.544174 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-92de2071-3372-4213-a98f-14580955792f tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:31:23.611502 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-92de2071-3372-4213-a98f-14580955792f tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:31:23.621718 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-92de2071-3372-4213-a98f-14580955792f tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1367 microversion: 2.1 time: 0.091050 Oct 20 06:31:23.622286 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1169/2349] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:31:23 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1367 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 06:31:24.645615 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-5dbd374c-423d-4a8c-8a80-dc80748dd034 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:31:24.646236 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-5dbd374c-423d-4a8c-8a80-dc80748dd034 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:31:24.652993 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5dbd374c-423d-4a8c-8a80-dc80748dd034 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:31:24.653485 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5dbd374c-423d-4a8c-8a80-dc80748dd034 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:31:24.653922 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5dbd374c-423d-4a8c-8a80-dc80748dd034 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:31:24.654626 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5dbd374c-423d-4a8c-8a80-dc80748dd034 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:31:24.655080 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5dbd374c-423d-4a8c-8a80-dc80748dd034 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:31:24.655507 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5dbd374c-423d-4a8c-8a80-dc80748dd034 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:31:24.717009 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-5dbd374c-423d-4a8c-8a80-dc80748dd034 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:31:24.725392 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-5dbd374c-423d-4a8c-8a80-dc80748dd034 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1367 microversion: 2.1 time: 0.083595 Oct 20 06:31:24.725959 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1181/2350] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:31:24 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1367 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:31:25.749084 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-a1f5a865-81f4-4c76-a48d-03d8ce22bc04 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:31:25.749699 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-a1f5a865-81f4-4c76-a48d-03d8ce22bc04 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:31:25.756230 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a1f5a865-81f4-4c76-a48d-03d8ce22bc04 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:31:25.756735 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a1f5a865-81f4-4c76-a48d-03d8ce22bc04 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:31:25.757175 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a1f5a865-81f4-4c76-a48d-03d8ce22bc04 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:31:25.757878 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a1f5a865-81f4-4c76-a48d-03d8ce22bc04 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:31:25.758338 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a1f5a865-81f4-4c76-a48d-03d8ce22bc04 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:31:25.758762 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a1f5a865-81f4-4c76-a48d-03d8ce22bc04 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:31:25.821291 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-a1f5a865-81f4-4c76-a48d-03d8ce22bc04 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:31:25.829556 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-a1f5a865-81f4-4c76-a48d-03d8ce22bc04 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1367 microversion: 2.1 time: 0.084508 Oct 20 06:31:25.830117 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1170/2351] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:31:25 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1367 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:31:26.852918 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-7838ad66-b9b6-421a-be07-60cd9bf0d8f5 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:31:26.853535 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-7838ad66-b9b6-421a-be07-60cd9bf0d8f5 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:31:26.860861 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7838ad66-b9b6-421a-be07-60cd9bf0d8f5 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:31:26.861352 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7838ad66-b9b6-421a-be07-60cd9bf0d8f5 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:31:26.861796 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7838ad66-b9b6-421a-be07-60cd9bf0d8f5 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:31:26.862494 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7838ad66-b9b6-421a-be07-60cd9bf0d8f5 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:31:26.862946 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7838ad66-b9b6-421a-be07-60cd9bf0d8f5 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:31:26.863373 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7838ad66-b9b6-421a-be07-60cd9bf0d8f5 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:31:26.925331 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-7838ad66-b9b6-421a-be07-60cd9bf0d8f5 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:31:26.934497 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-7838ad66-b9b6-421a-be07-60cd9bf0d8f5 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1367 microversion: 2.1 time: 0.085393 Oct 20 06:31:26.935005 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1182/2352] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:31:26 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1367 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:31:27.957306 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-ebc041d7-c60e-4fef-b0af-5e1f6cfda562 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:31:27.957933 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-ebc041d7-c60e-4fef-b0af-5e1f6cfda562 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:31:27.963949 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ebc041d7-c60e-4fef-b0af-5e1f6cfda562 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:31:27.964425 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ebc041d7-c60e-4fef-b0af-5e1f6cfda562 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:31:27.964884 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ebc041d7-c60e-4fef-b0af-5e1f6cfda562 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:31:27.965572 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ebc041d7-c60e-4fef-b0af-5e1f6cfda562 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:31:27.966019 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ebc041d7-c60e-4fef-b0af-5e1f6cfda562 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:31:27.966439 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ebc041d7-c60e-4fef-b0af-5e1f6cfda562 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:31:28.030448 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-ebc041d7-c60e-4fef-b0af-5e1f6cfda562 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:31:28.038992 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-ebc041d7-c60e-4fef-b0af-5e1f6cfda562 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1367 microversion: 2.1 time: 0.085895 Oct 20 06:31:28.039801 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1171/2353] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:31:27 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1367 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:31:29.062751 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-09d25c60-027f-4ed9-b604-537bd3c0e0ed tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:31:29.063330 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-09d25c60-027f-4ed9-b604-537bd3c0e0ed tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:31:29.069674 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-09d25c60-027f-4ed9-b604-537bd3c0e0ed tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:31:29.070155 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-09d25c60-027f-4ed9-b604-537bd3c0e0ed tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:31:29.070588 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-09d25c60-027f-4ed9-b604-537bd3c0e0ed tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:31:29.071273 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-09d25c60-027f-4ed9-b604-537bd3c0e0ed tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:31:29.071720 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-09d25c60-027f-4ed9-b604-537bd3c0e0ed tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:31:29.072139 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-09d25c60-027f-4ed9-b604-537bd3c0e0ed tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:31:29.135821 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-09d25c60-027f-4ed9-b604-537bd3c0e0ed tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:31:29.144352 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-09d25c60-027f-4ed9-b604-537bd3c0e0ed tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1367 microversion: 2.1 time: 0.085510 Oct 20 06:31:29.144969 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1183/2354] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:31:29 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1367 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:31:30.168155 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-da9977e0-55d3-4df9-ab9b-3062aac833dc tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:31:30.168917 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-da9977e0-55d3-4df9-ab9b-3062aac833dc tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:31:30.175365 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-da9977e0-55d3-4df9-ab9b-3062aac833dc tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:31:30.175848 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-da9977e0-55d3-4df9-ab9b-3062aac833dc tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:31:30.176289 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-da9977e0-55d3-4df9-ab9b-3062aac833dc tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:31:30.177010 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-da9977e0-55d3-4df9-ab9b-3062aac833dc tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:31:30.177470 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-da9977e0-55d3-4df9-ab9b-3062aac833dc tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:31:30.177897 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-da9977e0-55d3-4df9-ab9b-3062aac833dc tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:31:30.239180 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-da9977e0-55d3-4df9-ab9b-3062aac833dc tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:31:30.247608 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-da9977e0-55d3-4df9-ab9b-3062aac833dc tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1367 microversion: 2.1 time: 0.083973 Oct 20 06:31:30.248220 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1172/2355] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:31:30 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1367 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:31:31.270697 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-da072974-76ef-49b8-b8b2-b0e33812de55 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:31:31.271317 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-da072974-76ef-49b8-b8b2-b0e33812de55 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:31:31.278797 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-da072974-76ef-49b8-b8b2-b0e33812de55 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:31:31.279292 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-da072974-76ef-49b8-b8b2-b0e33812de55 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:31:31.279732 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-da072974-76ef-49b8-b8b2-b0e33812de55 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:31:31.280445 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-da072974-76ef-49b8-b8b2-b0e33812de55 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:31:31.280936 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-da072974-76ef-49b8-b8b2-b0e33812de55 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:31:31.281369 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-da072974-76ef-49b8-b8b2-b0e33812de55 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:31:31.346219 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-da072974-76ef-49b8-b8b2-b0e33812de55 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:31:31.354559 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-da072974-76ef-49b8-b8b2-b0e33812de55 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1367 microversion: 2.1 time: 0.087679 Oct 20 06:31:31.355528 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1184/2356] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:31:31 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1367 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:31:32.377054 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-6f38e135-421e-4fc9-add9-4b5353d27613 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:31:32.377672 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-6f38e135-421e-4fc9-add9-4b5353d27613 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:31:32.380182 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 20 06:31:32.380330 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: Thu Oct 20 06:31:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 (ip 10.222.0.20) !!! Oct 20 06:31:32.381355 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 20 06:31:32.381479 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: Thu Oct 20 06:31:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 (ip 10.222.0.20) !!! Oct 20 06:31:32.389649 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-6f38e135-421e-4fc9-add9-4b5353d27613 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:31:32.390139 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-6f38e135-421e-4fc9-add9-4b5353d27613 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:31:32.390582 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-6f38e135-421e-4fc9-add9-4b5353d27613 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:31:32.391291 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-6f38e135-421e-4fc9-add9-4b5353d27613 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:31:32.391817 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-6f38e135-421e-4fc9-add9-4b5353d27613 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:31:32.392203 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-6f38e135-421e-4fc9-add9-4b5353d27613 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:31:32.458944 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-6f38e135-421e-4fc9-add9-4b5353d27613 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:31:32.468157 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-6f38e135-421e-4fc9-add9-4b5353d27613 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1367 microversion: 2.1 time: 0.095050 Oct 20 06:31:32.468748 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1173/2357] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:31:32 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1367 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:31:33.492106 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-99f8d66c-e612-4595-a7bd-ec3ec976a969 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:31:33.492823 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-99f8d66c-e612-4595-a7bd-ec3ec976a969 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:31:33.500639 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-99f8d66c-e612-4595-a7bd-ec3ec976a969 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:31:33.501162 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-99f8d66c-e612-4595-a7bd-ec3ec976a969 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:31:33.501603 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-99f8d66c-e612-4595-a7bd-ec3ec976a969 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:31:33.502321 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-99f8d66c-e612-4595-a7bd-ec3ec976a969 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:31:33.502782 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-99f8d66c-e612-4595-a7bd-ec3ec976a969 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:31:33.503212 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-99f8d66c-e612-4595-a7bd-ec3ec976a969 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:31:33.567058 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-99f8d66c-e612-4595-a7bd-ec3ec976a969 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:31:33.575968 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-99f8d66c-e612-4595-a7bd-ec3ec976a969 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1367 microversion: 2.1 time: 0.087665 Oct 20 06:31:33.576550 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1185/2358] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:31:33 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1367 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:31:34.598775 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-8ff422fc-9022-420b-a16e-6dbe34ecb3cb tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:31:34.599316 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-8ff422fc-9022-420b-a16e-6dbe34ecb3cb tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:31:34.605784 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-8ff422fc-9022-420b-a16e-6dbe34ecb3cb tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:31:34.606268 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-8ff422fc-9022-420b-a16e-6dbe34ecb3cb tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:31:34.606707 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-8ff422fc-9022-420b-a16e-6dbe34ecb3cb tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:31:34.607402 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-8ff422fc-9022-420b-a16e-6dbe34ecb3cb tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:31:34.607864 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-8ff422fc-9022-420b-a16e-6dbe34ecb3cb tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:31:34.608292 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-8ff422fc-9022-420b-a16e-6dbe34ecb3cb tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:31:34.670096 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-8ff422fc-9022-420b-a16e-6dbe34ecb3cb tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:31:34.678430 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-8ff422fc-9022-420b-a16e-6dbe34ecb3cb tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1367 microversion: 2.1 time: 0.083796 Oct 20 06:31:34.678992 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1174/2359] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:31:34 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1367 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:31:35.702241 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-b653b2eb-9f66-47f3-bd00-7cc4525a44fc tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:31:35.702839 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-b653b2eb-9f66-47f3-bd00-7cc4525a44fc tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:31:35.709578 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b653b2eb-9f66-47f3-bd00-7cc4525a44fc tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:31:35.711008 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b653b2eb-9f66-47f3-bd00-7cc4525a44fc tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:31:35.711457 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b653b2eb-9f66-47f3-bd00-7cc4525a44fc tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:31:35.712159 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b653b2eb-9f66-47f3-bd00-7cc4525a44fc tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:31:35.712660 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b653b2eb-9f66-47f3-bd00-7cc4525a44fc tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:31:35.713157 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b653b2eb-9f66-47f3-bd00-7cc4525a44fc tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:31:35.773721 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-b653b2eb-9f66-47f3-bd00-7cc4525a44fc tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:31:35.782970 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-b653b2eb-9f66-47f3-bd00-7cc4525a44fc tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1367 microversion: 2.1 time: 0.084888 Oct 20 06:31:35.783531 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1186/2360] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:31:35 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1367 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:31:36.805986 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-8a5c5cf5-28eb-4289-8c00-cb7aede8326a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:31:36.806735 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-8a5c5cf5-28eb-4289-8c00-cb7aede8326a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:31:36.813852 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-8a5c5cf5-28eb-4289-8c00-cb7aede8326a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:31:36.814336 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-8a5c5cf5-28eb-4289-8c00-cb7aede8326a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:31:36.814774 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-8a5c5cf5-28eb-4289-8c00-cb7aede8326a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:31:36.815463 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-8a5c5cf5-28eb-4289-8c00-cb7aede8326a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:31:36.815919 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-8a5c5cf5-28eb-4289-8c00-cb7aede8326a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:31:36.816341 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-8a5c5cf5-28eb-4289-8c00-cb7aede8326a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:31:36.881746 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-8a5c5cf5-28eb-4289-8c00-cb7aede8326a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:31:36.890417 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-8a5c5cf5-28eb-4289-8c00-cb7aede8326a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1367 microversion: 2.1 time: 0.088253 Oct 20 06:31:36.890955 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1175/2361] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:31:36 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1367 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:31:37.913941 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-7c23b57d-4e94-4114-be12-1f4fecc4cd76 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:31:37.914549 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-7c23b57d-4e94-4114-be12-1f4fecc4cd76 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:31:37.916956 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG dbcounter [-] [118860] Writing DB stats nova_api:SELECT=28 {{(pid=118860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:31:37.922109 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7c23b57d-4e94-4114-be12-1f4fecc4cd76 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:31:37.922592 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7c23b57d-4e94-4114-be12-1f4fecc4cd76 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:31:37.923025 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7c23b57d-4e94-4114-be12-1f4fecc4cd76 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:31:37.923710 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7c23b57d-4e94-4114-be12-1f4fecc4cd76 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:31:37.924160 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7c23b57d-4e94-4114-be12-1f4fecc4cd76 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:31:37.924614 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7c23b57d-4e94-4114-be12-1f4fecc4cd76 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:31:37.927323 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG dbcounter [-] [118860] Writing DB stats nova_cell1:SELECT=84 {{(pid=118860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:31:37.988035 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-7c23b57d-4e94-4114-be12-1f4fecc4cd76 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:31:37.997220 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-7c23b57d-4e94-4114-be12-1f4fecc4cd76 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1367 microversion: 2.1 time: 0.087148 Oct 20 06:31:37.997779 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1187/2362] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:31:37 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1367 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:31:39.019799 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-598520f5-c03e-41f0-a029-47336ff15082 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:31:39.020532 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-598520f5-c03e-41f0-a029-47336ff15082 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:31:39.027488 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-598520f5-c03e-41f0-a029-47336ff15082 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:31:39.027983 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-598520f5-c03e-41f0-a029-47336ff15082 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:31:39.028425 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-598520f5-c03e-41f0-a029-47336ff15082 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:31:39.029173 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-598520f5-c03e-41f0-a029-47336ff15082 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:31:39.029635 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-598520f5-c03e-41f0-a029-47336ff15082 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:31:39.030065 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-598520f5-c03e-41f0-a029-47336ff15082 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:31:39.096037 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-598520f5-c03e-41f0-a029-47336ff15082 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:31:39.104203 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-598520f5-c03e-41f0-a029-47336ff15082 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1367 microversion: 2.1 time: 0.088336 Oct 20 06:31:39.105655 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1176/2363] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:31:39 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1367 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:31:40.127603 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-9a59b244-9c4d-4742-9ef3-ac1747e9348f tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:31:40.128263 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-9a59b244-9c4d-4742-9ef3-ac1747e9348f tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:31:40.134996 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-9a59b244-9c4d-4742-9ef3-ac1747e9348f tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:31:40.136097 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-9a59b244-9c4d-4742-9ef3-ac1747e9348f tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:31:40.136589 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-9a59b244-9c4d-4742-9ef3-ac1747e9348f tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:31:40.137510 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-9a59b244-9c4d-4742-9ef3-ac1747e9348f tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:31:40.137965 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-9a59b244-9c4d-4742-9ef3-ac1747e9348f tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:31:40.138524 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-9a59b244-9c4d-4742-9ef3-ac1747e9348f tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:31:40.204789 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-9a59b244-9c4d-4742-9ef3-ac1747e9348f tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:31:40.213055 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-9a59b244-9c4d-4742-9ef3-ac1747e9348f tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1367 microversion: 2.1 time: 0.089401 Oct 20 06:31:40.213636 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1188/2364] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:31:40 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1367 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:31:41.235502 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-67f4b0a8-3af6-4c6c-9e25-4d28f4b69941 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:31:41.236117 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-67f4b0a8-3af6-4c6c-9e25-4d28f4b69941 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:31:41.238452 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG dbcounter [-] [118861] Writing DB stats nova_api:SELECT=28 {{(pid=118861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:31:41.243737 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-67f4b0a8-3af6-4c6c-9e25-4d28f4b69941 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:31:41.244225 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-67f4b0a8-3af6-4c6c-9e25-4d28f4b69941 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:31:41.244684 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-67f4b0a8-3af6-4c6c-9e25-4d28f4b69941 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:31:41.245843 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-67f4b0a8-3af6-4c6c-9e25-4d28f4b69941 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:31:41.246310 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-67f4b0a8-3af6-4c6c-9e25-4d28f4b69941 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:31:41.246741 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-67f4b0a8-3af6-4c6c-9e25-4d28f4b69941 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:31:41.249525 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG dbcounter [-] [118861] Writing DB stats nova_cell1:SELECT=84 {{(pid=118861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:31:41.311135 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-67f4b0a8-3af6-4c6c-9e25-4d28f4b69941 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:31:41.319482 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-67f4b0a8-3af6-4c6c-9e25-4d28f4b69941 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1367 microversion: 2.1 time: 0.087878 Oct 20 06:31:41.320046 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1177/2365] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:31:41 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1367 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:31:42.343430 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-82bf07c2-1a82-446b-8831-25e44b71f777 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:31:42.344159 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-82bf07c2-1a82-446b-8831-25e44b71f777 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:31:42.350229 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-82bf07c2-1a82-446b-8831-25e44b71f777 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:31:42.350722 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-82bf07c2-1a82-446b-8831-25e44b71f777 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:31:42.351164 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-82bf07c2-1a82-446b-8831-25e44b71f777 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:31:42.351863 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-82bf07c2-1a82-446b-8831-25e44b71f777 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:31:42.352317 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-82bf07c2-1a82-446b-8831-25e44b71f777 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:31:42.352768 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-82bf07c2-1a82-446b-8831-25e44b71f777 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:31:42.415862 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-82bf07c2-1a82-446b-8831-25e44b71f777 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:31:42.424992 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-82bf07c2-1a82-446b-8831-25e44b71f777 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1367 microversion: 2.1 time: 0.086517 Oct 20 06:31:42.425569 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1189/2366] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:31:42 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1367 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:31:43.447349 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-0b673397-ce40-4ea8-b08f-d843bf665639 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:31:43.448621 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-0b673397-ce40-4ea8-b08f-d843bf665639 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:31:43.455187 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-0b673397-ce40-4ea8-b08f-d843bf665639 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:31:43.455668 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-0b673397-ce40-4ea8-b08f-d843bf665639 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:31:43.456098 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-0b673397-ce40-4ea8-b08f-d843bf665639 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:31:43.456807 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-0b673397-ce40-4ea8-b08f-d843bf665639 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:31:43.457255 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-0b673397-ce40-4ea8-b08f-d843bf665639 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:31:43.457676 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-0b673397-ce40-4ea8-b08f-d843bf665639 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:31:43.520131 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-0b673397-ce40-4ea8-b08f-d843bf665639 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:31:43.528740 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-0b673397-ce40-4ea8-b08f-d843bf665639 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1367 microversion: 2.1 time: 0.085252 Oct 20 06:31:43.529298 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1178/2367] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:31:43 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1367 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:31:44.551516 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-55b2e894-3e3c-433f-8b2a-e13aeafed7ab tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:31:44.552049 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-55b2e894-3e3c-433f-8b2a-e13aeafed7ab tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:31:44.559757 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-55b2e894-3e3c-433f-8b2a-e13aeafed7ab tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:31:44.560241 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-55b2e894-3e3c-433f-8b2a-e13aeafed7ab tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:31:44.560682 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-55b2e894-3e3c-433f-8b2a-e13aeafed7ab tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:31:44.561397 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-55b2e894-3e3c-433f-8b2a-e13aeafed7ab tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:31:44.561881 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-55b2e894-3e3c-433f-8b2a-e13aeafed7ab tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:31:44.562312 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-55b2e894-3e3c-433f-8b2a-e13aeafed7ab tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:31:44.626045 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-55b2e894-3e3c-433f-8b2a-e13aeafed7ab tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:31:44.634551 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-55b2e894-3e3c-433f-8b2a-e13aeafed7ab tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1367 microversion: 2.1 time: 0.086972 Oct 20 06:31:44.635113 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1190/2368] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:31:44 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1367 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:31:45.657773 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-7f436c18-718b-4596-83b3-47b1c84a555e tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:31:45.658386 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-7f436c18-718b-4596-83b3-47b1c84a555e tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:31:45.664895 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7f436c18-718b-4596-83b3-47b1c84a555e tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:31:45.665379 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7f436c18-718b-4596-83b3-47b1c84a555e tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:31:45.665817 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7f436c18-718b-4596-83b3-47b1c84a555e tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:31:45.667007 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7f436c18-718b-4596-83b3-47b1c84a555e tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:31:45.667454 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7f436c18-718b-4596-83b3-47b1c84a555e tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:31:45.667874 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7f436c18-718b-4596-83b3-47b1c84a555e tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:31:45.736502 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-7f436c18-718b-4596-83b3-47b1c84a555e tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:31:45.744882 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-7f436c18-718b-4596-83b3-47b1c84a555e tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1367 microversion: 2.1 time: 0.090847 Oct 20 06:31:45.745444 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1179/2369] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:31:45 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1367 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:31:46.767593 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-1734f64a-76b4-48bb-9a56-39d35d46d284 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:31:46.768209 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-1734f64a-76b4-48bb-9a56-39d35d46d284 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:31:46.774737 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1734f64a-76b4-48bb-9a56-39d35d46d284 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:31:46.775225 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1734f64a-76b4-48bb-9a56-39d35d46d284 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:31:46.775661 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1734f64a-76b4-48bb-9a56-39d35d46d284 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:31:46.777652 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1734f64a-76b4-48bb-9a56-39d35d46d284 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:31:46.778114 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1734f64a-76b4-48bb-9a56-39d35d46d284 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:31:46.778547 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1734f64a-76b4-48bb-9a56-39d35d46d284 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:31:46.841267 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-1734f64a-76b4-48bb-9a56-39d35d46d284 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:31:46.849589 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-1734f64a-76b4-48bb-9a56-39d35d46d284 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1367 microversion: 2.1 time: 0.085918 Oct 20 06:31:46.850159 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1191/2370] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:31:46 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1367 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:31:47.874573 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-4f5eaee1-c69c-424f-84c1-dc86f3c8dae4 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:31:47.875215 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-4f5eaee1-c69c-424f-84c1-dc86f3c8dae4 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:31:47.881698 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4f5eaee1-c69c-424f-84c1-dc86f3c8dae4 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:31:47.882174 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4f5eaee1-c69c-424f-84c1-dc86f3c8dae4 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:31:47.882609 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4f5eaee1-c69c-424f-84c1-dc86f3c8dae4 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:31:47.883321 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4f5eaee1-c69c-424f-84c1-dc86f3c8dae4 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:31:47.884029 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4f5eaee1-c69c-424f-84c1-dc86f3c8dae4 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:31:47.884449 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4f5eaee1-c69c-424f-84c1-dc86f3c8dae4 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:31:47.946532 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-4f5eaee1-c69c-424f-84c1-dc86f3c8dae4 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:31:47.955410 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-4f5eaee1-c69c-424f-84c1-dc86f3c8dae4 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1367 microversion: 2.1 time: 0.085682 Oct 20 06:31:47.955981 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1180/2371] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:31:47 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1367 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:31:48.978736 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-6e3e3a51-d244-4ee2-a7c2-2aaa2bdac06b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:31:48.979876 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-6e3e3a51-d244-4ee2-a7c2-2aaa2bdac06b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:31:48.986436 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-6e3e3a51-d244-4ee2-a7c2-2aaa2bdac06b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:31:48.986922 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-6e3e3a51-d244-4ee2-a7c2-2aaa2bdac06b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:31:48.987368 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-6e3e3a51-d244-4ee2-a7c2-2aaa2bdac06b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:31:48.988095 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-6e3e3a51-d244-4ee2-a7c2-2aaa2bdac06b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:31:48.988551 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-6e3e3a51-d244-4ee2-a7c2-2aaa2bdac06b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:31:48.989005 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-6e3e3a51-d244-4ee2-a7c2-2aaa2bdac06b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:31:49.057760 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-6e3e3a51-d244-4ee2-a7c2-2aaa2bdac06b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:31:49.066267 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-6e3e3a51-d244-4ee2-a7c2-2aaa2bdac06b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1367 microversion: 2.1 time: 0.091513 Oct 20 06:31:49.066844 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1192/2372] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:31:48 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1367 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:31:50.090072 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-15fdcfc9-517d-4ed7-9bdf-f00d187c55ab tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:31:50.090617 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-15fdcfc9-517d-4ed7-9bdf-f00d187c55ab tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:31:50.097081 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-15fdcfc9-517d-4ed7-9bdf-f00d187c55ab tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:31:50.097570 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-15fdcfc9-517d-4ed7-9bdf-f00d187c55ab tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:31:50.098001 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-15fdcfc9-517d-4ed7-9bdf-f00d187c55ab tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:31:50.098723 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-15fdcfc9-517d-4ed7-9bdf-f00d187c55ab tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:31:50.099173 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-15fdcfc9-517d-4ed7-9bdf-f00d187c55ab tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:31:50.099591 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-15fdcfc9-517d-4ed7-9bdf-f00d187c55ab tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:31:50.162752 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-15fdcfc9-517d-4ed7-9bdf-f00d187c55ab tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:31:50.171117 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-15fdcfc9-517d-4ed7-9bdf-f00d187c55ab tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1367 microversion: 2.1 time: 0.085575 Oct 20 06:31:50.171686 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1181/2373] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:31:50 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1367 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:31:51.194807 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-665e6f19-34eb-464e-bd2d-d786dc56bea2 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:31:51.195435 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-665e6f19-34eb-464e-bd2d-d786dc56bea2 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:31:51.202194 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-665e6f19-34eb-464e-bd2d-d786dc56bea2 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:31:51.202674 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-665e6f19-34eb-464e-bd2d-d786dc56bea2 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:31:51.203107 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-665e6f19-34eb-464e-bd2d-d786dc56bea2 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:31:51.203799 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-665e6f19-34eb-464e-bd2d-d786dc56bea2 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:31:51.204246 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-665e6f19-34eb-464e-bd2d-d786dc56bea2 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:31:51.204671 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-665e6f19-34eb-464e-bd2d-d786dc56bea2 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:31:51.267033 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-665e6f19-34eb-464e-bd2d-d786dc56bea2 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:31:51.275239 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-665e6f19-34eb-464e-bd2d-d786dc56bea2 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1367 microversion: 2.1 time: 0.084462 Oct 20 06:31:51.275836 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1193/2374] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:31:51 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1367 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:31:52.297828 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-ff5d4b27-fc32-4536-aafc-ec82ca9a3c42 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:31:52.298576 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-ff5d4b27-fc32-4536-aafc-ec82ca9a3c42 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:31:52.305775 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ff5d4b27-fc32-4536-aafc-ec82ca9a3c42 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:31:52.305775 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ff5d4b27-fc32-4536-aafc-ec82ca9a3c42 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:31:52.306554 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ff5d4b27-fc32-4536-aafc-ec82ca9a3c42 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:31:52.306694 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ff5d4b27-fc32-4536-aafc-ec82ca9a3c42 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:31:52.307345 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ff5d4b27-fc32-4536-aafc-ec82ca9a3c42 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:31:52.307782 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ff5d4b27-fc32-4536-aafc-ec82ca9a3c42 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:31:52.368990 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-ff5d4b27-fc32-4536-aafc-ec82ca9a3c42 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:31:52.377311 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-ff5d4b27-fc32-4536-aafc-ec82ca9a3c42 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1367 microversion: 2.1 time: 0.083394 Oct 20 06:31:52.377875 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1182/2375] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:31:52 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1367 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:31:53.401285 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-e783d725-1142-4901-8949-1617f7b41147 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:31:53.401881 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-e783d725-1142-4901-8949-1617f7b41147 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:31:53.408265 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e783d725-1142-4901-8949-1617f7b41147 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:31:53.408775 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e783d725-1142-4901-8949-1617f7b41147 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:31:53.409211 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e783d725-1142-4901-8949-1617f7b41147 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:31:53.409895 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e783d725-1142-4901-8949-1617f7b41147 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:31:53.410343 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e783d725-1142-4901-8949-1617f7b41147 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:31:53.410764 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e783d725-1142-4901-8949-1617f7b41147 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:31:53.473215 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-e783d725-1142-4901-8949-1617f7b41147 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:31:53.481505 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-e783d725-1142-4901-8949-1617f7b41147 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1367 microversion: 2.1 time: 0.084199 Oct 20 06:31:53.482064 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1194/2376] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:31:53 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1367 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:31:54.505078 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-1a80e382-dd11-468b-85c7-fbe377bbafa9 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:31:54.505772 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-1a80e382-dd11-468b-85c7-fbe377bbafa9 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:31:54.507660 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 20 06:31:54.507795 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: Thu Oct 20 06:31:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 (ip 10.222.0.20) !!! Oct 20 06:31:54.520820 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1a80e382-dd11-468b-85c7-fbe377bbafa9 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:31:54.521309 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1a80e382-dd11-468b-85c7-fbe377bbafa9 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:31:54.521744 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1a80e382-dd11-468b-85c7-fbe377bbafa9 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:31:54.522441 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1a80e382-dd11-468b-85c7-fbe377bbafa9 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:31:54.522894 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1a80e382-dd11-468b-85c7-fbe377bbafa9 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:31:54.523319 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1a80e382-dd11-468b-85c7-fbe377bbafa9 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:31:54.587508 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-1a80e382-dd11-468b-85c7-fbe377bbafa9 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:31:54.596381 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-1a80e382-dd11-468b-85c7-fbe377bbafa9 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1367 microversion: 2.1 time: 0.095251 Oct 20 06:31:54.596975 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1183/2377] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:31:54 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1367 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:31:55.619982 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-34768b51-b8d9-4f56-92d3-33c7eafc6207 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:31:55.620683 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-34768b51-b8d9-4f56-92d3-33c7eafc6207 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:31:55.627610 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-34768b51-b8d9-4f56-92d3-33c7eafc6207 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:31:55.628106 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-34768b51-b8d9-4f56-92d3-33c7eafc6207 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:31:55.628550 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-34768b51-b8d9-4f56-92d3-33c7eafc6207 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:31:55.629278 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-34768b51-b8d9-4f56-92d3-33c7eafc6207 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:31:55.629849 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-34768b51-b8d9-4f56-92d3-33c7eafc6207 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:31:55.630293 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-34768b51-b8d9-4f56-92d3-33c7eafc6207 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:31:55.692001 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-34768b51-b8d9-4f56-92d3-33c7eafc6207 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:31:55.701311 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-34768b51-b8d9-4f56-92d3-33c7eafc6207 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1367 microversion: 2.1 time: 0.085736 Oct 20 06:31:55.701884 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1195/2378] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:31:55 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1367 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:31:56.723345 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-5de79116-9745-4c03-8aea-a6430b75bc79 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:31:56.724019 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-5de79116-9745-4c03-8aea-a6430b75bc79 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:31:56.731293 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5de79116-9745-4c03-8aea-a6430b75bc79 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:31:56.731783 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5de79116-9745-4c03-8aea-a6430b75bc79 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:31:56.732223 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5de79116-9745-4c03-8aea-a6430b75bc79 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:31:56.733026 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5de79116-9745-4c03-8aea-a6430b75bc79 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:31:56.733486 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5de79116-9745-4c03-8aea-a6430b75bc79 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:31:56.733915 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5de79116-9745-4c03-8aea-a6430b75bc79 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:31:56.796015 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-5de79116-9745-4c03-8aea-a6430b75bc79 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:31:56.804391 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-5de79116-9745-4c03-8aea-a6430b75bc79 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1367 microversion: 2.1 time: 0.084884 Oct 20 06:31:56.805000 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1184/2379] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:31:56 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1367 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:31:57.827710 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-bf2f4de6-0d7d-496e-af82-b29a006c0f10 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:31:57.828402 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-bf2f4de6-0d7d-496e-af82-b29a006c0f10 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:31:57.834997 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-bf2f4de6-0d7d-496e-af82-b29a006c0f10 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:31:57.835488 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-bf2f4de6-0d7d-496e-af82-b29a006c0f10 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:31:57.835923 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-bf2f4de6-0d7d-496e-af82-b29a006c0f10 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:31:57.836632 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-bf2f4de6-0d7d-496e-af82-b29a006c0f10 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:31:57.837136 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-bf2f4de6-0d7d-496e-af82-b29a006c0f10 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:31:57.837561 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-bf2f4de6-0d7d-496e-af82-b29a006c0f10 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:31:57.902180 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-bf2f4de6-0d7d-496e-af82-b29a006c0f10 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:31:57.910400 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-bf2f4de6-0d7d-496e-af82-b29a006c0f10 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1367 microversion: 2.1 time: 0.086852 Oct 20 06:31:57.910954 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1196/2380] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:31:57 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1367 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:31:58.933699 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-b5f99d4a-b407-4806-bf0b-fa82757d8413 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:31:58.934472 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-b5f99d4a-b407-4806-bf0b-fa82757d8413 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:31:58.940600 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b5f99d4a-b407-4806-bf0b-fa82757d8413 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:31:58.941136 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b5f99d4a-b407-4806-bf0b-fa82757d8413 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:31:58.941575 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b5f99d4a-b407-4806-bf0b-fa82757d8413 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:31:58.942287 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b5f99d4a-b407-4806-bf0b-fa82757d8413 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:31:58.942721 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b5f99d4a-b407-4806-bf0b-fa82757d8413 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:31:58.943143 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b5f99d4a-b407-4806-bf0b-fa82757d8413 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:31:59.004201 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-b5f99d4a-b407-4806-bf0b-fa82757d8413 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:31:59.013472 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-b5f99d4a-b407-4806-bf0b-fa82757d8413 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1367 microversion: 2.1 time: 0.084100 Oct 20 06:31:59.014034 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1185/2381] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:31:58 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1367 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:32:00.036143 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-7df98a47-afc6-41a4-8c87-e320e80f32c5 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:32:00.036950 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-7df98a47-afc6-41a4-8c87-e320e80f32c5 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:32:00.043800 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7df98a47-afc6-41a4-8c87-e320e80f32c5 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:32:00.044296 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7df98a47-afc6-41a4-8c87-e320e80f32c5 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:32:00.044828 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7df98a47-afc6-41a4-8c87-e320e80f32c5 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:32:00.045547 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7df98a47-afc6-41a4-8c87-e320e80f32c5 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:32:00.046011 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7df98a47-afc6-41a4-8c87-e320e80f32c5 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:32:00.046440 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7df98a47-afc6-41a4-8c87-e320e80f32c5 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:32:00.112211 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-7df98a47-afc6-41a4-8c87-e320e80f32c5 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:32:00.121680 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-7df98a47-afc6-41a4-8c87-e320e80f32c5 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1367 microversion: 2.1 time: 0.089360 Oct 20 06:32:00.122263 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1197/2382] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:32:00 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1367 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:32:01.145390 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-489198ff-f75c-49f5-aabc-187bed8101ff tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:32:01.145995 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-489198ff-f75c-49f5-aabc-187bed8101ff tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:32:01.153269 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-489198ff-f75c-49f5-aabc-187bed8101ff tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:32:01.154031 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-489198ff-f75c-49f5-aabc-187bed8101ff tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:32:01.154470 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-489198ff-f75c-49f5-aabc-187bed8101ff tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:32:01.155179 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-489198ff-f75c-49f5-aabc-187bed8101ff tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:32:01.155627 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-489198ff-f75c-49f5-aabc-187bed8101ff tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:32:01.156047 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-489198ff-f75c-49f5-aabc-187bed8101ff tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:32:01.223053 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-489198ff-f75c-49f5-aabc-187bed8101ff tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:32:01.232084 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-489198ff-f75c-49f5-aabc-187bed8101ff tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1367 microversion: 2.1 time: 0.090567 Oct 20 06:32:01.234628 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1186/2383] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:32:01 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1367 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:32:02.255466 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-9c5efdaf-f90e-45c6-a588-81c63fdd0717 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:32:02.256083 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-9c5efdaf-f90e-45c6-a588-81c63fdd0717 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:32:02.263097 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-9c5efdaf-f90e-45c6-a588-81c63fdd0717 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:32:02.263636 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-9c5efdaf-f90e-45c6-a588-81c63fdd0717 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:32:02.264039 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-9c5efdaf-f90e-45c6-a588-81c63fdd0717 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:32:02.264769 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-9c5efdaf-f90e-45c6-a588-81c63fdd0717 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:32:02.265226 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-9c5efdaf-f90e-45c6-a588-81c63fdd0717 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:32:02.265651 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-9c5efdaf-f90e-45c6-a588-81c63fdd0717 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:32:02.330815 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-9c5efdaf-f90e-45c6-a588-81c63fdd0717 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:32:02.339851 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-9c5efdaf-f90e-45c6-a588-81c63fdd0717 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1367 microversion: 2.1 time: 0.088217 Oct 20 06:32:02.340631 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1198/2384] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:32:02 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1367 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:32:03.363456 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-44252004-7de6-4036-b3f1-64056e18b867 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:32:03.364199 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-44252004-7de6-4036-b3f1-64056e18b867 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:32:03.370995 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-44252004-7de6-4036-b3f1-64056e18b867 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:32:03.371466 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-44252004-7de6-4036-b3f1-64056e18b867 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:32:03.371893 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-44252004-7de6-4036-b3f1-64056e18b867 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:32:03.372580 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-44252004-7de6-4036-b3f1-64056e18b867 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:32:03.373061 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-44252004-7de6-4036-b3f1-64056e18b867 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:32:03.373479 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-44252004-7de6-4036-b3f1-64056e18b867 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:32:03.437541 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-44252004-7de6-4036-b3f1-64056e18b867 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:32:03.445688 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-44252004-7de6-4036-b3f1-64056e18b867 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1367 microversion: 2.1 time: 0.086267 Oct 20 06:32:03.446258 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1187/2385] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:32:03 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1367 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:32:04.468947 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-1a41124d-2691-431d-88a2-8df6a376dd22 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:32:04.469553 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-1a41124d-2691-431d-88a2-8df6a376dd22 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:32:04.476284 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1a41124d-2691-431d-88a2-8df6a376dd22 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:32:04.476800 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1a41124d-2691-431d-88a2-8df6a376dd22 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:32:04.477234 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1a41124d-2691-431d-88a2-8df6a376dd22 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:32:04.477928 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1a41124d-2691-431d-88a2-8df6a376dd22 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:32:04.478909 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1a41124d-2691-431d-88a2-8df6a376dd22 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:32:04.479330 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1a41124d-2691-431d-88a2-8df6a376dd22 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:32:04.547460 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-1a41124d-2691-431d-88a2-8df6a376dd22 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:32:04.555674 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-1a41124d-2691-431d-88a2-8df6a376dd22 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1367 microversion: 2.1 time: 0.090598 Oct 20 06:32:04.556180 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1199/2386] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:32:04 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1367 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:32:05.581398 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-45039290-6be7-41d2-b42a-7f5575ed8f37 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:32:05.581937 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-45039290-6be7-41d2-b42a-7f5575ed8f37 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:32:05.588745 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-45039290-6be7-41d2-b42a-7f5575ed8f37 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:32:05.589233 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-45039290-6be7-41d2-b42a-7f5575ed8f37 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:32:05.589672 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-45039290-6be7-41d2-b42a-7f5575ed8f37 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:32:05.590373 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-45039290-6be7-41d2-b42a-7f5575ed8f37 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:32:05.590824 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-45039290-6be7-41d2-b42a-7f5575ed8f37 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:32:05.591284 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-45039290-6be7-41d2-b42a-7f5575ed8f37 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:32:05.654050 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-45039290-6be7-41d2-b42a-7f5575ed8f37 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:32:05.662430 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-45039290-6be7-41d2-b42a-7f5575ed8f37 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1367 microversion: 2.1 time: 0.085013 Oct 20 06:32:05.662997 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1188/2387] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:32:05 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1367 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:32:06.686291 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-f073a0bc-02da-4ee6-8f30-fa60fa81e69a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:32:06.686889 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-f073a0bc-02da-4ee6-8f30-fa60fa81e69a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:32:06.693412 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f073a0bc-02da-4ee6-8f30-fa60fa81e69a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:32:06.693891 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f073a0bc-02da-4ee6-8f30-fa60fa81e69a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:32:06.694323 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f073a0bc-02da-4ee6-8f30-fa60fa81e69a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:32:06.695039 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f073a0bc-02da-4ee6-8f30-fa60fa81e69a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:32:06.695488 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f073a0bc-02da-4ee6-8f30-fa60fa81e69a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:32:06.695903 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f073a0bc-02da-4ee6-8f30-fa60fa81e69a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:32:06.758060 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-f073a0bc-02da-4ee6-8f30-fa60fa81e69a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:32:06.766836 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-f073a0bc-02da-4ee6-8f30-fa60fa81e69a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1367 microversion: 2.1 time: 0.084443 Oct 20 06:32:06.767400 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1200/2388] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:32:06 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1367 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:32:07.789792 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-af843eba-8bf3-44f0-95b9-6811bf124618 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:32:07.790584 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-af843eba-8bf3-44f0-95b9-6811bf124618 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:32:07.797454 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-af843eba-8bf3-44f0-95b9-6811bf124618 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:32:07.797643 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-af843eba-8bf3-44f0-95b9-6811bf124618 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:32:07.797951 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-af843eba-8bf3-44f0-95b9-6811bf124618 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:32:07.798748 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-af843eba-8bf3-44f0-95b9-6811bf124618 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:32:07.799277 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-af843eba-8bf3-44f0-95b9-6811bf124618 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:32:07.799748 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-af843eba-8bf3-44f0-95b9-6811bf124618 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:32:07.862548 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-af843eba-8bf3-44f0-95b9-6811bf124618 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:32:07.871549 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-af843eba-8bf3-44f0-95b9-6811bf124618 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1367 microversion: 2.1 time: 0.085589 Oct 20 06:32:07.887267 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1189/2389] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:32:07 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1367 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:32:08.895006 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-57c79d1b-410b-44db-a639-5a0b78b9bb2b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:32:08.895712 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-57c79d1b-410b-44db-a639-5a0b78b9bb2b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:32:08.898041 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG dbcounter [-] [118860] Writing DB stats nova_api:SELECT=28 {{(pid=118860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:32:08.904214 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-57c79d1b-410b-44db-a639-5a0b78b9bb2b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:32:08.904718 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-57c79d1b-410b-44db-a639-5a0b78b9bb2b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:32:08.905178 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-57c79d1b-410b-44db-a639-5a0b78b9bb2b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:32:08.905921 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-57c79d1b-410b-44db-a639-5a0b78b9bb2b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:32:08.906339 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-57c79d1b-410b-44db-a639-5a0b78b9bb2b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:32:08.906771 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-57c79d1b-410b-44db-a639-5a0b78b9bb2b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:32:08.909714 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG dbcounter [-] [118860] Writing DB stats nova_cell1:SELECT=84 {{(pid=118860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:32:08.969578 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-57c79d1b-410b-44db-a639-5a0b78b9bb2b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:32:08.977984 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-57c79d1b-410b-44db-a639-5a0b78b9bb2b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1367 microversion: 2.1 time: 0.086873 Oct 20 06:32:08.978858 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1201/2390] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:32:08 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1367 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:32:10.001096 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-038cd928-3624-4015-9be3-9531d4426f77 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:32:10.001713 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-038cd928-3624-4015-9be3-9531d4426f77 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:32:10.008286 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-038cd928-3624-4015-9be3-9531d4426f77 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:32:10.009062 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-038cd928-3624-4015-9be3-9531d4426f77 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:32:10.010106 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-038cd928-3624-4015-9be3-9531d4426f77 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:32:10.010809 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-038cd928-3624-4015-9be3-9531d4426f77 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:32:10.011266 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-038cd928-3624-4015-9be3-9531d4426f77 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:32:10.011698 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-038cd928-3624-4015-9be3-9531d4426f77 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:32:10.074963 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-038cd928-3624-4015-9be3-9531d4426f77 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:32:10.083355 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-038cd928-3624-4015-9be3-9531d4426f77 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1367 microversion: 2.1 time: 0.086135 Oct 20 06:32:10.083942 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1190/2391] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:32:09 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1367 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:32:11.106452 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-e7b7acf3-3308-4c76-88c8-a02a061f0436 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:32:11.107109 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-e7b7acf3-3308-4c76-88c8-a02a061f0436 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:32:11.113966 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e7b7acf3-3308-4c76-88c8-a02a061f0436 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:32:11.114450 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e7b7acf3-3308-4c76-88c8-a02a061f0436 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:32:11.114889 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e7b7acf3-3308-4c76-88c8-a02a061f0436 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:32:11.115597 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e7b7acf3-3308-4c76-88c8-a02a061f0436 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:32:11.116054 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e7b7acf3-3308-4c76-88c8-a02a061f0436 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:32:11.116482 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e7b7acf3-3308-4c76-88c8-a02a061f0436 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:32:11.179467 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-e7b7acf3-3308-4c76-88c8-a02a061f0436 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:32:11.188613 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-e7b7acf3-3308-4c76-88c8-a02a061f0436 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1367 microversion: 2.1 time: 0.087177 Oct 20 06:32:11.200886 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1202/2392] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:32:11 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1367 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:32:12.211442 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-465b80e1-d09b-41a5-8a18-431caab32408 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:32:12.212576 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-465b80e1-d09b-41a5-8a18-431caab32408 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:32:12.214920 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG dbcounter [-] [118861] Writing DB stats nova_api:SELECT=28 {{(pid=118861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:32:12.220521 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-465b80e1-d09b-41a5-8a18-431caab32408 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:32:12.221101 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-465b80e1-d09b-41a5-8a18-431caab32408 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:32:12.221541 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-465b80e1-d09b-41a5-8a18-431caab32408 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:32:12.222238 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-465b80e1-d09b-41a5-8a18-431caab32408 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:32:12.222690 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-465b80e1-d09b-41a5-8a18-431caab32408 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:32:12.223117 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-465b80e1-d09b-41a5-8a18-431caab32408 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:32:12.225794 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG dbcounter [-] [118861] Writing DB stats nova_cell1:SELECT=84 {{(pid=118861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:32:12.288225 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-465b80e1-d09b-41a5-8a18-431caab32408 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:32:12.298023 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-465b80e1-d09b-41a5-8a18-431caab32408 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1367 microversion: 2.1 time: 0.089466 Oct 20 06:32:12.298023 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1191/2393] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:32:12 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1367 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:32:13.319681 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-1a8e9168-e60f-457b-9735-026a39b93672 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:32:13.320275 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-1a8e9168-e60f-457b-9735-026a39b93672 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:32:13.327696 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1a8e9168-e60f-457b-9735-026a39b93672 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:32:13.328181 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1a8e9168-e60f-457b-9735-026a39b93672 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:32:13.328652 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1a8e9168-e60f-457b-9735-026a39b93672 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:32:13.329388 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1a8e9168-e60f-457b-9735-026a39b93672 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:32:13.329841 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1a8e9168-e60f-457b-9735-026a39b93672 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:32:13.330267 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1a8e9168-e60f-457b-9735-026a39b93672 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:32:13.399169 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-1a8e9168-e60f-457b-9735-026a39b93672 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:32:13.408660 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-1a8e9168-e60f-457b-9735-026a39b93672 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1367 microversion: 2.1 time: 0.092825 Oct 20 06:32:13.409289 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1203/2394] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:32:13 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1367 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:32:14.432238 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-e7a5ce57-1ad4-4e71-ac00-288d1349dea6 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:32:14.432885 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-e7a5ce57-1ad4-4e71-ac00-288d1349dea6 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:32:14.439309 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e7a5ce57-1ad4-4e71-ac00-288d1349dea6 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:32:14.439785 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e7a5ce57-1ad4-4e71-ac00-288d1349dea6 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:32:14.440215 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e7a5ce57-1ad4-4e71-ac00-288d1349dea6 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:32:14.440939 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e7a5ce57-1ad4-4e71-ac00-288d1349dea6 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:32:14.441389 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e7a5ce57-1ad4-4e71-ac00-288d1349dea6 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:32:14.441809 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e7a5ce57-1ad4-4e71-ac00-288d1349dea6 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:32:14.503888 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-e7a5ce57-1ad4-4e71-ac00-288d1349dea6 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:32:14.513400 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-e7a5ce57-1ad4-4e71-ac00-288d1349dea6 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1367 microversion: 2.1 time: 0.085571 Oct 20 06:32:14.513976 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1192/2395] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:32:14 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1367 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:32:15.536191 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-09c71375-9455-417e-aebc-c6aacc186a5b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:32:15.536831 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-09c71375-9455-417e-aebc-c6aacc186a5b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:32:15.543975 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-09c71375-9455-417e-aebc-c6aacc186a5b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:32:15.544465 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-09c71375-9455-417e-aebc-c6aacc186a5b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:32:15.544945 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-09c71375-9455-417e-aebc-c6aacc186a5b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:32:15.545646 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-09c71375-9455-417e-aebc-c6aacc186a5b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:32:15.546102 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-09c71375-9455-417e-aebc-c6aacc186a5b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:32:15.546531 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-09c71375-9455-417e-aebc-c6aacc186a5b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:32:15.609471 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-09c71375-9455-417e-aebc-c6aacc186a5b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:32:15.617866 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-09c71375-9455-417e-aebc-c6aacc186a5b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1367 microversion: 2.1 time: 0.085514 Oct 20 06:32:15.618478 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1204/2396] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:32:15 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1367 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:32:16.640556 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-d75038bf-ef2f-40f6-8627-98b4df13ee3d tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:32:16.641192 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-d75038bf-ef2f-40f6-8627-98b4df13ee3d tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:32:16.647683 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d75038bf-ef2f-40f6-8627-98b4df13ee3d tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:32:16.648162 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d75038bf-ef2f-40f6-8627-98b4df13ee3d tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:32:16.648600 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d75038bf-ef2f-40f6-8627-98b4df13ee3d tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:32:16.649319 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d75038bf-ef2f-40f6-8627-98b4df13ee3d tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:32:16.650008 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d75038bf-ef2f-40f6-8627-98b4df13ee3d tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:32:16.650671 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d75038bf-ef2f-40f6-8627-98b4df13ee3d tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:32:16.714550 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-d75038bf-ef2f-40f6-8627-98b4df13ee3d tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:32:16.722855 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-d75038bf-ef2f-40f6-8627-98b4df13ee3d tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1367 microversion: 2.1 time: 0.086265 Oct 20 06:32:16.723468 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1193/2397] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:32:16 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1367 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 06:32:17.745831 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-dc5a5ed1-1100-4441-8470-393dcb56d87b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:32:17.746458 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-dc5a5ed1-1100-4441-8470-393dcb56d87b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:32:17.753075 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-dc5a5ed1-1100-4441-8470-393dcb56d87b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:32:17.753562 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-dc5a5ed1-1100-4441-8470-393dcb56d87b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:32:17.754006 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-dc5a5ed1-1100-4441-8470-393dcb56d87b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:32:17.754704 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-dc5a5ed1-1100-4441-8470-393dcb56d87b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:32:17.755160 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-dc5a5ed1-1100-4441-8470-393dcb56d87b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:32:17.755593 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-dc5a5ed1-1100-4441-8470-393dcb56d87b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:32:17.822502 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-dc5a5ed1-1100-4441-8470-393dcb56d87b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:32:17.830939 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-dc5a5ed1-1100-4441-8470-393dcb56d87b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1367 microversion: 2.1 time: 0.089338 Oct 20 06:32:17.831510 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1205/2398] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:32:17 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1367 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:32:18.854755 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-b24235a6-c8dd-4a99-9fb3-99c68c202241 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:32:18.855398 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-b24235a6-c8dd-4a99-9fb3-99c68c202241 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:32:18.861854 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b24235a6-c8dd-4a99-9fb3-99c68c202241 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:32:18.862330 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b24235a6-c8dd-4a99-9fb3-99c68c202241 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:32:18.862763 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b24235a6-c8dd-4a99-9fb3-99c68c202241 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:32:18.863457 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b24235a6-c8dd-4a99-9fb3-99c68c202241 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:32:18.863902 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b24235a6-c8dd-4a99-9fb3-99c68c202241 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:32:18.864319 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b24235a6-c8dd-4a99-9fb3-99c68c202241 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:32:18.926640 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-b24235a6-c8dd-4a99-9fb3-99c68c202241 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:32:18.935291 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-b24235a6-c8dd-4a99-9fb3-99c68c202241 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1367 microversion: 2.1 time: 0.084794 Oct 20 06:32:18.935864 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1194/2399] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:32:18 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1367 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:32:19.957810 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-41c16a32-2b71-419f-9295-28e1dfb038cf tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:32:19.958413 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-41c16a32-2b71-419f-9295-28e1dfb038cf tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:32:19.964916 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-41c16a32-2b71-419f-9295-28e1dfb038cf tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:32:19.965393 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-41c16a32-2b71-419f-9295-28e1dfb038cf tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:32:19.965825 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-41c16a32-2b71-419f-9295-28e1dfb038cf tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:32:19.966509 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-41c16a32-2b71-419f-9295-28e1dfb038cf tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:32:19.966958 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-41c16a32-2b71-419f-9295-28e1dfb038cf tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:32:19.967377 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-41c16a32-2b71-419f-9295-28e1dfb038cf tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:32:20.028104 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-41c16a32-2b71-419f-9295-28e1dfb038cf tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:32:20.036385 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-41c16a32-2b71-419f-9295-28e1dfb038cf tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1367 microversion: 2.1 time: 0.082377 Oct 20 06:32:20.036974 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1206/2400] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:32:19 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1367 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:32:21.060235 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-e4d7208c-579c-4e07-8422-f8b0dd818c59 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:32:21.060888 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-e4d7208c-579c-4e07-8422-f8b0dd818c59 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:32:21.067274 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e4d7208c-579c-4e07-8422-f8b0dd818c59 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:32:21.067755 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e4d7208c-579c-4e07-8422-f8b0dd818c59 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:32:21.068194 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e4d7208c-579c-4e07-8422-f8b0dd818c59 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:32:21.068944 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e4d7208c-579c-4e07-8422-f8b0dd818c59 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:32:21.069399 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e4d7208c-579c-4e07-8422-f8b0dd818c59 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:32:21.069825 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e4d7208c-579c-4e07-8422-f8b0dd818c59 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:32:21.135967 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-e4d7208c-579c-4e07-8422-f8b0dd818c59 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:32:21.144374 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-e4d7208c-579c-4e07-8422-f8b0dd818c59 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1367 microversion: 2.1 time: 0.088717 Oct 20 06:32:21.144985 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1195/2401] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:32:21 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1367 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:32:22.169461 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-cb22fede-f23f-4283-a9ac-93ddd3483b8c tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:32:22.170074 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-cb22fede-f23f-4283-a9ac-93ddd3483b8c tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:32:22.176341 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-cb22fede-f23f-4283-a9ac-93ddd3483b8c tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:32:22.176851 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-cb22fede-f23f-4283-a9ac-93ddd3483b8c tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:32:22.177284 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-cb22fede-f23f-4283-a9ac-93ddd3483b8c tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:32:22.177973 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-cb22fede-f23f-4283-a9ac-93ddd3483b8c tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:32:22.178421 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-cb22fede-f23f-4283-a9ac-93ddd3483b8c tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:32:22.178840 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-cb22fede-f23f-4283-a9ac-93ddd3483b8c tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:32:22.243251 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-cb22fede-f23f-4283-a9ac-93ddd3483b8c tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:32:22.251518 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-cb22fede-f23f-4283-a9ac-93ddd3483b8c tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1367 microversion: 2.1 time: 0.086867 Oct 20 06:32:22.252083 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1207/2402] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:32:22 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1367 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:32:23.277627 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-1c3ebcbe-6fc1-46cd-8d2a-3f0e4a0b298f tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:32:23.278671 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-1c3ebcbe-6fc1-46cd-8d2a-3f0e4a0b298f tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:32:23.285405 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1c3ebcbe-6fc1-46cd-8d2a-3f0e4a0b298f tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:32:23.286161 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1c3ebcbe-6fc1-46cd-8d2a-3f0e4a0b298f tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:32:23.286605 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1c3ebcbe-6fc1-46cd-8d2a-3f0e4a0b298f tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:32:23.287317 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1c3ebcbe-6fc1-46cd-8d2a-3f0e4a0b298f tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:32:23.287774 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1c3ebcbe-6fc1-46cd-8d2a-3f0e4a0b298f tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:32:23.288207 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1c3ebcbe-6fc1-46cd-8d2a-3f0e4a0b298f tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:32:23.365896 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-1c3ebcbe-6fc1-46cd-8d2a-3f0e4a0b298f tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:32:23.374899 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-1c3ebcbe-6fc1-46cd-8d2a-3f0e4a0b298f tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1367 microversion: 2.1 time: 0.102849 Oct 20 06:32:23.375492 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1196/2403] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:32:23 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1367 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:32:24.401471 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-abe1a492-7136-4cde-aa69-0623107e303b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:32:24.402092 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-abe1a492-7136-4cde-aa69-0623107e303b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:32:24.409198 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-abe1a492-7136-4cde-aa69-0623107e303b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:32:24.409692 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-abe1a492-7136-4cde-aa69-0623107e303b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:32:24.410270 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-abe1a492-7136-4cde-aa69-0623107e303b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:32:24.410826 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-abe1a492-7136-4cde-aa69-0623107e303b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:32:24.411280 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-abe1a492-7136-4cde-aa69-0623107e303b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:32:24.411709 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-abe1a492-7136-4cde-aa69-0623107e303b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:32:24.475210 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-abe1a492-7136-4cde-aa69-0623107e303b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:32:24.485470 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-abe1a492-7136-4cde-aa69-0623107e303b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1367 microversion: 2.1 time: 0.088553 Oct 20 06:32:24.486276 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1208/2404] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:32:24 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1367 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:32:25.509784 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-aa7475a4-f7ff-49be-bb6e-54fe5acfa822 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:32:25.510874 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-aa7475a4-f7ff-49be-bb6e-54fe5acfa822 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:32:25.517436 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-aa7475a4-f7ff-49be-bb6e-54fe5acfa822 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:32:25.518218 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-aa7475a4-f7ff-49be-bb6e-54fe5acfa822 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:32:25.518651 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-aa7475a4-f7ff-49be-bb6e-54fe5acfa822 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:32:25.519338 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-aa7475a4-f7ff-49be-bb6e-54fe5acfa822 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:32:25.519961 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-aa7475a4-f7ff-49be-bb6e-54fe5acfa822 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:32:25.520385 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-aa7475a4-f7ff-49be-bb6e-54fe5acfa822 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:32:25.596531 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-aa7475a4-f7ff-49be-bb6e-54fe5acfa822 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:32:25.606067 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-aa7475a4-f7ff-49be-bb6e-54fe5acfa822 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1367 microversion: 2.1 time: 0.100710 Oct 20 06:32:25.607047 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1197/2405] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:32:25 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1367 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 06:32:26.629423 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-685fd054-428a-4045-ac20-a7bf7d8a6bb1 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:32:26.629982 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-685fd054-428a-4045-ac20-a7bf7d8a6bb1 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:32:26.636920 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-685fd054-428a-4045-ac20-a7bf7d8a6bb1 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:32:26.637413 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-685fd054-428a-4045-ac20-a7bf7d8a6bb1 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:32:26.637889 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-685fd054-428a-4045-ac20-a7bf7d8a6bb1 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:32:26.638595 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-685fd054-428a-4045-ac20-a7bf7d8a6bb1 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:32:26.639055 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-685fd054-428a-4045-ac20-a7bf7d8a6bb1 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:32:26.639491 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-685fd054-428a-4045-ac20-a7bf7d8a6bb1 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:32:26.700047 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-685fd054-428a-4045-ac20-a7bf7d8a6bb1 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:32:26.709947 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-685fd054-428a-4045-ac20-a7bf7d8a6bb1 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1367 microversion: 2.1 time: 0.083021 Oct 20 06:32:26.709947 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1209/2406] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:32:26 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1367 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:32:27.731922 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-44b2f5fc-c889-4e01-bff0-3a9d7871c972 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:32:27.733216 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-44b2f5fc-c889-4e01-bff0-3a9d7871c972 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:32:27.739260 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-44b2f5fc-c889-4e01-bff0-3a9d7871c972 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:32:27.739737 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-44b2f5fc-c889-4e01-bff0-3a9d7871c972 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:32:27.740166 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-44b2f5fc-c889-4e01-bff0-3a9d7871c972 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:32:27.740878 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-44b2f5fc-c889-4e01-bff0-3a9d7871c972 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:32:27.741321 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-44b2f5fc-c889-4e01-bff0-3a9d7871c972 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:32:27.741739 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-44b2f5fc-c889-4e01-bff0-3a9d7871c972 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:32:27.809950 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-44b2f5fc-c889-4e01-bff0-3a9d7871c972 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:32:27.818779 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-44b2f5fc-c889-4e01-bff0-3a9d7871c972 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1367 microversion: 2.1 time: 0.091020 Oct 20 06:32:27.819343 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1198/2407] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:32:27 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1367 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:32:28.843066 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-3061be91-597d-4742-ac9f-50e37ec98be7 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:32:28.843756 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-3061be91-597d-4742-ac9f-50e37ec98be7 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:32:28.850423 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3061be91-597d-4742-ac9f-50e37ec98be7 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:32:28.850910 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3061be91-597d-4742-ac9f-50e37ec98be7 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:32:28.851346 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3061be91-597d-4742-ac9f-50e37ec98be7 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:32:28.852107 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3061be91-597d-4742-ac9f-50e37ec98be7 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:32:28.852662 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3061be91-597d-4742-ac9f-50e37ec98be7 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:32:28.853114 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3061be91-597d-4742-ac9f-50e37ec98be7 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:32:28.914826 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-3061be91-597d-4742-ac9f-50e37ec98be7 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:32:28.923220 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-3061be91-597d-4742-ac9f-50e37ec98be7 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1367 microversion: 2.1 time: 0.084062 Oct 20 06:32:28.923794 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1210/2408] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:32:28 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1367 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:32:29.946580 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-376f979c-e725-466b-9f25-59faae1682cc tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:32:29.947193 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-376f979c-e725-466b-9f25-59faae1682cc tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:32:29.953633 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-376f979c-e725-466b-9f25-59faae1682cc tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:32:29.954109 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-376f979c-e725-466b-9f25-59faae1682cc tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:32:29.954540 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-376f979c-e725-466b-9f25-59faae1682cc tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:32:29.955218 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-376f979c-e725-466b-9f25-59faae1682cc tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:32:29.955665 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-376f979c-e725-466b-9f25-59faae1682cc tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:32:29.956084 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-376f979c-e725-466b-9f25-59faae1682cc tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:32:30.022006 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-376f979c-e725-466b-9f25-59faae1682cc tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:32:30.030375 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-376f979c-e725-466b-9f25-59faae1682cc tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1367 microversion: 2.1 time: 0.087947 Oct 20 06:32:30.030933 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1199/2409] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:32:29 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1367 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:32:31.053354 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-6db47f3e-8647-44dc-b294-02d2def0834e tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:32:31.053978 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-6db47f3e-8647-44dc-b294-02d2def0834e tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:32:31.061035 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-6db47f3e-8647-44dc-b294-02d2def0834e tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:32:31.061527 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-6db47f3e-8647-44dc-b294-02d2def0834e tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:32:31.061970 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-6db47f3e-8647-44dc-b294-02d2def0834e tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:32:31.062672 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-6db47f3e-8647-44dc-b294-02d2def0834e tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:32:31.063130 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-6db47f3e-8647-44dc-b294-02d2def0834e tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:32:31.063560 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-6db47f3e-8647-44dc-b294-02d2def0834e tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:32:31.129066 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-6db47f3e-8647-44dc-b294-02d2def0834e tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:32:31.138308 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-6db47f3e-8647-44dc-b294-02d2def0834e tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1367 microversion: 2.1 time: 0.088920 Oct 20 06:32:31.138879 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1211/2410] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:32:31 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1367 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:32:32.161438 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-d670f951-f861-4d6e-8795-9850433400b5 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:32:32.162192 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-d670f951-f861-4d6e-8795-9850433400b5 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:32:32.168831 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d670f951-f861-4d6e-8795-9850433400b5 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:32:32.169310 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d670f951-f861-4d6e-8795-9850433400b5 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:32:32.169742 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d670f951-f861-4d6e-8795-9850433400b5 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:32:32.170433 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d670f951-f861-4d6e-8795-9850433400b5 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:32:32.170877 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d670f951-f861-4d6e-8795-9850433400b5 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:32:32.171300 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d670f951-f861-4d6e-8795-9850433400b5 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:32:32.446025 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-d670f951-f861-4d6e-8795-9850433400b5 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:32:32.454234 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-d670f951-f861-4d6e-8795-9850433400b5 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1367 microversion: 2.1 time: 0.296742 Oct 20 06:32:32.454791 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1200/2411] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:32:32 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1367 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:32:33.478289 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-21025972-4e37-41e0-9cf5-90638e8c63d0 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:32:33.478859 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-21025972-4e37-41e0-9cf5-90638e8c63d0 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:32:33.486470 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-21025972-4e37-41e0-9cf5-90638e8c63d0 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:32:33.486470 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-21025972-4e37-41e0-9cf5-90638e8c63d0 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:32:33.486813 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-21025972-4e37-41e0-9cf5-90638e8c63d0 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:32:33.487603 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-21025972-4e37-41e0-9cf5-90638e8c63d0 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:32:33.487898 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-21025972-4e37-41e0-9cf5-90638e8c63d0 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:32:33.488329 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-21025972-4e37-41e0-9cf5-90638e8c63d0 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:32:33.571285 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-21025972-4e37-41e0-9cf5-90638e8c63d0 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:32:33.580805 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-21025972-4e37-41e0-9cf5-90638e8c63d0 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1367 microversion: 2.1 time: 0.106557 Oct 20 06:32:33.582199 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1212/2412] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:32:33 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1367 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:32:34.605206 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-e1d885f9-1750-40ef-a76f-b997bed425a6 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:32:34.605876 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-e1d885f9-1750-40ef-a76f-b997bed425a6 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:32:34.618356 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e1d885f9-1750-40ef-a76f-b997bed425a6 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:32:34.618847 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e1d885f9-1750-40ef-a76f-b997bed425a6 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:32:34.619283 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e1d885f9-1750-40ef-a76f-b997bed425a6 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:32:34.619994 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e1d885f9-1750-40ef-a76f-b997bed425a6 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:32:34.620443 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e1d885f9-1750-40ef-a76f-b997bed425a6 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:32:34.621052 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e1d885f9-1750-40ef-a76f-b997bed425a6 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:32:34.704833 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-e1d885f9-1750-40ef-a76f-b997bed425a6 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:32:34.718505 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-e1d885f9-1750-40ef-a76f-b997bed425a6 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1367 microversion: 2.1 time: 0.117438 Oct 20 06:32:34.733752 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1201/2413] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:32:34 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1367 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:32:35.741163 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-b0dc9cf3-d88f-4155-a774-3d80257c3b6b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:32:35.741850 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-b0dc9cf3-d88f-4155-a774-3d80257c3b6b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:32:35.748756 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b0dc9cf3-d88f-4155-a774-3d80257c3b6b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:32:35.749239 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b0dc9cf3-d88f-4155-a774-3d80257c3b6b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:32:35.749670 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b0dc9cf3-d88f-4155-a774-3d80257c3b6b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:32:35.750357 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b0dc9cf3-d88f-4155-a774-3d80257c3b6b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:32:35.750804 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b0dc9cf3-d88f-4155-a774-3d80257c3b6b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:32:35.751225 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b0dc9cf3-d88f-4155-a774-3d80257c3b6b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:32:35.812334 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-b0dc9cf3-d88f-4155-a774-3d80257c3b6b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:32:35.820619 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-b0dc9cf3-d88f-4155-a774-3d80257c3b6b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1367 microversion: 2.1 time: 0.083272 Oct 20 06:32:35.821506 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1213/2414] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:32:35 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1367 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:32:36.843165 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-3c486662-a872-44ea-a046-da1071ca11c2 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:32:36.843828 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-3c486662-a872-44ea-a046-da1071ca11c2 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:32:36.850598 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-3c486662-a872-44ea-a046-da1071ca11c2 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:32:36.851088 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-3c486662-a872-44ea-a046-da1071ca11c2 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:32:36.851526 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-3c486662-a872-44ea-a046-da1071ca11c2 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:32:36.852260 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-3c486662-a872-44ea-a046-da1071ca11c2 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:32:36.852841 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-3c486662-a872-44ea-a046-da1071ca11c2 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:32:36.853276 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-3c486662-a872-44ea-a046-da1071ca11c2 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:32:36.917411 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-3c486662-a872-44ea-a046-da1071ca11c2 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:32:36.925644 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-3c486662-a872-44ea-a046-da1071ca11c2 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1367 microversion: 2.1 time: 0.086422 Oct 20 06:32:36.926216 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1202/2415] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:32:36 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1367 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:32:37.949818 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-0514b6b4-28e3-4853-8c10-c06b63671d82 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:32:37.951001 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-0514b6b4-28e3-4853-8c10-c06b63671d82 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:32:37.957580 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0514b6b4-28e3-4853-8c10-c06b63671d82 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:32:37.958067 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0514b6b4-28e3-4853-8c10-c06b63671d82 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:32:37.958510 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0514b6b4-28e3-4853-8c10-c06b63671d82 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:32:37.973700 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0514b6b4-28e3-4853-8c10-c06b63671d82 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:32:37.974204 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0514b6b4-28e3-4853-8c10-c06b63671d82 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:32:37.974671 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0514b6b4-28e3-4853-8c10-c06b63671d82 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:32:38.038592 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-0514b6b4-28e3-4853-8c10-c06b63671d82 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:32:38.047481 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-0514b6b4-28e3-4853-8c10-c06b63671d82 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1367 microversion: 2.1 time: 0.101764 Oct 20 06:32:38.048041 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1214/2416] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:32:37 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1367 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:32:39.071353 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-34be71be-8ed6-4fd1-a858-ba14d7314205 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:32:39.072601 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-34be71be-8ed6-4fd1-a858-ba14d7314205 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:32:39.079163 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-34be71be-8ed6-4fd1-a858-ba14d7314205 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:32:39.079642 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-34be71be-8ed6-4fd1-a858-ba14d7314205 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:32:39.080080 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-34be71be-8ed6-4fd1-a858-ba14d7314205 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:32:39.080796 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-34be71be-8ed6-4fd1-a858-ba14d7314205 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:32:39.081267 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-34be71be-8ed6-4fd1-a858-ba14d7314205 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:32:39.081670 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-34be71be-8ed6-4fd1-a858-ba14d7314205 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:32:39.144683 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-34be71be-8ed6-4fd1-a858-ba14d7314205 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:32:39.153341 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-34be71be-8ed6-4fd1-a858-ba14d7314205 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1367 microversion: 2.1 time: 0.086476 Oct 20 06:32:39.153947 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1203/2417] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:32:39 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1367 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:32:40.175753 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-58ddb991-a6cd-4c3f-811c-83fcfa5a7a27 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:32:40.176392 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-58ddb991-a6cd-4c3f-811c-83fcfa5a7a27 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:32:40.178681 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG dbcounter [-] [118860] Writing DB stats nova_api:SELECT=28 {{(pid=118860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:32:40.183953 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-58ddb991-a6cd-4c3f-811c-83fcfa5a7a27 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:32:40.184422 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-58ddb991-a6cd-4c3f-811c-83fcfa5a7a27 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:32:40.184901 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-58ddb991-a6cd-4c3f-811c-83fcfa5a7a27 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:32:40.185619 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-58ddb991-a6cd-4c3f-811c-83fcfa5a7a27 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:32:40.186066 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-58ddb991-a6cd-4c3f-811c-83fcfa5a7a27 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:32:40.186486 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-58ddb991-a6cd-4c3f-811c-83fcfa5a7a27 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:32:40.189295 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG dbcounter [-] [118860] Writing DB stats nova_cell1:SELECT=84 {{(pid=118860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:32:40.253113 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-58ddb991-a6cd-4c3f-811c-83fcfa5a7a27 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:32:40.262449 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-58ddb991-a6cd-4c3f-811c-83fcfa5a7a27 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1367 microversion: 2.1 time: 0.090497 Oct 20 06:32:40.263120 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1215/2418] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:32:40 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1367 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 06:32:41.285612 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-46a5873f-fd8e-4ceb-a0ae-b905c3b0f48b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:32:41.286255 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-46a5873f-fd8e-4ceb-a0ae-b905c3b0f48b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:32:41.293365 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-46a5873f-fd8e-4ceb-a0ae-b905c3b0f48b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:32:41.293846 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-46a5873f-fd8e-4ceb-a0ae-b905c3b0f48b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:32:41.294275 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-46a5873f-fd8e-4ceb-a0ae-b905c3b0f48b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:32:41.294974 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-46a5873f-fd8e-4ceb-a0ae-b905c3b0f48b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:32:41.295428 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-46a5873f-fd8e-4ceb-a0ae-b905c3b0f48b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:32:41.295850 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-46a5873f-fd8e-4ceb-a0ae-b905c3b0f48b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:32:41.362069 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-46a5873f-fd8e-4ceb-a0ae-b905c3b0f48b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:32:41.371726 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-46a5873f-fd8e-4ceb-a0ae-b905c3b0f48b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1367 microversion: 2.1 time: 0.089946 Oct 20 06:32:41.372395 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1204/2419] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:32:41 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1367 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:32:42.395583 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-7b67dcfa-958f-4454-9e53-42c5071cfcd0 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:32:42.396214 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-7b67dcfa-958f-4454-9e53-42c5071cfcd0 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:32:42.402862 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7b67dcfa-958f-4454-9e53-42c5071cfcd0 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:32:42.403358 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7b67dcfa-958f-4454-9e53-42c5071cfcd0 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:32:42.403839 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7b67dcfa-958f-4454-9e53-42c5071cfcd0 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:32:42.404545 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7b67dcfa-958f-4454-9e53-42c5071cfcd0 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:32:42.405037 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7b67dcfa-958f-4454-9e53-42c5071cfcd0 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:32:42.405469 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7b67dcfa-958f-4454-9e53-42c5071cfcd0 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:32:42.467937 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-7b67dcfa-958f-4454-9e53-42c5071cfcd0 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:32:42.476831 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-7b67dcfa-958f-4454-9e53-42c5071cfcd0 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1367 microversion: 2.1 time: 0.084657 Oct 20 06:32:42.477432 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1216/2420] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:32:42 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1367 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:32:43.499574 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-4393ab50-c28e-4823-922f-7872868065eb tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:32:43.500184 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-4393ab50-c28e-4823-922f-7872868065eb tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:32:43.502523 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG dbcounter [-] [118861] Writing DB stats nova_api:SELECT=28 {{(pid=118861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:32:43.508248 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4393ab50-c28e-4823-922f-7872868065eb tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:32:43.509285 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4393ab50-c28e-4823-922f-7872868065eb tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:32:43.509795 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4393ab50-c28e-4823-922f-7872868065eb tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:32:43.510622 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4393ab50-c28e-4823-922f-7872868065eb tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:32:43.511141 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4393ab50-c28e-4823-922f-7872868065eb tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:32:43.511642 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4393ab50-c28e-4823-922f-7872868065eb tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:32:43.514665 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG dbcounter [-] [118861] Writing DB stats nova_cell1:SELECT=84 {{(pid=118861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:32:43.574676 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-4393ab50-c28e-4823-922f-7872868065eb tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:32:43.582888 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-4393ab50-c28e-4823-922f-7872868065eb tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1367 microversion: 2.1 time: 0.087244 Oct 20 06:32:43.583447 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1205/2421] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:32:43 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1367 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:32:44.606990 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-c150d37c-9ba1-41c9-b82f-d375b7398140 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:32:44.607552 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-c150d37c-9ba1-41c9-b82f-d375b7398140 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:32:44.614104 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c150d37c-9ba1-41c9-b82f-d375b7398140 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:32:44.614588 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c150d37c-9ba1-41c9-b82f-d375b7398140 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:32:44.615026 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c150d37c-9ba1-41c9-b82f-d375b7398140 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:32:44.615725 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c150d37c-9ba1-41c9-b82f-d375b7398140 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:32:44.616179 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c150d37c-9ba1-41c9-b82f-d375b7398140 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:32:44.616606 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c150d37c-9ba1-41c9-b82f-d375b7398140 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:32:44.678842 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-c150d37c-9ba1-41c9-b82f-d375b7398140 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:32:44.687122 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-c150d37c-9ba1-41c9-b82f-d375b7398140 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1367 microversion: 2.1 time: 0.084087 Oct 20 06:32:44.687693 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1217/2422] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:32:44 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1367 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 06:32:45.709611 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-933a0dc5-00f3-4d16-895c-cdd71b4a5805 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:32:45.710908 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-933a0dc5-00f3-4d16-895c-cdd71b4a5805 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:32:45.722724 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-933a0dc5-00f3-4d16-895c-cdd71b4a5805 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:32:45.723225 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-933a0dc5-00f3-4d16-895c-cdd71b4a5805 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:32:45.723656 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-933a0dc5-00f3-4d16-895c-cdd71b4a5805 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:32:45.724378 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-933a0dc5-00f3-4d16-895c-cdd71b4a5805 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:32:45.724844 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-933a0dc5-00f3-4d16-895c-cdd71b4a5805 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:32:45.725270 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-933a0dc5-00f3-4d16-895c-cdd71b4a5805 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:32:45.792085 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-933a0dc5-00f3-4d16-895c-cdd71b4a5805 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:32:45.800481 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-933a0dc5-00f3-4d16-895c-cdd71b4a5805 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1367 microversion: 2.1 time: 0.094789 Oct 20 06:32:45.801382 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1206/2423] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:32:45 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1367 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:32:46.823685 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-6ace8fd6-950f-4035-9954-e88b61bd1041 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:32:46.824294 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-6ace8fd6-950f-4035-9954-e88b61bd1041 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:32:46.830839 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-6ace8fd6-950f-4035-9954-e88b61bd1041 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:32:46.831409 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-6ace8fd6-950f-4035-9954-e88b61bd1041 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:32:46.831847 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-6ace8fd6-950f-4035-9954-e88b61bd1041 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:32:46.832534 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-6ace8fd6-950f-4035-9954-e88b61bd1041 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:32:46.833015 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-6ace8fd6-950f-4035-9954-e88b61bd1041 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:32:46.833444 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-6ace8fd6-950f-4035-9954-e88b61bd1041 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:32:46.895834 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-6ace8fd6-950f-4035-9954-e88b61bd1041 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:32:46.905601 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-6ace8fd6-950f-4035-9954-e88b61bd1041 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1367 microversion: 2.1 time: 0.085891 Oct 20 06:32:46.906191 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1218/2424] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:32:46 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1367 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:32:47.928511 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-65bf2e81-6943-4b7a-9b81-36bc3bbde0c4 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:32:47.929162 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-65bf2e81-6943-4b7a-9b81-36bc3bbde0c4 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:32:47.935624 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-65bf2e81-6943-4b7a-9b81-36bc3bbde0c4 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:32:47.936103 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-65bf2e81-6943-4b7a-9b81-36bc3bbde0c4 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:32:47.936533 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-65bf2e81-6943-4b7a-9b81-36bc3bbde0c4 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:32:47.937249 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-65bf2e81-6943-4b7a-9b81-36bc3bbde0c4 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:32:47.937702 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-65bf2e81-6943-4b7a-9b81-36bc3bbde0c4 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:32:47.938121 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-65bf2e81-6943-4b7a-9b81-36bc3bbde0c4 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:32:48.000389 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-65bf2e81-6943-4b7a-9b81-36bc3bbde0c4 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:32:48.009726 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-65bf2e81-6943-4b7a-9b81-36bc3bbde0c4 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1367 microversion: 2.1 time: 0.085076 Oct 20 06:32:48.010291 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1207/2425] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:32:47 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1367 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:32:49.032935 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-3cf42df2-1081-45ca-82d5-720043389f39 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:32:49.033485 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-3cf42df2-1081-45ca-82d5-720043389f39 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:32:49.040714 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3cf42df2-1081-45ca-82d5-720043389f39 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:32:49.041209 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3cf42df2-1081-45ca-82d5-720043389f39 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:32:49.041649 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3cf42df2-1081-45ca-82d5-720043389f39 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:32:49.042345 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3cf42df2-1081-45ca-82d5-720043389f39 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:32:49.042800 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3cf42df2-1081-45ca-82d5-720043389f39 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:32:49.043224 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3cf42df2-1081-45ca-82d5-720043389f39 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:32:49.109514 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-3cf42df2-1081-45ca-82d5-720043389f39 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:32:49.118812 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-3cf42df2-1081-45ca-82d5-720043389f39 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1367 microversion: 2.1 time: 0.089820 Oct 20 06:32:49.119382 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1219/2426] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:32:49 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1367 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:32:50.142310 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-0c9d100f-b8b5-4fc2-b52c-ba1dc3488149 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:32:50.142929 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-0c9d100f-b8b5-4fc2-b52c-ba1dc3488149 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:32:50.150193 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-0c9d100f-b8b5-4fc2-b52c-ba1dc3488149 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:32:50.150685 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-0c9d100f-b8b5-4fc2-b52c-ba1dc3488149 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:32:50.151124 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-0c9d100f-b8b5-4fc2-b52c-ba1dc3488149 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:32:50.151821 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-0c9d100f-b8b5-4fc2-b52c-ba1dc3488149 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:32:50.152275 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-0c9d100f-b8b5-4fc2-b52c-ba1dc3488149 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:32:50.152718 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-0c9d100f-b8b5-4fc2-b52c-ba1dc3488149 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:32:50.217650 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-0c9d100f-b8b5-4fc2-b52c-ba1dc3488149 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:32:50.225844 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-0c9d100f-b8b5-4fc2-b52c-ba1dc3488149 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1367 microversion: 2.1 time: 0.087409 Oct 20 06:32:50.226445 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1208/2427] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:32:50 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1367 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:32:51.249345 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-33cc63af-47c2-4d5e-a8ac-728ddea23712 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:32:51.249938 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-33cc63af-47c2-4d5e-a8ac-728ddea23712 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:32:51.256510 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-33cc63af-47c2-4d5e-a8ac-728ddea23712 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:32:51.257029 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-33cc63af-47c2-4d5e-a8ac-728ddea23712 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:32:51.258168 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-33cc63af-47c2-4d5e-a8ac-728ddea23712 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:32:51.259181 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-33cc63af-47c2-4d5e-a8ac-728ddea23712 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:32:51.259714 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-33cc63af-47c2-4d5e-a8ac-728ddea23712 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:32:51.260137 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-33cc63af-47c2-4d5e-a8ac-728ddea23712 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:32:51.322038 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-33cc63af-47c2-4d5e-a8ac-728ddea23712 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:32:51.330558 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-33cc63af-47c2-4d5e-a8ac-728ddea23712 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1367 microversion: 2.1 time: 0.085183 Oct 20 06:32:51.331114 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1220/2428] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:32:51 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1367 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:32:52.354469 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-138a198d-1fee-46c1-bdf4-13c6074e0a4b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:32:52.355079 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-138a198d-1fee-46c1-bdf4-13c6074e0a4b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:32:52.361549 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-138a198d-1fee-46c1-bdf4-13c6074e0a4b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:32:52.362035 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-138a198d-1fee-46c1-bdf4-13c6074e0a4b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:32:52.362473 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-138a198d-1fee-46c1-bdf4-13c6074e0a4b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:32:52.363163 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-138a198d-1fee-46c1-bdf4-13c6074e0a4b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:32:52.363615 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-138a198d-1fee-46c1-bdf4-13c6074e0a4b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:32:52.364035 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-138a198d-1fee-46c1-bdf4-13c6074e0a4b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:32:52.427632 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-138a198d-1fee-46c1-bdf4-13c6074e0a4b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:32:52.436532 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-138a198d-1fee-46c1-bdf4-13c6074e0a4b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1367 microversion: 2.1 time: 0.086505 Oct 20 06:32:52.437122 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1209/2429] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:32:52 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1367 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:32:53.459134 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-52f758a8-0a70-4b4f-9c00-94bbfbc7827c tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:32:53.459764 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-52f758a8-0a70-4b4f-9c00-94bbfbc7827c tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:32:53.466855 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-52f758a8-0a70-4b4f-9c00-94bbfbc7827c tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:32:53.467340 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-52f758a8-0a70-4b4f-9c00-94bbfbc7827c tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:32:53.468150 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-52f758a8-0a70-4b4f-9c00-94bbfbc7827c tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:32:53.468913 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-52f758a8-0a70-4b4f-9c00-94bbfbc7827c tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:32:53.469376 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-52f758a8-0a70-4b4f-9c00-94bbfbc7827c tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:32:53.469804 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-52f758a8-0a70-4b4f-9c00-94bbfbc7827c tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:32:53.532427 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-52f758a8-0a70-4b4f-9c00-94bbfbc7827c tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:32:53.541958 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-52f758a8-0a70-4b4f-9c00-94bbfbc7827c tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1367 microversion: 2.1 time: 0.086684 Oct 20 06:32:53.542539 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1221/2430] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:32:53 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1367 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:32:54.564218 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-bd995954-c3f2-49d2-902c-2c954bda2744 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:32:54.564875 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-bd995954-c3f2-49d2-902c-2c954bda2744 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:32:54.571383 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-bd995954-c3f2-49d2-902c-2c954bda2744 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:32:54.571861 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-bd995954-c3f2-49d2-902c-2c954bda2744 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:32:54.572290 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-bd995954-c3f2-49d2-902c-2c954bda2744 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:32:54.573020 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-bd995954-c3f2-49d2-902c-2c954bda2744 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:32:54.573469 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-bd995954-c3f2-49d2-902c-2c954bda2744 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:32:54.573904 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-bd995954-c3f2-49d2-902c-2c954bda2744 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:32:54.636542 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-bd995954-c3f2-49d2-902c-2c954bda2744 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:32:54.644907 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-bd995954-c3f2-49d2-902c-2c954bda2744 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1367 microversion: 2.1 time: 0.084619 Oct 20 06:32:54.645482 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1210/2431] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:32:54 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1367 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:32:55.667377 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-79057eae-d61f-4346-9659-9f49260fc974 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:32:55.668064 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-79057eae-d61f-4346-9659-9f49260fc974 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:32:55.675012 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-79057eae-d61f-4346-9659-9f49260fc974 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:32:55.675500 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-79057eae-d61f-4346-9659-9f49260fc974 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:32:55.675932 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-79057eae-d61f-4346-9659-9f49260fc974 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:32:55.676639 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-79057eae-d61f-4346-9659-9f49260fc974 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:32:55.677125 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-79057eae-d61f-4346-9659-9f49260fc974 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:32:55.677548 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-79057eae-d61f-4346-9659-9f49260fc974 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:32:55.742647 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-79057eae-d61f-4346-9659-9f49260fc974 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:32:55.750891 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-79057eae-d61f-4346-9659-9f49260fc974 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1367 microversion: 2.1 time: 0.087404 Oct 20 06:32:55.751452 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1222/2432] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:32:55 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1367 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:32:56.775146 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-be3e7685-bb45-4b94-a03d-31e14343436e tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:32:56.775762 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-be3e7685-bb45-4b94-a03d-31e14343436e tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:32:56.782754 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-be3e7685-bb45-4b94-a03d-31e14343436e tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:32:56.783242 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-be3e7685-bb45-4b94-a03d-31e14343436e tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:32:56.783708 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-be3e7685-bb45-4b94-a03d-31e14343436e tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:32:56.784418 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-be3e7685-bb45-4b94-a03d-31e14343436e tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:32:56.784904 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-be3e7685-bb45-4b94-a03d-31e14343436e tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:32:56.785336 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-be3e7685-bb45-4b94-a03d-31e14343436e tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:32:56.850483 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-be3e7685-bb45-4b94-a03d-31e14343436e tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:32:56.859237 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-be3e7685-bb45-4b94-a03d-31e14343436e tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1367 microversion: 2.1 time: 0.088500 Oct 20 06:32:56.859812 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1211/2433] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:32:56 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1367 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:32:57.882351 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-530b46db-fac6-43d3-a689-0c31ee120a15 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:32:57.883076 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-530b46db-fac6-43d3-a689-0c31ee120a15 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:32:57.889962 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-530b46db-fac6-43d3-a689-0c31ee120a15 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:32:57.890456 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-530b46db-fac6-43d3-a689-0c31ee120a15 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:32:57.890899 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-530b46db-fac6-43d3-a689-0c31ee120a15 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:32:57.891604 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-530b46db-fac6-43d3-a689-0c31ee120a15 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:32:57.892063 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-530b46db-fac6-43d3-a689-0c31ee120a15 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:32:57.892496 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-530b46db-fac6-43d3-a689-0c31ee120a15 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:32:57.957824 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-530b46db-fac6-43d3-a689-0c31ee120a15 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:32:57.966639 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-530b46db-fac6-43d3-a689-0c31ee120a15 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1367 microversion: 2.1 time: 0.088213 Oct 20 06:32:57.967208 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1223/2434] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:32:57 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1367 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:32:58.989980 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-58d73b8b-ac27-4163-be4e-f7593be172f3 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:32:58.990573 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-58d73b8b-ac27-4163-be4e-f7593be172f3 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:32:58.997310 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-58d73b8b-ac27-4163-be4e-f7593be172f3 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:32:58.997794 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-58d73b8b-ac27-4163-be4e-f7593be172f3 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:32:58.998227 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-58d73b8b-ac27-4163-be4e-f7593be172f3 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:32:58.998952 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-58d73b8b-ac27-4163-be4e-f7593be172f3 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:32:58.999401 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-58d73b8b-ac27-4163-be4e-f7593be172f3 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:32:58.999821 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-58d73b8b-ac27-4163-be4e-f7593be172f3 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:32:59.065454 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-58d73b8b-ac27-4163-be4e-f7593be172f3 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:32:59.073920 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-58d73b8b-ac27-4163-be4e-f7593be172f3 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1367 microversion: 2.1 time: 0.087866 Oct 20 06:32:59.074493 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1212/2435] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:32:58 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1367 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:33:00.097320 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-2b456a23-86ca-47fd-8759-7fc46cbe5733 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:33:00.097937 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-2b456a23-86ca-47fd-8759-7fc46cbe5733 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:33:00.105255 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2b456a23-86ca-47fd-8759-7fc46cbe5733 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:33:00.105768 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2b456a23-86ca-47fd-8759-7fc46cbe5733 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:33:00.106200 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2b456a23-86ca-47fd-8759-7fc46cbe5733 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:33:00.106893 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2b456a23-86ca-47fd-8759-7fc46cbe5733 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:33:00.107368 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2b456a23-86ca-47fd-8759-7fc46cbe5733 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:33:00.107791 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2b456a23-86ca-47fd-8759-7fc46cbe5733 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:33:00.169427 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-2b456a23-86ca-47fd-8759-7fc46cbe5733 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:33:00.177634 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-2b456a23-86ca-47fd-8759-7fc46cbe5733 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1367 microversion: 2.1 time: 0.084174 Oct 20 06:33:00.178186 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1224/2436] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:33:00 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1367 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:33:01.200062 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-da51623f-0f31-4959-aec3-03081d2102ba tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:33:01.200677 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-da51623f-0f31-4959-aec3-03081d2102ba tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:33:01.207412 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-da51623f-0f31-4959-aec3-03081d2102ba tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:33:01.207904 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-da51623f-0f31-4959-aec3-03081d2102ba tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:33:01.208346 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-da51623f-0f31-4959-aec3-03081d2102ba tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:33:01.209093 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-da51623f-0f31-4959-aec3-03081d2102ba tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:33:01.209554 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-da51623f-0f31-4959-aec3-03081d2102ba tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:33:01.209981 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-da51623f-0f31-4959-aec3-03081d2102ba tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:33:01.275597 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-da51623f-0f31-4959-aec3-03081d2102ba tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:33:01.283518 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-da51623f-0f31-4959-aec3-03081d2102ba tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1367 microversion: 2.1 time: 0.087890 Oct 20 06:33:01.284094 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1213/2437] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:33:01 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1367 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:33:02.307891 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-2d7da644-61aa-475e-bd00-4d7c3794636b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:33:02.308527 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-2d7da644-61aa-475e-bd00-4d7c3794636b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:33:02.315040 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2d7da644-61aa-475e-bd00-4d7c3794636b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:33:02.315524 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2d7da644-61aa-475e-bd00-4d7c3794636b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:33:02.315957 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2d7da644-61aa-475e-bd00-4d7c3794636b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:33:02.316644 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2d7da644-61aa-475e-bd00-4d7c3794636b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:33:02.317116 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2d7da644-61aa-475e-bd00-4d7c3794636b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:33:02.317538 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2d7da644-61aa-475e-bd00-4d7c3794636b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:33:02.379324 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-2d7da644-61aa-475e-bd00-4d7c3794636b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:33:02.388402 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-2d7da644-61aa-475e-bd00-4d7c3794636b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1367 microversion: 2.1 time: 0.084895 Oct 20 06:33:02.388999 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1225/2438] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:33:02 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1367 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:33:03.411467 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-85972fcf-5ace-4e6e-b9fc-8f7144dbd028 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:33:03.412081 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-85972fcf-5ace-4e6e-b9fc-8f7144dbd028 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:33:03.418880 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-85972fcf-5ace-4e6e-b9fc-8f7144dbd028 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:33:03.419367 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-85972fcf-5ace-4e6e-b9fc-8f7144dbd028 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:33:03.419808 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-85972fcf-5ace-4e6e-b9fc-8f7144dbd028 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:33:03.420499 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-85972fcf-5ace-4e6e-b9fc-8f7144dbd028 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:33:03.420985 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-85972fcf-5ace-4e6e-b9fc-8f7144dbd028 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:33:03.421413 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-85972fcf-5ace-4e6e-b9fc-8f7144dbd028 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:33:03.484010 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-85972fcf-5ace-4e6e-b9fc-8f7144dbd028 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:33:03.492248 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-85972fcf-5ace-4e6e-b9fc-8f7144dbd028 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1367 microversion: 2.1 time: 0.084756 Oct 20 06:33:03.493451 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1214/2439] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:33:03 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1367 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:33:04.516051 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-2b6b51d9-b934-4c47-8041-c7fb641aa29d tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:33:04.516660 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-2b6b51d9-b934-4c47-8041-c7fb641aa29d tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:33:04.523220 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2b6b51d9-b934-4c47-8041-c7fb641aa29d tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:33:04.524401 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2b6b51d9-b934-4c47-8041-c7fb641aa29d tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:33:04.525002 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2b6b51d9-b934-4c47-8041-c7fb641aa29d tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:33:04.525701 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2b6b51d9-b934-4c47-8041-c7fb641aa29d tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:33:04.526157 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2b6b51d9-b934-4c47-8041-c7fb641aa29d tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:33:04.526584 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-2b6b51d9-b934-4c47-8041-c7fb641aa29d tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:33:04.593218 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-2b6b51d9-b934-4c47-8041-c7fb641aa29d tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:33:04.601591 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-2b6b51d9-b934-4c47-8041-c7fb641aa29d tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1367 microversion: 2.1 time: 0.089420 Oct 20 06:33:04.602231 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1226/2440] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:33:04 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1367 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:33:05.623490 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-5406cca9-6e6d-4a05-be53-777a3c416223 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:33:05.624082 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-5406cca9-6e6d-4a05-be53-777a3c416223 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:33:05.630218 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5406cca9-6e6d-4a05-be53-777a3c416223 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:33:05.630704 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5406cca9-6e6d-4a05-be53-777a3c416223 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:33:05.631144 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5406cca9-6e6d-4a05-be53-777a3c416223 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:33:05.631854 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5406cca9-6e6d-4a05-be53-777a3c416223 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:33:05.632288 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5406cca9-6e6d-4a05-be53-777a3c416223 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:33:05.632724 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5406cca9-6e6d-4a05-be53-777a3c416223 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:33:05.697692 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-5406cca9-6e6d-4a05-be53-777a3c416223 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:33:05.705929 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-5406cca9-6e6d-4a05-be53-777a3c416223 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1367 microversion: 2.1 time: 0.086269 Oct 20 06:33:05.706495 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1215/2441] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:33:05 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1367 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:33:06.730934 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-5334bfbc-5fe8-48e7-b394-be0c9abe7838 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:33:06.730934 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-5334bfbc-5fe8-48e7-b394-be0c9abe7838 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:33:06.737436 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5334bfbc-5fe8-48e7-b394-be0c9abe7838 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:33:06.737966 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5334bfbc-5fe8-48e7-b394-be0c9abe7838 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:33:06.738407 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5334bfbc-5fe8-48e7-b394-be0c9abe7838 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:33:06.739105 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5334bfbc-5fe8-48e7-b394-be0c9abe7838 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:33:06.739557 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5334bfbc-5fe8-48e7-b394-be0c9abe7838 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:33:06.739981 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5334bfbc-5fe8-48e7-b394-be0c9abe7838 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:33:06.806904 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-5334bfbc-5fe8-48e7-b394-be0c9abe7838 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:33:06.815262 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-5334bfbc-5fe8-48e7-b394-be0c9abe7838 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1367 microversion: 2.1 time: 0.089718 Oct 20 06:33:06.815837 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1227/2442] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:33:06 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1367 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:33:07.838750 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-7efa3081-0227-4627-b2eb-7454f85dce1c tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:33:07.839347 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-7efa3081-0227-4627-b2eb-7454f85dce1c tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:33:07.845938 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7efa3081-0227-4627-b2eb-7454f85dce1c tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:33:07.846414 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7efa3081-0227-4627-b2eb-7454f85dce1c tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:33:07.846848 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7efa3081-0227-4627-b2eb-7454f85dce1c tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:33:07.847529 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7efa3081-0227-4627-b2eb-7454f85dce1c tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:33:07.847974 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7efa3081-0227-4627-b2eb-7454f85dce1c tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:33:07.848391 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7efa3081-0227-4627-b2eb-7454f85dce1c tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:33:07.912397 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-7efa3081-0227-4627-b2eb-7454f85dce1c tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:33:07.920967 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-7efa3081-0227-4627-b2eb-7454f85dce1c tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1367 microversion: 2.1 time: 0.086062 Oct 20 06:33:07.921538 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1216/2443] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:33:07 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1367 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:33:08.943426 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-6c6c3d8a-d981-42c5-bb5b-59765bc5c6e7 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:33:08.944021 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-6c6c3d8a-d981-42c5-bb5b-59765bc5c6e7 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:33:08.950540 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-6c6c3d8a-d981-42c5-bb5b-59765bc5c6e7 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:33:08.951018 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-6c6c3d8a-d981-42c5-bb5b-59765bc5c6e7 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:33:08.951453 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-6c6c3d8a-d981-42c5-bb5b-59765bc5c6e7 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:33:08.952137 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-6c6c3d8a-d981-42c5-bb5b-59765bc5c6e7 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:33:08.952588 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-6c6c3d8a-d981-42c5-bb5b-59765bc5c6e7 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:33:08.953061 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-6c6c3d8a-d981-42c5-bb5b-59765bc5c6e7 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:33:09.015941 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-6c6c3d8a-d981-42c5-bb5b-59765bc5c6e7 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:33:09.024419 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-6c6c3d8a-d981-42c5-bb5b-59765bc5c6e7 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1367 microversion: 2.1 time: 0.084731 Oct 20 06:33:09.025243 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1228/2444] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:33:08 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1367 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:33:10.047453 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-9dc7921a-d57a-4176-a2ad-8a6f006ce7ee tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:33:10.048034 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-9dc7921a-d57a-4176-a2ad-8a6f006ce7ee tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:33:10.055432 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-9dc7921a-d57a-4176-a2ad-8a6f006ce7ee tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:33:10.056091 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-9dc7921a-d57a-4176-a2ad-8a6f006ce7ee tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:33:10.056644 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-9dc7921a-d57a-4176-a2ad-8a6f006ce7ee tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:33:10.057324 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-9dc7921a-d57a-4176-a2ad-8a6f006ce7ee tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:33:10.057773 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-9dc7921a-d57a-4176-a2ad-8a6f006ce7ee tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:33:10.058207 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-9dc7921a-d57a-4176-a2ad-8a6f006ce7ee tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:33:10.121831 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-9dc7921a-d57a-4176-a2ad-8a6f006ce7ee tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:33:10.130146 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-9dc7921a-d57a-4176-a2ad-8a6f006ce7ee tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1367 microversion: 2.1 time: 0.086732 Oct 20 06:33:10.130809 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1217/2445] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:33:10 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1367 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:33:11.153658 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-f2d2db62-48ab-4440-adbb-cde2426ff46d tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:33:11.154265 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-f2d2db62-48ab-4440-adbb-cde2426ff46d tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:33:11.156560 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG dbcounter [-] [118860] Writing DB stats nova_api:SELECT=28 {{(pid=118860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:33:11.161950 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f2d2db62-48ab-4440-adbb-cde2426ff46d tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:33:11.162433 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f2d2db62-48ab-4440-adbb-cde2426ff46d tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:33:11.162864 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f2d2db62-48ab-4440-adbb-cde2426ff46d tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:33:11.163638 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f2d2db62-48ab-4440-adbb-cde2426ff46d tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:33:11.164715 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f2d2db62-48ab-4440-adbb-cde2426ff46d tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:33:11.165158 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f2d2db62-48ab-4440-adbb-cde2426ff46d tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:33:11.167737 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG dbcounter [-] [118860] Writing DB stats nova_cell1:SELECT=84 {{(pid=118860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:33:11.226238 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-f2d2db62-48ab-4440-adbb-cde2426ff46d tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:33:11.235097 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-f2d2db62-48ab-4440-adbb-cde2426ff46d tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1367 microversion: 2.1 time: 0.085334 Oct 20 06:33:11.235661 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1229/2446] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:33:11 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1367 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:33:12.258663 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-54d05584-8352-4b1b-ab5e-20849e092264 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:33:12.259261 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-54d05584-8352-4b1b-ab5e-20849e092264 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:33:12.266067 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-54d05584-8352-4b1b-ab5e-20849e092264 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:33:12.266553 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-54d05584-8352-4b1b-ab5e-20849e092264 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:33:12.266995 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-54d05584-8352-4b1b-ab5e-20849e092264 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:33:12.267700 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-54d05584-8352-4b1b-ab5e-20849e092264 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:33:12.268155 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-54d05584-8352-4b1b-ab5e-20849e092264 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:33:12.268583 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-54d05584-8352-4b1b-ab5e-20849e092264 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:33:12.332450 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-54d05584-8352-4b1b-ab5e-20849e092264 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:33:12.340985 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-54d05584-8352-4b1b-ab5e-20849e092264 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1367 microversion: 2.1 time: 0.086979 Oct 20 06:33:12.341566 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1218/2447] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:33:12 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1367 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:33:13.364333 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-942a14b9-0b4a-4379-ae1c-4de44001c075 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:33:13.364950 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-942a14b9-0b4a-4379-ae1c-4de44001c075 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:33:13.366878 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 20 06:33:13.367049 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: Thu Oct 20 06:33:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 (ip 10.222.0.20) !!! Oct 20 06:33:13.374396 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-942a14b9-0b4a-4379-ae1c-4de44001c075 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:33:13.374889 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-942a14b9-0b4a-4379-ae1c-4de44001c075 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:33:13.375330 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-942a14b9-0b4a-4379-ae1c-4de44001c075 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:33:13.376026 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-942a14b9-0b4a-4379-ae1c-4de44001c075 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:33:13.376482 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-942a14b9-0b4a-4379-ae1c-4de44001c075 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:33:13.376946 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-942a14b9-0b4a-4379-ae1c-4de44001c075 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:33:13.446151 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-942a14b9-0b4a-4379-ae1c-4de44001c075 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:33:13.454438 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-942a14b9-0b4a-4379-ae1c-4de44001c075 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1367 microversion: 2.1 time: 0.094136 Oct 20 06:33:13.455005 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1230/2448] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:33:13 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1367 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:33:14.477872 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-eb38a38e-06e6-418e-a06e-cbd6ef069112 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:33:14.478511 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-eb38a38e-06e6-418e-a06e-cbd6ef069112 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:33:14.481346 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG dbcounter [-] [118861] Writing DB stats nova_api:SELECT=28 {{(pid=118861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:33:14.486565 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-eb38a38e-06e6-418e-a06e-cbd6ef069112 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:33:14.487049 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-eb38a38e-06e6-418e-a06e-cbd6ef069112 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:33:14.487486 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-eb38a38e-06e6-418e-a06e-cbd6ef069112 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:33:14.488186 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-eb38a38e-06e6-418e-a06e-cbd6ef069112 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:33:14.488633 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-eb38a38e-06e6-418e-a06e-cbd6ef069112 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:33:14.489089 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-eb38a38e-06e6-418e-a06e-cbd6ef069112 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:33:14.491931 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG dbcounter [-] [118861] Writing DB stats nova_cell1:SELECT=84 {{(pid=118861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:33:14.551659 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-eb38a38e-06e6-418e-a06e-cbd6ef069112 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:33:14.560164 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-eb38a38e-06e6-418e-a06e-cbd6ef069112 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1367 microversion: 2.1 time: 0.086644 Oct 20 06:33:14.560972 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1219/2449] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:33:14 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1367 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:33:15.582454 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-5b7e4de5-7d53-4ee8-9ff7-77b2c17057ea tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:33:15.583043 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-5b7e4de5-7d53-4ee8-9ff7-77b2c17057ea tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:33:15.584997 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 20 06:33:15.585131 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: Thu Oct 20 06:33:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 (ip 10.222.0.20) !!! Oct 20 06:33:15.591976 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5b7e4de5-7d53-4ee8-9ff7-77b2c17057ea tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:33:15.592475 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5b7e4de5-7d53-4ee8-9ff7-77b2c17057ea tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:33:15.592949 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5b7e4de5-7d53-4ee8-9ff7-77b2c17057ea tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:33:15.593657 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5b7e4de5-7d53-4ee8-9ff7-77b2c17057ea tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:33:15.594121 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5b7e4de5-7d53-4ee8-9ff7-77b2c17057ea tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:33:15.594551 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5b7e4de5-7d53-4ee8-9ff7-77b2c17057ea tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:33:15.668608 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-5b7e4de5-7d53-4ee8-9ff7-77b2c17057ea tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:33:15.677352 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-5b7e4de5-7d53-4ee8-9ff7-77b2c17057ea tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1367 microversion: 2.1 time: 0.098804 Oct 20 06:33:15.677945 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1231/2450] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:33:15 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1367 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 06:33:16.700831 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-b9cddfc1-36bf-4328-accc-56e12e71e770 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:33:16.701453 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-b9cddfc1-36bf-4328-accc-56e12e71e770 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:33:16.707880 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b9cddfc1-36bf-4328-accc-56e12e71e770 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:33:16.708391 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b9cddfc1-36bf-4328-accc-56e12e71e770 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:33:16.708866 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b9cddfc1-36bf-4328-accc-56e12e71e770 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:33:16.709560 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b9cddfc1-36bf-4328-accc-56e12e71e770 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:33:16.710018 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b9cddfc1-36bf-4328-accc-56e12e71e770 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:33:16.710445 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b9cddfc1-36bf-4328-accc-56e12e71e770 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:33:16.777388 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-b9cddfc1-36bf-4328-accc-56e12e71e770 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:33:16.785719 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-b9cddfc1-36bf-4328-accc-56e12e71e770 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1367 microversion: 2.1 time: 0.088789 Oct 20 06:33:16.786283 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1220/2451] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:33:16 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1367 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:33:17.809690 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-bd74cd2f-b180-45e7-924d-05dd3d9a6d73 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:33:17.810308 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-bd74cd2f-b180-45e7-924d-05dd3d9a6d73 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:33:17.816918 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-bd74cd2f-b180-45e7-924d-05dd3d9a6d73 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:33:17.817403 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-bd74cd2f-b180-45e7-924d-05dd3d9a6d73 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:33:17.819473 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-bd74cd2f-b180-45e7-924d-05dd3d9a6d73 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:33:17.819473 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-bd74cd2f-b180-45e7-924d-05dd3d9a6d73 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:33:17.819473 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-bd74cd2f-b180-45e7-924d-05dd3d9a6d73 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:33:17.819473 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-bd74cd2f-b180-45e7-924d-05dd3d9a6d73 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:33:17.919080 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-bd74cd2f-b180-45e7-924d-05dd3d9a6d73 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:33:17.927492 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-bd74cd2f-b180-45e7-924d-05dd3d9a6d73 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1367 microversion: 2.1 time: 0.121664 Oct 20 06:33:17.928255 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1232/2452] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:33:17 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1367 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:33:18.951326 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-981112dc-1efb-4ca1-852e-2b982e7b2db3 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:33:18.951966 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-981112dc-1efb-4ca1-852e-2b982e7b2db3 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:33:18.958308 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-981112dc-1efb-4ca1-852e-2b982e7b2db3 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:33:18.958813 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-981112dc-1efb-4ca1-852e-2b982e7b2db3 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:33:18.959242 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-981112dc-1efb-4ca1-852e-2b982e7b2db3 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:33:18.959922 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-981112dc-1efb-4ca1-852e-2b982e7b2db3 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:33:18.960365 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-981112dc-1efb-4ca1-852e-2b982e7b2db3 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:33:18.960940 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-981112dc-1efb-4ca1-852e-2b982e7b2db3 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:33:19.022780 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-981112dc-1efb-4ca1-852e-2b982e7b2db3 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:33:19.031591 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-981112dc-1efb-4ca1-852e-2b982e7b2db3 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1367 microversion: 2.1 time: 0.084099 Oct 20 06:33:19.032332 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1221/2453] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:33:18 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1367 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:33:20.054396 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-3db00312-7746-4168-a7dd-f6c535c384a0 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:33:20.055093 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-3db00312-7746-4168-a7dd-f6c535c384a0 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:33:20.061519 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3db00312-7746-4168-a7dd-f6c535c384a0 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:33:20.061993 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3db00312-7746-4168-a7dd-f6c535c384a0 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:33:20.062422 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3db00312-7746-4168-a7dd-f6c535c384a0 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:33:20.063102 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3db00312-7746-4168-a7dd-f6c535c384a0 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:33:20.063580 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3db00312-7746-4168-a7dd-f6c535c384a0 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:33:20.064010 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3db00312-7746-4168-a7dd-f6c535c384a0 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:33:20.124157 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-3db00312-7746-4168-a7dd-f6c535c384a0 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:33:20.132207 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-3db00312-7746-4168-a7dd-f6c535c384a0 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1367 microversion: 2.1 time: 0.081744 Oct 20 06:33:20.133771 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1233/2454] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:33:20 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1367 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:33:21.157305 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-42d5f112-2796-4bf5-a372-b6bfd92266af tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:33:21.158028 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-42d5f112-2796-4bf5-a372-b6bfd92266af tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:33:21.165933 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-42d5f112-2796-4bf5-a372-b6bfd92266af tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:33:21.166420 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-42d5f112-2796-4bf5-a372-b6bfd92266af tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:33:21.166911 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-42d5f112-2796-4bf5-a372-b6bfd92266af tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:33:21.167566 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-42d5f112-2796-4bf5-a372-b6bfd92266af tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:33:21.168020 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-42d5f112-2796-4bf5-a372-b6bfd92266af tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:33:21.168445 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-42d5f112-2796-4bf5-a372-b6bfd92266af tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:33:21.232575 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-42d5f112-2796-4bf5-a372-b6bfd92266af tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:33:21.241082 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-42d5f112-2796-4bf5-a372-b6bfd92266af tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1367 microversion: 2.1 time: 0.088092 Oct 20 06:33:21.242180 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1222/2455] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:33:21 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1367 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:33:22.265098 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-0973fb05-be97-426d-8737-09380346dcb5 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:33:22.265737 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-0973fb05-be97-426d-8737-09380346dcb5 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:33:22.271859 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0973fb05-be97-426d-8737-09380346dcb5 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:33:22.272346 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0973fb05-be97-426d-8737-09380346dcb5 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:33:22.272821 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0973fb05-be97-426d-8737-09380346dcb5 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:33:22.274105 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0973fb05-be97-426d-8737-09380346dcb5 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:33:22.274569 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0973fb05-be97-426d-8737-09380346dcb5 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:33:22.274992 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0973fb05-be97-426d-8737-09380346dcb5 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:33:22.344613 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-0973fb05-be97-426d-8737-09380346dcb5 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:33:22.353392 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-0973fb05-be97-426d-8737-09380346dcb5 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1367 microversion: 2.1 time: 0.092344 Oct 20 06:33:22.354161 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1234/2456] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:33:22 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1367 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:33:23.376335 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-caa52e00-ab9f-4f4f-b89a-1d24b325a919 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:33:23.376977 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-caa52e00-ab9f-4f4f-b89a-1d24b325a919 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:33:23.386013 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-caa52e00-ab9f-4f4f-b89a-1d24b325a919 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:33:23.386620 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-caa52e00-ab9f-4f4f-b89a-1d24b325a919 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:33:23.387350 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-caa52e00-ab9f-4f4f-b89a-1d24b325a919 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:33:23.388063 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-caa52e00-ab9f-4f4f-b89a-1d24b325a919 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:33:23.388514 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-caa52e00-ab9f-4f4f-b89a-1d24b325a919 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:33:23.389147 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-caa52e00-ab9f-4f4f-b89a-1d24b325a919 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:33:23.452083 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-caa52e00-ab9f-4f4f-b89a-1d24b325a919 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:33:23.461544 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-caa52e00-ab9f-4f4f-b89a-1d24b325a919 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1367 microversion: 2.1 time: 0.089027 Oct 20 06:33:23.462124 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1223/2457] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:33:23 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1367 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:33:24.485919 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-5969d314-3e69-4cdc-b585-91fabf44c432 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:33:24.486529 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-5969d314-3e69-4cdc-b585-91fabf44c432 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:33:24.493858 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5969d314-3e69-4cdc-b585-91fabf44c432 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:33:24.494355 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5969d314-3e69-4cdc-b585-91fabf44c432 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:33:24.494778 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5969d314-3e69-4cdc-b585-91fabf44c432 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:33:24.495470 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5969d314-3e69-4cdc-b585-91fabf44c432 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:33:24.495922 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5969d314-3e69-4cdc-b585-91fabf44c432 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:33:24.496349 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5969d314-3e69-4cdc-b585-91fabf44c432 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:33:24.563272 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-5969d314-3e69-4cdc-b585-91fabf44c432 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:33:24.572374 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-5969d314-3e69-4cdc-b585-91fabf44c432 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1367 microversion: 2.1 time: 0.090302 Oct 20 06:33:24.572946 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1235/2458] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:33:24 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1367 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:33:25.595290 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-4ad67879-691b-4772-ae66-7442d243586f tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:33:25.595833 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-4ad67879-691b-4772-ae66-7442d243586f tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:33:25.603166 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4ad67879-691b-4772-ae66-7442d243586f tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:33:25.603652 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4ad67879-691b-4772-ae66-7442d243586f tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:33:25.604091 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4ad67879-691b-4772-ae66-7442d243586f tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:33:25.604830 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4ad67879-691b-4772-ae66-7442d243586f tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:33:25.605338 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4ad67879-691b-4772-ae66-7442d243586f tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:33:25.605713 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4ad67879-691b-4772-ae66-7442d243586f tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:33:25.670616 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-4ad67879-691b-4772-ae66-7442d243586f tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:33:25.678941 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-4ad67879-691b-4772-ae66-7442d243586f tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1367 microversion: 2.1 time: 0.087659 Oct 20 06:33:25.679576 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1224/2459] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:33:25 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1367 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:33:26.702157 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-64f4f521-ff24-4d04-89cf-3a472e144f4c tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:33:26.702744 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-64f4f521-ff24-4d04-89cf-3a472e144f4c tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:33:26.708759 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-64f4f521-ff24-4d04-89cf-3a472e144f4c tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:33:26.709241 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-64f4f521-ff24-4d04-89cf-3a472e144f4c tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:33:26.709675 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-64f4f521-ff24-4d04-89cf-3a472e144f4c tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:33:26.711020 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-64f4f521-ff24-4d04-89cf-3a472e144f4c tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:33:26.711489 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-64f4f521-ff24-4d04-89cf-3a472e144f4c tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:33:26.711913 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-64f4f521-ff24-4d04-89cf-3a472e144f4c tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:33:26.773585 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-64f4f521-ff24-4d04-89cf-3a472e144f4c tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:33:26.781846 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-64f4f521-ff24-4d04-89cf-3a472e144f4c tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1367 microversion: 2.1 time: 0.084346 Oct 20 06:33:26.782416 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1236/2460] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:33:26 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1367 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:33:27.805367 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-5aab3104-d008-46d8-b555-5f27a720971b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:33:27.805979 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-5aab3104-d008-46d8-b555-5f27a720971b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:33:27.812084 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5aab3104-d008-46d8-b555-5f27a720971b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:33:27.812561 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5aab3104-d008-46d8-b555-5f27a720971b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:33:27.813026 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5aab3104-d008-46d8-b555-5f27a720971b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:33:27.813711 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5aab3104-d008-46d8-b555-5f27a720971b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:33:27.814157 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5aab3104-d008-46d8-b555-5f27a720971b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:33:27.814582 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5aab3104-d008-46d8-b555-5f27a720971b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:33:27.876531 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-5aab3104-d008-46d8-b555-5f27a720971b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:33:27.885372 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-5aab3104-d008-46d8-b555-5f27a720971b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1367 microversion: 2.1 time: 0.084594 Oct 20 06:33:27.885937 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1225/2461] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:33:27 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1367 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:33:28.909207 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-4fdc7ae5-857a-408c-9cb0-0b70a9ef58fb tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:33:28.909818 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-4fdc7ae5-857a-408c-9cb0-0b70a9ef58fb tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:33:28.916320 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-4fdc7ae5-857a-408c-9cb0-0b70a9ef58fb tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:33:28.916838 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-4fdc7ae5-857a-408c-9cb0-0b70a9ef58fb tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:33:28.917272 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-4fdc7ae5-857a-408c-9cb0-0b70a9ef58fb tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:33:28.917956 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-4fdc7ae5-857a-408c-9cb0-0b70a9ef58fb tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:33:28.918404 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-4fdc7ae5-857a-408c-9cb0-0b70a9ef58fb tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:33:28.918821 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-4fdc7ae5-857a-408c-9cb0-0b70a9ef58fb tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:33:28.981159 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-4fdc7ae5-857a-408c-9cb0-0b70a9ef58fb tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:33:28.989507 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-4fdc7ae5-857a-408c-9cb0-0b70a9ef58fb tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1367 microversion: 2.1 time: 0.084177 Oct 20 06:33:28.990070 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1237/2462] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:33:28 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1367 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:33:30.011799 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-859552bc-0c05-4a83-a9de-d114c24a5d58 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:33:30.012420 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-859552bc-0c05-4a83-a9de-d114c24a5d58 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:33:30.019053 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-859552bc-0c05-4a83-a9de-d114c24a5d58 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:33:30.019540 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-859552bc-0c05-4a83-a9de-d114c24a5d58 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:33:30.019979 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-859552bc-0c05-4a83-a9de-d114c24a5d58 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:33:30.020685 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-859552bc-0c05-4a83-a9de-d114c24a5d58 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:33:30.021220 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-859552bc-0c05-4a83-a9de-d114c24a5d58 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:33:30.021595 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-859552bc-0c05-4a83-a9de-d114c24a5d58 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:33:30.084236 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-859552bc-0c05-4a83-a9de-d114c24a5d58 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:33:30.093364 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-859552bc-0c05-4a83-a9de-d114c24a5d58 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1367 microversion: 2.1 time: 0.085817 Oct 20 06:33:30.093961 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1226/2463] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:33:30 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1367 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:33:31.117863 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-29dc874b-34c7-4991-adc5-f9225ed7b394 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:33:31.118451 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-29dc874b-34c7-4991-adc5-f9225ed7b394 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:33:31.124864 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-29dc874b-34c7-4991-adc5-f9225ed7b394 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:33:31.125362 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-29dc874b-34c7-4991-adc5-f9225ed7b394 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:33:31.125788 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-29dc874b-34c7-4991-adc5-f9225ed7b394 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:33:31.126481 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-29dc874b-34c7-4991-adc5-f9225ed7b394 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:33:31.126931 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-29dc874b-34c7-4991-adc5-f9225ed7b394 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:33:31.127345 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-29dc874b-34c7-4991-adc5-f9225ed7b394 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:33:31.192557 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-29dc874b-34c7-4991-adc5-f9225ed7b394 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:33:31.201712 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-29dc874b-34c7-4991-adc5-f9225ed7b394 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1367 microversion: 2.1 time: 0.088324 Oct 20 06:33:31.202277 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1238/2464] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:33:31 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1367 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:33:32.223956 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-22a39979-7da3-4c68-8024-5ab2b887b7b4 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:33:32.224763 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-22a39979-7da3-4c68-8024-5ab2b887b7b4 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:33:32.232452 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-22a39979-7da3-4c68-8024-5ab2b887b7b4 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:33:32.232979 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-22a39979-7da3-4c68-8024-5ab2b887b7b4 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:33:32.233419 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-22a39979-7da3-4c68-8024-5ab2b887b7b4 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:33:32.234133 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-22a39979-7da3-4c68-8024-5ab2b887b7b4 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:33:32.234583 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-22a39979-7da3-4c68-8024-5ab2b887b7b4 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:33:32.235044 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-22a39979-7da3-4c68-8024-5ab2b887b7b4 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:33:32.307588 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-22a39979-7da3-4c68-8024-5ab2b887b7b4 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:33:32.315807 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-22a39979-7da3-4c68-8024-5ab2b887b7b4 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1367 microversion: 2.1 time: 0.095701 Oct 20 06:33:32.316377 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1227/2465] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:33:32 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1367 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:33:33.339880 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-836730d8-ca53-4111-a4df-3b46865e9efd tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:33:33.340487 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-836730d8-ca53-4111-a4df-3b46865e9efd tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:33:33.346952 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-836730d8-ca53-4111-a4df-3b46865e9efd tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:33:33.347435 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-836730d8-ca53-4111-a4df-3b46865e9efd tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:33:33.347873 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-836730d8-ca53-4111-a4df-3b46865e9efd tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:33:33.348572 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-836730d8-ca53-4111-a4df-3b46865e9efd tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:33:33.349047 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-836730d8-ca53-4111-a4df-3b46865e9efd tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:33:33.349473 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-836730d8-ca53-4111-a4df-3b46865e9efd tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:33:33.415118 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-836730d8-ca53-4111-a4df-3b46865e9efd tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:33:33.423383 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-836730d8-ca53-4111-a4df-3b46865e9efd tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1367 microversion: 2.1 time: 0.087614 Oct 20 06:33:33.423946 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1239/2466] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:33:33 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1367 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:33:34.446618 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-cc82c1a4-a876-482b-85e8-3bca4169b088 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:33:34.447213 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-cc82c1a4-a876-482b-85e8-3bca4169b088 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:33:34.453952 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-cc82c1a4-a876-482b-85e8-3bca4169b088 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:33:34.454429 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-cc82c1a4-a876-482b-85e8-3bca4169b088 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:33:34.454866 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-cc82c1a4-a876-482b-85e8-3bca4169b088 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:33:34.455561 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-cc82c1a4-a876-482b-85e8-3bca4169b088 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:33:34.456006 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-cc82c1a4-a876-482b-85e8-3bca4169b088 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:33:34.456429 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-cc82c1a4-a876-482b-85e8-3bca4169b088 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:33:34.523410 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-cc82c1a4-a876-482b-85e8-3bca4169b088 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:33:34.531557 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-cc82c1a4-a876-482b-85e8-3bca4169b088 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1367 microversion: 2.1 time: 0.089350 Oct 20 06:33:34.532130 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1228/2467] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:33:34 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1367 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:33:35.555125 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-f731d548-dd77-4ab3-962d-29c40ce66f30 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:33:35.555696 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-f731d548-dd77-4ab3-962d-29c40ce66f30 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:33:35.562312 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f731d548-dd77-4ab3-962d-29c40ce66f30 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:33:35.562794 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f731d548-dd77-4ab3-962d-29c40ce66f30 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:33:35.563225 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f731d548-dd77-4ab3-962d-29c40ce66f30 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:33:35.563978 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f731d548-dd77-4ab3-962d-29c40ce66f30 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:33:35.564429 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f731d548-dd77-4ab3-962d-29c40ce66f30 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:33:35.564882 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f731d548-dd77-4ab3-962d-29c40ce66f30 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:33:35.627530 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-f731d548-dd77-4ab3-962d-29c40ce66f30 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:33:35.637682 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-f731d548-dd77-4ab3-962d-29c40ce66f30 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1367 microversion: 2.1 time: 0.087171 Oct 20 06:33:35.638259 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1240/2468] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:33:35 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1367 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:33:36.660907 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-60fedc94-abac-4cb9-b391-e3b5755c95b3 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:33:36.661529 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-60fedc94-abac-4cb9-b391-e3b5755c95b3 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:33:36.668571 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-60fedc94-abac-4cb9-b391-e3b5755c95b3 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:33:36.669095 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-60fedc94-abac-4cb9-b391-e3b5755c95b3 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:33:36.669541 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-60fedc94-abac-4cb9-b391-e3b5755c95b3 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:33:36.670238 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-60fedc94-abac-4cb9-b391-e3b5755c95b3 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:33:36.670693 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-60fedc94-abac-4cb9-b391-e3b5755c95b3 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:33:36.671118 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-60fedc94-abac-4cb9-b391-e3b5755c95b3 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:33:36.732763 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-60fedc94-abac-4cb9-b391-e3b5755c95b3 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:33:36.741650 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-60fedc94-abac-4cb9-b391-e3b5755c95b3 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1367 microversion: 2.1 time: 0.084023 Oct 20 06:33:36.742221 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1229/2469] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:33:36 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1367 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:33:37.764605 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-ddf93687-8684-4146-b98d-f00d8dbbef07 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:33:37.765252 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-ddf93687-8684-4146-b98d-f00d8dbbef07 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:33:37.771891 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-ddf93687-8684-4146-b98d-f00d8dbbef07 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:33:37.772918 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-ddf93687-8684-4146-b98d-f00d8dbbef07 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:33:37.773373 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-ddf93687-8684-4146-b98d-f00d8dbbef07 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:33:37.774078 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-ddf93687-8684-4146-b98d-f00d8dbbef07 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:33:37.774536 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-ddf93687-8684-4146-b98d-f00d8dbbef07 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:33:37.774967 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-ddf93687-8684-4146-b98d-f00d8dbbef07 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:33:37.837411 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-ddf93687-8684-4146-b98d-f00d8dbbef07 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:33:37.845871 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-ddf93687-8684-4146-b98d-f00d8dbbef07 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1367 microversion: 2.1 time: 0.085081 Oct 20 06:33:37.846439 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1241/2470] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:33:37 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1367 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:33:38.868952 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-f94aa79b-3827-400f-b552-3ccd54a35eca tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:33:38.869693 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-f94aa79b-3827-400f-b552-3ccd54a35eca tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:33:38.876071 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f94aa79b-3827-400f-b552-3ccd54a35eca tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:33:38.876558 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f94aa79b-3827-400f-b552-3ccd54a35eca tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:33:38.877038 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f94aa79b-3827-400f-b552-3ccd54a35eca tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:33:38.877751 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f94aa79b-3827-400f-b552-3ccd54a35eca tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:33:38.878225 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f94aa79b-3827-400f-b552-3ccd54a35eca tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:33:38.878663 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f94aa79b-3827-400f-b552-3ccd54a35eca tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:33:38.940509 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-f94aa79b-3827-400f-b552-3ccd54a35eca tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:33:38.949469 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-f94aa79b-3827-400f-b552-3ccd54a35eca tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1367 microversion: 2.1 time: 0.084498 Oct 20 06:33:38.950031 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1230/2471] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:33:38 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1367 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:33:39.972968 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-3d00d66b-ebc0-4c0b-91e9-fa5ee93e0959 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:33:39.973579 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-3d00d66b-ebc0-4c0b-91e9-fa5ee93e0959 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:33:39.980097 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3d00d66b-ebc0-4c0b-91e9-fa5ee93e0959 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:33:39.980581 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3d00d66b-ebc0-4c0b-91e9-fa5ee93e0959 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:33:39.981057 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3d00d66b-ebc0-4c0b-91e9-fa5ee93e0959 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:33:39.981752 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3d00d66b-ebc0-4c0b-91e9-fa5ee93e0959 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:33:39.982206 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3d00d66b-ebc0-4c0b-91e9-fa5ee93e0959 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:33:39.982639 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3d00d66b-ebc0-4c0b-91e9-fa5ee93e0959 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:33:40.046651 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-3d00d66b-ebc0-4c0b-91e9-fa5ee93e0959 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:33:40.055667 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-3d00d66b-ebc0-4c0b-91e9-fa5ee93e0959 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1367 microversion: 2.1 time: 0.086621 Oct 20 06:33:40.056229 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1242/2472] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:33:39 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1367 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:33:41.078939 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-c0aaba11-a765-466f-ac94-4d414136c3db tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:33:41.079478 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-c0aaba11-a765-466f-ac94-4d414136c3db tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:33:41.085997 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c0aaba11-a765-466f-ac94-4d414136c3db tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:33:41.086476 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c0aaba11-a765-466f-ac94-4d414136c3db tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:33:41.086933 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c0aaba11-a765-466f-ac94-4d414136c3db tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:33:41.087615 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c0aaba11-a765-466f-ac94-4d414136c3db tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:33:41.088081 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c0aaba11-a765-466f-ac94-4d414136c3db tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:33:41.088481 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c0aaba11-a765-466f-ac94-4d414136c3db tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:33:41.151768 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-c0aaba11-a765-466f-ac94-4d414136c3db tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:33:41.160826 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-c0aaba11-a765-466f-ac94-4d414136c3db tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1367 microversion: 2.1 time: 0.085493 Oct 20 06:33:41.161454 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1231/2473] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:33:41 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1367 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:33:42.185270 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-a9f3d64a-d54a-4824-ad75-22c65e09cd8e tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:33:42.185887 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-a9f3d64a-d54a-4824-ad75-22c65e09cd8e tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:33:42.188229 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG dbcounter [-] [118860] Writing DB stats nova_api:SELECT=28 {{(pid=118860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:33:42.193721 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a9f3d64a-d54a-4824-ad75-22c65e09cd8e tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:33:42.194746 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a9f3d64a-d54a-4824-ad75-22c65e09cd8e tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:33:42.195183 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a9f3d64a-d54a-4824-ad75-22c65e09cd8e tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:33:42.195881 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a9f3d64a-d54a-4824-ad75-22c65e09cd8e tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:33:42.196338 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a9f3d64a-d54a-4824-ad75-22c65e09cd8e tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:33:42.196793 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a9f3d64a-d54a-4824-ad75-22c65e09cd8e tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:33:42.199405 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG dbcounter [-] [118860] Writing DB stats nova_cell1:SELECT=84 {{(pid=118860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:33:42.258665 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-a9f3d64a-d54a-4824-ad75-22c65e09cd8e tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:33:42.266921 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-a9f3d64a-d54a-4824-ad75-22c65e09cd8e tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1367 microversion: 2.1 time: 0.085526 Oct 20 06:33:42.267480 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1243/2474] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:33:42 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1367 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:33:43.289864 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-e5c3ec13-9ca0-4816-96f0-b4339a214221 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:33:43.290482 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-e5c3ec13-9ca0-4816-96f0-b4339a214221 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:33:43.297071 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e5c3ec13-9ca0-4816-96f0-b4339a214221 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:33:43.297565 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e5c3ec13-9ca0-4816-96f0-b4339a214221 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:33:43.298007 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e5c3ec13-9ca0-4816-96f0-b4339a214221 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:33:43.298794 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e5c3ec13-9ca0-4816-96f0-b4339a214221 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:33:43.299258 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e5c3ec13-9ca0-4816-96f0-b4339a214221 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:33:43.301767 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e5c3ec13-9ca0-4816-96f0-b4339a214221 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:33:43.367514 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-e5c3ec13-9ca0-4816-96f0-b4339a214221 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:33:43.376172 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-e5c3ec13-9ca0-4816-96f0-b4339a214221 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1367 microversion: 2.1 time: 0.090320 Oct 20 06:33:43.376792 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1232/2475] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:33:43 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1367 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:33:44.399941 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-a33103b6-d962-4868-b26b-cb5864937322 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:33:44.400614 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-a33103b6-d962-4868-b26b-cb5864937322 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:33:44.407206 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a33103b6-d962-4868-b26b-cb5864937322 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:33:44.407692 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a33103b6-d962-4868-b26b-cb5864937322 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:33:44.408134 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a33103b6-d962-4868-b26b-cb5864937322 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:33:44.408874 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a33103b6-d962-4868-b26b-cb5864937322 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:33:44.409343 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a33103b6-d962-4868-b26b-cb5864937322 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:33:44.409771 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a33103b6-d962-4868-b26b-cb5864937322 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:33:44.471615 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-a33103b6-d962-4868-b26b-cb5864937322 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:33:44.480610 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-a33103b6-d962-4868-b26b-cb5864937322 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1367 microversion: 2.1 time: 0.085036 Oct 20 06:33:44.481206 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1244/2476] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:33:44 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1367 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:33:45.503420 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-76bc30b3-0553-42a9-bb49-a82f23af0be5 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:33:45.504152 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-76bc30b3-0553-42a9-bb49-a82f23af0be5 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:33:45.506722 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG dbcounter [-] [118861] Writing DB stats nova_api:SELECT=28 {{(pid=118861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:33:45.512349 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-76bc30b3-0553-42a9-bb49-a82f23af0be5 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:33:45.512878 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-76bc30b3-0553-42a9-bb49-a82f23af0be5 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:33:45.513326 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-76bc30b3-0553-42a9-bb49-a82f23af0be5 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:33:45.514042 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-76bc30b3-0553-42a9-bb49-a82f23af0be5 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:33:45.514499 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-76bc30b3-0553-42a9-bb49-a82f23af0be5 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:33:45.514969 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-76bc30b3-0553-42a9-bb49-a82f23af0be5 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:33:45.517803 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG dbcounter [-] [118861] Writing DB stats nova_cell1:SELECT=84 {{(pid=118861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:33:45.653482 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-76bc30b3-0553-42a9-bb49-a82f23af0be5 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:33:45.666183 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-76bc30b3-0553-42a9-bb49-a82f23af0be5 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1367 microversion: 2.1 time: 0.166497 Oct 20 06:33:45.666773 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1233/2477] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:33:45 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1367 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:33:46.689517 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-1991678c-cc26-4ef7-8eab-874f7a662a3b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:33:46.690210 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-1991678c-cc26-4ef7-8eab-874f7a662a3b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:33:46.697160 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1991678c-cc26-4ef7-8eab-874f7a662a3b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:33:46.697652 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1991678c-cc26-4ef7-8eab-874f7a662a3b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:33:46.698087 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1991678c-cc26-4ef7-8eab-874f7a662a3b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:33:46.698779 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1991678c-cc26-4ef7-8eab-874f7a662a3b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:33:46.699232 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1991678c-cc26-4ef7-8eab-874f7a662a3b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:33:46.699656 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1991678c-cc26-4ef7-8eab-874f7a662a3b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:33:46.765493 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-1991678c-cc26-4ef7-8eab-874f7a662a3b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:33:46.773874 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-1991678c-cc26-4ef7-8eab-874f7a662a3b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1367 microversion: 2.1 time: 0.088227 Oct 20 06:33:46.774518 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1245/2478] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:33:46 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1367 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:33:47.796306 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-f94c90c5-a682-4625-86db-5877f294bb5d tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:33:47.797407 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-f94c90c5-a682-4625-86db-5877f294bb5d tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:33:47.804188 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f94c90c5-a682-4625-86db-5877f294bb5d tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:33:47.804667 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f94c90c5-a682-4625-86db-5877f294bb5d tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:33:47.805182 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f94c90c5-a682-4625-86db-5877f294bb5d tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:33:47.805868 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f94c90c5-a682-4625-86db-5877f294bb5d tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:33:47.806314 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f94c90c5-a682-4625-86db-5877f294bb5d tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:33:47.806774 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f94c90c5-a682-4625-86db-5877f294bb5d tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:33:47.872883 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-f94c90c5-a682-4625-86db-5877f294bb5d tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:33:47.881654 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-f94c90c5-a682-4625-86db-5877f294bb5d tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1367 microversion: 2.1 time: 0.088626 Oct 20 06:33:47.882240 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1234/2479] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:33:47 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1367 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:33:48.905803 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-0b567e6b-3596-4644-9e1f-7fb51d86c5e5 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:33:48.906406 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-0b567e6b-3596-4644-9e1f-7fb51d86c5e5 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:33:48.913476 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0b567e6b-3596-4644-9e1f-7fb51d86c5e5 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:33:48.913955 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0b567e6b-3596-4644-9e1f-7fb51d86c5e5 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:33:48.914388 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0b567e6b-3596-4644-9e1f-7fb51d86c5e5 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:33:48.915074 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0b567e6b-3596-4644-9e1f-7fb51d86c5e5 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:33:48.915517 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0b567e6b-3596-4644-9e1f-7fb51d86c5e5 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:33:48.915934 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0b567e6b-3596-4644-9e1f-7fb51d86c5e5 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:33:48.984917 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-0b567e6b-3596-4644-9e1f-7fb51d86c5e5 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:33:48.993333 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-0b567e6b-3596-4644-9e1f-7fb51d86c5e5 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1367 microversion: 2.1 time: 0.091759 Oct 20 06:33:48.993901 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1246/2480] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:33:48 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1367 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:33:50.015568 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-3670da8b-93f4-4175-bd2f-d3140ea147c3 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:33:50.016178 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-3670da8b-93f4-4175-bd2f-d3140ea147c3 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:33:50.023088 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-3670da8b-93f4-4175-bd2f-d3140ea147c3 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:33:50.023573 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-3670da8b-93f4-4175-bd2f-d3140ea147c3 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:33:50.024073 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-3670da8b-93f4-4175-bd2f-d3140ea147c3 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:33:50.024687 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-3670da8b-93f4-4175-bd2f-d3140ea147c3 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:33:50.025162 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-3670da8b-93f4-4175-bd2f-d3140ea147c3 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:33:50.025630 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-3670da8b-93f4-4175-bd2f-d3140ea147c3 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:33:50.089362 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-3670da8b-93f4-4175-bd2f-d3140ea147c3 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:33:50.097697 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-3670da8b-93f4-4175-bd2f-d3140ea147c3 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1367 microversion: 2.1 time: 0.086083 Oct 20 06:33:50.098301 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1235/2481] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:33:50 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1367 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:33:51.123935 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-69bf5390-e6bc-4422-8a5f-05c19328b1ed tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:33:51.124650 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-69bf5390-e6bc-4422-8a5f-05c19328b1ed tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:33:51.131691 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-69bf5390-e6bc-4422-8a5f-05c19328b1ed tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:33:51.132169 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-69bf5390-e6bc-4422-8a5f-05c19328b1ed tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:33:51.132607 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-69bf5390-e6bc-4422-8a5f-05c19328b1ed tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:33:51.133596 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-69bf5390-e6bc-4422-8a5f-05c19328b1ed tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:33:51.134052 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-69bf5390-e6bc-4422-8a5f-05c19328b1ed tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:33:51.134477 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-69bf5390-e6bc-4422-8a5f-05c19328b1ed tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:33:51.196364 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-69bf5390-e6bc-4422-8a5f-05c19328b1ed tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:33:51.204807 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-69bf5390-e6bc-4422-8a5f-05c19328b1ed tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1367 microversion: 2.1 time: 0.085778 Oct 20 06:33:51.205381 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1247/2482] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:33:51 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1367 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:33:52.227856 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-896c520d-4ebe-4d63-9549-72b751547387 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:33:52.228473 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-896c520d-4ebe-4d63-9549-72b751547387 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:33:52.234889 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-896c520d-4ebe-4d63-9549-72b751547387 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:33:52.235364 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-896c520d-4ebe-4d63-9549-72b751547387 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:33:52.235793 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-896c520d-4ebe-4d63-9549-72b751547387 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:33:52.236464 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-896c520d-4ebe-4d63-9549-72b751547387 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:33:52.236937 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-896c520d-4ebe-4d63-9549-72b751547387 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:33:52.237356 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-896c520d-4ebe-4d63-9549-72b751547387 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:33:52.301215 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-896c520d-4ebe-4d63-9549-72b751547387 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:33:52.310158 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-896c520d-4ebe-4d63-9549-72b751547387 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1367 microversion: 2.1 time: 0.086584 Oct 20 06:33:52.310746 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1236/2483] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:33:52 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1367 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:33:53.332750 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-5ccfe649-60af-41ed-b999-1f820ed6891c tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:33:53.333370 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-5ccfe649-60af-41ed-b999-1f820ed6891c tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:33:53.340006 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5ccfe649-60af-41ed-b999-1f820ed6891c tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:33:53.340490 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5ccfe649-60af-41ed-b999-1f820ed6891c tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:33:53.340962 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5ccfe649-60af-41ed-b999-1f820ed6891c tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:33:53.341655 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5ccfe649-60af-41ed-b999-1f820ed6891c tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:33:53.342136 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5ccfe649-60af-41ed-b999-1f820ed6891c tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:33:53.342560 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5ccfe649-60af-41ed-b999-1f820ed6891c tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:33:53.402788 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-5ccfe649-60af-41ed-b999-1f820ed6891c tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:33:53.410961 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-5ccfe649-60af-41ed-b999-1f820ed6891c tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1367 microversion: 2.1 time: 0.082105 Oct 20 06:33:53.411718 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1248/2484] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:33:53 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1367 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:33:54.433931 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-67953e2f-fd71-484e-8690-250c2e4e30fb tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:33:54.434756 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-67953e2f-fd71-484e-8690-250c2e4e30fb tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:33:54.441106 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-67953e2f-fd71-484e-8690-250c2e4e30fb tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:33:54.441582 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-67953e2f-fd71-484e-8690-250c2e4e30fb tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:33:54.442011 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-67953e2f-fd71-484e-8690-250c2e4e30fb tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:33:54.442690 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-67953e2f-fd71-484e-8690-250c2e4e30fb tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:33:54.443612 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-67953e2f-fd71-484e-8690-250c2e4e30fb tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:33:54.444039 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-67953e2f-fd71-484e-8690-250c2e4e30fb tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:33:54.503452 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-67953e2f-fd71-484e-8690-250c2e4e30fb tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:33:54.513032 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-67953e2f-fd71-484e-8690-250c2e4e30fb tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1367 microversion: 2.1 time: 0.082952 Oct 20 06:33:54.513597 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1237/2485] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:33:54 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1367 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:33:55.535577 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-b988723e-0563-438a-ac49-0464be969e4a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:33:55.537491 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-b988723e-0563-438a-ac49-0464be969e4a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:33:55.544470 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b988723e-0563-438a-ac49-0464be969e4a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:33:55.544987 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b988723e-0563-438a-ac49-0464be969e4a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:33:55.545425 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b988723e-0563-438a-ac49-0464be969e4a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:33:55.546123 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b988723e-0563-438a-ac49-0464be969e4a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:33:55.546608 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b988723e-0563-438a-ac49-0464be969e4a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:33:55.547036 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b988723e-0563-438a-ac49-0464be969e4a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:33:55.609655 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-b988723e-0563-438a-ac49-0464be969e4a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:33:55.619637 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-b988723e-0563-438a-ac49-0464be969e4a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1367 microversion: 2.1 time: 0.088028 Oct 20 06:33:55.620215 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1249/2486] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:33:55 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1367 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:33:56.642782 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-1120ce3e-25b1-4ac5-b32f-c35f936ab7a3 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:33:56.643529 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-1120ce3e-25b1-4ac5-b32f-c35f936ab7a3 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:33:56.650160 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1120ce3e-25b1-4ac5-b32f-c35f936ab7a3 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:33:56.650641 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1120ce3e-25b1-4ac5-b32f-c35f936ab7a3 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:33:56.651077 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1120ce3e-25b1-4ac5-b32f-c35f936ab7a3 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:33:56.651765 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1120ce3e-25b1-4ac5-b32f-c35f936ab7a3 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:33:56.652220 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1120ce3e-25b1-4ac5-b32f-c35f936ab7a3 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:33:56.652644 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1120ce3e-25b1-4ac5-b32f-c35f936ab7a3 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:33:56.713692 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-1120ce3e-25b1-4ac5-b32f-c35f936ab7a3 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:33:56.721922 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-1120ce3e-25b1-4ac5-b32f-c35f936ab7a3 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1367 microversion: 2.1 time: 0.083058 Oct 20 06:33:56.722733 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1238/2487] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:33:56 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1367 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:33:57.746421 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-11efbc26-c4d9-4e7f-a43f-9c17d17ef624 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:33:57.747094 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-11efbc26-c4d9-4e7f-a43f-9c17d17ef624 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:33:57.753827 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-11efbc26-c4d9-4e7f-a43f-9c17d17ef624 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:33:57.754309 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-11efbc26-c4d9-4e7f-a43f-9c17d17ef624 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:33:57.754738 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-11efbc26-c4d9-4e7f-a43f-9c17d17ef624 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:33:57.755438 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-11efbc26-c4d9-4e7f-a43f-9c17d17ef624 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:33:57.756556 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-11efbc26-c4d9-4e7f-a43f-9c17d17ef624 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:33:57.757010 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-11efbc26-c4d9-4e7f-a43f-9c17d17ef624 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:33:57.822909 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-11efbc26-c4d9-4e7f-a43f-9c17d17ef624 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:33:57.831676 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-11efbc26-c4d9-4e7f-a43f-9c17d17ef624 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1367 microversion: 2.1 time: 0.089131 Oct 20 06:33:57.832732 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1250/2488] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:33:57 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1367 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:33:58.854733 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-6bd97189-b58d-4638-8819-c06f8ed5f9c0 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:33:58.855344 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-6bd97189-b58d-4638-8819-c06f8ed5f9c0 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:33:58.861417 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-6bd97189-b58d-4638-8819-c06f8ed5f9c0 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:33:58.861896 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-6bd97189-b58d-4638-8819-c06f8ed5f9c0 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:33:58.862330 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-6bd97189-b58d-4638-8819-c06f8ed5f9c0 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:33:58.863010 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-6bd97189-b58d-4638-8819-c06f8ed5f9c0 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:33:58.863515 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-6bd97189-b58d-4638-8819-c06f8ed5f9c0 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:33:58.863877 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-6bd97189-b58d-4638-8819-c06f8ed5f9c0 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:33:58.926119 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-6bd97189-b58d-4638-8819-c06f8ed5f9c0 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:33:58.935016 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-6bd97189-b58d-4638-8819-c06f8ed5f9c0 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1367 microversion: 2.1 time: 0.084172 Oct 20 06:33:58.935578 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1239/2489] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:33:58 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1367 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 06:33:59.958477 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-b615a05f-1665-494c-a123-43400bbe3240 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:33:59.959715 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-b615a05f-1665-494c-a123-43400bbe3240 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:33:59.966183 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b615a05f-1665-494c-a123-43400bbe3240 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:33:59.966674 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b615a05f-1665-494c-a123-43400bbe3240 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:33:59.967111 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b615a05f-1665-494c-a123-43400bbe3240 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:33:59.967807 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b615a05f-1665-494c-a123-43400bbe3240 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:33:59.968261 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b615a05f-1665-494c-a123-43400bbe3240 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:33:59.968687 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b615a05f-1665-494c-a123-43400bbe3240 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:34:00.030633 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-b615a05f-1665-494c-a123-43400bbe3240 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:34:00.039065 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-b615a05f-1665-494c-a123-43400bbe3240 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1367 microversion: 2.1 time: 0.084558 Oct 20 06:34:00.039629 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1251/2490] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:33:59 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1367 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:34:01.063053 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-fb878623-bc9e-4d54-8f83-0201246d422b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:34:01.063593 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-fb878623-bc9e-4d54-8f83-0201246d422b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:34:01.070648 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-fb878623-bc9e-4d54-8f83-0201246d422b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:34:01.071134 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-fb878623-bc9e-4d54-8f83-0201246d422b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:34:01.071572 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-fb878623-bc9e-4d54-8f83-0201246d422b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:34:01.072274 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-fb878623-bc9e-4d54-8f83-0201246d422b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:34:01.072752 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-fb878623-bc9e-4d54-8f83-0201246d422b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:34:01.073184 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-fb878623-bc9e-4d54-8f83-0201246d422b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:34:01.141967 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-fb878623-bc9e-4d54-8f83-0201246d422b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:34:01.150523 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-fb878623-bc9e-4d54-8f83-0201246d422b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1367 microversion: 2.1 time: 0.091443 Oct 20 06:34:01.151399 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1240/2491] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:34:01 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1367 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:34:02.173700 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-4501f9ac-e4a5-4535-b6cd-38edb372c5b2 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:34:02.174318 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-4501f9ac-e4a5-4535-b6cd-38edb372c5b2 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:34:02.181710 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-4501f9ac-e4a5-4535-b6cd-38edb372c5b2 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:34:02.182197 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-4501f9ac-e4a5-4535-b6cd-38edb372c5b2 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:34:02.182640 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-4501f9ac-e4a5-4535-b6cd-38edb372c5b2 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:34:02.183373 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-4501f9ac-e4a5-4535-b6cd-38edb372c5b2 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:34:02.183826 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-4501f9ac-e4a5-4535-b6cd-38edb372c5b2 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:34:02.184254 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-4501f9ac-e4a5-4535-b6cd-38edb372c5b2 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:34:02.249891 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-4501f9ac-e4a5-4535-b6cd-38edb372c5b2 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:34:02.258879 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-4501f9ac-e4a5-4535-b6cd-38edb372c5b2 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1367 microversion: 2.1 time: 0.089037 Oct 20 06:34:02.259459 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1252/2492] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:34:02 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1367 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:34:03.281534 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-90444c2c-f07c-4950-8dd2-1903951d840a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:34:03.282219 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-90444c2c-f07c-4950-8dd2-1903951d840a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:34:03.289586 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-90444c2c-f07c-4950-8dd2-1903951d840a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:34:03.290065 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-90444c2c-f07c-4950-8dd2-1903951d840a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:34:03.290555 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-90444c2c-f07c-4950-8dd2-1903951d840a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:34:03.291247 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-90444c2c-f07c-4950-8dd2-1903951d840a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:34:03.291693 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-90444c2c-f07c-4950-8dd2-1903951d840a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:34:03.292110 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-90444c2c-f07c-4950-8dd2-1903951d840a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:34:03.354576 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-90444c2c-f07c-4950-8dd2-1903951d840a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:34:03.363035 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-90444c2c-f07c-4950-8dd2-1903951d840a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1367 microversion: 2.1 time: 0.085454 Oct 20 06:34:03.363605 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1241/2493] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:34:03 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1367 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:34:04.386670 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-e61dfb2e-c4ec-4b91-bbb3-f6c99f1cefad tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:34:04.387300 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-e61dfb2e-c4ec-4b91-bbb3-f6c99f1cefad tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:34:04.393865 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e61dfb2e-c4ec-4b91-bbb3-f6c99f1cefad tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:34:04.394349 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e61dfb2e-c4ec-4b91-bbb3-f6c99f1cefad tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:34:04.394784 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e61dfb2e-c4ec-4b91-bbb3-f6c99f1cefad tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:34:04.395477 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e61dfb2e-c4ec-4b91-bbb3-f6c99f1cefad tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:34:04.396001 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e61dfb2e-c4ec-4b91-bbb3-f6c99f1cefad tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:34:04.396426 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e61dfb2e-c4ec-4b91-bbb3-f6c99f1cefad tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:34:04.460093 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-e61dfb2e-c4ec-4b91-bbb3-f6c99f1cefad tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:34:04.468233 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-e61dfb2e-c4ec-4b91-bbb3-f6c99f1cefad tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1367 microversion: 2.1 time: 0.085661 Oct 20 06:34:04.468824 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1253/2494] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:34:04 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1367 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:34:05.491634 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-e805bac5-65bd-4755-a955-62e784233e22 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:34:05.492258 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-e805bac5-65bd-4755-a955-62e784233e22 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:34:05.499276 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e805bac5-65bd-4755-a955-62e784233e22 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:34:05.499775 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e805bac5-65bd-4755-a955-62e784233e22 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:34:05.500213 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e805bac5-65bd-4755-a955-62e784233e22 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:34:05.500957 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e805bac5-65bd-4755-a955-62e784233e22 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:34:05.501414 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e805bac5-65bd-4755-a955-62e784233e22 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:34:05.501842 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e805bac5-65bd-4755-a955-62e784233e22 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:34:05.565967 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-e805bac5-65bd-4755-a955-62e784233e22 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:34:05.575667 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-e805bac5-65bd-4755-a955-62e784233e22 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1367 microversion: 2.1 time: 0.088472 Oct 20 06:34:05.588250 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1242/2495] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:34:05 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1367 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:34:06.598671 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-7a36cbea-4a7e-40a2-a104-32c16791d4f0 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:34:06.599578 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-7a36cbea-4a7e-40a2-a104-32c16791d4f0 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:34:06.605863 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7a36cbea-4a7e-40a2-a104-32c16791d4f0 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:34:06.606339 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7a36cbea-4a7e-40a2-a104-32c16791d4f0 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:34:06.606769 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7a36cbea-4a7e-40a2-a104-32c16791d4f0 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:34:06.607459 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7a36cbea-4a7e-40a2-a104-32c16791d4f0 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:34:06.607906 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7a36cbea-4a7e-40a2-a104-32c16791d4f0 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:34:06.608325 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7a36cbea-4a7e-40a2-a104-32c16791d4f0 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:34:06.670427 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-7a36cbea-4a7e-40a2-a104-32c16791d4f0 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:34:06.679955 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-7a36cbea-4a7e-40a2-a104-32c16791d4f0 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1367 microversion: 2.1 time: 0.085099 Oct 20 06:34:06.680794 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1254/2496] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:34:06 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1367 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:34:07.703072 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-140e320e-5120-45bc-b855-fe9294c1fca7 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:34:07.705617 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-140e320e-5120-45bc-b855-fe9294c1fca7 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:34:07.711437 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-140e320e-5120-45bc-b855-fe9294c1fca7 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:34:07.711918 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-140e320e-5120-45bc-b855-fe9294c1fca7 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:34:07.712349 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-140e320e-5120-45bc-b855-fe9294c1fca7 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:34:07.713068 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-140e320e-5120-45bc-b855-fe9294c1fca7 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:34:07.713516 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-140e320e-5120-45bc-b855-fe9294c1fca7 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:34:07.714074 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-140e320e-5120-45bc-b855-fe9294c1fca7 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:34:07.776480 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-140e320e-5120-45bc-b855-fe9294c1fca7 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:34:07.784769 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-140e320e-5120-45bc-b855-fe9294c1fca7 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1367 microversion: 2.1 time: 0.085493 Oct 20 06:34:07.785336 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1243/2497] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:34:07 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1367 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:34:08.809346 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-5f0a24ec-0917-468b-88d5-604a7fba368f tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:34:08.809994 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-5f0a24ec-0917-468b-88d5-604a7fba368f tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:34:08.816371 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5f0a24ec-0917-468b-88d5-604a7fba368f tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:34:08.816891 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5f0a24ec-0917-468b-88d5-604a7fba368f tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:34:08.817332 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5f0a24ec-0917-468b-88d5-604a7fba368f tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:34:08.818612 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5f0a24ec-0917-468b-88d5-604a7fba368f tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:34:08.819068 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5f0a24ec-0917-468b-88d5-604a7fba368f tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:34:08.819498 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5f0a24ec-0917-468b-88d5-604a7fba368f tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:34:08.881485 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-5f0a24ec-0917-468b-88d5-604a7fba368f tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:34:08.890112 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-5f0a24ec-0917-468b-88d5-604a7fba368f tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1367 microversion: 2.1 time: 0.084660 Oct 20 06:34:08.890672 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1255/2498] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:34:08 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1367 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:34:09.913474 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-a0e69dd0-a528-42e3-97b8-ab96671f9afa tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:34:09.914068 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-a0e69dd0-a528-42e3-97b8-ab96671f9afa tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:34:09.920626 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a0e69dd0-a528-42e3-97b8-ab96671f9afa tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:34:09.921137 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a0e69dd0-a528-42e3-97b8-ab96671f9afa tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:34:09.921573 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a0e69dd0-a528-42e3-97b8-ab96671f9afa tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:34:09.922263 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a0e69dd0-a528-42e3-97b8-ab96671f9afa tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:34:09.922716 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a0e69dd0-a528-42e3-97b8-ab96671f9afa tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:34:09.923143 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a0e69dd0-a528-42e3-97b8-ab96671f9afa tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:34:09.988569 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-a0e69dd0-a528-42e3-97b8-ab96671f9afa tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:34:09.997470 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-a0e69dd0-a528-42e3-97b8-ab96671f9afa tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 200 len: 1367 microversion: 2.1 time: 0.087909 Oct 20 06:34:09.998038 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1244/2499] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:34:09 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 1367 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 06:34:10.021582 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-5af551e5-c5f9-4da8-a1e2-a17f18acbcba tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '.version_select at 0x7fbe4e22f310>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:34:10.044045 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-5af551e5-c5f9-4da8-a1e2-a17f18acbcba tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-994757528" status: 202 len: 0 microversion: 2.1 time: 0.026506 Oct 20 06:34:10.044737 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1256/2500] 10.222.0.20 () {58 vars in 1218 bytes} [Thu Oct 20 06:34:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-994757528 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 20 06:34:10.894789 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-1926a36b-649e-4ca0-91b6-51aad76ff449 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Action: 'create', calling method: .version_select at 0x7fbe4e451820>, body: {"keypair": {"name": "tempest-keypair-591130919", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBETy9vraZVytbw9/YWKYoC6n4zfeuHVCuvG1QGgFYjJcVphFeoQfim+R3FP4d9cGHdC9Lbx7F+xjYWeoju/cJ8+VsV3LH+c/MP8qc0WO+8O/oR+oMB2NZv5muqpiOCpSYA=="}} {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 06:34:10.915251 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.quota [None req-1926a36b-649e-4ca0-91b6-51aad76ff449 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Getting quotas for project b21953597b4c45059f7f78ac8fdecbee. Resources: {'key_pairs'} {{(pid=118861) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 20 06:34:10.921314 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.quota [None req-1926a36b-649e-4ca0-91b6-51aad76ff449 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Getting quotas for user 6da8a7cb6ef849faad7d7091a1095ab9 and project b21953597b4c45059f7f78ac8fdecbee. Resources: {'key_pairs'} {{(pid=118861) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 20 06:34:10.948468 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-1926a36b-649e-4ca0-91b6-51aad76ff449 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.057707 Oct 20 06:34:10.949114 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1245/2501] 10.222.0.20 () {60 vars in 1159 bytes} [Thu Oct 20 06:34:10 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:34:12.476920 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-a8354606-ecc5-4201-8292-50a93b6eb885 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-351625431", "imageRef": "9fcec276-734d-41d9-905b-10d2bbcbfba5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "80bcba85-6a9c-4514-8c39-a60c7b6c80a5"}], "security_groups": [{"name": "tempest-securitygroup--2135029859"}], "key_name": "tempest-keypair-591130919", "user_data": "}} {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 06:34:12.487446 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG dbcounter [-] [118860] Writing DB stats nova_api:SELECT=29,nova_api:DELETE=1 {{(pid=118860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:34:12.613411 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.network.neutron [None req-a8354606-ecc5-4201-8292-50a93b6eb885 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] validate_networks() for [('80bcba85-6a9c-4514-8c39-a60c7b6c80a5', None, None, None, None, None)] {{(pid=118860) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 20 06:34:13.082468 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.virt.hardware [None req-a8354606-ecc5-4201-8292-50a93b6eb885 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Flavor limits 0:0:0 {{(pid=118860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 20 06:34:13.083529 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.virt.hardware [None req-a8354606-ecc5-4201-8292-50a93b6eb885 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Image limits 0:0:0 {{(pid=118860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 20 06:34:13.084228 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.virt.hardware [None req-a8354606-ecc5-4201-8292-50a93b6eb885 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Flavor pref 0:0:0 {{(pid=118860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 20 06:34:13.084671 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.virt.hardware [None req-a8354606-ecc5-4201-8292-50a93b6eb885 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Image pref 0:0:0 {{(pid=118860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 20 06:34:13.085117 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.virt.hardware [None req-a8354606-ecc5-4201-8292-50a93b6eb885 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 20 06:34:13.094035 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a8354606-ecc5-4201-8292-50a93b6eb885 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:34:13.094524 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a8354606-ecc5-4201-8292-50a93b6eb885 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:34:13.094963 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a8354606-ecc5-4201-8292-50a93b6eb885 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:34:13.095688 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a8354606-ecc5-4201-8292-50a93b6eb885 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:34:13.096142 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a8354606-ecc5-4201-8292-50a93b6eb885 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:34:13.096601 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a8354606-ecc5-4201-8292-50a93b6eb885 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:34:13.104311 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG dbcounter [-] [118860] Writing DB stats nova_cell1:SELECT=78 {{(pid=118860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:34:13.115764 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.quota [None req-a8354606-ecc5-4201-8292-50a93b6eb885 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Getting quotas for project b21953597b4c45059f7f78ac8fdecbee. Resources: {'cores', 'ram', 'instances'} {{(pid=118860) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 20 06:34:13.119776 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.quota [None req-a8354606-ecc5-4201-8292-50a93b6eb885 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Getting quotas for user 6da8a7cb6ef849faad7d7091a1095ab9 and project b21953597b4c45059f7f78ac8fdecbee. Resources: {'cores', 'ram', 'instances'} {{(pid=118860) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 20 06:34:13.131256 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-a8354606-ecc5-4201-8292-50a93b6eb885 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Going to run 1 instances... {{(pid=118860) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 20 06:34:13.133857 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-a8354606-ecc5-4201-8292-50a93b6eb885 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: fc2d86f7-2f9c-49ce-9df9-ab93f7ea0301] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9fcec276-734d-41d9-905b-10d2bbcbfba5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118860) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 20 06:34:13.188547 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-a8354606-ecc5-4201-8292-50a93b6eb885 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.719430 Oct 20 06:34:13.189401 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1257/2502] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Oct 20 06:34:12 2022] POST /compute/v2.1/servers => generated 402 bytes in 721 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 20 06:34:13.200818 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-7540f2a7-5792-4e3a-a6b4-fe5ce4cbac12 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:34:13.201424 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-7540f2a7-5792-4e3a-a6b4-fe5ce4cbac12 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: fc2d86f7-2f9c-49ce-9df9-ab93f7ea0301] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:34:13.276664 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-7540f2a7-5792-4e3a-a6b4-fe5ce4cbac12 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:34:13.285060 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-7540f2a7-5792-4e3a-a6b4-fe5ce4cbac12 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/fc2d86f7-2f9c-49ce-9df9-ab93f7ea0301" status: 200 len: 1236 microversion: 2.1 time: 0.087994 Oct 20 06:34:13.285614 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1246/2503] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:34:13 2022] GET /compute/v2.1/servers/fc2d86f7-2f9c-49ce-9df9-ab93f7ea0301 => generated 1236 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:34:14.309584 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-045a7ec6-2c87-48b8-a47f-7af126a42539 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:34:14.310195 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-045a7ec6-2c87-48b8-a47f-7af126a42539 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: fc2d86f7-2f9c-49ce-9df9-ab93f7ea0301] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:34:14.316218 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-045a7ec6-2c87-48b8-a47f-7af126a42539 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:34:14.316720 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-045a7ec6-2c87-48b8-a47f-7af126a42539 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:34:14.317161 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-045a7ec6-2c87-48b8-a47f-7af126a42539 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:34:14.317984 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-045a7ec6-2c87-48b8-a47f-7af126a42539 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:34:14.318464 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-045a7ec6-2c87-48b8-a47f-7af126a42539 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:34:14.318925 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-045a7ec6-2c87-48b8-a47f-7af126a42539 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:34:14.385833 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-045a7ec6-2c87-48b8-a47f-7af126a42539 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:34:14.396822 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-045a7ec6-2c87-48b8-a47f-7af126a42539 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/fc2d86f7-2f9c-49ce-9df9-ab93f7ea0301" status: 200 len: 1288 microversion: 2.1 time: 0.091235 Oct 20 06:34:14.397843 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1258/2504] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:34:14 2022] GET /compute/v2.1/servers/fc2d86f7-2f9c-49ce-9df9-ab93f7ea0301 => generated 1288 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:34:15.420087 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-03abbd90-2e39-4564-82e1-29116a2808bf tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:34:15.420926 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-03abbd90-2e39-4564-82e1-29116a2808bf tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: fc2d86f7-2f9c-49ce-9df9-ab93f7ea0301] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:34:15.428074 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-03abbd90-2e39-4564-82e1-29116a2808bf tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:34:15.428563 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-03abbd90-2e39-4564-82e1-29116a2808bf tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:34:15.429025 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-03abbd90-2e39-4564-82e1-29116a2808bf tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:34:15.429730 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-03abbd90-2e39-4564-82e1-29116a2808bf tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:34:15.430189 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-03abbd90-2e39-4564-82e1-29116a2808bf tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:34:15.430615 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-03abbd90-2e39-4564-82e1-29116a2808bf tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:34:15.571608 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-03abbd90-2e39-4564-82e1-29116a2808bf tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:34:15.573952 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG dbcounter [-] [118861] Writing DB stats nova_cell1:SELECT=76 {{(pid=118861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:34:15.581999 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-03abbd90-2e39-4564-82e1-29116a2808bf tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/fc2d86f7-2f9c-49ce-9df9-ab93f7ea0301" status: 200 len: 1362 microversion: 2.1 time: 0.165744 Oct 20 06:34:15.582585 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1247/2505] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:34:15 2022] GET /compute/v2.1/servers/fc2d86f7-2f9c-49ce-9df9-ab93f7ea0301 => generated 1362 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:34:15.943490 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [req-6dcf4444-0b6a-4148-a9ea-d7ee3d55c395 req-60a0c8b0-7d8f-47b2-954e-da4ced8cdcd6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fc2d86f7-2f9c-49ce-9df9-ab93f7ea0301", "tag": "6645b9eb-d066-4e42-9d56-6ab07056e841"}]} {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 06:34:15.957130 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [req-6dcf4444-0b6a-4148-a9ea-d7ee3d55c395 req-60a0c8b0-7d8f-47b2-954e-da4ced8cdcd6 service nova] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:34:15.957690 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [req-6dcf4444-0b6a-4148-a9ea-d7ee3d55c395 req-60a0c8b0-7d8f-47b2-954e-da4ced8cdcd6 service nova] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:34:15.958725 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [req-6dcf4444-0b6a-4148-a9ea-d7ee3d55c395 req-60a0c8b0-7d8f-47b2-954e-da4ced8cdcd6 service nova] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:34:15.970600 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.compute.server_external_events [req-6dcf4444-0b6a-4148-a9ea-d7ee3d55c395 req-60a0c8b0-7d8f-47b2-954e-da4ced8cdcd6 service nova] Creating event network-changed:6645b9eb-d066-4e42-9d56-6ab07056e841 for instance fc2d86f7-2f9c-49ce-9df9-ab93f7ea0301 on hv-cinder-86156 Oct 20 06:34:15.975006 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR oslo.messaging._drivers.impl_rabbit [req-6dcf4444-0b6a-4148-a9ea-d7ee3d55c395 req-60a0c8b0-7d8f-47b2-954e-da4ced8cdcd6 service nova] [08a62a08-76e3-4c4c-9ead-7e177de324fc] AMQP server on 10.222.0.20:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 20 06:34:16.606543 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-b0abafed-0f93-43e8-95c2-7178537e52ea tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:34:16.607078 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-b0abafed-0f93-43e8-95c2-7178537e52ea tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: fc2d86f7-2f9c-49ce-9df9-ab93f7ea0301] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:34:16.609554 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG dbcounter [-] [118861] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=118861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:34:16.614939 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b0abafed-0f93-43e8-95c2-7178537e52ea tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:34:16.615434 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b0abafed-0f93-43e8-95c2-7178537e52ea tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:34:16.615874 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b0abafed-0f93-43e8-95c2-7178537e52ea tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:34:16.616608 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b0abafed-0f93-43e8-95c2-7178537e52ea tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:34:16.617088 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b0abafed-0f93-43e8-95c2-7178537e52ea tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:34:16.617519 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b0abafed-0f93-43e8-95c2-7178537e52ea tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:34:16.753812 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-b0abafed-0f93-43e8-95c2-7178537e52ea tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:34:16.762342 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-b0abafed-0f93-43e8-95c2-7178537e52ea tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/fc2d86f7-2f9c-49ce-9df9-ab93f7ea0301" status: 200 len: 1362 microversion: 2.1 time: 0.159815 Oct 20 06:34:16.762899 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1248/2506] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:34:16 2022] GET /compute/v2.1/servers/fc2d86f7-2f9c-49ce-9df9-ab93f7ea0301 => generated 1362 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 06:34:16.981906 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO oslo.messaging._drivers.impl_rabbit [req-6dcf4444-0b6a-4148-a9ea-d7ee3d55c395 req-60a0c8b0-7d8f-47b2-954e-da4ced8cdcd6 service nova] [08a62a08-76e3-4c4c-9ead-7e177de324fc] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 38328. Oct 20 06:34:16.985264 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [req-6dcf4444-0b6a-4148-a9ea-d7ee3d55c395 req-60a0c8b0-7d8f-47b2-954e-da4ced8cdcd6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.119263 Oct 20 06:34:16.985862 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1259/2507] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 20 06:34:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:34:17.785274 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-1d7f00a6-ca33-4b39-b496-6d49f583b376 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:34:17.786356 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-1d7f00a6-ca33-4b39-b496-6d49f583b376 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: fc2d86f7-2f9c-49ce-9df9-ab93f7ea0301] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:34:17.794552 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1d7f00a6-ca33-4b39-b496-6d49f583b376 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:34:17.795038 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1d7f00a6-ca33-4b39-b496-6d49f583b376 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:34:17.795467 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1d7f00a6-ca33-4b39-b496-6d49f583b376 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:34:17.796179 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1d7f00a6-ca33-4b39-b496-6d49f583b376 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:34:17.796629 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1d7f00a6-ca33-4b39-b496-6d49f583b376 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:34:17.797089 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1d7f00a6-ca33-4b39-b496-6d49f583b376 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:34:17.941907 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-1d7f00a6-ca33-4b39-b496-6d49f583b376 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:34:17.950124 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-1d7f00a6-ca33-4b39-b496-6d49f583b376 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/fc2d86f7-2f9c-49ce-9df9-ab93f7ea0301" status: 200 len: 1362 microversion: 2.1 time: 0.168771 Oct 20 06:34:17.950705 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1249/2508] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:34:17 2022] GET /compute/v2.1/servers/fc2d86f7-2f9c-49ce-9df9-ab93f7ea0301 => generated 1362 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:34:18.973129 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-4169082f-a499-47ee-969c-c411a3cb1a5b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:34:18.974023 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-4169082f-a499-47ee-969c-c411a3cb1a5b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: fc2d86f7-2f9c-49ce-9df9-ab93f7ea0301] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:34:18.980569 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-4169082f-a499-47ee-969c-c411a3cb1a5b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:34:18.981092 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-4169082f-a499-47ee-969c-c411a3cb1a5b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:34:18.981531 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-4169082f-a499-47ee-969c-c411a3cb1a5b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:34:18.982240 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-4169082f-a499-47ee-969c-c411a3cb1a5b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:34:18.982698 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-4169082f-a499-47ee-969c-c411a3cb1a5b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:34:18.983138 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-4169082f-a499-47ee-969c-c411a3cb1a5b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:34:19.118910 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-4169082f-a499-47ee-969c-c411a3cb1a5b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:34:19.126994 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-4169082f-a499-47ee-969c-c411a3cb1a5b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/fc2d86f7-2f9c-49ce-9df9-ab93f7ea0301" status: 200 len: 1362 microversion: 2.1 time: 0.158763 Oct 20 06:34:19.127910 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1260/2509] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:34:18 2022] GET /compute/v2.1/servers/fc2d86f7-2f9c-49ce-9df9-ab93f7ea0301 => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:34:20.151129 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-7b4d3b40-9f18-40d7-b149-0489e33335b8 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:34:20.151718 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-7b4d3b40-9f18-40d7-b149-0489e33335b8 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: fc2d86f7-2f9c-49ce-9df9-ab93f7ea0301] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:34:20.158177 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7b4d3b40-9f18-40d7-b149-0489e33335b8 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:34:20.158678 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7b4d3b40-9f18-40d7-b149-0489e33335b8 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:34:20.159082 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7b4d3b40-9f18-40d7-b149-0489e33335b8 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:34:20.159764 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7b4d3b40-9f18-40d7-b149-0489e33335b8 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:34:20.160206 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7b4d3b40-9f18-40d7-b149-0489e33335b8 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:34:20.160625 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7b4d3b40-9f18-40d7-b149-0489e33335b8 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:34:20.292854 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-7b4d3b40-9f18-40d7-b149-0489e33335b8 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:34:20.300648 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-7b4d3b40-9f18-40d7-b149-0489e33335b8 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/fc2d86f7-2f9c-49ce-9df9-ab93f7ea0301" status: 200 len: 1362 microversion: 2.1 time: 0.153255 Oct 20 06:34:20.301242 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1250/2510] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:34:20 2022] GET /compute/v2.1/servers/fc2d86f7-2f9c-49ce-9df9-ab93f7ea0301 => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:34:21.283572 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [req-3ac1cfc0-eb2a-4968-a348-17281148f01f req-153b8ec4-8d65-4c24-b3ab-11b24d4db368 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc2d86f7-2f9c-49ce-9df9-ab93f7ea0301", "name": "network-vif-plugged", "status": "completed", "tag": "6645b9eb-d066-4e42-9d56-6ab07056e841"}]} {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 06:34:21.293595 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [req-3ac1cfc0-eb2a-4968-a348-17281148f01f req-153b8ec4-8d65-4c24-b3ab-11b24d4db368 service nova] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:34:21.294077 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [req-3ac1cfc0-eb2a-4968-a348-17281148f01f req-153b8ec4-8d65-4c24-b3ab-11b24d4db368 service nova] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:34:21.294513 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [req-3ac1cfc0-eb2a-4968-a348-17281148f01f req-153b8ec4-8d65-4c24-b3ab-11b24d4db368 service nova] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:34:21.309072 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.compute.server_external_events [req-3ac1cfc0-eb2a-4968-a348-17281148f01f req-153b8ec4-8d65-4c24-b3ab-11b24d4db368 service nova] Creating event network-vif-plugged:6645b9eb-d066-4e42-9d56-6ab07056e841 for instance fc2d86f7-2f9c-49ce-9df9-ab93f7ea0301 on hv-cinder-86156 Oct 20 06:34:21.314369 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [req-3ac1cfc0-eb2a-4968-a348-17281148f01f req-153b8ec4-8d65-4c24-b3ab-11b24d4db368 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102901 Oct 20 06:34:21.314995 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1261/2511] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 20 06:34:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:34:21.324068 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-aa59791f-ca71-463e-8723-fd322b8b74bb tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:34:21.330757 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-aa59791f-ca71-463e-8723-fd322b8b74bb tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: fc2d86f7-2f9c-49ce-9df9-ab93f7ea0301] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:34:21.337234 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-aa59791f-ca71-463e-8723-fd322b8b74bb tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:34:21.337721 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-aa59791f-ca71-463e-8723-fd322b8b74bb tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:34:21.338160 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-aa59791f-ca71-463e-8723-fd322b8b74bb tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:34:21.338891 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-aa59791f-ca71-463e-8723-fd322b8b74bb tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:34:21.339356 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-aa59791f-ca71-463e-8723-fd322b8b74bb tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:34:21.339786 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-aa59791f-ca71-463e-8723-fd322b8b74bb tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:34:21.490472 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-aa59791f-ca71-463e-8723-fd322b8b74bb tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:34:21.497761 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-aa59791f-ca71-463e-8723-fd322b8b74bb tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/fc2d86f7-2f9c-49ce-9df9-ab93f7ea0301" status: 200 len: 1362 microversion: 2.1 time: 0.177485 Oct 20 06:34:21.499000 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1251/2512] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:34:21 2022] GET /compute/v2.1/servers/fc2d86f7-2f9c-49ce-9df9-ab93f7ea0301 => generated 1362 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:34:22.522450 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-b89283c7-3b8b-402e-a42a-7ec61181c059 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:34:22.523132 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-b89283c7-3b8b-402e-a42a-7ec61181c059 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: fc2d86f7-2f9c-49ce-9df9-ab93f7ea0301] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:34:22.529716 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b89283c7-3b8b-402e-a42a-7ec61181c059 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:34:22.530191 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b89283c7-3b8b-402e-a42a-7ec61181c059 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:34:22.530621 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b89283c7-3b8b-402e-a42a-7ec61181c059 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:34:22.531299 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b89283c7-3b8b-402e-a42a-7ec61181c059 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:34:22.531747 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b89283c7-3b8b-402e-a42a-7ec61181c059 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:34:22.532164 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b89283c7-3b8b-402e-a42a-7ec61181c059 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:34:22.671833 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-b89283c7-3b8b-402e-a42a-7ec61181c059 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:34:22.679659 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-b89283c7-3b8b-402e-a42a-7ec61181c059 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/fc2d86f7-2f9c-49ce-9df9-ab93f7ea0301" status: 200 len: 1362 microversion: 2.1 time: 0.161432 Oct 20 06:34:22.680233 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1262/2513] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:34:22 2022] GET /compute/v2.1/servers/fc2d86f7-2f9c-49ce-9df9-ab93f7ea0301 => generated 1362 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:34:23.702657 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-f5eceb57-95a5-46b1-ae98-746f14a426a0 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:34:23.703276 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-f5eceb57-95a5-46b1-ae98-746f14a426a0 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: fc2d86f7-2f9c-49ce-9df9-ab93f7ea0301] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:34:23.705589 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG dbcounter [-] [118861] Writing DB stats nova_cell0:SELECT=6 {{(pid=118861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:34:23.712960 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f5eceb57-95a5-46b1-ae98-746f14a426a0 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:34:23.713514 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f5eceb57-95a5-46b1-ae98-746f14a426a0 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:34:23.714078 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f5eceb57-95a5-46b1-ae98-746f14a426a0 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:34:23.714794 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f5eceb57-95a5-46b1-ae98-746f14a426a0 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:34:23.715256 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f5eceb57-95a5-46b1-ae98-746f14a426a0 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:34:23.715720 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f5eceb57-95a5-46b1-ae98-746f14a426a0 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:34:23.849397 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-f5eceb57-95a5-46b1-ae98-746f14a426a0 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:34:23.857563 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-f5eceb57-95a5-46b1-ae98-746f14a426a0 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/fc2d86f7-2f9c-49ce-9df9-ab93f7ea0301" status: 200 len: 1548 microversion: 2.1 time: 0.158747 Oct 20 06:34:23.858126 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1252/2514] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:34:23 2022] GET /compute/v2.1/servers/fc2d86f7-2f9c-49ce-9df9-ab93f7ea0301 => generated 1548 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:34:23.880201 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-12d8f662-9666-4404-803e-ee1c709ab409 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:34:23.880762 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-12d8f662-9666-4404-803e-ee1c709ab409 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: fc2d86f7-2f9c-49ce-9df9-ab93f7ea0301] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:34:23.883119 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG dbcounter [-] [118860] Writing DB stats nova_cell0:SELECT=2 {{(pid=118860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:34:23.883779 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG dbcounter [-] [118860] Writing DB stats nova_cell0:SELECT=6 {{(pid=118860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:34:23.890022 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-12d8f662-9666-4404-803e-ee1c709ab409 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:34:23.890512 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-12d8f662-9666-4404-803e-ee1c709ab409 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:34:23.890956 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-12d8f662-9666-4404-803e-ee1c709ab409 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:34:23.891674 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-12d8f662-9666-4404-803e-ee1c709ab409 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:34:23.892134 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-12d8f662-9666-4404-803e-ee1c709ab409 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:34:23.892566 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-12d8f662-9666-4404-803e-ee1c709ab409 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:34:23.971160 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-12d8f662-9666-4404-803e-ee1c709ab409 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/fc2d86f7-2f9c-49ce-9df9-ab93f7ea0301/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.095414 Oct 20 06:34:23.971742 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1263/2515] 10.222.0.20 () {58 vars in 1275 bytes} [Thu Oct 20 06:34:23 2022] GET /compute/v2.1/servers/fc2d86f7-2f9c-49ce-9df9-ab93f7ea0301/os-interface => generated 284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:34:25.152876 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [req-f474afd1-dd16-448b-b382-e15a97284a9a req-63296e74-d3e9-4cf6-a4de-ffd729cbd04a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fc2d86f7-2f9c-49ce-9df9-ab93f7ea0301", "tag": "6645b9eb-d066-4e42-9d56-6ab07056e841"}]} {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 06:34:25.171197 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [req-f474afd1-dd16-448b-b382-e15a97284a9a req-63296e74-d3e9-4cf6-a4de-ffd729cbd04a service nova] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:34:25.171677 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [req-f474afd1-dd16-448b-b382-e15a97284a9a req-63296e74-d3e9-4cf6-a4de-ffd729cbd04a service nova] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:34:25.172186 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [req-f474afd1-dd16-448b-b382-e15a97284a9a req-63296e74-d3e9-4cf6-a4de-ffd729cbd04a service nova] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:34:25.184770 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.compute.server_external_events [req-f474afd1-dd16-448b-b382-e15a97284a9a req-63296e74-d3e9-4cf6-a4de-ffd729cbd04a service nova] Creating event network-changed:6645b9eb-d066-4e42-9d56-6ab07056e841 for instance fc2d86f7-2f9c-49ce-9df9-ab93f7ea0301 on hv-cinder-86156 Oct 20 06:34:25.196742 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [req-f474afd1-dd16-448b-b382-e15a97284a9a req-63296e74-d3e9-4cf6-a4de-ffd729cbd04a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046067 Oct 20 06:34:25.198595 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1253/2516] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 20 06:34:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:34:38.137130 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG dbcounter [-] [118860] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=3 {{(pid=118860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:34:38.137983 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG dbcounter [-] [118860] Writing DB stats nova_cell1:SELECT=27 {{(pid=118860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:34:38.141890 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-12baeee3-9ad0-4a3d-8e61-57717de0fc83 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:34:38.142395 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-12baeee3-9ad0-4a3d-8e61-57717de0fc83 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: 52c09583-1827-45d5-ac39-7d02ea4b658a] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:34:38.156506 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-12baeee3-9ad0-4a3d-8e61-57717de0fc83 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:34:38.158582 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-12baeee3-9ad0-4a3d-8e61-57717de0fc83 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:34:38.169319 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-12baeee3-9ad0-4a3d-8e61-57717de0fc83 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:34:38.170547 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-12baeee3-9ad0-4a3d-8e61-57717de0fc83 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:34:38.170677 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-12baeee3-9ad0-4a3d-8e61-57717de0fc83 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:34:38.171003 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-12baeee3-9ad0-4a3d-8e61-57717de0fc83 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:34:38.203802 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-12baeee3-9ad0-4a3d-8e61-57717de0fc83 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: 52c09583-1827-45d5-ac39-7d02ea4b658a] Going to try to terminate instance {{(pid=118860) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 20 06:34:38.279993 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-12baeee3-9ad0-4a3d-8e61-57717de0fc83 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "DELETE /compute/v2.1/servers/52c09583-1827-45d5-ac39-7d02ea4b658a" status: 204 len: 0 microversion: 2.1 time: 0.143861 Oct 20 06:34:38.280588 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1264/2517] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 20 06:34:38 2022] DELETE /compute/v2.1/servers/52c09583-1827-45d5-ac39-7d02ea4b658a => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 20 06:34:38.287155 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG dbcounter [-] [118861] Writing DB stats nova_api:SELECT=11 {{(pid=118861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:34:38.289283 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG dbcounter [-] [118861] Writing DB stats nova_cell1:SELECT=33 {{(pid=118861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:34:38.293715 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-d069e03b-a6e1-4f5b-b922-b186e0b6da56 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:34:38.297610 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-d069e03b-a6e1-4f5b-b922-b186e0b6da56 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: 52c09583-1827-45d5-ac39-7d02ea4b658a] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:34:38.306905 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d069e03b-a6e1-4f5b-b922-b186e0b6da56 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:34:38.307191 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d069e03b-a6e1-4f5b-b922-b186e0b6da56 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:34:38.307631 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d069e03b-a6e1-4f5b-b922-b186e0b6da56 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:34:38.308500 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d069e03b-a6e1-4f5b-b922-b186e0b6da56 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:34:38.312889 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d069e03b-a6e1-4f5b-b922-b186e0b6da56 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:34:38.313364 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d069e03b-a6e1-4f5b-b922-b186e0b6da56 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:34:38.456261 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-d069e03b-a6e1-4f5b-b922-b186e0b6da56 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:34:38.464253 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-d069e03b-a6e1-4f5b-b922-b186e0b6da56 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/52c09583-1827-45d5-ac39-7d02ea4b658a" status: 200 len: 1681 microversion: 2.1 time: 0.178691 Oct 20 06:34:38.464825 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1254/2518] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:34:38 2022] GET /compute/v2.1/servers/52c09583-1827-45d5-ac39-7d02ea4b658a => generated 1681 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:34:39.488084 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-d0403c61-5a59-4d62-b05e-3be438bab05d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:34:39.489099 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-d0403c61-5a59-4d62-b05e-3be438bab05d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: 52c09583-1827-45d5-ac39-7d02ea4b658a] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:34:39.496558 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-d0403c61-5a59-4d62-b05e-3be438bab05d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:34:39.497081 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-d0403c61-5a59-4d62-b05e-3be438bab05d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:34:39.497520 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-d0403c61-5a59-4d62-b05e-3be438bab05d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:34:39.498279 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-d0403c61-5a59-4d62-b05e-3be438bab05d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:34:39.498985 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-d0403c61-5a59-4d62-b05e-3be438bab05d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:34:39.499610 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-d0403c61-5a59-4d62-b05e-3be438bab05d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:34:39.567369 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [req-211b23bc-547e-4835-95f9-4ef492ea6064 req-c34011ca-9aa3-4a39-8eb7-c57aff0a39d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52c09583-1827-45d5-ac39-7d02ea4b658a", "name": "network-vif-deleted", "tag": "8bc1d538-8258-452a-9497-f1c7e5377c12"}]} {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 06:34:39.593159 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [req-211b23bc-547e-4835-95f9-4ef492ea6064 req-c34011ca-9aa3-4a39-8eb7-c57aff0a39d1 service nova] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:34:39.593768 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [req-211b23bc-547e-4835-95f9-4ef492ea6064 req-c34011ca-9aa3-4a39-8eb7-c57aff0a39d1 service nova] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:34:39.594391 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [req-211b23bc-547e-4835-95f9-4ef492ea6064 req-c34011ca-9aa3-4a39-8eb7-c57aff0a39d1 service nova] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:34:39.603047 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-d0403c61-5a59-4d62-b05e-3be438bab05d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:34:39.613505 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.compute.server_external_events [req-211b23bc-547e-4835-95f9-4ef492ea6064 req-c34011ca-9aa3-4a39-8eb7-c57aff0a39d1 service nova] Creating event network-vif-deleted:8bc1d538-8258-452a-9497-f1c7e5377c12 for instance 52c09583-1827-45d5-ac39-7d02ea4b658a on hv-cinder-86156 Oct 20 06:34:39.620971 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [req-211b23bc-547e-4835-95f9-4ef492ea6064 req-c34011ca-9aa3-4a39-8eb7-c57aff0a39d1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059137 Oct 20 06:34:39.626273 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1255/2519] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 20 06:34:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:34:39.631540 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-d0403c61-5a59-4d62-b05e-3be438bab05d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/52c09583-1827-45d5-ac39-7d02ea4b658a" status: 200 len: 1614 microversion: 2.1 time: 0.147549 Oct 20 06:34:39.640873 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1265/2520] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:34:39 2022] GET /compute/v2.1/servers/52c09583-1827-45d5-ac39-7d02ea4b658a => generated 1614 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:34:40.660466 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-1abb8a58-a836-4653-b018-1f9c1bb835b8 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:34:40.661826 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-1abb8a58-a836-4653-b018-1f9c1bb835b8 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: 52c09583-1827-45d5-ac39-7d02ea4b658a] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:34:40.669222 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1abb8a58-a836-4653-b018-1f9c1bb835b8 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:34:40.669718 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1abb8a58-a836-4653-b018-1f9c1bb835b8 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:34:40.670166 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1abb8a58-a836-4653-b018-1f9c1bb835b8 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:34:40.670873 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1abb8a58-a836-4653-b018-1f9c1bb835b8 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:34:40.671333 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1abb8a58-a836-4653-b018-1f9c1bb835b8 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:34:40.671767 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1abb8a58-a836-4653-b018-1f9c1bb835b8 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:34:40.687722 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.wsgi [None req-1abb8a58-a836-4653-b018-1f9c1bb835b8 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] HTTP exception thrown: Instance 52c09583-1827-45d5-ac39-7d02ea4b658a could not be found. Oct 20 06:34:40.689424 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-1abb8a58-a836-4653-b018-1f9c1bb835b8 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Request method failure captured: Oct 20 06:34:40.689424 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: request: GET /compute/v2.1/servers/52c09583-1827-45d5-ac39-7d02ea4b658a HTTP/1.1 Oct 20 06:34:40.689424 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: Accept: application/json Oct 20 06:34:40.689424 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: Accept-Encoding: identity Oct 20 06:34:40.689424 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: Connection: close Oct 20 06:34:40.689424 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: Content-Length: 0 Oct 20 06:34:40.689424 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: Content-Type: application/json Oct 20 06:34:40.689424 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: Host: 10.222.0.20 Oct 20 06:34:40.689424 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: Openstack-System-Scope: None Oct 20 06:34:40.689424 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: User-Agent: python-urllib3/1.26.12 Oct 20 06:34:40.689424 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Auth-Token: gAAAAABjUOTwMaxd25vy00-4oHbEqr1c9uD0B3sBZ9MAdUaT4nUKyQqgu2h768xAiNalZc89J9ijH_fe0UIBbKxoYtfSVrasjyy2mvwwjVbv-SkvU3sz2HoGnLJESeVi8iC7ILXfpH5FGWeNjpUJsWoV8PgeWEWJ-eQs7SGcBSSwmqYY25H6IKc Oct 20 06:34:40.689424 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Domain-Id: None Oct 20 06:34:40.689424 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Domain-Name: None Oct 20 06:34:40.689424 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Identity-Status: Confirmed Oct 20 06:34:40.689424 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Is-Admin-Project: True Oct 20 06:34:40.689424 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Project-Domain-Id: default Oct 20 06:34:40.689424 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Project-Domain-Name: Default Oct 20 06:34:40.689424 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Project-Id: b90087118fe040389f291d846461c0a7 Oct 20 06:34:40.689424 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Project-Name: tempest-AttachVolumeNegativeTest-617663425 Oct 20 06:34:40.689424 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Role: reader,member Oct 20 06:34:40.689424 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Roles: reader,member Oct 20 06:34:40.691225 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b90087118fe040389f291d846461c0a7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b90087118fe040389f291d846461c0a7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b90087118fe040389f291d846461c0a7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b90087118fe040389f291d846461c0a7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 20 06:34:40.691225 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Tenant: tempest-AttachVolumeNegativeTest-617663425 Oct 20 06:34:40.691225 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Tenant-Id: b90087118fe040389f291d846461c0a7 Oct 20 06:34:40.691225 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-617663425 Oct 20 06:34:40.691225 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-User: tempest-AttachVolumeNegativeTest-617663425-project Oct 20 06:34:40.691225 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-User-Domain-Id: default Oct 20 06:34:40.691225 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-User-Domain-Name: Default Oct 20 06:34:40.691225 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-User-Id: 2c6be23065c643939055a3de375187d5 Oct 20 06:34:40.691225 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-User-Name: tempest-AttachVolumeNegativeTest-617663425-project Oct 20 06:34:40.691225 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: method: > Oct 20 06:34:40.691225 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: exception: Instance 52c09583-1827-45d5-ac39-7d02ea4b658a could not be found. Oct 20 06:34:40.691225 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: action_args: {'id': '52c09583-1827-45d5-ac39-7d02ea4b658a'} Oct 20 06:34:40.692299 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 20 06:34:40.692299 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 06:34:40.692299 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 20 06:34:40.692299 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 20 06:34:40.692299 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 20 06:34:40.692299 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 20 06:34:40.692299 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 20 06:34:40.692299 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 20 06:34:40.692299 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 20 06:34:40.692299 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 20 06:34:40.692299 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 52c09583-1827-45d5-ac39-7d02ea4b658a could not be found. Oct 20 06:34:40.692299 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi Oct 20 06:34:40.692299 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 06:34:40.692299 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi Oct 20 06:34:40.692299 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 06:34:40.692299 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 06:34:40.692299 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 06:34:40.692299 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 20 06:34:40.692299 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 20 06:34:40.692299 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 20 06:34:40.694089 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 20 06:34:40.694089 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 20 06:34:40.694089 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 20 06:34:40.694089 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 20 06:34:40.694089 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 20 06:34:40.694089 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 20 06:34:40.694089 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 20 06:34:40.694089 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 52c09583-1827-45d5-ac39-7d02ea4b658a could not be found. Oct 20 06:34:40.694089 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi Oct 20 06:34:40.694089 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 06:34:40.694089 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi Oct 20 06:34:40.694089 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 06:34:40.694089 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 06:34:40.694089 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 06:34:40.694089 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 20 06:34:40.694089 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 20 06:34:40.694089 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 52c09583-1827-45d5-ac39-7d02ea4b658a could not be found. Oct 20 06:34:40.694089 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi Oct 20 06:34:40.695624 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-1abb8a58-a836-4653-b018-1f9c1bb835b8 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Returning 404 to user: Instance 52c09583-1827-45d5-ac39-7d02ea4b658a could not be found. {{(pid=118861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 20 06:34:40.695624 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-1abb8a58-a836-4653-b018-1f9c1bb835b8 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/52c09583-1827-45d5-ac39-7d02ea4b658a" status: 404 len: 111 microversion: 2.1 time: 0.035076 Oct 20 06:34:40.695624 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1256/2521] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:34:40 2022] GET /compute/v2.1/servers/52c09583-1827-45d5-ac39-7d02ea4b658a => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 20 06:34:40.700008 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-494b1488-978f-44a4-9082-10602e68c1c4 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '.version_select at 0x7fbe4e2780d0>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:34:40.720410 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-494b1488-978f-44a4-9082-10602e68c1c4 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-314386252" status: 202 len: 0 microversion: 2.1 time: 0.024246 Oct 20 06:34:40.721024 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1266/2522] 10.222.0.20 () {58 vars in 1218 bytes} [Thu Oct 20 06:34:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-314386252 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 20 06:34:41.345267 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-61a7b7b2-565e-484c-a778-0e35287e6635 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Action: 'create', calling method: .version_select at 0x7fbe4b8dadc0>, body: {"keypair": {"name": "tempest-keypair-1111713367", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLCbT+OnWnVO3hjnwCxGmTDM7IggWcdvQ3auaGRhdA6uQX2pn+IBcCBeVXhselHCljdac7sKTrfAnE+DqksPJAST2uYck2BnoIzOC+rpSvoY15xuEzheIZMQU9L56WsuJQ=="}} {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 06:34:41.361409 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.quota [None req-61a7b7b2-565e-484c-a778-0e35287e6635 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Getting quotas for project b90087118fe040389f291d846461c0a7. Resources: {'key_pairs'} {{(pid=118861) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 20 06:34:41.365293 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.quota [None req-61a7b7b2-565e-484c-a778-0e35287e6635 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Getting quotas for user 2c6be23065c643939055a3de375187d5 and project b90087118fe040389f291d846461c0a7. Resources: {'key_pairs'} {{(pid=118861) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 20 06:34:41.387792 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-61a7b7b2-565e-484c-a778-0e35287e6635 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.046258 Oct 20 06:34:41.388396 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1257/2523] 10.222.0.20 () {60 vars in 1159 bytes} [Thu Oct 20 06:34:41 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:34:42.667523 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-eab32520-89c4-4043-afb7-758c9794e46b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-342008156", "imageRef": "9fcec276-734d-41d9-905b-10d2bbcbfba5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "25101033-a54e-4dc6-a6b0-89acf3ee0337"}], "security_groups": [{"name": "tempest-securitygroup--726422228"}], "key_name": "tempest-keypair-1111713367", "user_data": "}} {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 06:34:42.771383 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.network.neutron [None req-eab32520-89c4-4043-afb7-758c9794e46b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] validate_networks() for [('25101033-a54e-4dc6-a6b0-89acf3ee0337', None, None, None, None, None)] {{(pid=118860) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 20 06:34:43.142518 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.virt.hardware [None req-eab32520-89c4-4043-afb7-758c9794e46b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Flavor limits 0:0:0 {{(pid=118860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 20 06:34:43.142938 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.virt.hardware [None req-eab32520-89c4-4043-afb7-758c9794e46b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Image limits 0:0:0 {{(pid=118860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 20 06:34:43.143400 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.virt.hardware [None req-eab32520-89c4-4043-afb7-758c9794e46b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Flavor pref 0:0:0 {{(pid=118860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 20 06:34:43.143800 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.virt.hardware [None req-eab32520-89c4-4043-afb7-758c9794e46b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Image pref 0:0:0 {{(pid=118860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 20 06:34:43.144204 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.virt.hardware [None req-eab32520-89c4-4043-afb7-758c9794e46b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 20 06:34:43.153928 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-eab32520-89c4-4043-afb7-758c9794e46b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:34:43.154332 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-eab32520-89c4-4043-afb7-758c9794e46b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:34:43.154762 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-eab32520-89c4-4043-afb7-758c9794e46b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:34:43.155474 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-eab32520-89c4-4043-afb7-758c9794e46b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:34:43.155918 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-eab32520-89c4-4043-afb7-758c9794e46b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:34:43.156335 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-eab32520-89c4-4043-afb7-758c9794e46b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:34:43.174227 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.quota [None req-eab32520-89c4-4043-afb7-758c9794e46b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Getting quotas for project b90087118fe040389f291d846461c0a7. Resources: {'cores', 'ram', 'instances'} {{(pid=118860) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 20 06:34:43.178438 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.quota [None req-eab32520-89c4-4043-afb7-758c9794e46b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Getting quotas for user 2c6be23065c643939055a3de375187d5 and project b90087118fe040389f291d846461c0a7. Resources: {'cores', 'ram', 'instances'} {{(pid=118860) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 20 06:34:43.189587 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-eab32520-89c4-4043-afb7-758c9794e46b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Going to run 1 instances... {{(pid=118860) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 20 06:34:43.191901 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-eab32520-89c4-4043-afb7-758c9794e46b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: 29a22e50-5767-4eed-955c-d06e5436df4d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9fcec276-734d-41d9-905b-10d2bbcbfba5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118860) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 20 06:34:43.239174 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-eab32520-89c4-4043-afb7-758c9794e46b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.576378 Oct 20 06:34:43.240047 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1267/2524] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Oct 20 06:34:42 2022] POST /compute/v2.1/servers => generated 401 bytes in 578 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 20 06:34:43.251982 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-a2e4d190-a152-4dbe-920c-d0c1110f99a0 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:34:43.252848 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-a2e4d190-a152-4dbe-920c-d0c1110f99a0 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: 29a22e50-5767-4eed-955c-d06e5436df4d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:34:43.337334 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-a2e4d190-a152-4dbe-920c-d0c1110f99a0 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:34:43.345007 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-a2e4d190-a152-4dbe-920c-d0c1110f99a0 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/29a22e50-5767-4eed-955c-d06e5436df4d" status: 200 len: 1241 microversion: 2.1 time: 0.097668 Oct 20 06:34:43.345707 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1258/2525] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:34:43 2022] GET /compute/v2.1/servers/29a22e50-5767-4eed-955c-d06e5436df4d => generated 1241 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:34:44.369290 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-687318e8-b964-4c07-b547-9961b7d95349 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:34:44.370013 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-687318e8-b964-4c07-b547-9961b7d95349 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: 29a22e50-5767-4eed-955c-d06e5436df4d] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:34:44.376786 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-687318e8-b964-4c07-b547-9961b7d95349 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:34:44.377272 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-687318e8-b964-4c07-b547-9961b7d95349 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:34:44.377707 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-687318e8-b964-4c07-b547-9961b7d95349 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:34:44.378538 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-687318e8-b964-4c07-b547-9961b7d95349 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:34:44.379005 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-687318e8-b964-4c07-b547-9961b7d95349 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:34:44.379455 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-687318e8-b964-4c07-b547-9961b7d95349 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:34:44.443365 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-687318e8-b964-4c07-b547-9961b7d95349 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:34:44.452337 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-687318e8-b964-4c07-b547-9961b7d95349 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/29a22e50-5767-4eed-955c-d06e5436df4d" status: 200 len: 1293 microversion: 2.1 time: 0.088281 Oct 20 06:34:44.453170 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1268/2526] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:34:44 2022] GET /compute/v2.1/servers/29a22e50-5767-4eed-955c-d06e5436df4d => generated 1293 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:34:45.476113 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-f04db82e-6602-450e-b2f4-23bc6a16e2e8 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:34:45.477105 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-f04db82e-6602-450e-b2f4-23bc6a16e2e8 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: 29a22e50-5767-4eed-955c-d06e5436df4d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:34:45.483784 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f04db82e-6602-450e-b2f4-23bc6a16e2e8 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:34:45.484478 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f04db82e-6602-450e-b2f4-23bc6a16e2e8 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:34:45.484945 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f04db82e-6602-450e-b2f4-23bc6a16e2e8 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:34:45.485808 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f04db82e-6602-450e-b2f4-23bc6a16e2e8 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:34:45.486262 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f04db82e-6602-450e-b2f4-23bc6a16e2e8 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:34:45.486690 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f04db82e-6602-450e-b2f4-23bc6a16e2e8 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:34:45.627425 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-f04db82e-6602-450e-b2f4-23bc6a16e2e8 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:34:45.638152 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-f04db82e-6602-450e-b2f4-23bc6a16e2e8 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/29a22e50-5767-4eed-955c-d06e5436df4d" status: 200 len: 1366 microversion: 2.1 time: 0.166543 Oct 20 06:34:45.638715 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1259/2527] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:34:45 2022] GET /compute/v2.1/servers/29a22e50-5767-4eed-955c-d06e5436df4d => generated 1366 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:34:45.976377 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [req-8b259234-d1e4-4bc1-9299-785d9042d37b req-ba8e9b9d-8d85-4dea-ae51-b0036a1abc8a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "29a22e50-5767-4eed-955c-d06e5436df4d", "tag": "f26a241d-a18b-4b4f-9744-d295e1c02366"}]} {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 06:34:45.987894 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [req-8b259234-d1e4-4bc1-9299-785d9042d37b req-ba8e9b9d-8d85-4dea-ae51-b0036a1abc8a service nova] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:34:45.988552 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [req-8b259234-d1e4-4bc1-9299-785d9042d37b req-ba8e9b9d-8d85-4dea-ae51-b0036a1abc8a service nova] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:34:45.989531 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [req-8b259234-d1e4-4bc1-9299-785d9042d37b req-ba8e9b9d-8d85-4dea-ae51-b0036a1abc8a service nova] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:34:46.009330 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.compute.server_external_events [req-8b259234-d1e4-4bc1-9299-785d9042d37b req-ba8e9b9d-8d85-4dea-ae51-b0036a1abc8a service nova] Creating event network-changed:f26a241d-a18b-4b4f-9744-d295e1c02366 for instance 29a22e50-5767-4eed-955c-d06e5436df4d on hv-cinder-86156 Oct 20 06:34:46.016406 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [req-8b259234-d1e4-4bc1-9299-785d9042d37b req-ba8e9b9d-8d85-4dea-ae51-b0036a1abc8a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043824 Oct 20 06:34:46.017223 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1269/2528] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 20 06:34:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:34:46.661543 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-7acd5e5a-f775-4438-9d59-7dcc60a19cda tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:34:46.662160 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-7acd5e5a-f775-4438-9d59-7dcc60a19cda tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: 29a22e50-5767-4eed-955c-d06e5436df4d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:34:46.669223 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7acd5e5a-f775-4438-9d59-7dcc60a19cda tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:34:46.669709 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7acd5e5a-f775-4438-9d59-7dcc60a19cda tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:34:46.670147 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7acd5e5a-f775-4438-9d59-7dcc60a19cda tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:34:46.670846 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7acd5e5a-f775-4438-9d59-7dcc60a19cda tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:34:46.671298 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7acd5e5a-f775-4438-9d59-7dcc60a19cda tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:34:46.671723 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7acd5e5a-f775-4438-9d59-7dcc60a19cda tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:34:46.801704 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-7acd5e5a-f775-4438-9d59-7dcc60a19cda tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:34:46.809360 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-7acd5e5a-f775-4438-9d59-7dcc60a19cda tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/29a22e50-5767-4eed-955c-d06e5436df4d" status: 200 len: 1366 microversion: 2.1 time: 0.151658 Oct 20 06:34:46.809919 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1260/2529] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:34:46 2022] GET /compute/v2.1/servers/29a22e50-5767-4eed-955c-d06e5436df4d => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:34:47.832299 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-269c7587-7953-419f-b0c3-c8b85ccba4d1 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:34:47.833193 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-269c7587-7953-419f-b0c3-c8b85ccba4d1 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: 29a22e50-5767-4eed-955c-d06e5436df4d] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:34:47.841230 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-269c7587-7953-419f-b0c3-c8b85ccba4d1 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:34:47.841933 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-269c7587-7953-419f-b0c3-c8b85ccba4d1 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:34:47.842514 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-269c7587-7953-419f-b0c3-c8b85ccba4d1 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:34:47.843733 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-269c7587-7953-419f-b0c3-c8b85ccba4d1 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:34:47.844399 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-269c7587-7953-419f-b0c3-c8b85ccba4d1 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:34:47.849184 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-269c7587-7953-419f-b0c3-c8b85ccba4d1 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:34:48.054579 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-269c7587-7953-419f-b0c3-c8b85ccba4d1 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:34:48.066609 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-269c7587-7953-419f-b0c3-c8b85ccba4d1 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/29a22e50-5767-4eed-955c-d06e5436df4d" status: 200 len: 1366 microversion: 2.1 time: 0.238407 Oct 20 06:34:48.067324 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1270/2530] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:34:47 2022] GET /compute/v2.1/servers/29a22e50-5767-4eed-955c-d06e5436df4d => generated 1366 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:34:49.089769 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-965a1cf2-f479-4b23-9f03-ab2122540758 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:34:49.090290 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-965a1cf2-f479-4b23-9f03-ab2122540758 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: 29a22e50-5767-4eed-955c-d06e5436df4d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:34:49.097240 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-965a1cf2-f479-4b23-9f03-ab2122540758 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:34:49.097727 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-965a1cf2-f479-4b23-9f03-ab2122540758 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:34:49.098164 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-965a1cf2-f479-4b23-9f03-ab2122540758 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:34:49.098919 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-965a1cf2-f479-4b23-9f03-ab2122540758 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:34:49.099367 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-965a1cf2-f479-4b23-9f03-ab2122540758 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:34:49.099786 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-965a1cf2-f479-4b23-9f03-ab2122540758 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:34:49.248072 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-965a1cf2-f479-4b23-9f03-ab2122540758 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:34:49.258121 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-965a1cf2-f479-4b23-9f03-ab2122540758 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/29a22e50-5767-4eed-955c-d06e5436df4d" status: 200 len: 1366 microversion: 2.1 time: 0.171913 Oct 20 06:34:49.273238 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1261/2531] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:34:49 2022] GET /compute/v2.1/servers/29a22e50-5767-4eed-955c-d06e5436df4d => generated 1366 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:34:50.282392 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-b53f07fd-157f-42a4-8b12-236f0c3ec257 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:34:50.283000 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-b53f07fd-157f-42a4-8b12-236f0c3ec257 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: 29a22e50-5767-4eed-955c-d06e5436df4d] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:34:50.290400 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b53f07fd-157f-42a4-8b12-236f0c3ec257 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:34:50.290916 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b53f07fd-157f-42a4-8b12-236f0c3ec257 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:34:50.291351 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b53f07fd-157f-42a4-8b12-236f0c3ec257 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:34:50.292051 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b53f07fd-157f-42a4-8b12-236f0c3ec257 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:34:50.292497 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b53f07fd-157f-42a4-8b12-236f0c3ec257 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:34:50.292951 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b53f07fd-157f-42a4-8b12-236f0c3ec257 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:34:50.431865 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-b53f07fd-157f-42a4-8b12-236f0c3ec257 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:34:50.439718 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-b53f07fd-157f-42a4-8b12-236f0c3ec257 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/29a22e50-5767-4eed-955c-d06e5436df4d" status: 200 len: 1366 microversion: 2.1 time: 0.161120 Oct 20 06:34:50.440289 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1271/2532] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:34:50 2022] GET /compute/v2.1/servers/29a22e50-5767-4eed-955c-d06e5436df4d => generated 1366 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:34:51.310472 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [req-1aca0cb3-a5f0-417d-8c38-a2930e0cfa5c req-7e096395-e62a-4ab8-bcb1-7c8f99381246 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29a22e50-5767-4eed-955c-d06e5436df4d", "name": "network-vif-plugged", "status": "completed", "tag": "f26a241d-a18b-4b4f-9744-d295e1c02366"}]} {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 06:34:51.322806 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [req-1aca0cb3-a5f0-417d-8c38-a2930e0cfa5c req-7e096395-e62a-4ab8-bcb1-7c8f99381246 service nova] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:34:51.323583 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [req-1aca0cb3-a5f0-417d-8c38-a2930e0cfa5c req-7e096395-e62a-4ab8-bcb1-7c8f99381246 service nova] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:34:51.324019 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [req-1aca0cb3-a5f0-417d-8c38-a2930e0cfa5c req-7e096395-e62a-4ab8-bcb1-7c8f99381246 service nova] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:34:51.335889 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.compute.server_external_events [req-1aca0cb3-a5f0-417d-8c38-a2930e0cfa5c req-7e096395-e62a-4ab8-bcb1-7c8f99381246 service nova] Creating event network-vif-plugged:f26a241d-a18b-4b4f-9744-d295e1c02366 for instance 29a22e50-5767-4eed-955c-d06e5436df4d on hv-cinder-86156 Oct 20 06:34:51.340945 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [req-1aca0cb3-a5f0-417d-8c38-a2930e0cfa5c req-7e096395-e62a-4ab8-bcb1-7c8f99381246 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034149 Oct 20 06:34:51.341718 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1262/2533] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 20 06:34:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:34:51.467057 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-f607e188-30a9-4440-9e27-89d782fe1afc tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:34:51.468347 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-f607e188-30a9-4440-9e27-89d782fe1afc tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: 29a22e50-5767-4eed-955c-d06e5436df4d] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:34:51.476845 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f607e188-30a9-4440-9e27-89d782fe1afc tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:34:51.477678 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f607e188-30a9-4440-9e27-89d782fe1afc tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:34:51.478305 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f607e188-30a9-4440-9e27-89d782fe1afc tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:34:51.479266 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f607e188-30a9-4440-9e27-89d782fe1afc tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:34:51.480030 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f607e188-30a9-4440-9e27-89d782fe1afc tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:34:51.480638 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f607e188-30a9-4440-9e27-89d782fe1afc tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:34:51.685538 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-f607e188-30a9-4440-9e27-89d782fe1afc tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:34:51.693434 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-f607e188-30a9-4440-9e27-89d782fe1afc tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/29a22e50-5767-4eed-955c-d06e5436df4d" status: 200 len: 1366 microversion: 2.1 time: 0.233950 Oct 20 06:34:51.694663 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1272/2534] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:34:51 2022] GET /compute/v2.1/servers/29a22e50-5767-4eed-955c-d06e5436df4d => generated 1366 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:34:52.716856 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-01050e75-d048-4eff-8f1a-112a7fc4b5d4 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:34:52.717546 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-01050e75-d048-4eff-8f1a-112a7fc4b5d4 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: 29a22e50-5767-4eed-955c-d06e5436df4d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:34:52.723694 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-01050e75-d048-4eff-8f1a-112a7fc4b5d4 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:34:52.724168 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-01050e75-d048-4eff-8f1a-112a7fc4b5d4 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:34:52.724602 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-01050e75-d048-4eff-8f1a-112a7fc4b5d4 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:34:52.725925 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-01050e75-d048-4eff-8f1a-112a7fc4b5d4 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:34:52.726376 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-01050e75-d048-4eff-8f1a-112a7fc4b5d4 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:34:52.726784 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-01050e75-d048-4eff-8f1a-112a7fc4b5d4 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:34:52.862163 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-01050e75-d048-4eff-8f1a-112a7fc4b5d4 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:34:52.870002 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-01050e75-d048-4eff-8f1a-112a7fc4b5d4 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/29a22e50-5767-4eed-955c-d06e5436df4d" status: 200 len: 1366 microversion: 2.1 time: 0.157840 Oct 20 06:34:52.870557 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1263/2535] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:34:52 2022] GET /compute/v2.1/servers/29a22e50-5767-4eed-955c-d06e5436df4d => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:34:53.893276 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-b06c5fc1-68ab-4204-bff1-c8f4a9885e9b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:34:53.893801 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-b06c5fc1-68ab-4204-bff1-c8f4a9885e9b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: 29a22e50-5767-4eed-955c-d06e5436df4d] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:34:53.896456 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG dbcounter [-] [118860] Writing DB stats nova_cell0:SELECT=2 {{(pid=118860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:34:53.897912 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG dbcounter [-] [118860] Writing DB stats nova_cell0:SELECT=6 {{(pid=118860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:34:53.904301 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b06c5fc1-68ab-4204-bff1-c8f4a9885e9b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:34:53.904802 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b06c5fc1-68ab-4204-bff1-c8f4a9885e9b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:34:53.905243 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b06c5fc1-68ab-4204-bff1-c8f4a9885e9b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:34:53.905936 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b06c5fc1-68ab-4204-bff1-c8f4a9885e9b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:34:53.906383 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b06c5fc1-68ab-4204-bff1-c8f4a9885e9b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:34:53.906804 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b06c5fc1-68ab-4204-bff1-c8f4a9885e9b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:34:54.035663 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-b06c5fc1-68ab-4204-bff1-c8f4a9885e9b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:34:54.044096 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-b06c5fc1-68ab-4204-bff1-c8f4a9885e9b tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/29a22e50-5767-4eed-955c-d06e5436df4d" status: 200 len: 1557 microversion: 2.1 time: 0.154831 Oct 20 06:34:54.044668 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1273/2536] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:34:53 2022] GET /compute/v2.1/servers/29a22e50-5767-4eed-955c-d06e5436df4d => generated 1557 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:34:54.066974 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-466cce60-27d2-4972-bedf-9abc0963d293 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:34:54.067502 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-466cce60-27d2-4972-bedf-9abc0963d293 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: 29a22e50-5767-4eed-955c-d06e5436df4d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:34:54.070271 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG dbcounter [-] [118861] Writing DB stats nova_cell0:SELECT=6 {{(pid=118861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:34:54.076048 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-466cce60-27d2-4972-bedf-9abc0963d293 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:34:54.076527 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-466cce60-27d2-4972-bedf-9abc0963d293 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:34:54.077135 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-466cce60-27d2-4972-bedf-9abc0963d293 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:34:54.078302 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-466cce60-27d2-4972-bedf-9abc0963d293 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:34:54.078755 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-466cce60-27d2-4972-bedf-9abc0963d293 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:34:54.079177 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-466cce60-27d2-4972-bedf-9abc0963d293 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:34:54.157233 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-466cce60-27d2-4972-bedf-9abc0963d293 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/29a22e50-5767-4eed-955c-d06e5436df4d/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.094136 Oct 20 06:34:54.157815 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1264/2537] 10.222.0.20 () {58 vars in 1275 bytes} [Thu Oct 20 06:34:54 2022] GET /compute/v2.1/servers/29a22e50-5767-4eed-955c-d06e5436df4d/os-interface => generated 285 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:34:55.165719 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [req-18449fe7-6695-40fb-a4c6-b5e636087a5e req-06f18f7a-5837-44d1-99d9-4f230cd88163 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "29a22e50-5767-4eed-955c-d06e5436df4d", "tag": "f26a241d-a18b-4b4f-9744-d295e1c02366"}]} {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 06:34:55.175843 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [req-18449fe7-6695-40fb-a4c6-b5e636087a5e req-06f18f7a-5837-44d1-99d9-4f230cd88163 service nova] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:34:55.176326 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [req-18449fe7-6695-40fb-a4c6-b5e636087a5e req-06f18f7a-5837-44d1-99d9-4f230cd88163 service nova] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:34:55.176796 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [req-18449fe7-6695-40fb-a4c6-b5e636087a5e req-06f18f7a-5837-44d1-99d9-4f230cd88163 service nova] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:34:55.187933 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.compute.server_external_events [req-18449fe7-6695-40fb-a4c6-b5e636087a5e req-06f18f7a-5837-44d1-99d9-4f230cd88163 service nova] Creating event network-changed:f26a241d-a18b-4b4f-9744-d295e1c02366 for instance 29a22e50-5767-4eed-955c-d06e5436df4d on hv-cinder-86156 Oct 20 06:34:55.192905 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [req-18449fe7-6695-40fb-a4c6-b5e636087a5e req-06f18f7a-5837-44d1-99d9-4f230cd88163 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106236 Oct 20 06:34:55.194176 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1274/2538] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 20 06:34:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 20 06:35:03.095203 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 20 06:35:03.095678 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: Thu Oct 20 06:35:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/fc2d86f7-2f9c-49ce-9df9-ab93f7ea0301/ips (ip 10.222.0.20) !!! Oct 20 06:35:03.102351 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-db3df351-766e-4517-afee-9bb15712665e tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:35:03.102868 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-db3df351-766e-4517-afee-9bb15712665e tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: fc2d86f7-2f9c-49ce-9df9-ab93f7ea0301] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:35:03.110462 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-db3df351-766e-4517-afee-9bb15712665e tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:35:03.110943 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-db3df351-766e-4517-afee-9bb15712665e tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:35:03.111374 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-db3df351-766e-4517-afee-9bb15712665e tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:35:03.112061 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-db3df351-766e-4517-afee-9bb15712665e tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:35:03.112533 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-db3df351-766e-4517-afee-9bb15712665e tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:35:03.112975 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-db3df351-766e-4517-afee-9bb15712665e tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:35:03.139265 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-db3df351-766e-4517-afee-9bb15712665e tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/fc2d86f7-2f9c-49ce-9df9-ab93f7ea0301/ips" status: 200 len: 146 microversion: 2.1 time: 0.044934 Oct 20 06:35:03.139817 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1265/2539] 10.222.0.20 () {58 vars in 1248 bytes} [Thu Oct 20 06:35:03 2022] GET /compute/v2.1/servers/fc2d86f7-2f9c-49ce-9df9-ab93f7ea0301/ips => generated 146 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:35:31.026106 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG dbcounter [-] [118860] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=118860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:35:31.026773 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG dbcounter [-] [118860] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:35:31.079400 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-378b52d7-2086-4595-9f5b-4d8c4ac7b716 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:35:31.079988 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-378b52d7-2086-4595-9f5b-4d8c4ac7b716 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: 29a22e50-5767-4eed-955c-d06e5436df4d] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:35:31.086084 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-378b52d7-2086-4595-9f5b-4d8c4ac7b716 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:35:31.086574 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-378b52d7-2086-4595-9f5b-4d8c4ac7b716 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:35:31.087011 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-378b52d7-2086-4595-9f5b-4d8c4ac7b716 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:35:31.087705 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-378b52d7-2086-4595-9f5b-4d8c4ac7b716 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:35:31.088164 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-378b52d7-2086-4595-9f5b-4d8c4ac7b716 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:35:31.088591 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-378b52d7-2086-4595-9f5b-4d8c4ac7b716 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:35:31.111102 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-378b52d7-2086-4595-9f5b-4d8c4ac7b716 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/29a22e50-5767-4eed-955c-d06e5436df4d/ips" status: 200 len: 150 microversion: 2.1 time: 0.086978 Oct 20 06:35:31.111648 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1275/2540] 10.222.0.20 () {58 vars in 1248 bytes} [Thu Oct 20 06:35:31 2022] GET /compute/v2.1/servers/29a22e50-5767-4eed-955c-d06e5436df4d/ips => generated 150 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 20 06:36:03.214381 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG dbcounter [-] [118861] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=1 {{(pid=118861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:36:03.215127 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG dbcounter [-] [118861] Writing DB stats nova_cell1:SELECT=44 {{(pid=118861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:36:03.219266 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-03b4f3b1-cf99-4f7f-bd93-933dbc9f145b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:36:03.219789 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-03b4f3b1-cf99-4f7f-bd93-933dbc9f145b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: fc2d86f7-2f9c-49ce-9df9-ab93f7ea0301] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:36:03.227440 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-03b4f3b1-cf99-4f7f-bd93-933dbc9f145b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:36:03.227945 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-03b4f3b1-cf99-4f7f-bd93-933dbc9f145b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:36:03.228390 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-03b4f3b1-cf99-4f7f-bd93-933dbc9f145b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:36:03.229108 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-03b4f3b1-cf99-4f7f-bd93-933dbc9f145b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:36:03.229563 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-03b4f3b1-cf99-4f7f-bd93-933dbc9f145b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:36:03.229989 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-03b4f3b1-cf99-4f7f-bd93-933dbc9f145b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:36:03.254610 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-03b4f3b1-cf99-4f7f-bd93-933dbc9f145b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: fc2d86f7-2f9c-49ce-9df9-ab93f7ea0301] Going to try to terminate instance {{(pid=118861) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 20 06:36:03.330558 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-03b4f3b1-cf99-4f7f-bd93-933dbc9f145b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "DELETE /compute/v2.1/servers/fc2d86f7-2f9c-49ce-9df9-ab93f7ea0301" status: 204 len: 0 microversion: 2.1 time: 0.117598 Oct 20 06:36:03.331284 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1266/2541] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 20 06:36:03 2022] DELETE /compute/v2.1/servers/fc2d86f7-2f9c-49ce-9df9-ab93f7ea0301 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 20 06:36:03.340278 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-b3e81fee-c4a5-4e30-8c31-eed0875d5580 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:36:03.340925 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-b3e81fee-c4a5-4e30-8c31-eed0875d5580 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: fc2d86f7-2f9c-49ce-9df9-ab93f7ea0301] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:36:03.343527 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG dbcounter [-] [118860] Writing DB stats nova_api:SELECT=2 {{(pid=118860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:36:03.344161 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG dbcounter [-] [118860] Writing DB stats nova_cell1:SELECT=4 {{(pid=118860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:36:03.349578 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b3e81fee-c4a5-4e30-8c31-eed0875d5580 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:36:03.350062 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b3e81fee-c4a5-4e30-8c31-eed0875d5580 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:36:03.350500 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b3e81fee-c4a5-4e30-8c31-eed0875d5580 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:36:03.351208 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b3e81fee-c4a5-4e30-8c31-eed0875d5580 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:36:03.351677 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b3e81fee-c4a5-4e30-8c31-eed0875d5580 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:36:03.352114 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b3e81fee-c4a5-4e30-8c31-eed0875d5580 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:36:03.522860 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-b3e81fee-c4a5-4e30-8c31-eed0875d5580 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:36:03.531050 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-b3e81fee-c4a5-4e30-8c31-eed0875d5580 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/fc2d86f7-2f9c-49ce-9df9-ab93f7ea0301" status: 200 len: 1673 microversion: 2.1 time: 0.194614 Oct 20 06:36:03.531618 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1276/2542] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:36:03 2022] GET /compute/v2.1/servers/fc2d86f7-2f9c-49ce-9df9-ab93f7ea0301 => generated 1673 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:36:04.556010 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-edfc0897-0608-4829-9f81-8051e398350a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:36:04.556628 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-edfc0897-0608-4829-9f81-8051e398350a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: fc2d86f7-2f9c-49ce-9df9-ab93f7ea0301] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:36:04.563010 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-edfc0897-0608-4829-9f81-8051e398350a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:36:04.563487 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-edfc0897-0608-4829-9f81-8051e398350a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:36:04.563917 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-edfc0897-0608-4829-9f81-8051e398350a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:36:04.564598 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-edfc0897-0608-4829-9f81-8051e398350a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:36:04.565080 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-edfc0897-0608-4829-9f81-8051e398350a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:36:04.565502 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-edfc0897-0608-4829-9f81-8051e398350a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:36:04.697160 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-edfc0897-0608-4829-9f81-8051e398350a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:36:04.704725 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-edfc0897-0608-4829-9f81-8051e398350a tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/fc2d86f7-2f9c-49ce-9df9-ab93f7ea0301" status: 200 len: 1673 microversion: 2.1 time: 0.153683 Oct 20 06:36:04.705303 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1267/2543] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:36:04 2022] GET /compute/v2.1/servers/fc2d86f7-2f9c-49ce-9df9-ab93f7ea0301 => generated 1673 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:36:05.620210 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [req-b4c909f0-97c7-4135-b993-89bda2bfc999 req-8e04e089-d92f-40ea-b664-ee579fef9297 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc2d86f7-2f9c-49ce-9df9-ab93f7ea0301", "name": "network-vif-deleted", "tag": "6645b9eb-d066-4e42-9d56-6ab07056e841"}]} {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 06:36:05.643248 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [req-b4c909f0-97c7-4135-b993-89bda2bfc999 req-8e04e089-d92f-40ea-b664-ee579fef9297 service nova] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:36:05.645087 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [req-b4c909f0-97c7-4135-b993-89bda2bfc999 req-8e04e089-d92f-40ea-b664-ee579fef9297 service nova] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:36:05.645617 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [req-b4c909f0-97c7-4135-b993-89bda2bfc999 req-8e04e089-d92f-40ea-b664-ee579fef9297 service nova] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:36:05.659213 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.compute.server_external_events [req-b4c909f0-97c7-4135-b993-89bda2bfc999 req-8e04e089-d92f-40ea-b664-ee579fef9297 service nova] Creating event network-vif-deleted:6645b9eb-d066-4e42-9d56-6ab07056e841 for instance fc2d86f7-2f9c-49ce-9df9-ab93f7ea0301 on hv-cinder-86156 Oct 20 06:36:05.665200 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [req-b4c909f0-97c7-4135-b993-89bda2bfc999 req-8e04e089-d92f-40ea-b664-ee579fef9297 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048790 Oct 20 06:36:05.666200 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1277/2544] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 20 06:36:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:36:05.728506 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-f8c77c55-6af8-4a52-bdac-d5f65c03d40b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:36:05.729677 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-f8c77c55-6af8-4a52-bdac-d5f65c03d40b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: fc2d86f7-2f9c-49ce-9df9-ab93f7ea0301] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:36:05.737677 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f8c77c55-6af8-4a52-bdac-d5f65c03d40b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:36:05.738571 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f8c77c55-6af8-4a52-bdac-d5f65c03d40b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:36:05.739227 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f8c77c55-6af8-4a52-bdac-d5f65c03d40b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:36:05.740170 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f8c77c55-6af8-4a52-bdac-d5f65c03d40b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:36:05.740866 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f8c77c55-6af8-4a52-bdac-d5f65c03d40b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:36:05.741698 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f8c77c55-6af8-4a52-bdac-d5f65c03d40b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:36:05.788071 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f8c77c55-6af8-4a52-bdac-d5f65c03d40b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:36:05.788560 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f8c77c55-6af8-4a52-bdac-d5f65c03d40b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:36:05.789134 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f8c77c55-6af8-4a52-bdac-d5f65c03d40b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:36:05.789592 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.objects.instance [None req-f8c77c55-6af8-4a52-bdac-d5f65c03d40b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lazy-loading 'fault' on Instance uuid fc2d86f7-2f9c-49ce-9df9-ab93f7ea0301 {{(pid=118861) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 20 06:36:05.838818 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-f8c77c55-6af8-4a52-bdac-d5f65c03d40b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6da8a7cb6ef849faad7d7091a1095ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b21953597b4c45059f7f78ac8fdecbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:36:05.847174 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-f8c77c55-6af8-4a52-bdac-d5f65c03d40b tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/fc2d86f7-2f9c-49ce-9df9-ab93f7ea0301" status: 200 len: 1326 microversion: 2.1 time: 0.122917 Oct 20 06:36:05.848019 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1268/2545] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:36:05 2022] GET /compute/v2.1/servers/fc2d86f7-2f9c-49ce-9df9-ab93f7ea0301 => generated 1326 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:36:06.872167 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-3938ed0a-57fd-48bf-b2ef-dcc91f6580eb tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:36:06.872892 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-3938ed0a-57fd-48bf-b2ef-dcc91f6580eb tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: fc2d86f7-2f9c-49ce-9df9-ab93f7ea0301] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:36:06.879444 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3938ed0a-57fd-48bf-b2ef-dcc91f6580eb tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:36:06.879917 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3938ed0a-57fd-48bf-b2ef-dcc91f6580eb tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:36:06.880346 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3938ed0a-57fd-48bf-b2ef-dcc91f6580eb tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:36:06.881056 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3938ed0a-57fd-48bf-b2ef-dcc91f6580eb tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:36:06.881504 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3938ed0a-57fd-48bf-b2ef-dcc91f6580eb tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:36:06.882175 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3938ed0a-57fd-48bf-b2ef-dcc91f6580eb tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:36:06.897508 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.wsgi [None req-3938ed0a-57fd-48bf-b2ef-dcc91f6580eb tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] HTTP exception thrown: Instance fc2d86f7-2f9c-49ce-9df9-ab93f7ea0301 could not be found. Oct 20 06:36:06.899306 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-3938ed0a-57fd-48bf-b2ef-dcc91f6580eb tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Request method failure captured: Oct 20 06:36:06.899306 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: request: GET /compute/v2.1/servers/fc2d86f7-2f9c-49ce-9df9-ab93f7ea0301 HTTP/1.1 Oct 20 06:36:06.899306 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: Accept: application/json Oct 20 06:36:06.899306 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: Accept-Encoding: identity Oct 20 06:36:06.899306 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: Connection: close Oct 20 06:36:06.899306 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: Content-Length: 0 Oct 20 06:36:06.899306 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: Content-Type: application/json Oct 20 06:36:06.899306 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: Host: 10.222.0.20 Oct 20 06:36:06.899306 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: Openstack-System-Scope: None Oct 20 06:36:06.899306 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: User-Agent: python-urllib3/1.26.12 Oct 20 06:36:06.899306 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Auth-Token: gAAAAABjUOT8TEyteWHV2z8RkrnsToMLaxlNClh5BxtYhXfK42N4XWDIxYvbaMlmNyanhogw9L8osfx_sbQKTfeJHTda__o6-ha71BUGGJy0GvQ_RI9Mh3GIW9WIyAB8-J4QjsbkgdDqXunJE7aVnYvRPqpsoQxqzW-KmETWwXSxpvPu3SbYBWU Oct 20 06:36:06.899306 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Domain-Id: None Oct 20 06:36:06.899306 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Domain-Name: None Oct 20 06:36:06.899306 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Identity-Status: Confirmed Oct 20 06:36:06.899306 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Is-Admin-Project: True Oct 20 06:36:06.899306 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Project-Domain-Id: default Oct 20 06:36:06.899306 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Project-Domain-Name: Default Oct 20 06:36:06.899306 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Project-Id: b21953597b4c45059f7f78ac8fdecbee Oct 20 06:36:06.899306 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Project-Name: tempest-AttachVolumeTestJSON-676062256 Oct 20 06:36:06.899306 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Role: reader,member Oct 20 06:36:06.899306 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Roles: reader,member Oct 20 06:36:06.900621 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b21953597b4c45059f7f78ac8fdecbee"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b21953597b4c45059f7f78ac8fdecbee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b21953597b4c45059f7f78ac8fdecbee"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b21953597b4c45059f7f78ac8fdecbee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 20 06:36:06.900621 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Tenant: tempest-AttachVolumeTestJSON-676062256 Oct 20 06:36:06.900621 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Tenant-Id: b21953597b4c45059f7f78ac8fdecbee Oct 20 06:36:06.900621 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Tenant-Name: tempest-AttachVolumeTestJSON-676062256 Oct 20 06:36:06.900621 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-User: tempest-AttachVolumeTestJSON-676062256-project Oct 20 06:36:06.900621 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-User-Domain-Id: default Oct 20 06:36:06.900621 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-User-Domain-Name: Default Oct 20 06:36:06.900621 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-User-Id: 6da8a7cb6ef849faad7d7091a1095ab9 Oct 20 06:36:06.900621 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-User-Name: tempest-AttachVolumeTestJSON-676062256-project Oct 20 06:36:06.900621 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: method: > Oct 20 06:36:06.900621 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: exception: Instance fc2d86f7-2f9c-49ce-9df9-ab93f7ea0301 could not be found. Oct 20 06:36:06.900621 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: action_args: {'id': 'fc2d86f7-2f9c-49ce-9df9-ab93f7ea0301'} Oct 20 06:36:06.901442 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 20 06:36:06.901442 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 06:36:06.901442 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 20 06:36:06.901442 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 20 06:36:06.901442 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 20 06:36:06.901442 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 20 06:36:06.901442 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 20 06:36:06.901442 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 20 06:36:06.901442 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 20 06:36:06.901442 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 20 06:36:06.901442 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fc2d86f7-2f9c-49ce-9df9-ab93f7ea0301 could not be found. Oct 20 06:36:06.901442 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi Oct 20 06:36:06.901442 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 06:36:06.901442 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi Oct 20 06:36:06.901442 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 06:36:06.901442 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 06:36:06.901442 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 06:36:06.901442 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 20 06:36:06.901442 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 20 06:36:06.901442 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 20 06:36:06.902500 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 20 06:36:06.902500 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 20 06:36:06.902500 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 20 06:36:06.902500 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 20 06:36:06.902500 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 20 06:36:06.902500 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 20 06:36:06.902500 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 20 06:36:06.902500 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fc2d86f7-2f9c-49ce-9df9-ab93f7ea0301 could not be found. Oct 20 06:36:06.902500 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi Oct 20 06:36:06.902500 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 06:36:06.902500 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi Oct 20 06:36:06.902500 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 06:36:06.902500 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 06:36:06.902500 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 06:36:06.902500 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 20 06:36:06.902500 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 20 06:36:06.902500 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fc2d86f7-2f9c-49ce-9df9-ab93f7ea0301 could not be found. Oct 20 06:36:06.902500 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi Oct 20 06:36:06.903586 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-3938ed0a-57fd-48bf-b2ef-dcc91f6580eb tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Returning 404 to user: Instance fc2d86f7-2f9c-49ce-9df9-ab93f7ea0301 could not be found. {{(pid=118860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 20 06:36:06.903586 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-3938ed0a-57fd-48bf-b2ef-dcc91f6580eb tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/fc2d86f7-2f9c-49ce-9df9-ab93f7ea0301" status: 404 len: 111 microversion: 2.1 time: 0.033479 Oct 20 06:36:06.903586 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1278/2546] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:36:06 2022] GET /compute/v2.1/servers/fc2d86f7-2f9c-49ce-9df9-ab93f7ea0301 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 20 06:36:06.910402 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-c77d2821-8e93-4f22-9e52-7337a617925e tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '.version_select at 0x7fbe4e45d940>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:36:06.929959 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-c77d2821-8e93-4f22-9e52-7337a617925e tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-591130919" status: 202 len: 0 microversion: 2.1 time: 0.023604 Oct 20 06:36:06.930635 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1269/2547] 10.222.0.20 () {58 vars in 1218 bytes} [Thu Oct 20 06:36:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-591130919 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 20 06:36:07.529571 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-56cb8079-befb-465e-a18f-0e77d731c34c tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:36:07.530006 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-56cb8079-befb-465e-a18f-0e77d731c34c tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: fc2d86f7-2f9c-49ce-9df9-ab93f7ea0301] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:36:07.535862 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-56cb8079-befb-465e-a18f-0e77d731c34c tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:36:07.536344 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-56cb8079-befb-465e-a18f-0e77d731c34c tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:36:07.536817 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-56cb8079-befb-465e-a18f-0e77d731c34c tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:36:07.537513 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-56cb8079-befb-465e-a18f-0e77d731c34c tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:36:07.537969 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-56cb8079-befb-465e-a18f-0e77d731c34c tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:36:07.538397 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-56cb8079-befb-465e-a18f-0e77d731c34c tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:36:07.706969 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.wsgi [None req-56cb8079-befb-465e-a18f-0e77d731c34c tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] HTTP exception thrown: Instance fc2d86f7-2f9c-49ce-9df9-ab93f7ea0301 could not be found. Oct 20 06:36:07.708520 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-56cb8079-befb-465e-a18f-0e77d731c34c tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Request method failure captured: Oct 20 06:36:07.708520 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: request: DELETE /compute/v2.1/servers/fc2d86f7-2f9c-49ce-9df9-ab93f7ea0301 HTTP/1.1 Oct 20 06:36:07.708520 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: Accept: application/json Oct 20 06:36:07.708520 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: Accept-Encoding: identity Oct 20 06:36:07.708520 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: Connection: close Oct 20 06:36:07.708520 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: Content-Length: 0 Oct 20 06:36:07.708520 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: Content-Type: application/json Oct 20 06:36:07.708520 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: Host: 10.222.0.20 Oct 20 06:36:07.708520 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: Openstack-System-Scope: None Oct 20 06:36:07.708520 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: User-Agent: python-urllib3/1.26.12 Oct 20 06:36:07.708520 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Auth-Token: gAAAAABjUOT8TEyteWHV2z8RkrnsToMLaxlNClh5BxtYhXfK42N4XWDIxYvbaMlmNyanhogw9L8osfx_sbQKTfeJHTda__o6-ha71BUGGJy0GvQ_RI9Mh3GIW9WIyAB8-J4QjsbkgdDqXunJE7aVnYvRPqpsoQxqzW-KmETWwXSxpvPu3SbYBWU Oct 20 06:36:07.708520 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Domain-Id: None Oct 20 06:36:07.708520 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Domain-Name: None Oct 20 06:36:07.708520 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Identity-Status: Confirmed Oct 20 06:36:07.708520 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Is-Admin-Project: True Oct 20 06:36:07.708520 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Project-Domain-Id: default Oct 20 06:36:07.708520 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Project-Domain-Name: Default Oct 20 06:36:07.708520 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Project-Id: b21953597b4c45059f7f78ac8fdecbee Oct 20 06:36:07.708520 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Project-Name: tempest-AttachVolumeTestJSON-676062256 Oct 20 06:36:07.708520 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Role: reader,member Oct 20 06:36:07.708520 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Roles: reader,member Oct 20 06:36:07.709814 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b21953597b4c45059f7f78ac8fdecbee"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b21953597b4c45059f7f78ac8fdecbee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b21953597b4c45059f7f78ac8fdecbee"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b21953597b4c45059f7f78ac8fdecbee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 20 06:36:07.709814 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Tenant: tempest-AttachVolumeTestJSON-676062256 Oct 20 06:36:07.709814 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Tenant-Id: b21953597b4c45059f7f78ac8fdecbee Oct 20 06:36:07.709814 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Tenant-Name: tempest-AttachVolumeTestJSON-676062256 Oct 20 06:36:07.709814 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-User: tempest-AttachVolumeTestJSON-676062256-project Oct 20 06:36:07.709814 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-User-Domain-Id: default Oct 20 06:36:07.709814 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-User-Domain-Name: Default Oct 20 06:36:07.709814 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-User-Id: 6da8a7cb6ef849faad7d7091a1095ab9 Oct 20 06:36:07.709814 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-User-Name: tempest-AttachVolumeTestJSON-676062256-project Oct 20 06:36:07.709814 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: method: > Oct 20 06:36:07.709814 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: exception: Instance fc2d86f7-2f9c-49ce-9df9-ab93f7ea0301 could not be found. Oct 20 06:36:07.709814 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: action_args: {'id': 'fc2d86f7-2f9c-49ce-9df9-ab93f7ea0301'} Oct 20 06:36:07.710518 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 20 06:36:07.710518 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 06:36:07.710518 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 20 06:36:07.710518 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 20 06:36:07.710518 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 20 06:36:07.710518 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 20 06:36:07.710518 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 20 06:36:07.710518 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 20 06:36:07.710518 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 20 06:36:07.710518 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 20 06:36:07.710518 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fc2d86f7-2f9c-49ce-9df9-ab93f7ea0301 could not be found. Oct 20 06:36:07.710518 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi Oct 20 06:36:07.710518 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 06:36:07.710518 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi Oct 20 06:36:07.710518 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 06:36:07.710518 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 06:36:07.710518 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 06:36:07.710518 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 20 06:36:07.710518 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 20 06:36:07.710518 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 20 06:36:07.712168 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 20 06:36:07.712168 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 20 06:36:07.712168 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 20 06:36:07.712168 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 20 06:36:07.712168 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 20 06:36:07.712168 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 20 06:36:07.712168 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 20 06:36:07.712168 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 20 06:36:07.712168 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 20 06:36:07.712168 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fc2d86f7-2f9c-49ce-9df9-ab93f7ea0301 could not be found. Oct 20 06:36:07.712168 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi Oct 20 06:36:07.712168 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 06:36:07.712168 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi Oct 20 06:36:07.712168 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 06:36:07.712168 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 06:36:07.712168 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 06:36:07.712168 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 20 06:36:07.712168 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 20 06:36:07.712168 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fc2d86f7-2f9c-49ce-9df9-ab93f7ea0301 could not be found. Oct 20 06:36:07.712168 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi Oct 20 06:36:07.713367 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-56cb8079-befb-465e-a18f-0e77d731c34c tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Returning 404 to user: Instance fc2d86f7-2f9c-49ce-9df9-ab93f7ea0301 could not be found. {{(pid=118860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 20 06:36:07.713367 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-56cb8079-befb-465e-a18f-0e77d731c34c tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "DELETE /compute/v2.1/servers/fc2d86f7-2f9c-49ce-9df9-ab93f7ea0301" status: 404 len: 111 microversion: 2.1 time: 0.184358 Oct 20 06:36:07.713367 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1279/2548] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 20 06:36:07 2022] DELETE /compute/v2.1/servers/fc2d86f7-2f9c-49ce-9df9-ab93f7ea0301 => generated 111 bytes in 186 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 20 06:36:07.719126 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-2287a265-f793-4985-96c9-f82e4addd993 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:36:07.719734 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-2287a265-f793-4985-96c9-f82e4addd993 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: fc2d86f7-2f9c-49ce-9df9-ab93f7ea0301] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:36:07.725663 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-2287a265-f793-4985-96c9-f82e4addd993 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:36:07.726138 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-2287a265-f793-4985-96c9-f82e4addd993 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:36:07.727378 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-2287a265-f793-4985-96c9-f82e4addd993 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:36:07.728060 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-2287a265-f793-4985-96c9-f82e4addd993 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:36:07.728505 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-2287a265-f793-4985-96c9-f82e4addd993 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:36:07.728949 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-2287a265-f793-4985-96c9-f82e4addd993 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:36:07.741955 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.wsgi [None req-2287a265-f793-4985-96c9-f82e4addd993 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] HTTP exception thrown: Instance fc2d86f7-2f9c-49ce-9df9-ab93f7ea0301 could not be found. Oct 20 06:36:07.743665 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-2287a265-f793-4985-96c9-f82e4addd993 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Request method failure captured: Oct 20 06:36:07.743665 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: request: GET /compute/v2.1/servers/fc2d86f7-2f9c-49ce-9df9-ab93f7ea0301 HTTP/1.1 Oct 20 06:36:07.743665 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: Accept: application/json Oct 20 06:36:07.743665 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: Accept-Encoding: identity Oct 20 06:36:07.743665 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: Connection: close Oct 20 06:36:07.743665 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: Content-Length: 0 Oct 20 06:36:07.743665 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: Content-Type: application/json Oct 20 06:36:07.743665 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: Host: 10.222.0.20 Oct 20 06:36:07.743665 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: Openstack-System-Scope: None Oct 20 06:36:07.743665 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: User-Agent: python-urllib3/1.26.12 Oct 20 06:36:07.743665 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Auth-Token: gAAAAABjUOT8TEyteWHV2z8RkrnsToMLaxlNClh5BxtYhXfK42N4XWDIxYvbaMlmNyanhogw9L8osfx_sbQKTfeJHTda__o6-ha71BUGGJy0GvQ_RI9Mh3GIW9WIyAB8-J4QjsbkgdDqXunJE7aVnYvRPqpsoQxqzW-KmETWwXSxpvPu3SbYBWU Oct 20 06:36:07.743665 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Domain-Id: None Oct 20 06:36:07.743665 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Domain-Name: None Oct 20 06:36:07.743665 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Identity-Status: Confirmed Oct 20 06:36:07.743665 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Is-Admin-Project: True Oct 20 06:36:07.743665 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Project-Domain-Id: default Oct 20 06:36:07.743665 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Project-Domain-Name: Default Oct 20 06:36:07.743665 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Project-Id: b21953597b4c45059f7f78ac8fdecbee Oct 20 06:36:07.743665 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Project-Name: tempest-AttachVolumeTestJSON-676062256 Oct 20 06:36:07.743665 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Role: reader,member Oct 20 06:36:07.743665 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Roles: reader,member Oct 20 06:36:07.744917 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b21953597b4c45059f7f78ac8fdecbee"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b21953597b4c45059f7f78ac8fdecbee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b21953597b4c45059f7f78ac8fdecbee"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b21953597b4c45059f7f78ac8fdecbee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 20 06:36:07.744917 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Tenant: tempest-AttachVolumeTestJSON-676062256 Oct 20 06:36:07.744917 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Tenant-Id: b21953597b4c45059f7f78ac8fdecbee Oct 20 06:36:07.744917 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Tenant-Name: tempest-AttachVolumeTestJSON-676062256 Oct 20 06:36:07.744917 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-User: tempest-AttachVolumeTestJSON-676062256-project Oct 20 06:36:07.744917 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-User-Domain-Id: default Oct 20 06:36:07.744917 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-User-Domain-Name: Default Oct 20 06:36:07.744917 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-User-Id: 6da8a7cb6ef849faad7d7091a1095ab9 Oct 20 06:36:07.744917 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-User-Name: tempest-AttachVolumeTestJSON-676062256-project Oct 20 06:36:07.744917 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: method: > Oct 20 06:36:07.744917 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: exception: Instance fc2d86f7-2f9c-49ce-9df9-ab93f7ea0301 could not be found. Oct 20 06:36:07.744917 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: action_args: {'id': 'fc2d86f7-2f9c-49ce-9df9-ab93f7ea0301'} Oct 20 06:36:07.745611 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 20 06:36:07.745611 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 06:36:07.745611 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 20 06:36:07.745611 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 20 06:36:07.745611 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 20 06:36:07.745611 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 20 06:36:07.745611 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 20 06:36:07.745611 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 20 06:36:07.745611 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 20 06:36:07.745611 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 20 06:36:07.745611 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fc2d86f7-2f9c-49ce-9df9-ab93f7ea0301 could not be found. Oct 20 06:36:07.745611 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi Oct 20 06:36:07.745611 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 06:36:07.745611 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi Oct 20 06:36:07.745611 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 06:36:07.745611 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 06:36:07.745611 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 06:36:07.745611 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 20 06:36:07.745611 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 20 06:36:07.745611 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 20 06:36:07.746733 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 20 06:36:07.746733 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 20 06:36:07.746733 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 20 06:36:07.746733 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 20 06:36:07.746733 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 20 06:36:07.746733 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 20 06:36:07.746733 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 20 06:36:07.746733 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fc2d86f7-2f9c-49ce-9df9-ab93f7ea0301 could not be found. Oct 20 06:36:07.746733 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi Oct 20 06:36:07.746733 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 06:36:07.746733 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi Oct 20 06:36:07.746733 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 06:36:07.746733 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 06:36:07.746733 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 06:36:07.746733 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 20 06:36:07.746733 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 20 06:36:07.746733 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fc2d86f7-2f9c-49ce-9df9-ab93f7ea0301 could not be found. Oct 20 06:36:07.746733 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi Oct 20 06:36:07.747806 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-2287a265-f793-4985-96c9-f82e4addd993 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Returning 404 to user: Instance fc2d86f7-2f9c-49ce-9df9-ab93f7ea0301 could not be found. {{(pid=118861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 20 06:36:07.747806 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-2287a265-f793-4985-96c9-f82e4addd993 tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/fc2d86f7-2f9c-49ce-9df9-ab93f7ea0301" status: 404 len: 111 microversion: 2.1 time: 0.029789 Oct 20 06:36:07.747806 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1270/2549] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:36:07 2022] GET /compute/v2.1/servers/fc2d86f7-2f9c-49ce-9df9-ab93f7ea0301 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 20 06:36:13.688003 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-d94250f3-d7eb-4368-b59d-fdec769ce2d9 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:36:13.688519 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-d94250f3-d7eb-4368-b59d-fdec769ce2d9 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:36:13.695283 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-d94250f3-d7eb-4368-b59d-fdec769ce2d9 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:36:13.695769 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-d94250f3-d7eb-4368-b59d-fdec769ce2d9 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:36:13.696204 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-d94250f3-d7eb-4368-b59d-fdec769ce2d9 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:36:13.696940 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-d94250f3-d7eb-4368-b59d-fdec769ce2d9 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:36:13.697556 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-d94250f3-d7eb-4368-b59d-fdec769ce2d9 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:36:13.697989 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-d94250f3-d7eb-4368-b59d-fdec769ce2d9 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:36:13.712395 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.wsgi [None req-d94250f3-d7eb-4368-b59d-fdec769ce2d9 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] HTTP exception thrown: Instance 71be459d-e948-4a17-b379-182f4196411d could not be found. Oct 20 06:36:13.713978 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-d94250f3-d7eb-4368-b59d-fdec769ce2d9 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Request method failure captured: Oct 20 06:36:13.713978 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: request: DELETE /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d HTTP/1.1 Oct 20 06:36:13.713978 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: Accept: application/json Oct 20 06:36:13.713978 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: Accept-Encoding: identity Oct 20 06:36:13.713978 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: Connection: close Oct 20 06:36:13.713978 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: Content-Length: 0 Oct 20 06:36:13.713978 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: Content-Type: application/json Oct 20 06:36:13.713978 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: Host: 10.222.0.20 Oct 20 06:36:13.713978 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: Openstack-System-Scope: None Oct 20 06:36:13.713978 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: User-Agent: python-urllib3/1.26.12 Oct 20 06:36:13.713978 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Auth-Token: gAAAAABjUOT4WE-GeZ9nIY9RvQJPLx5cfKBHzS8w2P3ohAEeWZ7MhC3JV8mQEPTHfIaK5zuvYmNfTMyv3TZQQoGbyre2yxtMqG3RrbumkPK47M1IYrJzUzzgVth48PWOx3W0AtdNXY07UuKLEobMmvxQ_9GrsNYkeXVZIvq9kqYpG7ipSg6jPmI Oct 20 06:36:13.713978 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Domain-Id: None Oct 20 06:36:13.713978 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Domain-Name: None Oct 20 06:36:13.713978 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Identity-Status: Confirmed Oct 20 06:36:13.713978 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Is-Admin-Project: True Oct 20 06:36:13.713978 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Openstack-Nova-Api-Version: 2.20 Oct 20 06:36:13.713978 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Project-Domain-Id: default Oct 20 06:36:13.713978 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Project-Domain-Name: Default Oct 20 06:36:13.713978 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Project-Id: 66a33a727f9c40b99fb14bd2e0fc5090 Oct 20 06:36:13.713978 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1640997354 Oct 20 06:36:13.713978 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Role: reader,member Oct 20 06:36:13.713978 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Roles: reader,member Oct 20 06:36:13.715287 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/66a33a727f9c40b99fb14bd2e0fc5090"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_66a33a727f9c40b99fb14bd2e0fc5090"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/66a33a727f9c40b99fb14bd2e0fc5090"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/66a33a727f9c40b99fb14bd2e0fc5090"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 20 06:36:13.715287 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1640997354 Oct 20 06:36:13.715287 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Tenant-Id: 66a33a727f9c40b99fb14bd2e0fc5090 Oct 20 06:36:13.715287 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1640997354 Oct 20 06:36:13.715287 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-User: tempest-AttachVolumeShelveTestJSON-1640997354-project Oct 20 06:36:13.715287 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-User-Domain-Id: default Oct 20 06:36:13.715287 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-User-Domain-Name: Default Oct 20 06:36:13.715287 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-User-Id: db34ffc8f90247daac1548bbb421b015 Oct 20 06:36:13.715287 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1640997354-project Oct 20 06:36:13.715287 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: method: > Oct 20 06:36:13.715287 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: exception: Instance 71be459d-e948-4a17-b379-182f4196411d could not be found. Oct 20 06:36:13.715287 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: action_args: {'id': '71be459d-e948-4a17-b379-182f4196411d'} Oct 20 06:36:13.716107 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 20 06:36:13.716107 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 06:36:13.716107 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 20 06:36:13.716107 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 20 06:36:13.716107 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 20 06:36:13.716107 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 20 06:36:13.716107 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 20 06:36:13.716107 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 20 06:36:13.716107 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 20 06:36:13.716107 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 20 06:36:13.716107 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 71be459d-e948-4a17-b379-182f4196411d could not be found. Oct 20 06:36:13.716107 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi Oct 20 06:36:13.716107 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 06:36:13.716107 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi Oct 20 06:36:13.716107 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 06:36:13.716107 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 06:36:13.716107 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 06:36:13.716107 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 20 06:36:13.716107 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 20 06:36:13.716107 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 20 06:36:13.717595 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 20 06:36:13.717595 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 20 06:36:13.717595 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 20 06:36:13.717595 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 20 06:36:13.717595 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 20 06:36:13.717595 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 20 06:36:13.717595 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 20 06:36:13.717595 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 20 06:36:13.717595 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 20 06:36:13.717595 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71be459d-e948-4a17-b379-182f4196411d could not be found. Oct 20 06:36:13.717595 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi Oct 20 06:36:13.717595 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 06:36:13.717595 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi Oct 20 06:36:13.717595 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 06:36:13.717595 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 06:36:13.717595 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 06:36:13.717595 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 20 06:36:13.717595 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 20 06:36:13.717595 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71be459d-e948-4a17-b379-182f4196411d could not be found. Oct 20 06:36:13.717595 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi Oct 20 06:36:13.719433 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-d94250f3-d7eb-4368-b59d-fdec769ce2d9 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Returning 404 to user: Instance 71be459d-e948-4a17-b379-182f4196411d could not be found. {{(pid=118860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 20 06:36:13.719433 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-d94250f3-d7eb-4368-b59d-fdec769ce2d9 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "DELETE /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 404 len: 111 microversion: 2.20 time: 0.031192 Oct 20 06:36:13.719433 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1280/2550] 10.222.0.20 () {60 vars in 1280 bytes} [Thu Oct 20 06:36:13 2022] DELETE /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 20 06:36:13.723896 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-8311a377-4039-4637-a31d-7b52b55f03b2 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:36:13.724512 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-8311a377-4039-4637-a31d-7b52b55f03b2 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] [instance: 71be459d-e948-4a17-b379-182f4196411d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:36:13.731370 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-8311a377-4039-4637-a31d-7b52b55f03b2 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:36:13.731850 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-8311a377-4039-4637-a31d-7b52b55f03b2 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:36:13.732291 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-8311a377-4039-4637-a31d-7b52b55f03b2 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:36:13.733375 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-8311a377-4039-4637-a31d-7b52b55f03b2 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:36:13.733833 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-8311a377-4039-4637-a31d-7b52b55f03b2 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:36:13.734259 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-8311a377-4039-4637-a31d-7b52b55f03b2 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:36:13.748939 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.wsgi [None req-8311a377-4039-4637-a31d-7b52b55f03b2 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] HTTP exception thrown: Instance 71be459d-e948-4a17-b379-182f4196411d could not be found. Oct 20 06:36:13.750581 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-8311a377-4039-4637-a31d-7b52b55f03b2 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Request method failure captured: Oct 20 06:36:13.750581 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: request: GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d HTTP/1.1 Oct 20 06:36:13.750581 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: Accept: application/json Oct 20 06:36:13.750581 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: Accept-Encoding: identity Oct 20 06:36:13.750581 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: Connection: close Oct 20 06:36:13.750581 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: Content-Length: 0 Oct 20 06:36:13.750581 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: Content-Type: application/json Oct 20 06:36:13.750581 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: Host: 10.222.0.20 Oct 20 06:36:13.750581 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: Openstack-System-Scope: None Oct 20 06:36:13.750581 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: User-Agent: python-urllib3/1.26.12 Oct 20 06:36:13.750581 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Auth-Token: gAAAAABjUOT4WE-GeZ9nIY9RvQJPLx5cfKBHzS8w2P3ohAEeWZ7MhC3JV8mQEPTHfIaK5zuvYmNfTMyv3TZQQoGbyre2yxtMqG3RrbumkPK47M1IYrJzUzzgVth48PWOx3W0AtdNXY07UuKLEobMmvxQ_9GrsNYkeXVZIvq9kqYpG7ipSg6jPmI Oct 20 06:36:13.750581 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Domain-Id: None Oct 20 06:36:13.750581 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Domain-Name: None Oct 20 06:36:13.750581 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Identity-Status: Confirmed Oct 20 06:36:13.750581 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Is-Admin-Project: True Oct 20 06:36:13.750581 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Openstack-Nova-Api-Version: 2.20 Oct 20 06:36:13.750581 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Project-Domain-Id: default Oct 20 06:36:13.750581 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Project-Domain-Name: Default Oct 20 06:36:13.750581 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Project-Id: 66a33a727f9c40b99fb14bd2e0fc5090 Oct 20 06:36:13.750581 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1640997354 Oct 20 06:36:13.750581 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Role: reader,member Oct 20 06:36:13.750581 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Roles: reader,member Oct 20 06:36:13.751841 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/66a33a727f9c40b99fb14bd2e0fc5090"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_66a33a727f9c40b99fb14bd2e0fc5090"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/66a33a727f9c40b99fb14bd2e0fc5090"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/66a33a727f9c40b99fb14bd2e0fc5090"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 20 06:36:13.751841 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1640997354 Oct 20 06:36:13.751841 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Tenant-Id: 66a33a727f9c40b99fb14bd2e0fc5090 Oct 20 06:36:13.751841 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1640997354 Oct 20 06:36:13.751841 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-User: tempest-AttachVolumeShelveTestJSON-1640997354-project Oct 20 06:36:13.751841 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-User-Domain-Id: default Oct 20 06:36:13.751841 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-User-Domain-Name: Default Oct 20 06:36:13.751841 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-User-Id: db34ffc8f90247daac1548bbb421b015 Oct 20 06:36:13.751841 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1640997354-project Oct 20 06:36:13.751841 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: method: > Oct 20 06:36:13.751841 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: exception: Instance 71be459d-e948-4a17-b379-182f4196411d could not be found. Oct 20 06:36:13.751841 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: action_args: {'id': '71be459d-e948-4a17-b379-182f4196411d'} Oct 20 06:36:13.752518 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 20 06:36:13.752518 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 06:36:13.752518 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 20 06:36:13.752518 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 20 06:36:13.752518 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 20 06:36:13.752518 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 20 06:36:13.752518 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 20 06:36:13.752518 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 20 06:36:13.752518 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 20 06:36:13.752518 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 20 06:36:13.752518 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 71be459d-e948-4a17-b379-182f4196411d could not be found. Oct 20 06:36:13.752518 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi Oct 20 06:36:13.752518 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 06:36:13.752518 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi Oct 20 06:36:13.752518 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 06:36:13.752518 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 06:36:13.752518 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 06:36:13.752518 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 20 06:36:13.752518 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 20 06:36:13.752518 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 20 06:36:13.753655 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 20 06:36:13.753655 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 20 06:36:13.753655 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 20 06:36:13.753655 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 20 06:36:13.753655 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 20 06:36:13.753655 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 20 06:36:13.753655 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 20 06:36:13.753655 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71be459d-e948-4a17-b379-182f4196411d could not be found. Oct 20 06:36:13.753655 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi Oct 20 06:36:13.753655 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 06:36:13.753655 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi Oct 20 06:36:13.753655 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 06:36:13.753655 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 06:36:13.753655 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 06:36:13.753655 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 20 06:36:13.753655 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 20 06:36:13.753655 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71be459d-e948-4a17-b379-182f4196411d could not be found. Oct 20 06:36:13.753655 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi Oct 20 06:36:13.754701 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-8311a377-4039-4637-a31d-7b52b55f03b2 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] Returning 404 to user: Instance 71be459d-e948-4a17-b379-182f4196411d could not be found. {{(pid=118861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 20 06:36:13.754701 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-8311a377-4039-4637-a31d-7b52b55f03b2 tempest-AttachVolumeShelveTestJSON-1640997354 tempest-AttachVolumeShelveTestJSON-1640997354-project] 10.222.0.20 "GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d" status: 404 len: 111 microversion: 2.20 time: 0.032084 Oct 20 06:36:13.755007 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1271/2551] 10.222.0.20 () {60 vars in 1277 bytes} [Thu Oct 20 06:36:13 2022] GET /compute/v2.1/servers/71be459d-e948-4a17-b379-182f4196411d => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 20 06:37:49.088186 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG dbcounter [-] [118860] Writing DB stats nova_api:SELECT=10 {{(pid=118860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:37:49.094429 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG dbcounter [-] [118860] Writing DB stats nova_cell1:SELECT=14 {{(pid=118860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:37:49.095864 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 20 06:37:49.096951 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: Thu Oct 20 06:37:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-volumes/620e638f-adb0-4413-88ff-c497e876874d (ip 10.222.0.20) !!! Oct 20 06:37:49.100781 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 20 06:37:49.101089 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: Thu Oct 20 06:37:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-volumes/620e638f-adb0-4413-88ff-c497e876874d (ip 10.222.0.20) !!! Oct 20 06:37:49.112715 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-e968c1ff-2749-468d-b43f-7a72a56c35ad tempest-VolumesTestJSON-1127505580 tempest-VolumesTestJSON-1127505580-project] Calling method '.version_select at 0x7fbe4e2dc430>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:37:49.142935 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG dbcounter [-] [118861] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=118861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:37:49.144285 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG dbcounter [-] [118861] Writing DB stats nova_cell1:SELECT=32,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:37:49.151826 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-a938483b-1e7d-4a68-a9ad-151eb1c5d319 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f11d1637-1b28-49d6-9a54-c389fd1998f0"}} {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 06:37:49.155920 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-a938483b-1e7d-4a68-a9ad-151eb1c5d319 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: 29a22e50-5767-4eed-955c-d06e5436df4d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:37:49.188125 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a938483b-1e7d-4a68-a9ad-151eb1c5d319 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:37:49.188626 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a938483b-1e7d-4a68-a9ad-151eb1c5d319 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:37:49.189333 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a938483b-1e7d-4a68-a9ad-151eb1c5d319 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:37:49.190069 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a938483b-1e7d-4a68-a9ad-151eb1c5d319 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:37:49.190699 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a938483b-1e7d-4a68-a9ad-151eb1c5d319 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:37:49.192894 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a938483b-1e7d-4a68-a9ad-151eb1c5d319 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:37:49.286662 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-e968c1ff-2749-468d-b43f-7a72a56c35ad tempest-VolumesTestJSON-1127505580 tempest-VolumesTestJSON-1127505580-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/620e638f-adb0-4413-88ff-c497e876874d" status: 200 len: 351 microversion: 2.1 time: 0.200214 Oct 20 06:37:49.287522 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1281/2552] 10.222.0.20 () {58 vars in 1245 bytes} [Thu Oct 20 06:37:49 2022] GET /compute/v2.1/os-volumes/620e638f-adb0-4413-88ff-c497e876874d => generated 351 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:37:50.122372 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-a938483b-1e7d-4a68-a9ad-151eb1c5d319 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "POST /compute/v2.1/servers/29a22e50-5767-4eed-955c-d06e5436df4d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.981326 Oct 20 06:37:50.124736 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1272/2553] 10.222.0.20 () {60 vars in 1323 bytes} [Thu Oct 20 06:37:49 2022] POST /compute/v2.1/servers/29a22e50-5767-4eed-955c-d06e5436df4d/os-volume_attachments => generated 194 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 20 06:37:50.608768 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [req-75d7b955-c030-4e8d-8ce4-bb1b47069b61 req-7aa16a1d-6c5d-4ae3-858e-ae2fbd37f9b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0247d13a-779d-4301-ba85-6cbcbf12252f", "name": "network-vif-deleted", "tag": "418af13b-a918-48be-b332-3b304b1004cc"}]} {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 06:37:50.625962 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [req-75d7b955-c030-4e8d-8ce4-bb1b47069b61 req-7aa16a1d-6c5d-4ae3-858e-ae2fbd37f9b8 service nova] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:37:50.627286 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [req-75d7b955-c030-4e8d-8ce4-bb1b47069b61 req-7aa16a1d-6c5d-4ae3-858e-ae2fbd37f9b8 service nova] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:37:50.627804 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [req-75d7b955-c030-4e8d-8ce4-bb1b47069b61 req-7aa16a1d-6c5d-4ae3-858e-ae2fbd37f9b8 service nova] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:37:50.654171 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.compute.server_external_events [req-75d7b955-c030-4e8d-8ce4-bb1b47069b61 req-7aa16a1d-6c5d-4ae3-858e-ae2fbd37f9b8 service nova] Creating event network-vif-deleted:418af13b-a918-48be-b332-3b304b1004cc for instance 0247d13a-779d-4301-ba85-6cbcbf12252f on hv-cinder-86156 Oct 20 06:37:50.663674 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [req-75d7b955-c030-4e8d-8ce4-bb1b47069b61 req-7aa16a1d-6c5d-4ae3-858e-ae2fbd37f9b8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059518 Oct 20 06:37:50.663674 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1282/2554] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 20 06:37:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 20 06:37:54.202064 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-1cde7230-50fd-4ef3-b001-7c5505c677b7 tempest-VolumesTestJSON-1127505580 tempest-VolumesTestJSON-1127505580-project] Calling method '.version_select at 0x7fbe4e45d160>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:37:54.272089 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-1cde7230-50fd-4ef3-b001-7c5505c677b7 tempest-VolumesTestJSON-1127505580 tempest-VolumesTestJSON-1127505580-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/868ea8a1-4c78-484b-81f8-7094bdfd3d71" status: 200 len: 350 microversion: 2.1 time: 0.077647 Oct 20 06:37:54.272843 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1273/2555] 10.222.0.20 () {58 vars in 1245 bytes} [Thu Oct 20 06:37:54 2022] GET /compute/v2.1/os-volumes/868ea8a1-4c78-484b-81f8-7094bdfd3d71 => generated 350 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:37:55.807937 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-e0c2a1cd-7743-4b4f-9331-6921d5baee62 tempest-VolumesTestJSON-1127505580 tempest-VolumesTestJSON-1127505580-project] Calling method '.version_select at 0x7fbe4e2dc160>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:37:55.896448 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-e0c2a1cd-7743-4b4f-9331-6921d5baee62 tempest-VolumesTestJSON-1127505580 tempest-VolumesTestJSON-1127505580-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/f325ae71-1c6b-428d-b767-077f7bee0907" status: 200 len: 351 microversion: 2.1 time: 0.096149 Oct 20 06:37:55.897120 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1283/2556] 10.222.0.20 () {58 vars in 1245 bytes} [Thu Oct 20 06:37:55 2022] GET /compute/v2.1/os-volumes/f325ae71-1c6b-428d-b767-077f7bee0907 => generated 351 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:37:55.911190 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-47c637f9-d7d3-4d05-9950-c01d8501569c tempest-VolumesTestJSON-1127505580 tempest-VolumesTestJSON-1127505580-project] Calling method '.version_select at 0x7fbe4ad373a0>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:37:56.006497 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-47c637f9-d7d3-4d05-9950-c01d8501569c tempest-VolumesTestJSON-1127505580 tempest-VolumesTestJSON-1127505580-project] 10.222.0.20 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.099476 Oct 20 06:37:56.007070 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1274/2557] 10.222.0.20 () {58 vars in 1134 bytes} [Thu Oct 20 06:37:55 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:37:56.023147 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-020c00c8-1c8a-4f37-96d0-1bdff47aefc3 tempest-VolumesTestJSON-1127505580 tempest-VolumesTestJSON-1127505580-project] Calling method '.version_select at 0x7fbe4e3e7b80>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:37:56.129716 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-020c00c8-1c8a-4f37-96d0-1bdff47aefc3 tempest-VolumesTestJSON-1127505580 tempest-VolumesTestJSON-1127505580-project] 10.222.0.20 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.111028 Oct 20 06:37:56.130407 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1284/2558] 10.222.0.20 () {58 vars in 1149 bytes} [Thu Oct 20 06:37:56 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:37:56.148135 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-a6202b9d-b1a6-440a-9af4-84f19e7921ee tempest-VolumesTestJSON-1127505580 tempest-VolumesTestJSON-1127505580-project] Calling method '.version_select at 0x7fbe4adfc940>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:37:56.250349 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-a6202b9d-b1a6-440a-9af4-84f19e7921ee tempest-VolumesTestJSON-1127505580 tempest-VolumesTestJSON-1127505580-project] 10.222.0.20 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.107995 Oct 20 06:37:56.250982 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1275/2559] 10.222.0.20 () {58 vars in 1134 bytes} [Thu Oct 20 06:37:56 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:37:56.265535 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-3665f1c5-8c8d-4a6b-a7a5-42d5655ff98d tempest-VolumesTestJSON-1127505580 tempest-VolumesTestJSON-1127505580-project] Calling method '.version_select at 0x7fbe4e325310>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:37:56.389260 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-3665f1c5-8c8d-4a6b-a7a5-42d5655ff98d tempest-VolumesTestJSON-1127505580 tempest-VolumesTestJSON-1127505580-project] 10.222.0.20 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.123397 Oct 20 06:37:56.389854 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1285/2560] 10.222.0.20 () {58 vars in 1167 bytes} [Thu Oct 20 06:37:56 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:37:56.425562 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-beafb9ad-551c-4e57-86d0-0c7461089eab tempest-VolumesTestJSON-1127505580 tempest-VolumesTestJSON-1127505580-project] Calling method '.version_select at 0x7fbe4ad89310>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:37:56.531288 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-beafb9ad-551c-4e57-86d0-0c7461089eab tempest-VolumesTestJSON-1127505580 tempest-VolumesTestJSON-1127505580-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.128483 Oct 20 06:37:56.532144 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1276/2561] 10.222.0.20 () {58 vars in 1170 bytes} [Thu Oct 20 06:37:56 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:37:56.547877 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-5b0bb76e-284d-4727-869d-0b3954d5b100 tempest-VolumesTestJSON-1127505580 tempest-VolumesTestJSON-1127505580-project] Calling method '.version_select at 0x7fbe4e2dcd30>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:37:56.650197 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-5b0bb76e-284d-4727-869d-0b3954d5b100 tempest-VolumesTestJSON-1127505580 tempest-VolumesTestJSON-1127505580-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.106174 Oct 20 06:37:56.651012 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1286/2562] 10.222.0.20 () {58 vars in 1155 bytes} [Thu Oct 20 06:37:56 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:37:56.667611 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-7f80da16-7853-4bed-9652-5d590a328174 tempest-VolumesTestJSON-1127505580 tempest-VolumesTestJSON-1127505580-project] Calling method '.version_select at 0x7fbe4e45d160>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:37:56.758690 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-7f80da16-7853-4bed-9652-5d590a328174 tempest-VolumesTestJSON-1127505580 tempest-VolumesTestJSON-1127505580-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.097391 Oct 20 06:37:56.759684 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1277/2563] 10.222.0.20 () {58 vars in 1188 bytes} [Thu Oct 20 06:37:56 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:37:56.775558 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-e0c300ed-024d-4bfa-bd09-57a449d5c6b8 tempest-VolumesTestJSON-1127505580 tempest-VolumesTestJSON-1127505580-project] Calling method '.version_select at 0x7fbe4e325dc0>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:37:56.873153 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-e0c300ed-024d-4bfa-bd09-57a449d5c6b8 tempest-VolumesTestJSON-1127505580 tempest-VolumesTestJSON-1127505580-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.101991 Oct 20 06:37:56.873987 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1287/2564] 10.222.0.20 () {58 vars in 1155 bytes} [Thu Oct 20 06:37:56 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:38:01.521770 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG dbcounter [-] [118861] Writing DB stats nova_api:SELECT=2 {{(pid=118861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:38:01.522991 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG dbcounter [-] [118861] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:38:01.530950 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-bf5d6ec2-ae63-4088-98d7-82ad0b62e88f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:38:01.531628 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-bf5d6ec2-ae63-4088-98d7-82ad0b62e88f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: 29a22e50-5767-4eed-955c-d06e5436df4d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:38:01.563073 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-bf5d6ec2-ae63-4088-98d7-82ad0b62e88f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:38:01.563963 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-bf5d6ec2-ae63-4088-98d7-82ad0b62e88f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:38:01.564869 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-bf5d6ec2-ae63-4088-98d7-82ad0b62e88f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:38:01.565810 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-bf5d6ec2-ae63-4088-98d7-82ad0b62e88f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:38:01.566471 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-bf5d6ec2-ae63-4088-98d7-82ad0b62e88f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:38:01.567183 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-bf5d6ec2-ae63-4088-98d7-82ad0b62e88f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:38:01.694786 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.objects.instance [None req-bf5d6ec2-ae63-4088-98d7-82ad0b62e88f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lazy-loading 'services' on Instance uuid 29a22e50-5767-4eed-955c-d06e5436df4d {{(pid=118861) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 20 06:38:01.838776 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-bf5d6ec2-ae63-4088-98d7-82ad0b62e88f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "DELETE /compute/v2.1/servers/29a22e50-5767-4eed-955c-d06e5436df4d/os-volume_attachments/f11d1637-1b28-49d6-9a54-c389fd1998f0" status: 202 len: 0 microversion: 2.1 time: 0.317061 Oct 20 06:38:01.839491 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1278/2565] 10.222.0.20 () {58 vars in 1416 bytes} [Thu Oct 20 06:38:01 2022] DELETE /compute/v2.1/servers/29a22e50-5767-4eed-955c-d06e5436df4d/os-volume_attachments/f11d1637-1b28-49d6-9a54-c389fd1998f0 => generated 0 bytes in 320 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 20 06:38:01.845370 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG dbcounter [-] [118860] Writing DB stats nova_api:SELECT=2 {{(pid=118860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:38:01.851072 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG dbcounter [-] [118860] Writing DB stats nova_cell1:SELECT=2 {{(pid=118860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:38:01.868002 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-7614081b-7237-42b0-bd2e-a2354598c137 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:38:01.871046 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-7614081b-7237-42b0-bd2e-a2354598c137 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: 29a22e50-5767-4eed-955c-d06e5436df4d] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:38:01.882300 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7614081b-7237-42b0-bd2e-a2354598c137 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:38:01.885913 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7614081b-7237-42b0-bd2e-a2354598c137 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:38:01.887931 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7614081b-7237-42b0-bd2e-a2354598c137 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:38:01.888902 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7614081b-7237-42b0-bd2e-a2354598c137 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:38:01.892561 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7614081b-7237-42b0-bd2e-a2354598c137 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:38:01.893269 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7614081b-7237-42b0-bd2e-a2354598c137 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:38:01.972542 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-7614081b-7237-42b0-bd2e-a2354598c137 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/29a22e50-5767-4eed-955c-d06e5436df4d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.124495 Oct 20 06:38:01.973934 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1288/2566] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:38:01 2022] GET /compute/v2.1/servers/29a22e50-5767-4eed-955c-d06e5436df4d/os-volume_attachments => generated 197 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:38:02.988069 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-fd2e3824-049a-45cd-86fb-2e3c20126301 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:38:02.991159 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-fd2e3824-049a-45cd-86fb-2e3c20126301 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: 29a22e50-5767-4eed-955c-d06e5436df4d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:38:03.013135 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-fd2e3824-049a-45cd-86fb-2e3c20126301 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:38:03.013830 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-fd2e3824-049a-45cd-86fb-2e3c20126301 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:38:03.016160 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-fd2e3824-049a-45cd-86fb-2e3c20126301 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:38:03.017339 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-fd2e3824-049a-45cd-86fb-2e3c20126301 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:38:03.020940 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-fd2e3824-049a-45cd-86fb-2e3c20126301 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:38:03.021598 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-fd2e3824-049a-45cd-86fb-2e3c20126301 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:38:03.089894 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-fd2e3824-049a-45cd-86fb-2e3c20126301 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/29a22e50-5767-4eed-955c-d06e5436df4d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.106980 Oct 20 06:38:03.096363 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1279/2567] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:38:02 2022] GET /compute/v2.1/servers/29a22e50-5767-4eed-955c-d06e5436df4d/os-volume_attachments => generated 197 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:38:04.102297 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-a6900090-5278-456c-af33-1950a6812973 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:38:04.105475 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-a6900090-5278-456c-af33-1950a6812973 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: 29a22e50-5767-4eed-955c-d06e5436df4d] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:38:04.116830 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a6900090-5278-456c-af33-1950a6812973 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:38:04.120438 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a6900090-5278-456c-af33-1950a6812973 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:38:04.120861 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a6900090-5278-456c-af33-1950a6812973 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:38:04.121599 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a6900090-5278-456c-af33-1950a6812973 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:38:04.123272 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a6900090-5278-456c-af33-1950a6812973 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:38:04.123944 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a6900090-5278-456c-af33-1950a6812973 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:38:04.189104 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-a6900090-5278-456c-af33-1950a6812973 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/29a22e50-5767-4eed-955c-d06e5436df4d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.090518 Oct 20 06:38:04.189707 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1289/2568] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:38:04 2022] GET /compute/v2.1/servers/29a22e50-5767-4eed-955c-d06e5436df4d/os-volume_attachments => generated 25 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 20 06:38:04.292271 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-37be3bd8-647a-420a-aefb-234f4b827ddf tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:38:04.292850 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-37be3bd8-647a-420a-aefb-234f4b827ddf tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: 29a22e50-5767-4eed-955c-d06e5436df4d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:38:04.316423 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-37be3bd8-647a-420a-aefb-234f4b827ddf tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:38:04.316945 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-37be3bd8-647a-420a-aefb-234f4b827ddf tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:38:04.317390 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-37be3bd8-647a-420a-aefb-234f4b827ddf tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:38:04.318099 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-37be3bd8-647a-420a-aefb-234f4b827ddf tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:38:04.318597 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-37be3bd8-647a-420a-aefb-234f4b827ddf tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:38:04.319027 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-37be3bd8-647a-420a-aefb-234f4b827ddf tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:38:04.347796 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-37be3bd8-647a-420a-aefb-234f4b827ddf tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: 29a22e50-5767-4eed-955c-d06e5436df4d] Going to try to terminate instance {{(pid=118861) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 20 06:38:04.449240 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-37be3bd8-647a-420a-aefb-234f4b827ddf tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "DELETE /compute/v2.1/servers/29a22e50-5767-4eed-955c-d06e5436df4d" status: 204 len: 0 microversion: 2.1 time: 0.164559 Oct 20 06:38:04.450219 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1280/2569] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 20 06:38:04 2022] DELETE /compute/v2.1/servers/29a22e50-5767-4eed-955c-d06e5436df4d => generated 0 bytes in 167 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 20 06:38:04.459664 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-734a86b9-500e-4e65-a44c-6554d91462f6 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:38:04.460485 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-734a86b9-500e-4e65-a44c-6554d91462f6 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: 29a22e50-5767-4eed-955c-d06e5436df4d] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:38:04.467883 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-734a86b9-500e-4e65-a44c-6554d91462f6 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:38:04.468380 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-734a86b9-500e-4e65-a44c-6554d91462f6 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:38:04.468875 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-734a86b9-500e-4e65-a44c-6554d91462f6 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:38:04.469762 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-734a86b9-500e-4e65-a44c-6554d91462f6 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:38:04.470668 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-734a86b9-500e-4e65-a44c-6554d91462f6 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:38:04.471388 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-734a86b9-500e-4e65-a44c-6554d91462f6 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:38:04.674666 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-734a86b9-500e-4e65-a44c-6554d91462f6 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:38:04.684067 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-734a86b9-500e-4e65-a44c-6554d91462f6 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/29a22e50-5767-4eed-955c-d06e5436df4d" status: 200 len: 1681 microversion: 2.1 time: 0.229135 Oct 20 06:38:04.685531 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1290/2570] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:38:04 2022] GET /compute/v2.1/servers/29a22e50-5767-4eed-955c-d06e5436df4d => generated 1681 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 06:38:05.711809 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-8ccb2735-9378-457a-9c83-c36c897f02e7 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:38:05.712762 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-8ccb2735-9378-457a-9c83-c36c897f02e7 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: 29a22e50-5767-4eed-955c-d06e5436df4d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:38:05.726295 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-8ccb2735-9378-457a-9c83-c36c897f02e7 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:38:05.732034 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-8ccb2735-9378-457a-9c83-c36c897f02e7 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:38:05.732810 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-8ccb2735-9378-457a-9c83-c36c897f02e7 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:38:05.734038 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-8ccb2735-9378-457a-9c83-c36c897f02e7 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:38:05.734660 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-8ccb2735-9378-457a-9c83-c36c897f02e7 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:38:05.737721 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-8ccb2735-9378-457a-9c83-c36c897f02e7 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:38:06.064080 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-8ccb2735-9378-457a-9c83-c36c897f02e7 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:38:06.074669 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-8ccb2735-9378-457a-9c83-c36c897f02e7 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/29a22e50-5767-4eed-955c-d06e5436df4d" status: 200 len: 1681 microversion: 2.1 time: 0.367166 Oct 20 06:38:06.078087 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1281/2571] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:38:05 2022] GET /compute/v2.1/servers/29a22e50-5767-4eed-955c-d06e5436df4d => generated 1681 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:38:07.106865 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-391fa7d5-31e4-4b23-a300-5f7bc6b5043c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:38:07.109120 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-391fa7d5-31e4-4b23-a300-5f7bc6b5043c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: 29a22e50-5767-4eed-955c-d06e5436df4d] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:38:07.134084 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-391fa7d5-31e4-4b23-a300-5f7bc6b5043c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:38:07.136310 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-391fa7d5-31e4-4b23-a300-5f7bc6b5043c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:38:07.138183 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-391fa7d5-31e4-4b23-a300-5f7bc6b5043c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:38:07.140242 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-391fa7d5-31e4-4b23-a300-5f7bc6b5043c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:38:07.141617 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-391fa7d5-31e4-4b23-a300-5f7bc6b5043c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:38:07.143621 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-391fa7d5-31e4-4b23-a300-5f7bc6b5043c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:38:07.495703 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-391fa7d5-31e4-4b23-a300-5f7bc6b5043c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:38:07.515845 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-391fa7d5-31e4-4b23-a300-5f7bc6b5043c tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/29a22e50-5767-4eed-955c-d06e5436df4d" status: 200 len: 1614 microversion: 2.1 time: 0.418734 Oct 20 06:38:07.517912 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1291/2572] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:38:07 2022] GET /compute/v2.1/servers/29a22e50-5767-4eed-955c-d06e5436df4d => generated 1614 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:38:08.033593 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [req-fb82d979-3cf7-43c9-aef9-940771a0f226 req-c25f038f-1954-44d6-8890-11567f83c2c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29a22e50-5767-4eed-955c-d06e5436df4d", "name": "network-vif-deleted", "tag": "f26a241d-a18b-4b4f-9744-d295e1c02366"}]} {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 06:38:08.055117 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [req-fb82d979-3cf7-43c9-aef9-940771a0f226 req-c25f038f-1954-44d6-8890-11567f83c2c3 service nova] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:38:08.058368 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [req-fb82d979-3cf7-43c9-aef9-940771a0f226 req-c25f038f-1954-44d6-8890-11567f83c2c3 service nova] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:38:08.059286 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [req-fb82d979-3cf7-43c9-aef9-940771a0f226 req-c25f038f-1954-44d6-8890-11567f83c2c3 service nova] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:38:08.123904 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.compute.server_external_events [req-fb82d979-3cf7-43c9-aef9-940771a0f226 req-c25f038f-1954-44d6-8890-11567f83c2c3 service nova] Creating event network-vif-deleted:f26a241d-a18b-4b4f-9744-d295e1c02366 for instance 29a22e50-5767-4eed-955c-d06e5436df4d on hv-cinder-86156 Oct 20 06:38:08.154997 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [req-fb82d979-3cf7-43c9-aef9-940771a0f226 req-c25f038f-1954-44d6-8890-11567f83c2c3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.149935 Oct 20 06:38:08.176103 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1282/2573] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 20 06:38:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 20 06:38:08.549070 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-144afa38-07b0-41d0-9f1a-cf5bf3ec0cf5 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:38:08.549704 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-144afa38-07b0-41d0-9f1a-cf5bf3ec0cf5 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: 29a22e50-5767-4eed-955c-d06e5436df4d] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:38:08.594314 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-144afa38-07b0-41d0-9f1a-cf5bf3ec0cf5 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:38:08.598165 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-144afa38-07b0-41d0-9f1a-cf5bf3ec0cf5 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:38:08.598826 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-144afa38-07b0-41d0-9f1a-cf5bf3ec0cf5 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:38:08.599990 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-144afa38-07b0-41d0-9f1a-cf5bf3ec0cf5 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:38:08.600791 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-144afa38-07b0-41d0-9f1a-cf5bf3ec0cf5 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:38:08.601432 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-144afa38-07b0-41d0-9f1a-cf5bf3ec0cf5 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:38:08.730503 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-144afa38-07b0-41d0-9f1a-cf5bf3ec0cf5 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:38:08.734288 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-144afa38-07b0-41d0-9f1a-cf5bf3ec0cf5 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:38:08.735739 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-144afa38-07b0-41d0-9f1a-cf5bf3ec0cf5 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:38:08.736497 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.objects.instance [None req-144afa38-07b0-41d0-9f1a-cf5bf3ec0cf5 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lazy-loading 'fault' on Instance uuid 29a22e50-5767-4eed-955c-d06e5436df4d {{(pid=118860) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 20 06:38:08.858233 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-144afa38-07b0-41d0-9f1a-cf5bf3ec0cf5 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6be23065c643939055a3de375187d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b90087118fe040389f291d846461c0a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:38:08.871267 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-144afa38-07b0-41d0-9f1a-cf5bf3ec0cf5 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/29a22e50-5767-4eed-955c-d06e5436df4d" status: 200 len: 1331 microversion: 2.1 time: 0.331010 Oct 20 06:38:08.873750 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1292/2574] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:38:08 2022] GET /compute/v2.1/servers/29a22e50-5767-4eed-955c-d06e5436df4d => generated 1331 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:38:09.898574 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-06f80603-8074-4cd5-98f6-1ff31b7f3e3d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:38:09.902195 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-06f80603-8074-4cd5-98f6-1ff31b7f3e3d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: 29a22e50-5767-4eed-955c-d06e5436df4d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:38:09.914439 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-06f80603-8074-4cd5-98f6-1ff31b7f3e3d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:38:09.916911 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-06f80603-8074-4cd5-98f6-1ff31b7f3e3d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:38:09.917536 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-06f80603-8074-4cd5-98f6-1ff31b7f3e3d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:38:09.921820 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-06f80603-8074-4cd5-98f6-1ff31b7f3e3d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:38:09.922493 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-06f80603-8074-4cd5-98f6-1ff31b7f3e3d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:38:09.923341 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-06f80603-8074-4cd5-98f6-1ff31b7f3e3d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:38:09.965941 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.wsgi [None req-06f80603-8074-4cd5-98f6-1ff31b7f3e3d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] HTTP exception thrown: Instance 29a22e50-5767-4eed-955c-d06e5436df4d could not be found. Oct 20 06:38:09.967763 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-06f80603-8074-4cd5-98f6-1ff31b7f3e3d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Request method failure captured: Oct 20 06:38:09.967763 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: request: GET /compute/v2.1/servers/29a22e50-5767-4eed-955c-d06e5436df4d HTTP/1.1 Oct 20 06:38:09.967763 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: Accept: application/json Oct 20 06:38:09.967763 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: Accept-Encoding: identity Oct 20 06:38:09.967763 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: Connection: close Oct 20 06:38:09.967763 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: Content-Length: 0 Oct 20 06:38:09.967763 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: Content-Type: application/json Oct 20 06:38:09.967763 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: Host: 10.222.0.20 Oct 20 06:38:09.967763 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: Openstack-System-Scope: None Oct 20 06:38:09.967763 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: User-Agent: python-urllib3/1.26.12 Oct 20 06:38:09.967763 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Auth-Token: gAAAAABjUOTwMaxd25vy00-4oHbEqr1c9uD0B3sBZ9MAdUaT4nUKyQqgu2h768xAiNalZc89J9ijH_fe0UIBbKxoYtfSVrasjyy2mvwwjVbv-SkvU3sz2HoGnLJESeVi8iC7ILXfpH5FGWeNjpUJsWoV8PgeWEWJ-eQs7SGcBSSwmqYY25H6IKc Oct 20 06:38:09.967763 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Domain-Id: None Oct 20 06:38:09.967763 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Domain-Name: None Oct 20 06:38:09.967763 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Identity-Status: Confirmed Oct 20 06:38:09.967763 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Is-Admin-Project: True Oct 20 06:38:09.967763 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Project-Domain-Id: default Oct 20 06:38:09.967763 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Project-Domain-Name: Default Oct 20 06:38:09.967763 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Project-Id: b90087118fe040389f291d846461c0a7 Oct 20 06:38:09.967763 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Project-Name: tempest-AttachVolumeNegativeTest-617663425 Oct 20 06:38:09.967763 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Role: reader,member Oct 20 06:38:09.967763 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Roles: reader,member Oct 20 06:38:09.968978 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b90087118fe040389f291d846461c0a7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b90087118fe040389f291d846461c0a7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b90087118fe040389f291d846461c0a7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b90087118fe040389f291d846461c0a7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 20 06:38:09.968978 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Tenant: tempest-AttachVolumeNegativeTest-617663425 Oct 20 06:38:09.968978 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Tenant-Id: b90087118fe040389f291d846461c0a7 Oct 20 06:38:09.968978 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-617663425 Oct 20 06:38:09.968978 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-User: tempest-AttachVolumeNegativeTest-617663425-project Oct 20 06:38:09.968978 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-User-Domain-Id: default Oct 20 06:38:09.968978 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-User-Domain-Name: Default Oct 20 06:38:09.968978 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-User-Id: 2c6be23065c643939055a3de375187d5 Oct 20 06:38:09.968978 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-User-Name: tempest-AttachVolumeNegativeTest-617663425-project Oct 20 06:38:09.968978 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: method: > Oct 20 06:38:09.968978 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: exception: Instance 29a22e50-5767-4eed-955c-d06e5436df4d could not be found. Oct 20 06:38:09.968978 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: action_args: {'id': '29a22e50-5767-4eed-955c-d06e5436df4d'} Oct 20 06:38:09.969626 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 20 06:38:09.969626 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 06:38:09.969626 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 20 06:38:09.969626 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 20 06:38:09.969626 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 20 06:38:09.969626 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 20 06:38:09.969626 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 20 06:38:09.969626 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 20 06:38:09.969626 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 20 06:38:09.969626 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 20 06:38:09.969626 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 29a22e50-5767-4eed-955c-d06e5436df4d could not be found. Oct 20 06:38:09.969626 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi Oct 20 06:38:09.969626 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 06:38:09.969626 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi Oct 20 06:38:09.969626 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 06:38:09.969626 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 06:38:09.969626 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 06:38:09.969626 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 20 06:38:09.969626 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 20 06:38:09.969626 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 20 06:38:09.970662 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 20 06:38:09.970662 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 20 06:38:09.970662 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 20 06:38:09.970662 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 20 06:38:09.970662 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 20 06:38:09.970662 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 20 06:38:09.970662 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 20 06:38:09.970662 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 29a22e50-5767-4eed-955c-d06e5436df4d could not be found. Oct 20 06:38:09.970662 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi Oct 20 06:38:09.970662 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 06:38:09.970662 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi Oct 20 06:38:09.970662 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 06:38:09.970662 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 06:38:09.970662 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 06:38:09.970662 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 20 06:38:09.970662 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 20 06:38:09.970662 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 29a22e50-5767-4eed-955c-d06e5436df4d could not be found. Oct 20 06:38:09.970662 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi Oct 20 06:38:09.971578 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-06f80603-8074-4cd5-98f6-1ff31b7f3e3d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Returning 404 to user: Instance 29a22e50-5767-4eed-955c-d06e5436df4d could not be found. {{(pid=118861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 20 06:38:09.971578 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-06f80603-8074-4cd5-98f6-1ff31b7f3e3d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/29a22e50-5767-4eed-955c-d06e5436df4d" status: 404 len: 111 microversion: 2.1 time: 0.075861 Oct 20 06:38:09.971578 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1283/2575] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:38:09 2022] GET /compute/v2.1/servers/29a22e50-5767-4eed-955c-d06e5436df4d => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 20 06:38:09.979558 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-9dd9dbda-2358-4c7a-ad04-0871a586326d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '.version_select at 0x7fbe4e325ca0>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:38:10.058399 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-9dd9dbda-2358-4c7a-ad04-0871a586326d tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1111713367" status: 202 len: 0 microversion: 2.1 time: 0.083926 Oct 20 06:38:10.059725 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1293/2576] 10.222.0.20 () {58 vars in 1221 bytes} [Thu Oct 20 06:38:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1111713367 => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 20 06:38:12.604768 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-e684e9ab-0655-47cd-a7b8-984f95dabae8 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:38:12.605930 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-e684e9ab-0655-47cd-a7b8-984f95dabae8 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: 29a22e50-5767-4eed-955c-d06e5436df4d] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:38:12.616901 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e684e9ab-0655-47cd-a7b8-984f95dabae8 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:38:12.618185 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e684e9ab-0655-47cd-a7b8-984f95dabae8 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:38:12.618623 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e684e9ab-0655-47cd-a7b8-984f95dabae8 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:38:12.622472 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e684e9ab-0655-47cd-a7b8-984f95dabae8 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:38:12.623108 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e684e9ab-0655-47cd-a7b8-984f95dabae8 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:38:12.623998 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e684e9ab-0655-47cd-a7b8-984f95dabae8 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:38:12.659917 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.wsgi [None req-e684e9ab-0655-47cd-a7b8-984f95dabae8 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] HTTP exception thrown: Instance 29a22e50-5767-4eed-955c-d06e5436df4d could not be found. Oct 20 06:38:12.661564 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-e684e9ab-0655-47cd-a7b8-984f95dabae8 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Request method failure captured: Oct 20 06:38:12.661564 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: request: DELETE /compute/v2.1/servers/29a22e50-5767-4eed-955c-d06e5436df4d HTTP/1.1 Oct 20 06:38:12.661564 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: Accept: application/json Oct 20 06:38:12.661564 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: Accept-Encoding: identity Oct 20 06:38:12.661564 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: Connection: close Oct 20 06:38:12.661564 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: Content-Length: 0 Oct 20 06:38:12.661564 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: Content-Type: application/json Oct 20 06:38:12.661564 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: Host: 10.222.0.20 Oct 20 06:38:12.661564 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: Openstack-System-Scope: None Oct 20 06:38:12.661564 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: User-Agent: python-urllib3/1.26.12 Oct 20 06:38:12.661564 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Auth-Token: gAAAAABjUOTwMaxd25vy00-4oHbEqr1c9uD0B3sBZ9MAdUaT4nUKyQqgu2h768xAiNalZc89J9ijH_fe0UIBbKxoYtfSVrasjyy2mvwwjVbv-SkvU3sz2HoGnLJESeVi8iC7ILXfpH5FGWeNjpUJsWoV8PgeWEWJ-eQs7SGcBSSwmqYY25H6IKc Oct 20 06:38:12.661564 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Domain-Id: None Oct 20 06:38:12.661564 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Domain-Name: None Oct 20 06:38:12.661564 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Identity-Status: Confirmed Oct 20 06:38:12.661564 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Is-Admin-Project: True Oct 20 06:38:12.661564 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Project-Domain-Id: default Oct 20 06:38:12.661564 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Project-Domain-Name: Default Oct 20 06:38:12.661564 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Project-Id: b90087118fe040389f291d846461c0a7 Oct 20 06:38:12.661564 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Project-Name: tempest-AttachVolumeNegativeTest-617663425 Oct 20 06:38:12.661564 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Role: reader,member Oct 20 06:38:12.661564 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Roles: reader,member Oct 20 06:38:12.663043 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b90087118fe040389f291d846461c0a7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b90087118fe040389f291d846461c0a7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b90087118fe040389f291d846461c0a7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b90087118fe040389f291d846461c0a7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 20 06:38:12.663043 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Tenant: tempest-AttachVolumeNegativeTest-617663425 Oct 20 06:38:12.663043 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Tenant-Id: b90087118fe040389f291d846461c0a7 Oct 20 06:38:12.663043 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-617663425 Oct 20 06:38:12.663043 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-User: tempest-AttachVolumeNegativeTest-617663425-project Oct 20 06:38:12.663043 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-User-Domain-Id: default Oct 20 06:38:12.663043 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-User-Domain-Name: Default Oct 20 06:38:12.663043 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-User-Id: 2c6be23065c643939055a3de375187d5 Oct 20 06:38:12.663043 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-User-Name: tempest-AttachVolumeNegativeTest-617663425-project Oct 20 06:38:12.663043 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: method: > Oct 20 06:38:12.663043 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: exception: Instance 29a22e50-5767-4eed-955c-d06e5436df4d could not be found. Oct 20 06:38:12.663043 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: action_args: {'id': '29a22e50-5767-4eed-955c-d06e5436df4d'} Oct 20 06:38:12.663736 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 20 06:38:12.663736 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 06:38:12.663736 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 20 06:38:12.663736 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 20 06:38:12.663736 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 20 06:38:12.663736 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 20 06:38:12.663736 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 20 06:38:12.663736 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 20 06:38:12.663736 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 20 06:38:12.663736 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 20 06:38:12.663736 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 29a22e50-5767-4eed-955c-d06e5436df4d could not be found. Oct 20 06:38:12.663736 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi Oct 20 06:38:12.663736 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 06:38:12.663736 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi Oct 20 06:38:12.663736 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 06:38:12.663736 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 06:38:12.663736 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 06:38:12.663736 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 20 06:38:12.663736 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 20 06:38:12.663736 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 20 06:38:12.664980 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 20 06:38:12.664980 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 20 06:38:12.664980 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 20 06:38:12.664980 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 20 06:38:12.664980 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 20 06:38:12.664980 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 20 06:38:12.664980 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 20 06:38:12.664980 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 20 06:38:12.664980 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 20 06:38:12.664980 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 29a22e50-5767-4eed-955c-d06e5436df4d could not be found. Oct 20 06:38:12.664980 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi Oct 20 06:38:12.664980 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 06:38:12.664980 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi Oct 20 06:38:12.664980 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 06:38:12.664980 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 06:38:12.664980 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 06:38:12.664980 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 20 06:38:12.664980 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 20 06:38:12.664980 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 29a22e50-5767-4eed-955c-d06e5436df4d could not be found. Oct 20 06:38:12.664980 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi Oct 20 06:38:12.666125 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-e684e9ab-0655-47cd-a7b8-984f95dabae8 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Returning 404 to user: Instance 29a22e50-5767-4eed-955c-d06e5436df4d could not be found. {{(pid=118861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 20 06:38:12.668109 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-e684e9ab-0655-47cd-a7b8-984f95dabae8 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "DELETE /compute/v2.1/servers/29a22e50-5767-4eed-955c-d06e5436df4d" status: 404 len: 111 microversion: 2.1 time: 0.063473 Oct 20 06:38:12.670698 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1284/2577] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 20 06:38:12 2022] DELETE /compute/v2.1/servers/29a22e50-5767-4eed-955c-d06e5436df4d => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 20 06:38:12.679920 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-09f0e7e5-b96a-4713-9ce1-bddc2c74da4a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:38:12.681814 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-09f0e7e5-b96a-4713-9ce1-bddc2c74da4a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: 29a22e50-5767-4eed-955c-d06e5436df4d] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:38:12.695944 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-09f0e7e5-b96a-4713-9ce1-bddc2c74da4a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:38:12.696449 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-09f0e7e5-b96a-4713-9ce1-bddc2c74da4a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:38:12.697098 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-09f0e7e5-b96a-4713-9ce1-bddc2c74da4a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:38:12.697618 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-09f0e7e5-b96a-4713-9ce1-bddc2c74da4a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:38:12.698075 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-09f0e7e5-b96a-4713-9ce1-bddc2c74da4a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:38:12.701338 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-09f0e7e5-b96a-4713-9ce1-bddc2c74da4a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:38:12.722942 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.wsgi [None req-09f0e7e5-b96a-4713-9ce1-bddc2c74da4a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] HTTP exception thrown: Instance 29a22e50-5767-4eed-955c-d06e5436df4d could not be found. Oct 20 06:38:12.725471 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-09f0e7e5-b96a-4713-9ce1-bddc2c74da4a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Request method failure captured: Oct 20 06:38:12.725471 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: request: GET /compute/v2.1/servers/29a22e50-5767-4eed-955c-d06e5436df4d HTTP/1.1 Oct 20 06:38:12.725471 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: Accept: application/json Oct 20 06:38:12.725471 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: Accept-Encoding: identity Oct 20 06:38:12.725471 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: Connection: close Oct 20 06:38:12.725471 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: Content-Length: 0 Oct 20 06:38:12.725471 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: Content-Type: application/json Oct 20 06:38:12.725471 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: Host: 10.222.0.20 Oct 20 06:38:12.725471 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: Openstack-System-Scope: None Oct 20 06:38:12.725471 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: User-Agent: python-urllib3/1.26.12 Oct 20 06:38:12.725471 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Auth-Token: gAAAAABjUOTwMaxd25vy00-4oHbEqr1c9uD0B3sBZ9MAdUaT4nUKyQqgu2h768xAiNalZc89J9ijH_fe0UIBbKxoYtfSVrasjyy2mvwwjVbv-SkvU3sz2HoGnLJESeVi8iC7ILXfpH5FGWeNjpUJsWoV8PgeWEWJ-eQs7SGcBSSwmqYY25H6IKc Oct 20 06:38:12.725471 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Domain-Id: None Oct 20 06:38:12.725471 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Domain-Name: None Oct 20 06:38:12.725471 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Identity-Status: Confirmed Oct 20 06:38:12.725471 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Is-Admin-Project: True Oct 20 06:38:12.725471 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Project-Domain-Id: default Oct 20 06:38:12.725471 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Project-Domain-Name: Default Oct 20 06:38:12.725471 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Project-Id: b90087118fe040389f291d846461c0a7 Oct 20 06:38:12.725471 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Project-Name: tempest-AttachVolumeNegativeTest-617663425 Oct 20 06:38:12.725471 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Role: reader,member Oct 20 06:38:12.725471 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Roles: reader,member Oct 20 06:38:12.726739 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b90087118fe040389f291d846461c0a7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b90087118fe040389f291d846461c0a7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b90087118fe040389f291d846461c0a7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b90087118fe040389f291d846461c0a7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 20 06:38:12.726739 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Tenant: tempest-AttachVolumeNegativeTest-617663425 Oct 20 06:38:12.726739 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Tenant-Id: b90087118fe040389f291d846461c0a7 Oct 20 06:38:12.726739 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-617663425 Oct 20 06:38:12.726739 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-User: tempest-AttachVolumeNegativeTest-617663425-project Oct 20 06:38:12.726739 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-User-Domain-Id: default Oct 20 06:38:12.726739 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-User-Domain-Name: Default Oct 20 06:38:12.726739 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-User-Id: 2c6be23065c643939055a3de375187d5 Oct 20 06:38:12.726739 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-User-Name: tempest-AttachVolumeNegativeTest-617663425-project Oct 20 06:38:12.726739 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: method: > Oct 20 06:38:12.726739 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: exception: Instance 29a22e50-5767-4eed-955c-d06e5436df4d could not be found. Oct 20 06:38:12.726739 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: action_args: {'id': '29a22e50-5767-4eed-955c-d06e5436df4d'} Oct 20 06:38:12.728270 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 20 06:38:12.728270 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 06:38:12.728270 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 20 06:38:12.728270 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 20 06:38:12.728270 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 20 06:38:12.728270 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 20 06:38:12.728270 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 20 06:38:12.728270 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 20 06:38:12.728270 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 20 06:38:12.728270 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 20 06:38:12.728270 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 29a22e50-5767-4eed-955c-d06e5436df4d could not be found. Oct 20 06:38:12.728270 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi Oct 20 06:38:12.728270 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 06:38:12.728270 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi Oct 20 06:38:12.728270 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 06:38:12.728270 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 06:38:12.728270 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 06:38:12.728270 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 20 06:38:12.728270 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 20 06:38:12.728270 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 20 06:38:12.729751 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 20 06:38:12.729751 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 20 06:38:12.729751 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 20 06:38:12.729751 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 20 06:38:12.729751 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 20 06:38:12.729751 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 20 06:38:12.729751 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 20 06:38:12.729751 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 29a22e50-5767-4eed-955c-d06e5436df4d could not be found. Oct 20 06:38:12.729751 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi Oct 20 06:38:12.729751 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 06:38:12.729751 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi Oct 20 06:38:12.729751 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 06:38:12.729751 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 06:38:12.729751 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 06:38:12.729751 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 20 06:38:12.729751 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 20 06:38:12.729751 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 29a22e50-5767-4eed-955c-d06e5436df4d could not be found. Oct 20 06:38:12.729751 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi Oct 20 06:38:12.731939 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-09f0e7e5-b96a-4713-9ce1-bddc2c74da4a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Returning 404 to user: Instance 29a22e50-5767-4eed-955c-d06e5436df4d could not be found. {{(pid=118860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 20 06:38:12.735527 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-09f0e7e5-b96a-4713-9ce1-bddc2c74da4a tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/29a22e50-5767-4eed-955c-d06e5436df4d" status: 404 len: 111 microversion: 2.1 time: 0.058232 Oct 20 06:38:12.739723 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1294/2578] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:38:12 2022] GET /compute/v2.1/servers/29a22e50-5767-4eed-955c-d06e5436df4d => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 20 06:38:13.982043 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-ad1e0839-3991-4133-95a3-e94bb3d59cd8 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:38:13.982608 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-ad1e0839-3991-4133-95a3-e94bb3d59cd8 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: 52c09583-1827-45d5-ac39-7d02ea4b658a] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:38:13.996687 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ad1e0839-3991-4133-95a3-e94bb3d59cd8 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:38:13.997223 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ad1e0839-3991-4133-95a3-e94bb3d59cd8 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:38:13.997670 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ad1e0839-3991-4133-95a3-e94bb3d59cd8 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:38:13.998391 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ad1e0839-3991-4133-95a3-e94bb3d59cd8 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:38:14.005003 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ad1e0839-3991-4133-95a3-e94bb3d59cd8 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:38:14.005994 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ad1e0839-3991-4133-95a3-e94bb3d59cd8 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:38:14.037275 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.wsgi [None req-ad1e0839-3991-4133-95a3-e94bb3d59cd8 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] HTTP exception thrown: Instance 52c09583-1827-45d5-ac39-7d02ea4b658a could not be found. Oct 20 06:38:14.042344 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-ad1e0839-3991-4133-95a3-e94bb3d59cd8 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Request method failure captured: Oct 20 06:38:14.042344 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: request: DELETE /compute/v2.1/servers/52c09583-1827-45d5-ac39-7d02ea4b658a HTTP/1.1 Oct 20 06:38:14.042344 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: Accept: application/json Oct 20 06:38:14.042344 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: Accept-Encoding: identity Oct 20 06:38:14.042344 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: Connection: close Oct 20 06:38:14.042344 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: Content-Length: 0 Oct 20 06:38:14.042344 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: Content-Type: application/json Oct 20 06:38:14.042344 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: Host: 10.222.0.20 Oct 20 06:38:14.042344 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: Openstack-System-Scope: None Oct 20 06:38:14.042344 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: User-Agent: python-urllib3/1.26.12 Oct 20 06:38:14.042344 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Auth-Token: gAAAAABjUOTwMaxd25vy00-4oHbEqr1c9uD0B3sBZ9MAdUaT4nUKyQqgu2h768xAiNalZc89J9ijH_fe0UIBbKxoYtfSVrasjyy2mvwwjVbv-SkvU3sz2HoGnLJESeVi8iC7ILXfpH5FGWeNjpUJsWoV8PgeWEWJ-eQs7SGcBSSwmqYY25H6IKc Oct 20 06:38:14.042344 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Domain-Id: None Oct 20 06:38:14.042344 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Domain-Name: None Oct 20 06:38:14.042344 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Identity-Status: Confirmed Oct 20 06:38:14.042344 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Is-Admin-Project: True Oct 20 06:38:14.042344 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Project-Domain-Id: default Oct 20 06:38:14.042344 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Project-Domain-Name: Default Oct 20 06:38:14.042344 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Project-Id: b90087118fe040389f291d846461c0a7 Oct 20 06:38:14.042344 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Project-Name: tempest-AttachVolumeNegativeTest-617663425 Oct 20 06:38:14.042344 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Role: reader,member Oct 20 06:38:14.042344 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Roles: reader,member Oct 20 06:38:14.043597 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b90087118fe040389f291d846461c0a7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b90087118fe040389f291d846461c0a7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b90087118fe040389f291d846461c0a7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b90087118fe040389f291d846461c0a7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 20 06:38:14.043597 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Tenant: tempest-AttachVolumeNegativeTest-617663425 Oct 20 06:38:14.043597 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Tenant-Id: b90087118fe040389f291d846461c0a7 Oct 20 06:38:14.043597 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-617663425 Oct 20 06:38:14.043597 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-User: tempest-AttachVolumeNegativeTest-617663425-project Oct 20 06:38:14.043597 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-User-Domain-Id: default Oct 20 06:38:14.043597 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-User-Domain-Name: Default Oct 20 06:38:14.043597 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-User-Id: 2c6be23065c643939055a3de375187d5 Oct 20 06:38:14.043597 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-User-Name: tempest-AttachVolumeNegativeTest-617663425-project Oct 20 06:38:14.043597 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: method: > Oct 20 06:38:14.043597 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: exception: Instance 52c09583-1827-45d5-ac39-7d02ea4b658a could not be found. Oct 20 06:38:14.043597 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: action_args: {'id': '52c09583-1827-45d5-ac39-7d02ea4b658a'} Oct 20 06:38:14.044433 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 20 06:38:14.044433 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 06:38:14.044433 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 20 06:38:14.044433 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 20 06:38:14.044433 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 20 06:38:14.044433 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 20 06:38:14.044433 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 20 06:38:14.044433 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 20 06:38:14.044433 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 20 06:38:14.044433 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 20 06:38:14.044433 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 52c09583-1827-45d5-ac39-7d02ea4b658a could not be found. Oct 20 06:38:14.044433 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi Oct 20 06:38:14.044433 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 06:38:14.044433 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi Oct 20 06:38:14.044433 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 06:38:14.044433 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 06:38:14.044433 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 06:38:14.044433 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 20 06:38:14.044433 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 20 06:38:14.044433 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 20 06:38:14.045461 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 20 06:38:14.045461 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 20 06:38:14.045461 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 20 06:38:14.045461 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 20 06:38:14.045461 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 20 06:38:14.045461 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 20 06:38:14.045461 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 20 06:38:14.045461 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 20 06:38:14.045461 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 20 06:38:14.045461 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 52c09583-1827-45d5-ac39-7d02ea4b658a could not be found. Oct 20 06:38:14.045461 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi Oct 20 06:38:14.045461 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 06:38:14.045461 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi Oct 20 06:38:14.045461 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 06:38:14.045461 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 06:38:14.045461 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 06:38:14.045461 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 20 06:38:14.045461 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 20 06:38:14.045461 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 52c09583-1827-45d5-ac39-7d02ea4b658a could not be found. Oct 20 06:38:14.045461 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi Oct 20 06:38:14.049509 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-ad1e0839-3991-4133-95a3-e94bb3d59cd8 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Returning 404 to user: Instance 52c09583-1827-45d5-ac39-7d02ea4b658a could not be found. {{(pid=118861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 20 06:38:14.050589 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-ad1e0839-3991-4133-95a3-e94bb3d59cd8 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "DELETE /compute/v2.1/servers/52c09583-1827-45d5-ac39-7d02ea4b658a" status: 404 len: 111 microversion: 2.1 time: 0.072447 Oct 20 06:38:14.057559 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1285/2579] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 20 06:38:13 2022] DELETE /compute/v2.1/servers/52c09583-1827-45d5-ac39-7d02ea4b658a => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 20 06:38:14.061414 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-53d0323e-7fe9-4c30-89c9-b212b64c33e6 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:38:14.062282 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-53d0323e-7fe9-4c30-89c9-b212b64c33e6 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: 52c09583-1827-45d5-ac39-7d02ea4b658a] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:38:14.074841 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-53d0323e-7fe9-4c30-89c9-b212b64c33e6 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:38:14.081031 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-53d0323e-7fe9-4c30-89c9-b212b64c33e6 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:38:14.083144 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-53d0323e-7fe9-4c30-89c9-b212b64c33e6 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:38:14.088196 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-53d0323e-7fe9-4c30-89c9-b212b64c33e6 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:38:14.089879 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-53d0323e-7fe9-4c30-89c9-b212b64c33e6 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:38:14.091165 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-53d0323e-7fe9-4c30-89c9-b212b64c33e6 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:38:14.111256 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.wsgi [None req-53d0323e-7fe9-4c30-89c9-b212b64c33e6 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] HTTP exception thrown: Instance 52c09583-1827-45d5-ac39-7d02ea4b658a could not be found. Oct 20 06:38:14.113373 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-53d0323e-7fe9-4c30-89c9-b212b64c33e6 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Request method failure captured: Oct 20 06:38:14.113373 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: request: GET /compute/v2.1/servers/52c09583-1827-45d5-ac39-7d02ea4b658a HTTP/1.1 Oct 20 06:38:14.113373 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: Accept: application/json Oct 20 06:38:14.113373 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: Accept-Encoding: identity Oct 20 06:38:14.113373 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: Connection: close Oct 20 06:38:14.113373 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: Content-Length: 0 Oct 20 06:38:14.113373 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: Content-Type: application/json Oct 20 06:38:14.113373 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: Host: 10.222.0.20 Oct 20 06:38:14.113373 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: Openstack-System-Scope: None Oct 20 06:38:14.113373 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: User-Agent: python-urllib3/1.26.12 Oct 20 06:38:14.113373 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Auth-Token: gAAAAABjUOTwMaxd25vy00-4oHbEqr1c9uD0B3sBZ9MAdUaT4nUKyQqgu2h768xAiNalZc89J9ijH_fe0UIBbKxoYtfSVrasjyy2mvwwjVbv-SkvU3sz2HoGnLJESeVi8iC7ILXfpH5FGWeNjpUJsWoV8PgeWEWJ-eQs7SGcBSSwmqYY25H6IKc Oct 20 06:38:14.113373 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Domain-Id: None Oct 20 06:38:14.113373 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Domain-Name: None Oct 20 06:38:14.113373 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Identity-Status: Confirmed Oct 20 06:38:14.113373 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Is-Admin-Project: True Oct 20 06:38:14.113373 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Project-Domain-Id: default Oct 20 06:38:14.113373 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Project-Domain-Name: Default Oct 20 06:38:14.113373 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Project-Id: b90087118fe040389f291d846461c0a7 Oct 20 06:38:14.113373 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Project-Name: tempest-AttachVolumeNegativeTest-617663425 Oct 20 06:38:14.113373 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Role: reader,member Oct 20 06:38:14.113373 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Roles: reader,member Oct 20 06:38:14.114543 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b90087118fe040389f291d846461c0a7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b90087118fe040389f291d846461c0a7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b90087118fe040389f291d846461c0a7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b90087118fe040389f291d846461c0a7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 20 06:38:14.114543 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Tenant: tempest-AttachVolumeNegativeTest-617663425 Oct 20 06:38:14.114543 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Tenant-Id: b90087118fe040389f291d846461c0a7 Oct 20 06:38:14.114543 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-617663425 Oct 20 06:38:14.114543 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-User: tempest-AttachVolumeNegativeTest-617663425-project Oct 20 06:38:14.114543 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-User-Domain-Id: default Oct 20 06:38:14.114543 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-User-Domain-Name: Default Oct 20 06:38:14.114543 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-User-Id: 2c6be23065c643939055a3de375187d5 Oct 20 06:38:14.114543 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-User-Name: tempest-AttachVolumeNegativeTest-617663425-project Oct 20 06:38:14.114543 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: method: > Oct 20 06:38:14.114543 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: exception: Instance 52c09583-1827-45d5-ac39-7d02ea4b658a could not be found. Oct 20 06:38:14.114543 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: action_args: {'id': '52c09583-1827-45d5-ac39-7d02ea4b658a'} Oct 20 06:38:14.115184 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 20 06:38:14.115184 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 06:38:14.115184 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 20 06:38:14.115184 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 20 06:38:14.115184 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 20 06:38:14.115184 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 20 06:38:14.115184 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 20 06:38:14.115184 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 20 06:38:14.115184 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 20 06:38:14.115184 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 20 06:38:14.115184 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 52c09583-1827-45d5-ac39-7d02ea4b658a could not be found. Oct 20 06:38:14.115184 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi Oct 20 06:38:14.115184 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 06:38:14.115184 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi Oct 20 06:38:14.115184 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 06:38:14.115184 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 06:38:14.115184 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 06:38:14.115184 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 20 06:38:14.115184 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 20 06:38:14.115184 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 20 06:38:14.116491 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 20 06:38:14.116491 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 20 06:38:14.116491 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 20 06:38:14.116491 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 20 06:38:14.116491 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 20 06:38:14.116491 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 20 06:38:14.116491 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 20 06:38:14.116491 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 52c09583-1827-45d5-ac39-7d02ea4b658a could not be found. Oct 20 06:38:14.116491 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi Oct 20 06:38:14.116491 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 06:38:14.116491 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi Oct 20 06:38:14.116491 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 06:38:14.116491 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 06:38:14.116491 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 06:38:14.116491 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 20 06:38:14.116491 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 20 06:38:14.116491 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 52c09583-1827-45d5-ac39-7d02ea4b658a could not be found. Oct 20 06:38:14.116491 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi Oct 20 06:38:14.119526 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-53d0323e-7fe9-4c30-89c9-b212b64c33e6 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Returning 404 to user: Instance 52c09583-1827-45d5-ac39-7d02ea4b658a could not be found. {{(pid=118860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 20 06:38:14.121008 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-53d0323e-7fe9-4c30-89c9-b212b64c33e6 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/52c09583-1827-45d5-ac39-7d02ea4b658a" status: 404 len: 111 microversion: 2.1 time: 0.064302 Oct 20 06:38:14.127767 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1295/2580] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:38:14 2022] GET /compute/v2.1/servers/52c09583-1827-45d5-ac39-7d02ea4b658a => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 20 06:38:14.132601 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-24bf4584-e879-4380-9ab9-2564a3c30f62 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:38:14.133811 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-24bf4584-e879-4380-9ab9-2564a3c30f62 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: 5a669c5b-898f-4fef-8508-254ccd998571] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:38:14.144072 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-24bf4584-e879-4380-9ab9-2564a3c30f62 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:38:14.144585 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-24bf4584-e879-4380-9ab9-2564a3c30f62 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:38:14.147363 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-24bf4584-e879-4380-9ab9-2564a3c30f62 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:38:14.151356 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-24bf4584-e879-4380-9ab9-2564a3c30f62 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:38:14.152024 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-24bf4584-e879-4380-9ab9-2564a3c30f62 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:38:14.152485 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-24bf4584-e879-4380-9ab9-2564a3c30f62 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:38:14.176533 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.wsgi [None req-24bf4584-e879-4380-9ab9-2564a3c30f62 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] HTTP exception thrown: Instance 5a669c5b-898f-4fef-8508-254ccd998571 could not be found. Oct 20 06:38:14.178747 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-24bf4584-e879-4380-9ab9-2564a3c30f62 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Request method failure captured: Oct 20 06:38:14.178747 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: request: DELETE /compute/v2.1/servers/5a669c5b-898f-4fef-8508-254ccd998571 HTTP/1.1 Oct 20 06:38:14.178747 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: Accept: application/json Oct 20 06:38:14.178747 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: Accept-Encoding: identity Oct 20 06:38:14.178747 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: Connection: close Oct 20 06:38:14.178747 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: Content-Length: 0 Oct 20 06:38:14.178747 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: Content-Type: application/json Oct 20 06:38:14.178747 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: Host: 10.222.0.20 Oct 20 06:38:14.178747 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: Openstack-System-Scope: None Oct 20 06:38:14.178747 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: User-Agent: python-urllib3/1.26.12 Oct 20 06:38:14.178747 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Auth-Token: gAAAAABjUOTwMaxd25vy00-4oHbEqr1c9uD0B3sBZ9MAdUaT4nUKyQqgu2h768xAiNalZc89J9ijH_fe0UIBbKxoYtfSVrasjyy2mvwwjVbv-SkvU3sz2HoGnLJESeVi8iC7ILXfpH5FGWeNjpUJsWoV8PgeWEWJ-eQs7SGcBSSwmqYY25H6IKc Oct 20 06:38:14.178747 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Domain-Id: None Oct 20 06:38:14.178747 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Domain-Name: None Oct 20 06:38:14.178747 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Identity-Status: Confirmed Oct 20 06:38:14.178747 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Is-Admin-Project: True Oct 20 06:38:14.178747 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Project-Domain-Id: default Oct 20 06:38:14.178747 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Project-Domain-Name: Default Oct 20 06:38:14.178747 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Project-Id: b90087118fe040389f291d846461c0a7 Oct 20 06:38:14.178747 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Project-Name: tempest-AttachVolumeNegativeTest-617663425 Oct 20 06:38:14.178747 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Role: reader,member Oct 20 06:38:14.178747 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Roles: reader,member Oct 20 06:38:14.180752 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b90087118fe040389f291d846461c0a7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b90087118fe040389f291d846461c0a7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b90087118fe040389f291d846461c0a7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b90087118fe040389f291d846461c0a7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 20 06:38:14.180752 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Tenant: tempest-AttachVolumeNegativeTest-617663425 Oct 20 06:38:14.180752 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Tenant-Id: b90087118fe040389f291d846461c0a7 Oct 20 06:38:14.180752 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-617663425 Oct 20 06:38:14.180752 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-User: tempest-AttachVolumeNegativeTest-617663425-project Oct 20 06:38:14.180752 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-User-Domain-Id: default Oct 20 06:38:14.180752 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-User-Domain-Name: Default Oct 20 06:38:14.180752 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-User-Id: 2c6be23065c643939055a3de375187d5 Oct 20 06:38:14.180752 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-User-Name: tempest-AttachVolumeNegativeTest-617663425-project Oct 20 06:38:14.180752 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: method: > Oct 20 06:38:14.180752 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: exception: Instance 5a669c5b-898f-4fef-8508-254ccd998571 could not be found. Oct 20 06:38:14.180752 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: action_args: {'id': '5a669c5b-898f-4fef-8508-254ccd998571'} Oct 20 06:38:14.181600 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 20 06:38:14.181600 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 06:38:14.181600 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 20 06:38:14.181600 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 20 06:38:14.181600 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 20 06:38:14.181600 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 20 06:38:14.181600 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 20 06:38:14.181600 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 20 06:38:14.181600 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 20 06:38:14.181600 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 20 06:38:14.181600 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a669c5b-898f-4fef-8508-254ccd998571 could not be found. Oct 20 06:38:14.181600 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi Oct 20 06:38:14.181600 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 06:38:14.181600 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi Oct 20 06:38:14.181600 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 06:38:14.181600 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 06:38:14.181600 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 06:38:14.181600 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 20 06:38:14.181600 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 20 06:38:14.181600 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 20 06:38:14.182733 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 20 06:38:14.182733 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 20 06:38:14.182733 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 20 06:38:14.182733 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 20 06:38:14.182733 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 20 06:38:14.182733 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 20 06:38:14.182733 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 20 06:38:14.182733 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 20 06:38:14.182733 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 20 06:38:14.182733 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a669c5b-898f-4fef-8508-254ccd998571 could not be found. Oct 20 06:38:14.182733 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi Oct 20 06:38:14.182733 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 06:38:14.182733 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi Oct 20 06:38:14.182733 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 06:38:14.182733 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 06:38:14.182733 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 06:38:14.182733 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 20 06:38:14.182733 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 20 06:38:14.182733 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a669c5b-898f-4fef-8508-254ccd998571 could not be found. Oct 20 06:38:14.182733 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi Oct 20 06:38:14.185104 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-24bf4584-e879-4380-9ab9-2564a3c30f62 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Returning 404 to user: Instance 5a669c5b-898f-4fef-8508-254ccd998571 could not be found. {{(pid=118861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 20 06:38:14.186240 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-24bf4584-e879-4380-9ab9-2564a3c30f62 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "DELETE /compute/v2.1/servers/5a669c5b-898f-4fef-8508-254ccd998571" status: 404 len: 111 microversion: 2.1 time: 0.060320 Oct 20 06:38:14.188381 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1286/2581] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 20 06:38:14 2022] DELETE /compute/v2.1/servers/5a669c5b-898f-4fef-8508-254ccd998571 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 20 06:38:14.201636 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-ba28d563-414e-47d5-b8c2-c215dde6fa2e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:38:14.213588 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-ba28d563-414e-47d5-b8c2-c215dde6fa2e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: 5a669c5b-898f-4fef-8508-254ccd998571] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:38:14.226515 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-ba28d563-414e-47d5-b8c2-c215dde6fa2e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:38:14.231123 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-ba28d563-414e-47d5-b8c2-c215dde6fa2e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:38:14.234608 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-ba28d563-414e-47d5-b8c2-c215dde6fa2e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:38:14.237051 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-ba28d563-414e-47d5-b8c2-c215dde6fa2e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:38:14.240184 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-ba28d563-414e-47d5-b8c2-c215dde6fa2e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:38:14.240784 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-ba28d563-414e-47d5-b8c2-c215dde6fa2e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:38:14.299098 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.wsgi [None req-ba28d563-414e-47d5-b8c2-c215dde6fa2e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] HTTP exception thrown: Instance 5a669c5b-898f-4fef-8508-254ccd998571 could not be found. Oct 20 06:38:14.308827 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-ba28d563-414e-47d5-b8c2-c215dde6fa2e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Request method failure captured: Oct 20 06:38:14.308827 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: request: GET /compute/v2.1/servers/5a669c5b-898f-4fef-8508-254ccd998571 HTTP/1.1 Oct 20 06:38:14.308827 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: Accept: application/json Oct 20 06:38:14.308827 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: Accept-Encoding: identity Oct 20 06:38:14.308827 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: Connection: close Oct 20 06:38:14.308827 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: Content-Length: 0 Oct 20 06:38:14.308827 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: Content-Type: application/json Oct 20 06:38:14.308827 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: Host: 10.222.0.20 Oct 20 06:38:14.308827 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: Openstack-System-Scope: None Oct 20 06:38:14.308827 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: User-Agent: python-urllib3/1.26.12 Oct 20 06:38:14.308827 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Auth-Token: gAAAAABjUOTwMaxd25vy00-4oHbEqr1c9uD0B3sBZ9MAdUaT4nUKyQqgu2h768xAiNalZc89J9ijH_fe0UIBbKxoYtfSVrasjyy2mvwwjVbv-SkvU3sz2HoGnLJESeVi8iC7ILXfpH5FGWeNjpUJsWoV8PgeWEWJ-eQs7SGcBSSwmqYY25H6IKc Oct 20 06:38:14.308827 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Domain-Id: None Oct 20 06:38:14.308827 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Domain-Name: None Oct 20 06:38:14.308827 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Identity-Status: Confirmed Oct 20 06:38:14.308827 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Is-Admin-Project: True Oct 20 06:38:14.308827 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Project-Domain-Id: default Oct 20 06:38:14.308827 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Project-Domain-Name: Default Oct 20 06:38:14.308827 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Project-Id: b90087118fe040389f291d846461c0a7 Oct 20 06:38:14.308827 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Project-Name: tempest-AttachVolumeNegativeTest-617663425 Oct 20 06:38:14.308827 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Role: reader,member Oct 20 06:38:14.308827 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Roles: reader,member Oct 20 06:38:14.310068 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b90087118fe040389f291d846461c0a7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b90087118fe040389f291d846461c0a7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b90087118fe040389f291d846461c0a7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b90087118fe040389f291d846461c0a7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 20 06:38:14.310068 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Tenant: tempest-AttachVolumeNegativeTest-617663425 Oct 20 06:38:14.310068 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Tenant-Id: b90087118fe040389f291d846461c0a7 Oct 20 06:38:14.310068 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-617663425 Oct 20 06:38:14.310068 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-User: tempest-AttachVolumeNegativeTest-617663425-project Oct 20 06:38:14.310068 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-User-Domain-Id: default Oct 20 06:38:14.310068 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-User-Domain-Name: Default Oct 20 06:38:14.310068 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-User-Id: 2c6be23065c643939055a3de375187d5 Oct 20 06:38:14.310068 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-User-Name: tempest-AttachVolumeNegativeTest-617663425-project Oct 20 06:38:14.310068 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: method: > Oct 20 06:38:14.310068 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: exception: Instance 5a669c5b-898f-4fef-8508-254ccd998571 could not be found. Oct 20 06:38:14.310068 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: action_args: {'id': '5a669c5b-898f-4fef-8508-254ccd998571'} Oct 20 06:38:14.311185 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 20 06:38:14.311185 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 06:38:14.311185 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 20 06:38:14.311185 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 20 06:38:14.311185 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 20 06:38:14.311185 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 20 06:38:14.311185 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 20 06:38:14.311185 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 20 06:38:14.311185 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 20 06:38:14.311185 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 20 06:38:14.311185 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a669c5b-898f-4fef-8508-254ccd998571 could not be found. Oct 20 06:38:14.311185 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi Oct 20 06:38:14.311185 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 06:38:14.311185 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi Oct 20 06:38:14.311185 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 06:38:14.311185 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 06:38:14.311185 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 06:38:14.311185 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 20 06:38:14.311185 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 20 06:38:14.311185 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 20 06:38:14.312281 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 20 06:38:14.312281 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 20 06:38:14.312281 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 20 06:38:14.312281 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 20 06:38:14.312281 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 20 06:38:14.312281 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 20 06:38:14.312281 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 20 06:38:14.312281 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a669c5b-898f-4fef-8508-254ccd998571 could not be found. Oct 20 06:38:14.312281 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi Oct 20 06:38:14.312281 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 06:38:14.312281 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi Oct 20 06:38:14.312281 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 06:38:14.312281 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 06:38:14.312281 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 06:38:14.312281 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 20 06:38:14.312281 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 20 06:38:14.312281 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a669c5b-898f-4fef-8508-254ccd998571 could not be found. Oct 20 06:38:14.312281 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi Oct 20 06:38:14.315373 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-ba28d563-414e-47d5-b8c2-c215dde6fa2e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Returning 404 to user: Instance 5a669c5b-898f-4fef-8508-254ccd998571 could not be found. {{(pid=118860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 20 06:38:14.316506 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-ba28d563-414e-47d5-b8c2-c215dde6fa2e tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/5a669c5b-898f-4fef-8508-254ccd998571" status: 404 len: 111 microversion: 2.1 time: 0.124200 Oct 20 06:38:14.320426 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1296/2582] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:38:14 2022] GET /compute/v2.1/servers/5a669c5b-898f-4fef-8508-254ccd998571 => generated 111 bytes in 129 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 20 06:38:20.484767 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-ecb485ac-75eb-4b23-98fa-aeb0484e3d34 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Action: 'create', calling method: .version_select at 0x7fbe4b8daee0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-999875005", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA57EE4YCx+d5xOaqz6GRS5qJaNeU0RKmNKBDPTpr0LIa+4jAVWohxai83TQkmBeJHgvmkCAO9SZCRDgyqlSTl9r1Akud6CLZPOI7B9x1mUyAU5eM8UyI7YNhqhzVD5/oA=="}} {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 06:38:20.507870 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.quota [None req-ecb485ac-75eb-4b23-98fa-aeb0484e3d34 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Getting quotas for project c6d602fe085a4d7d82788e61287b352d. Resources: {'key_pairs'} {{(pid=118861) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 20 06:38:20.512306 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.quota [None req-ecb485ac-75eb-4b23-98fa-aeb0484e3d34 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Getting quotas for user 30be578ddd664bc79498d9a21f708f04 and project c6d602fe085a4d7d82788e61287b352d. Resources: {'key_pairs'} {{(pid=118861) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 20 06:38:20.537460 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-ecb485ac-75eb-4b23-98fa-aeb0484e3d34 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.058877 Oct 20 06:38:20.538158 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1287/2583] 10.222.0.20 () {60 vars in 1159 bytes} [Thu Oct 20 06:38:20 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:38:20.649400 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-1367147c-1c0b-4aed-901e-67691b694d97 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1480610734", "imageRef": "c94847f5-4d46-484a-b9f4-9f0371014302", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-999875005", "networks": [{"uuid": "245a1fae-dc24-4f3d-92bd-2b29aa1492dd"}]}} {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 06:38:20.718109 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.network.neutron [None req-1367147c-1c0b-4aed-901e-67691b694d97 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] validate_networks() for [('245a1fae-dc24-4f3d-92bd-2b29aa1492dd', None, None, None, None, None)] {{(pid=118860) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 20 06:38:21.120556 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.virt.hardware [None req-1367147c-1c0b-4aed-901e-67691b694d97 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Flavor limits 0:0:0 {{(pid=118860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 20 06:38:21.121133 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.virt.hardware [None req-1367147c-1c0b-4aed-901e-67691b694d97 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Image limits 0:0:0 {{(pid=118860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 20 06:38:21.121723 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.virt.hardware [None req-1367147c-1c0b-4aed-901e-67691b694d97 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Flavor pref 0:0:0 {{(pid=118860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 20 06:38:21.122226 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.virt.hardware [None req-1367147c-1c0b-4aed-901e-67691b694d97 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Image pref 0:0:0 {{(pid=118860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 20 06:38:21.123233 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.virt.hardware [None req-1367147c-1c0b-4aed-901e-67691b694d97 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 20 06:38:21.132213 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1367147c-1c0b-4aed-901e-67691b694d97 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:38:21.132907 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1367147c-1c0b-4aed-901e-67691b694d97 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:38:21.133421 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1367147c-1c0b-4aed-901e-67691b694d97 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:38:21.134222 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1367147c-1c0b-4aed-901e-67691b694d97 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:38:21.134767 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1367147c-1c0b-4aed-901e-67691b694d97 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:38:21.135269 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1367147c-1c0b-4aed-901e-67691b694d97 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:38:21.151732 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.quota [None req-1367147c-1c0b-4aed-901e-67691b694d97 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Getting quotas for project c6d602fe085a4d7d82788e61287b352d. Resources: {'cores', 'ram', 'instances'} {{(pid=118860) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 20 06:38:21.155938 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.quota [None req-1367147c-1c0b-4aed-901e-67691b694d97 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Getting quotas for user 30be578ddd664bc79498d9a21f708f04 and project c6d602fe085a4d7d82788e61287b352d. Resources: {'cores', 'ram', 'instances'} {{(pid=118860) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 20 06:38:21.167771 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-1367147c-1c0b-4aed-901e-67691b694d97 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Going to run 1 instances... {{(pid=118860) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 20 06:38:21.170059 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-1367147c-1c0b-4aed-901e-67691b694d97 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] [instance: 065efbd0-fdd1-4b98-ba6a-b132a9b99086] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c94847f5-4d46-484a-b9f4-9f0371014302',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118860) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 20 06:38:21.219617 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-1367147c-1c0b-4aed-901e-67691b694d97 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.574236 Oct 20 06:38:21.226335 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1297/2584] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Oct 20 06:38:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 576 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 20 06:38:21.231987 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-447ee35d-3473-4c04-9783-7b99e7137744 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:38:21.232765 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-447ee35d-3473-4c04-9783-7b99e7137744 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] [instance: 065efbd0-fdd1-4b98-ba6a-b132a9b99086] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:38:21.313558 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-447ee35d-3473-4c04-9783-7b99e7137744 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30be578ddd664bc79498d9a21f708f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6d602fe085a4d7d82788e61287b352d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:38:21.322207 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-447ee35d-3473-4c04-9783-7b99e7137744 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] 10.222.0.20 "GET /compute/v2.1/servers/065efbd0-fdd1-4b98-ba6a-b132a9b99086" status: 200 len: 1258 microversion: 2.1 time: 0.093342 Oct 20 06:38:21.323119 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1288/2585] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:38:21 2022] GET /compute/v2.1/servers/065efbd0-fdd1-4b98-ba6a-b132a9b99086 => generated 1258 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:38:22.346168 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-6f7e1785-2147-41ea-b7b0-21aecb5cb769 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:38:22.346782 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-6f7e1785-2147-41ea-b7b0-21aecb5cb769 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] [instance: 065efbd0-fdd1-4b98-ba6a-b132a9b99086] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:38:22.354767 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-6f7e1785-2147-41ea-b7b0-21aecb5cb769 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:38:22.355255 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-6f7e1785-2147-41ea-b7b0-21aecb5cb769 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:38:22.355855 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-6f7e1785-2147-41ea-b7b0-21aecb5cb769 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:38:22.356741 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-6f7e1785-2147-41ea-b7b0-21aecb5cb769 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:38:22.357190 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-6f7e1785-2147-41ea-b7b0-21aecb5cb769 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:38:22.357622 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-6f7e1785-2147-41ea-b7b0-21aecb5cb769 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:38:22.488837 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-6f7e1785-2147-41ea-b7b0-21aecb5cb769 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30be578ddd664bc79498d9a21f708f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6d602fe085a4d7d82788e61287b352d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:38:22.499021 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-6f7e1785-2147-41ea-b7b0-21aecb5cb769 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] 10.222.0.20 "GET /compute/v2.1/servers/065efbd0-fdd1-4b98-ba6a-b132a9b99086" status: 200 len: 1310 microversion: 2.1 time: 0.157153 Oct 20 06:38:22.500254 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1298/2586] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:38:22 2022] GET /compute/v2.1/servers/065efbd0-fdd1-4b98-ba6a-b132a9b99086 => generated 1310 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:38:23.525375 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-55dc16c5-1ea2-479f-96b4-83d387d384e4 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:38:23.526137 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-55dc16c5-1ea2-479f-96b4-83d387d384e4 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] [instance: 065efbd0-fdd1-4b98-ba6a-b132a9b99086] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:38:23.542036 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-55dc16c5-1ea2-479f-96b4-83d387d384e4 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:38:23.543670 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-55dc16c5-1ea2-479f-96b4-83d387d384e4 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:38:23.544214 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-55dc16c5-1ea2-479f-96b4-83d387d384e4 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:38:23.547780 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-55dc16c5-1ea2-479f-96b4-83d387d384e4 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:38:23.548593 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-55dc16c5-1ea2-479f-96b4-83d387d384e4 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:38:23.549336 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-55dc16c5-1ea2-479f-96b4-83d387d384e4 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:38:23.857022 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-55dc16c5-1ea2-479f-96b4-83d387d384e4 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30be578ddd664bc79498d9a21f708f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6d602fe085a4d7d82788e61287b352d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:38:23.868679 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-55dc16c5-1ea2-479f-96b4-83d387d384e4 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] 10.222.0.20 "GET /compute/v2.1/servers/065efbd0-fdd1-4b98-ba6a-b132a9b99086" status: 200 len: 1358 microversion: 2.1 time: 0.348647 Oct 20 06:38:23.871918 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1289/2587] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:38:23 2022] GET /compute/v2.1/servers/065efbd0-fdd1-4b98-ba6a-b132a9b99086 => generated 1358 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:38:24.896302 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-e54e4dbb-3ec6-44c3-8a93-fca61df73904 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:38:24.896962 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-e54e4dbb-3ec6-44c3-8a93-fca61df73904 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] [instance: 065efbd0-fdd1-4b98-ba6a-b132a9b99086] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:38:24.903819 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e54e4dbb-3ec6-44c3-8a93-fca61df73904 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:38:24.904294 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e54e4dbb-3ec6-44c3-8a93-fca61df73904 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:38:24.904939 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e54e4dbb-3ec6-44c3-8a93-fca61df73904 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:38:24.905634 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e54e4dbb-3ec6-44c3-8a93-fca61df73904 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:38:24.906226 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e54e4dbb-3ec6-44c3-8a93-fca61df73904 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:38:24.906653 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e54e4dbb-3ec6-44c3-8a93-fca61df73904 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:38:25.051859 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-e54e4dbb-3ec6-44c3-8a93-fca61df73904 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30be578ddd664bc79498d9a21f708f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6d602fe085a4d7d82788e61287b352d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:38:25.059623 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-e54e4dbb-3ec6-44c3-8a93-fca61df73904 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] 10.222.0.20 "GET /compute/v2.1/servers/065efbd0-fdd1-4b98-ba6a-b132a9b99086" status: 200 len: 1358 microversion: 2.1 time: 0.167055 Oct 20 06:38:25.060181 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1299/2588] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:38:24 2022] GET /compute/v2.1/servers/065efbd0-fdd1-4b98-ba6a-b132a9b99086 => generated 1358 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:38:26.084977 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-d69b16bc-a382-4352-8679-c52fc9534f75 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:38:26.087305 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-d69b16bc-a382-4352-8679-c52fc9534f75 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] [instance: 065efbd0-fdd1-4b98-ba6a-b132a9b99086] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:38:26.099330 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d69b16bc-a382-4352-8679-c52fc9534f75 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:38:26.099837 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d69b16bc-a382-4352-8679-c52fc9534f75 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:38:26.100277 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d69b16bc-a382-4352-8679-c52fc9534f75 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:38:26.101006 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d69b16bc-a382-4352-8679-c52fc9534f75 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:38:26.102027 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d69b16bc-a382-4352-8679-c52fc9534f75 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:38:26.102510 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d69b16bc-a382-4352-8679-c52fc9534f75 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:38:26.262809 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-d69b16bc-a382-4352-8679-c52fc9534f75 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30be578ddd664bc79498d9a21f708f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6d602fe085a4d7d82788e61287b352d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:38:26.270574 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-d69b16bc-a382-4352-8679-c52fc9534f75 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] 10.222.0.20 "GET /compute/v2.1/servers/065efbd0-fdd1-4b98-ba6a-b132a9b99086" status: 200 len: 1358 microversion: 2.1 time: 0.191016 Oct 20 06:38:26.271155 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1290/2589] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:38:26 2022] GET /compute/v2.1/servers/065efbd0-fdd1-4b98-ba6a-b132a9b99086 => generated 1358 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:38:27.293868 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-776dd275-94a5-43aa-87bf-aae641daf15b tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:38:27.294492 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-776dd275-94a5-43aa-87bf-aae641daf15b tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] [instance: 065efbd0-fdd1-4b98-ba6a-b132a9b99086] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:38:27.304733 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-776dd275-94a5-43aa-87bf-aae641daf15b tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:38:27.305221 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-776dd275-94a5-43aa-87bf-aae641daf15b tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:38:27.307074 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-776dd275-94a5-43aa-87bf-aae641daf15b tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:38:27.307942 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-776dd275-94a5-43aa-87bf-aae641daf15b tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:38:27.309216 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-776dd275-94a5-43aa-87bf-aae641daf15b tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:38:27.309803 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-776dd275-94a5-43aa-87bf-aae641daf15b tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:38:27.470352 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-776dd275-94a5-43aa-87bf-aae641daf15b tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30be578ddd664bc79498d9a21f708f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6d602fe085a4d7d82788e61287b352d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:38:27.478874 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-776dd275-94a5-43aa-87bf-aae641daf15b tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] 10.222.0.20 "GET /compute/v2.1/servers/065efbd0-fdd1-4b98-ba6a-b132a9b99086" status: 200 len: 1358 microversion: 2.1 time: 0.189025 Oct 20 06:38:27.479432 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1300/2590] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:38:27 2022] GET /compute/v2.1/servers/065efbd0-fdd1-4b98-ba6a-b132a9b99086 => generated 1358 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:38:28.506021 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-c432372a-625c-4385-b8f7-752dc42888c8 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:38:28.506631 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-c432372a-625c-4385-b8f7-752dc42888c8 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] [instance: 065efbd0-fdd1-4b98-ba6a-b132a9b99086] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:38:28.517032 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c432372a-625c-4385-b8f7-752dc42888c8 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:38:28.517882 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c432372a-625c-4385-b8f7-752dc42888c8 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:38:28.518614 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c432372a-625c-4385-b8f7-752dc42888c8 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:38:28.519720 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c432372a-625c-4385-b8f7-752dc42888c8 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:38:28.520375 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c432372a-625c-4385-b8f7-752dc42888c8 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:38:28.521040 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c432372a-625c-4385-b8f7-752dc42888c8 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:38:28.685177 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-c432372a-625c-4385-b8f7-752dc42888c8 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30be578ddd664bc79498d9a21f708f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6d602fe085a4d7d82788e61287b352d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:38:28.693719 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-c432372a-625c-4385-b8f7-752dc42888c8 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] 10.222.0.20 "GET /compute/v2.1/servers/065efbd0-fdd1-4b98-ba6a-b132a9b99086" status: 200 len: 1358 microversion: 2.1 time: 0.193528 Oct 20 06:38:28.694283 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1291/2591] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:38:28 2022] GET /compute/v2.1/servers/065efbd0-fdd1-4b98-ba6a-b132a9b99086 => generated 1358 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:38:29.722411 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-1d823a1e-456f-49b0-97a8-2658dc3d6150 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:38:29.723050 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-1d823a1e-456f-49b0-97a8-2658dc3d6150 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] [instance: 065efbd0-fdd1-4b98-ba6a-b132a9b99086] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:38:29.729577 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1d823a1e-456f-49b0-97a8-2658dc3d6150 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:38:29.730052 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1d823a1e-456f-49b0-97a8-2658dc3d6150 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:38:29.730484 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1d823a1e-456f-49b0-97a8-2658dc3d6150 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:38:29.731159 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1d823a1e-456f-49b0-97a8-2658dc3d6150 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:38:29.731604 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1d823a1e-456f-49b0-97a8-2658dc3d6150 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:38:29.732024 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1d823a1e-456f-49b0-97a8-2658dc3d6150 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:38:29.856520 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-1d823a1e-456f-49b0-97a8-2658dc3d6150 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30be578ddd664bc79498d9a21f708f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6d602fe085a4d7d82788e61287b352d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:38:29.864053 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-1d823a1e-456f-49b0-97a8-2658dc3d6150 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] 10.222.0.20 "GET /compute/v2.1/servers/065efbd0-fdd1-4b98-ba6a-b132a9b99086" status: 200 len: 1358 microversion: 2.1 time: 0.145595 Oct 20 06:38:29.864604 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1301/2592] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:38:29 2022] GET /compute/v2.1/servers/065efbd0-fdd1-4b98-ba6a-b132a9b99086 => generated 1358 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:38:30.887963 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-0e910582-fb98-424a-98e6-a32d853d64b6 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:38:30.889290 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-0e910582-fb98-424a-98e6-a32d853d64b6 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] [instance: 065efbd0-fdd1-4b98-ba6a-b132a9b99086] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:38:30.895800 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-0e910582-fb98-424a-98e6-a32d853d64b6 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:38:30.896146 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-0e910582-fb98-424a-98e6-a32d853d64b6 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:38:30.896585 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-0e910582-fb98-424a-98e6-a32d853d64b6 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:38:30.897411 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-0e910582-fb98-424a-98e6-a32d853d64b6 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:38:30.897875 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-0e910582-fb98-424a-98e6-a32d853d64b6 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:38:30.898303 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-0e910582-fb98-424a-98e6-a32d853d64b6 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:38:31.111547 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-0e910582-fb98-424a-98e6-a32d853d64b6 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30be578ddd664bc79498d9a21f708f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6d602fe085a4d7d82788e61287b352d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:38:31.125541 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-0e910582-fb98-424a-98e6-a32d853d64b6 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] 10.222.0.20 "GET /compute/v2.1/servers/065efbd0-fdd1-4b98-ba6a-b132a9b99086" status: 200 len: 1358 microversion: 2.1 time: 0.241953 Oct 20 06:38:31.127341 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1292/2593] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:38:30 2022] GET /compute/v2.1/servers/065efbd0-fdd1-4b98-ba6a-b132a9b99086 => generated 1358 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:38:32.149953 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-757bcb5b-c0fe-4af2-a207-35a82b6f22f6 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:38:32.151240 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-757bcb5b-c0fe-4af2-a207-35a82b6f22f6 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] [instance: 065efbd0-fdd1-4b98-ba6a-b132a9b99086] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:38:32.153967 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG dbcounter [-] [118860] Writing DB stats nova_cell0:SELECT=2 {{(pid=118860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:38:32.154617 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG dbcounter [-] [118860] Writing DB stats nova_cell0:SELECT=6 {{(pid=118860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:38:32.155552 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG dbcounter [-] [118860] Writing DB stats nova_api:SELECT=45,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=118860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:38:32.162050 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-757bcb5b-c0fe-4af2-a207-35a82b6f22f6 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:38:32.162533 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-757bcb5b-c0fe-4af2-a207-35a82b6f22f6 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:38:32.162961 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-757bcb5b-c0fe-4af2-a207-35a82b6f22f6 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:38:32.163721 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-757bcb5b-c0fe-4af2-a207-35a82b6f22f6 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:38:32.164122 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-757bcb5b-c0fe-4af2-a207-35a82b6f22f6 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:38:32.164505 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-757bcb5b-c0fe-4af2-a207-35a82b6f22f6 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:38:32.168035 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG dbcounter [-] [118860] Writing DB stats nova_cell1:SELECT=65 {{(pid=118860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:38:32.355797 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-757bcb5b-c0fe-4af2-a207-35a82b6f22f6 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30be578ddd664bc79498d9a21f708f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6d602fe085a4d7d82788e61287b352d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:38:32.371965 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-757bcb5b-c0fe-4af2-a207-35a82b6f22f6 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] 10.222.0.20 "GET /compute/v2.1/servers/065efbd0-fdd1-4b98-ba6a-b132a9b99086" status: 200 len: 1358 microversion: 2.1 time: 0.224829 Oct 20 06:38:32.386511 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1302/2594] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:38:32 2022] GET /compute/v2.1/servers/065efbd0-fdd1-4b98-ba6a-b132a9b99086 => generated 1358 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:38:33.400155 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-edfb72b2-f7a0-4e50-a167-ef7d2699ebb2 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:38:33.401385 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-edfb72b2-f7a0-4e50-a167-ef7d2699ebb2 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] [instance: 065efbd0-fdd1-4b98-ba6a-b132a9b99086] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:38:33.412041 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG dbcounter [-] [118861] Writing DB stats nova_cell0:SELECT=6 {{(pid=118861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:38:33.415235 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG dbcounter [-] [118861] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=118861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:38:33.416810 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-edfb72b2-f7a0-4e50-a167-ef7d2699ebb2 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:38:33.417519 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-edfb72b2-f7a0-4e50-a167-ef7d2699ebb2 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:38:33.418171 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-edfb72b2-f7a0-4e50-a167-ef7d2699ebb2 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:38:33.419028 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-edfb72b2-f7a0-4e50-a167-ef7d2699ebb2 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:38:33.419770 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-edfb72b2-f7a0-4e50-a167-ef7d2699ebb2 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:38:33.420050 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-edfb72b2-f7a0-4e50-a167-ef7d2699ebb2 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:38:33.449985 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG dbcounter [-] [118861] Writing DB stats nova_cell1:SELECT=70,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:38:33.608262 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-edfb72b2-f7a0-4e50-a167-ef7d2699ebb2 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30be578ddd664bc79498d9a21f708f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6d602fe085a4d7d82788e61287b352d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:38:33.621260 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-edfb72b2-f7a0-4e50-a167-ef7d2699ebb2 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] 10.222.0.20 "GET /compute/v2.1/servers/065efbd0-fdd1-4b98-ba6a-b132a9b99086" status: 200 len: 1358 microversion: 2.1 time: 0.223667 Oct 20 06:38:33.642017 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1293/2595] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:38:33 2022] GET /compute/v2.1/servers/065efbd0-fdd1-4b98-ba6a-b132a9b99086 => generated 1358 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:38:34.652140 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-09cf0d47-e449-4c4a-bda5-5c9ab0547c56 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:38:34.652935 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-09cf0d47-e449-4c4a-bda5-5c9ab0547c56 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] [instance: 065efbd0-fdd1-4b98-ba6a-b132a9b99086] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:38:34.659022 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-09cf0d47-e449-4c4a-bda5-5c9ab0547c56 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:38:34.659517 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-09cf0d47-e449-4c4a-bda5-5c9ab0547c56 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:38:34.659964 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-09cf0d47-e449-4c4a-bda5-5c9ab0547c56 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:38:34.660687 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-09cf0d47-e449-4c4a-bda5-5c9ab0547c56 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:38:34.661153 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-09cf0d47-e449-4c4a-bda5-5c9ab0547c56 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:38:34.661588 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-09cf0d47-e449-4c4a-bda5-5c9ab0547c56 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:38:34.810131 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-09cf0d47-e449-4c4a-bda5-5c9ab0547c56 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30be578ddd664bc79498d9a21f708f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6d602fe085a4d7d82788e61287b352d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:38:34.820604 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-09cf0d47-e449-4c4a-bda5-5c9ab0547c56 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] 10.222.0.20 "GET /compute/v2.1/servers/065efbd0-fdd1-4b98-ba6a-b132a9b99086" status: 200 len: 1358 microversion: 2.1 time: 0.172277 Oct 20 06:38:34.821209 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1303/2596] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:38:34 2022] GET /compute/v2.1/servers/065efbd0-fdd1-4b98-ba6a-b132a9b99086 => generated 1358 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:38:35.844567 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-4d625dcd-54b3-4892-b581-cd5eb61bacde tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:38:35.845321 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-4d625dcd-54b3-4892-b581-cd5eb61bacde tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] [instance: 065efbd0-fdd1-4b98-ba6a-b132a9b99086] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:38:35.851431 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4d625dcd-54b3-4892-b581-cd5eb61bacde tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:38:35.851907 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4d625dcd-54b3-4892-b581-cd5eb61bacde tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:38:35.852334 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4d625dcd-54b3-4892-b581-cd5eb61bacde tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:38:35.853049 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4d625dcd-54b3-4892-b581-cd5eb61bacde tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:38:35.853558 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4d625dcd-54b3-4892-b581-cd5eb61bacde tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:38:35.853974 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-4d625dcd-54b3-4892-b581-cd5eb61bacde tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:38:36.026809 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-4d625dcd-54b3-4892-b581-cd5eb61bacde tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30be578ddd664bc79498d9a21f708f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6d602fe085a4d7d82788e61287b352d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:38:36.035104 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-4d625dcd-54b3-4892-b581-cd5eb61bacde tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] 10.222.0.20 "GET /compute/v2.1/servers/065efbd0-fdd1-4b98-ba6a-b132a9b99086" status: 200 len: 1358 microversion: 2.1 time: 0.194265 Oct 20 06:38:36.035689 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1294/2597] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:38:35 2022] GET /compute/v2.1/servers/065efbd0-fdd1-4b98-ba6a-b132a9b99086 => generated 1358 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:38:37.061541 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-1ac0bcb7-1d86-44b0-9777-cc18a08ea183 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:38:37.062151 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-1ac0bcb7-1d86-44b0-9777-cc18a08ea183 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] [instance: 065efbd0-fdd1-4b98-ba6a-b132a9b99086] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:38:37.068525 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1ac0bcb7-1d86-44b0-9777-cc18a08ea183 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:38:37.069056 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1ac0bcb7-1d86-44b0-9777-cc18a08ea183 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:38:37.069528 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1ac0bcb7-1d86-44b0-9777-cc18a08ea183 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:38:37.070222 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1ac0bcb7-1d86-44b0-9777-cc18a08ea183 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:38:37.070676 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1ac0bcb7-1d86-44b0-9777-cc18a08ea183 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:38:37.071104 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1ac0bcb7-1d86-44b0-9777-cc18a08ea183 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:38:37.200379 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-1ac0bcb7-1d86-44b0-9777-cc18a08ea183 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30be578ddd664bc79498d9a21f708f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6d602fe085a4d7d82788e61287b352d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:38:37.208077 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-1ac0bcb7-1d86-44b0-9777-cc18a08ea183 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] 10.222.0.20 "GET /compute/v2.1/servers/065efbd0-fdd1-4b98-ba6a-b132a9b99086" status: 200 len: 1358 microversion: 2.1 time: 0.151119 Oct 20 06:38:37.208631 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1304/2598] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:38:37 2022] GET /compute/v2.1/servers/065efbd0-fdd1-4b98-ba6a-b132a9b99086 => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:38:38.230800 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-8b704e94-738b-4399-8133-365ee2eb6de6 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:38:38.231406 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-8b704e94-738b-4399-8133-365ee2eb6de6 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] [instance: 065efbd0-fdd1-4b98-ba6a-b132a9b99086] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:38:38.237790 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-8b704e94-738b-4399-8133-365ee2eb6de6 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:38:38.238264 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-8b704e94-738b-4399-8133-365ee2eb6de6 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:38:38.238697 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-8b704e94-738b-4399-8133-365ee2eb6de6 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:38:38.239372 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-8b704e94-738b-4399-8133-365ee2eb6de6 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:38:38.239816 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-8b704e94-738b-4399-8133-365ee2eb6de6 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:38:38.240235 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-8b704e94-738b-4399-8133-365ee2eb6de6 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:38:38.367971 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-8b704e94-738b-4399-8133-365ee2eb6de6 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30be578ddd664bc79498d9a21f708f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6d602fe085a4d7d82788e61287b352d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:38:38.376245 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-8b704e94-738b-4399-8133-365ee2eb6de6 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] 10.222.0.20 "GET /compute/v2.1/servers/065efbd0-fdd1-4b98-ba6a-b132a9b99086" status: 200 len: 1358 microversion: 2.1 time: 0.149379 Oct 20 06:38:38.376826 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1295/2599] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:38:38 2022] GET /compute/v2.1/servers/065efbd0-fdd1-4b98-ba6a-b132a9b99086 => generated 1358 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:38:39.178113 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [req-f38a25de-a9b8-43ed-9393-5151b7267bdd req-7cbe7c8b-73e6-4686-aa2d-bcb7fe205c28 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "065efbd0-fdd1-4b98-ba6a-b132a9b99086", "tag": "8c1553c3-fdce-433e-84c9-e9d42237847c"}]} {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 06:38:39.190081 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [req-f38a25de-a9b8-43ed-9393-5151b7267bdd req-7cbe7c8b-73e6-4686-aa2d-bcb7fe205c28 service nova] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:38:39.190521 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [req-f38a25de-a9b8-43ed-9393-5151b7267bdd req-7cbe7c8b-73e6-4686-aa2d-bcb7fe205c28 service nova] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:38:39.191015 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [req-f38a25de-a9b8-43ed-9393-5151b7267bdd req-7cbe7c8b-73e6-4686-aa2d-bcb7fe205c28 service nova] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:38:39.202987 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.compute.server_external_events [req-f38a25de-a9b8-43ed-9393-5151b7267bdd req-7cbe7c8b-73e6-4686-aa2d-bcb7fe205c28 service nova] Creating event network-changed:8c1553c3-fdce-433e-84c9-e9d42237847c for instance 065efbd0-fdd1-4b98-ba6a-b132a9b99086 on hv-cinder-86156 Oct 20 06:38:39.207959 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [req-f38a25de-a9b8-43ed-9393-5151b7267bdd req-7cbe7c8b-73e6-4686-aa2d-bcb7fe205c28 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033828 Oct 20 06:38:39.208757 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1305/2600] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 20 06:38:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:38:39.399274 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-0fb79553-df84-470f-860f-d6d9d16c2a5e tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:38:39.399887 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-0fb79553-df84-470f-860f-d6d9d16c2a5e tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] [instance: 065efbd0-fdd1-4b98-ba6a-b132a9b99086] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:38:39.407197 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-0fb79553-df84-470f-860f-d6d9d16c2a5e tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:38:39.407679 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-0fb79553-df84-470f-860f-d6d9d16c2a5e tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:38:39.408111 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-0fb79553-df84-470f-860f-d6d9d16c2a5e tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:38:39.408824 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-0fb79553-df84-470f-860f-d6d9d16c2a5e tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:38:39.409279 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-0fb79553-df84-470f-860f-d6d9d16c2a5e tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:38:39.409698 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-0fb79553-df84-470f-860f-d6d9d16c2a5e tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:38:39.538799 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-0fb79553-df84-470f-860f-d6d9d16c2a5e tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30be578ddd664bc79498d9a21f708f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6d602fe085a4d7d82788e61287b352d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:38:39.546348 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-0fb79553-df84-470f-860f-d6d9d16c2a5e tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] 10.222.0.20 "GET /compute/v2.1/servers/065efbd0-fdd1-4b98-ba6a-b132a9b99086" status: 200 len: 1358 microversion: 2.1 time: 0.150951 Oct 20 06:38:39.546916 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1296/2601] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:38:39 2022] GET /compute/v2.1/servers/065efbd0-fdd1-4b98-ba6a-b132a9b99086 => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:38:40.570749 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-14329621-2754-488b-b306-e8d036535278 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:38:40.571398 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-14329621-2754-488b-b306-e8d036535278 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] [instance: 065efbd0-fdd1-4b98-ba6a-b132a9b99086] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:38:40.581966 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-14329621-2754-488b-b306-e8d036535278 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:38:40.582477 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-14329621-2754-488b-b306-e8d036535278 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:38:40.583235 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-14329621-2754-488b-b306-e8d036535278 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:38:40.583693 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-14329621-2754-488b-b306-e8d036535278 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:38:40.584149 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-14329621-2754-488b-b306-e8d036535278 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:38:40.584571 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-14329621-2754-488b-b306-e8d036535278 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:38:40.811592 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-14329621-2754-488b-b306-e8d036535278 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30be578ddd664bc79498d9a21f708f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6d602fe085a4d7d82788e61287b352d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:38:40.819237 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-14329621-2754-488b-b306-e8d036535278 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] 10.222.0.20 "GET /compute/v2.1/servers/065efbd0-fdd1-4b98-ba6a-b132a9b99086" status: 200 len: 1358 microversion: 2.1 time: 0.253430 Oct 20 06:38:40.819828 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1306/2602] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:38:40 2022] GET /compute/v2.1/servers/065efbd0-fdd1-4b98-ba6a-b132a9b99086 => generated 1358 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:38:41.843111 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-d15f64c6-232b-4aab-bced-0f18914532f1 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:38:41.843826 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-d15f64c6-232b-4aab-bced-0f18914532f1 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] [instance: 065efbd0-fdd1-4b98-ba6a-b132a9b99086] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:38:41.850370 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d15f64c6-232b-4aab-bced-0f18914532f1 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:38:41.850945 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d15f64c6-232b-4aab-bced-0f18914532f1 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:38:41.851388 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d15f64c6-232b-4aab-bced-0f18914532f1 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:38:41.852076 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d15f64c6-232b-4aab-bced-0f18914532f1 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:38:41.852519 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d15f64c6-232b-4aab-bced-0f18914532f1 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:38:41.852971 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d15f64c6-232b-4aab-bced-0f18914532f1 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:38:41.981364 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-d15f64c6-232b-4aab-bced-0f18914532f1 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30be578ddd664bc79498d9a21f708f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6d602fe085a4d7d82788e61287b352d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:38:41.989179 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-d15f64c6-232b-4aab-bced-0f18914532f1 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] 10.222.0.20 "GET /compute/v2.1/servers/065efbd0-fdd1-4b98-ba6a-b132a9b99086" status: 200 len: 1358 microversion: 2.1 time: 0.150966 Oct 20 06:38:41.989864 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1297/2603] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:38:41 2022] GET /compute/v2.1/servers/065efbd0-fdd1-4b98-ba6a-b132a9b99086 => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:38:43.012857 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-6fac02a6-0ad5-4fc4-9189-fb92d98e3234 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:38:43.013502 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-6fac02a6-0ad5-4fc4-9189-fb92d98e3234 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] [instance: 065efbd0-fdd1-4b98-ba6a-b132a9b99086] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:38:43.020286 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-6fac02a6-0ad5-4fc4-9189-fb92d98e3234 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:38:43.020808 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-6fac02a6-0ad5-4fc4-9189-fb92d98e3234 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:38:43.021250 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-6fac02a6-0ad5-4fc4-9189-fb92d98e3234 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:38:43.021955 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-6fac02a6-0ad5-4fc4-9189-fb92d98e3234 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:38:43.022410 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-6fac02a6-0ad5-4fc4-9189-fb92d98e3234 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:38:43.022871 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-6fac02a6-0ad5-4fc4-9189-fb92d98e3234 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:38:43.157182 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-6fac02a6-0ad5-4fc4-9189-fb92d98e3234 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30be578ddd664bc79498d9a21f708f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6d602fe085a4d7d82788e61287b352d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:38:43.165262 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-6fac02a6-0ad5-4fc4-9189-fb92d98e3234 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] 10.222.0.20 "GET /compute/v2.1/servers/065efbd0-fdd1-4b98-ba6a-b132a9b99086" status: 200 len: 1358 microversion: 2.1 time: 0.157186 Oct 20 06:38:43.165833 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1307/2604] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:38:43 2022] GET /compute/v2.1/servers/065efbd0-fdd1-4b98-ba6a-b132a9b99086 => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:38:44.189692 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-040f5bc0-41d4-4801-951f-3da2b9102a33 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:38:44.190278 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-040f5bc0-41d4-4801-951f-3da2b9102a33 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] [instance: 065efbd0-fdd1-4b98-ba6a-b132a9b99086] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:38:44.197301 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-040f5bc0-41d4-4801-951f-3da2b9102a33 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:38:44.197782 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-040f5bc0-41d4-4801-951f-3da2b9102a33 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:38:44.198217 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-040f5bc0-41d4-4801-951f-3da2b9102a33 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:38:44.199881 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-040f5bc0-41d4-4801-951f-3da2b9102a33 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:38:44.200342 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-040f5bc0-41d4-4801-951f-3da2b9102a33 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:38:44.200800 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-040f5bc0-41d4-4801-951f-3da2b9102a33 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:38:44.331582 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-040f5bc0-41d4-4801-951f-3da2b9102a33 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30be578ddd664bc79498d9a21f708f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6d602fe085a4d7d82788e61287b352d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:38:44.339306 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-040f5bc0-41d4-4801-951f-3da2b9102a33 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] 10.222.0.20 "GET /compute/v2.1/servers/065efbd0-fdd1-4b98-ba6a-b132a9b99086" status: 200 len: 1358 microversion: 2.1 time: 0.153972 Oct 20 06:38:44.339885 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1298/2605] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:38:44 2022] GET /compute/v2.1/servers/065efbd0-fdd1-4b98-ba6a-b132a9b99086 => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:38:44.515398 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [req-ba7b153a-f842-40f5-8abb-c2c3550eb288 req-fe167d04-8def-46b8-ac58-7db233c465d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "065efbd0-fdd1-4b98-ba6a-b132a9b99086", "name": "network-vif-plugged", "status": "completed", "tag": "8c1553c3-fdce-433e-84c9-e9d42237847c"}]} {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 06:38:44.525201 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [req-ba7b153a-f842-40f5-8abb-c2c3550eb288 req-fe167d04-8def-46b8-ac58-7db233c465d9 service nova] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:38:44.525677 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [req-ba7b153a-f842-40f5-8abb-c2c3550eb288 req-fe167d04-8def-46b8-ac58-7db233c465d9 service nova] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:38:44.526142 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [req-ba7b153a-f842-40f5-8abb-c2c3550eb288 req-fe167d04-8def-46b8-ac58-7db233c465d9 service nova] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:38:44.536997 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.compute.server_external_events [req-ba7b153a-f842-40f5-8abb-c2c3550eb288 req-fe167d04-8def-46b8-ac58-7db233c465d9 service nova] Creating event network-vif-plugged:8c1553c3-fdce-433e-84c9-e9d42237847c for instance 065efbd0-fdd1-4b98-ba6a-b132a9b99086 on hv-cinder-86156 Oct 20 06:38:44.542730 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [req-ba7b153a-f842-40f5-8abb-c2c3550eb288 req-fe167d04-8def-46b8-ac58-7db233c465d9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030648 Oct 20 06:38:44.543501 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1308/2606] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 20 06:38:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:38:45.361732 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-e9375095-e76f-49a3-9795-7de34238d47d tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:38:45.362354 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-e9375095-e76f-49a3-9795-7de34238d47d tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] [instance: 065efbd0-fdd1-4b98-ba6a-b132a9b99086] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:38:45.368827 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e9375095-e76f-49a3-9795-7de34238d47d tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:38:45.369309 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e9375095-e76f-49a3-9795-7de34238d47d tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:38:45.369747 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e9375095-e76f-49a3-9795-7de34238d47d tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:38:45.371093 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e9375095-e76f-49a3-9795-7de34238d47d tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:38:45.371582 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e9375095-e76f-49a3-9795-7de34238d47d tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:38:45.372012 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e9375095-e76f-49a3-9795-7de34238d47d tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:38:45.499051 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-e9375095-e76f-49a3-9795-7de34238d47d tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30be578ddd664bc79498d9a21f708f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6d602fe085a4d7d82788e61287b352d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:38:45.507227 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-e9375095-e76f-49a3-9795-7de34238d47d tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] 10.222.0.20 "GET /compute/v2.1/servers/065efbd0-fdd1-4b98-ba6a-b132a9b99086" status: 200 len: 1358 microversion: 2.1 time: 0.149398 Oct 20 06:38:45.507880 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1299/2607] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:38:45 2022] GET /compute/v2.1/servers/065efbd0-fdd1-4b98-ba6a-b132a9b99086 => generated 1358 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:38:46.529814 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-c412970a-f5f9-4ca8-b749-4017954a7fc6 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:38:46.530507 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-c412970a-f5f9-4ca8-b749-4017954a7fc6 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] [instance: 065efbd0-fdd1-4b98-ba6a-b132a9b99086] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:38:46.537275 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c412970a-f5f9-4ca8-b749-4017954a7fc6 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:38:46.537755 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c412970a-f5f9-4ca8-b749-4017954a7fc6 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:38:46.538186 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c412970a-f5f9-4ca8-b749-4017954a7fc6 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:38:46.538868 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c412970a-f5f9-4ca8-b749-4017954a7fc6 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:38:46.539314 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c412970a-f5f9-4ca8-b749-4017954a7fc6 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:38:46.539732 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c412970a-f5f9-4ca8-b749-4017954a7fc6 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:38:46.666664 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-c412970a-f5f9-4ca8-b749-4017954a7fc6 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30be578ddd664bc79498d9a21f708f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6d602fe085a4d7d82788e61287b352d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:38:46.674755 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-c412970a-f5f9-4ca8-b749-4017954a7fc6 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] 10.222.0.20 "GET /compute/v2.1/servers/065efbd0-fdd1-4b98-ba6a-b132a9b99086" status: 200 len: 1548 microversion: 2.1 time: 0.149201 Oct 20 06:38:46.675309 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1309/2608] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:38:46 2022] GET /compute/v2.1/servers/065efbd0-fdd1-4b98-ba6a-b132a9b99086 => generated 1548 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:38:46.700638 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-f742535c-0c98-41cc-8d81-621a2d49f6fc tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:38:46.701277 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-f742535c-0c98-41cc-8d81-621a2d49f6fc tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] [instance: 065efbd0-fdd1-4b98-ba6a-b132a9b99086] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:38:46.707574 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f742535c-0c98-41cc-8d81-621a2d49f6fc tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:38:46.708046 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f742535c-0c98-41cc-8d81-621a2d49f6fc tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:38:46.708476 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f742535c-0c98-41cc-8d81-621a2d49f6fc tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:38:46.709208 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f742535c-0c98-41cc-8d81-621a2d49f6fc tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:38:46.709658 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f742535c-0c98-41cc-8d81-621a2d49f6fc tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:38:46.710080 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f742535c-0c98-41cc-8d81-621a2d49f6fc tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:38:46.999953 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-f742535c-0c98-41cc-8d81-621a2d49f6fc tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30be578ddd664bc79498d9a21f708f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6d602fe085a4d7d82788e61287b352d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:38:47.007891 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-f742535c-0c98-41cc-8d81-621a2d49f6fc tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] 10.222.0.20 "GET /compute/v2.1/servers/065efbd0-fdd1-4b98-ba6a-b132a9b99086" status: 200 len: 1548 microversion: 2.1 time: 0.311297 Oct 20 06:38:47.008448 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1300/2609] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:38:46 2022] GET /compute/v2.1/servers/065efbd0-fdd1-4b98-ba6a-b132a9b99086 => generated 1548 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:38:47.029648 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-a92bb31d-1f16-4f64-9d48-ab053189b55f tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:38:47.034372 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-a92bb31d-1f16-4f64-9d48-ab053189b55f tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '30be578ddd664bc79498d9a21f708f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6d602fe085a4d7d82788e61287b352d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:38:47.035125 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-a92bb31d-1f16-4f64-9d48-ab053189b55f tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Searching by: {'deleted': False, 'project_id': 'c6d602fe085a4d7d82788e61287b352d'} {{(pid=118860) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 20 06:38:47.041850 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a92bb31d-1f16-4f64-9d48-ab053189b55f tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:38:47.042326 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a92bb31d-1f16-4f64-9d48-ab053189b55f tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:38:47.042757 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a92bb31d-1f16-4f64-9d48-ab053189b55f tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:38:47.044185 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a92bb31d-1f16-4f64-9d48-ab053189b55f tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:38:47.044634 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a92bb31d-1f16-4f64-9d48-ab053189b55f tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:38:47.045083 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-a92bb31d-1f16-4f64-9d48-ab053189b55f tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:38:47.133988 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.multi_cell_list [None req-a92bb31d-1f16-4f64-9d48-ab053189b55f tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=118860) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 20 06:38:47.228213 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-a92bb31d-1f16-4f64-9d48-ab053189b55f tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] 10.222.0.20 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.202709 Oct 20 06:38:47.228824 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1310/2610] 10.222.0.20 () {58 vars in 1125 bytes} [Thu Oct 20 06:38:47 2022] GET /compute/v2.1/servers => generated 343 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:38:47.241065 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-d6b158cb-ce24-4cef-b383-259bbfdeec1f tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:38:47.241682 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-d6b158cb-ce24-4cef-b383-259bbfdeec1f tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] [instance: 065efbd0-fdd1-4b98-ba6a-b132a9b99086] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:38:47.247643 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d6b158cb-ce24-4cef-b383-259bbfdeec1f tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:38:47.248116 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d6b158cb-ce24-4cef-b383-259bbfdeec1f tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:38:47.248548 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d6b158cb-ce24-4cef-b383-259bbfdeec1f tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:38:47.249274 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d6b158cb-ce24-4cef-b383-259bbfdeec1f tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:38:47.249729 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d6b158cb-ce24-4cef-b383-259bbfdeec1f tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:38:47.250152 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d6b158cb-ce24-4cef-b383-259bbfdeec1f tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:38:47.375888 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-d6b158cb-ce24-4cef-b383-259bbfdeec1f tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30be578ddd664bc79498d9a21f708f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6d602fe085a4d7d82788e61287b352d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:38:47.383652 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-d6b158cb-ce24-4cef-b383-259bbfdeec1f tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] 10.222.0.20 "GET /compute/v2.1/servers/065efbd0-fdd1-4b98-ba6a-b132a9b99086" status: 200 len: 1548 microversion: 2.1 time: 0.146429 Oct 20 06:38:47.384212 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1301/2611] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:38:47 2022] GET /compute/v2.1/servers/065efbd0-fdd1-4b98-ba6a-b132a9b99086 => generated 1548 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:38:48.925104 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-bc5206fe-e7dd-4670-a045-ea76d9734ee7 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "853c981c-1e34-486f-a89d-c7c1c3b715e9"}} {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 06:38:48.927374 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-bc5206fe-e7dd-4670-a045-ea76d9734ee7 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] [instance: 065efbd0-fdd1-4b98-ba6a-b132a9b99086] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:38:48.934166 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-bc5206fe-e7dd-4670-a045-ea76d9734ee7 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:38:48.934781 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-bc5206fe-e7dd-4670-a045-ea76d9734ee7 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:38:48.935417 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-bc5206fe-e7dd-4670-a045-ea76d9734ee7 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:38:48.936098 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-bc5206fe-e7dd-4670-a045-ea76d9734ee7 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:38:48.936542 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-bc5206fe-e7dd-4670-a045-ea76d9734ee7 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:38:48.937000 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-bc5206fe-e7dd-4670-a045-ea76d9734ee7 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:38:49.172688 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-bc5206fe-e7dd-4670-a045-ea76d9734ee7 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] 10.222.0.20 "POST /compute/v2.1/servers/065efbd0-fdd1-4b98-ba6a-b132a9b99086/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.251304 Oct 20 06:38:49.173424 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1311/2612] 10.222.0.20 () {60 vars in 1323 bytes} [Thu Oct 20 06:38:48 2022] POST /compute/v2.1/servers/065efbd0-fdd1-4b98-ba6a-b132a9b99086/os-volume_attachments => generated 194 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:38:55.708258 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-298c53e4-dbbb-4f24-8fcf-439e78c87a5e tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:38:55.708912 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-298c53e4-dbbb-4f24-8fcf-439e78c87a5e tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] [instance: 065efbd0-fdd1-4b98-ba6a-b132a9b99086] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:38:55.716680 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-298c53e4-dbbb-4f24-8fcf-439e78c87a5e tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:38:55.716928 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-298c53e4-dbbb-4f24-8fcf-439e78c87a5e tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:38:55.717368 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-298c53e4-dbbb-4f24-8fcf-439e78c87a5e tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:38:55.718055 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-298c53e4-dbbb-4f24-8fcf-439e78c87a5e tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:38:55.718502 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-298c53e4-dbbb-4f24-8fcf-439e78c87a5e tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:38:55.718927 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-298c53e4-dbbb-4f24-8fcf-439e78c87a5e tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:38:55.847641 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-298c53e4-dbbb-4f24-8fcf-439e78c87a5e tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30be578ddd664bc79498d9a21f708f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6d602fe085a4d7d82788e61287b352d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:38:55.855824 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-298c53e4-dbbb-4f24-8fcf-439e78c87a5e tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] 10.222.0.20 "GET /compute/v2.1/servers/065efbd0-fdd1-4b98-ba6a-b132a9b99086" status: 200 len: 1594 microversion: 2.1 time: 0.151405 Oct 20 06:38:55.856417 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1302/2613] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:38:55 2022] GET /compute/v2.1/servers/065efbd0-fdd1-4b98-ba6a-b132a9b99086 => generated 1594 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:38:57.773299 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG dbcounter [-] [118860] Writing DB stats nova_cell0:SELECT=2 {{(pid=118860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:38:57.777699 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [req-496919a8-41b1-4bc0-bbbc-92c9968c55f7 req-906436c5-8a6f-462b-99b7-d3a385e28094 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "065efbd0-fdd1-4b98-ba6a-b132a9b99086", "tag": "8c1553c3-fdce-433e-84c9-e9d42237847c"}]} {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 06:38:57.789427 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [req-496919a8-41b1-4bc0-bbbc-92c9968c55f7 req-906436c5-8a6f-462b-99b7-d3a385e28094 service nova] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:38:57.790264 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [req-496919a8-41b1-4bc0-bbbc-92c9968c55f7 req-906436c5-8a6f-462b-99b7-d3a385e28094 service nova] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:38:57.790722 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [req-496919a8-41b1-4bc0-bbbc-92c9968c55f7 req-906436c5-8a6f-462b-99b7-d3a385e28094 service nova] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:38:57.803440 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.compute.server_external_events [req-496919a8-41b1-4bc0-bbbc-92c9968c55f7 req-906436c5-8a6f-462b-99b7-d3a385e28094 service nova] Creating event network-changed:8c1553c3-fdce-433e-84c9-e9d42237847c for instance 065efbd0-fdd1-4b98-ba6a-b132a9b99086 on hv-cinder-86156 Oct 20 06:38:57.808796 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [req-496919a8-41b1-4bc0-bbbc-92c9968c55f7 req-906436c5-8a6f-462b-99b7-d3a385e28094 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036974 Oct 20 06:38:57.810198 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1312/2614] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 20 06:38:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:38:59.003270 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-918d08ab-b8c0-4e72-9001-64e28454e79c tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1477133084"}} {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 06:38:59.003906 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-918d08ab-b8c0-4e72-9001-64e28454e79c tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] [instance: 065efbd0-fdd1-4b98-ba6a-b132a9b99086] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:38:59.010618 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-918d08ab-b8c0-4e72-9001-64e28454e79c tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:38:59.011103 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-918d08ab-b8c0-4e72-9001-64e28454e79c tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:38:59.011559 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-918d08ab-b8c0-4e72-9001-64e28454e79c tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:38:59.012263 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-918d08ab-b8c0-4e72-9001-64e28454e79c tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:38:59.013345 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-918d08ab-b8c0-4e72-9001-64e28454e79c tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:38:59.013773 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-918d08ab-b8c0-4e72-9001-64e28454e79c tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:38:59.143222 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.network.security_group_api [None req-918d08ab-b8c0-4e72-9001-64e28454e79c tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Adding security group db9fe50e-d10c-45c8-ba52-aab4ee1ff84f to port 8c1553c3-fdce-433e-84c9-e9d42237847c Oct 20 06:38:59.483418 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-918d08ab-b8c0-4e72-9001-64e28454e79c tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] 10.222.0.20 "POST /compute/v2.1/servers/065efbd0-fdd1-4b98-ba6a-b132a9b99086/action" status: 202 len: 0 microversion: 2.1 time: 0.484109 Oct 20 06:38:59.484025 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1303/2615] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Oct 20 06:38:58 2022] POST /compute/v2.1/servers/065efbd0-fdd1-4b98-ba6a-b132a9b99086/action => generated 0 bytes in 485 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 20 06:38:59.492631 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-366186a9-0550-4f84-9f99-4d25b39b720f tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:38:59.493359 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-366186a9-0550-4f84-9f99-4d25b39b720f tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] [instance: 065efbd0-fdd1-4b98-ba6a-b132a9b99086] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:38:59.500683 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-366186a9-0550-4f84-9f99-4d25b39b720f tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:38:59.501193 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-366186a9-0550-4f84-9f99-4d25b39b720f tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:38:59.501628 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-366186a9-0550-4f84-9f99-4d25b39b720f tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:38:59.502320 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-366186a9-0550-4f84-9f99-4d25b39b720f tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:38:59.502773 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-366186a9-0550-4f84-9f99-4d25b39b720f tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:38:59.503200 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-366186a9-0550-4f84-9f99-4d25b39b720f tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:38:59.651169 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-366186a9-0550-4f84-9f99-4d25b39b720f tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30be578ddd664bc79498d9a21f708f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6d602fe085a4d7d82788e61287b352d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:38:59.660436 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-366186a9-0550-4f84-9f99-4d25b39b720f tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] 10.222.0.20 "GET /compute/v2.1/servers/065efbd0-fdd1-4b98-ba6a-b132a9b99086" status: 200 len: 1760 microversion: 2.1 time: 0.171971 Oct 20 06:38:59.661051 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1313/2616] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:38:59 2022] GET /compute/v2.1/servers/065efbd0-fdd1-4b98-ba6a-b132a9b99086 => generated 1760 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:38:59.824636 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [req-83c03620-f5dc-4a30-9c72-16eb327de5bc req-7ca0d8df-bed1-4793-89ec-724eb196e2dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "065efbd0-fdd1-4b98-ba6a-b132a9b99086", "tag": "8c1553c3-fdce-433e-84c9-e9d42237847c"}]} {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 06:38:59.834299 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [req-83c03620-f5dc-4a30-9c72-16eb327de5bc req-7ca0d8df-bed1-4793-89ec-724eb196e2dc service nova] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:38:59.834780 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [req-83c03620-f5dc-4a30-9c72-16eb327de5bc req-7ca0d8df-bed1-4793-89ec-724eb196e2dc service nova] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:38:59.835216 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [req-83c03620-f5dc-4a30-9c72-16eb327de5bc req-7ca0d8df-bed1-4793-89ec-724eb196e2dc service nova] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:38:59.846654 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.compute.server_external_events [req-83c03620-f5dc-4a30-9c72-16eb327de5bc req-7ca0d8df-bed1-4793-89ec-724eb196e2dc service nova] Creating event network-changed:8c1553c3-fdce-433e-84c9-e9d42237847c for instance 065efbd0-fdd1-4b98-ba6a-b132a9b99086 on hv-cinder-86156 Oct 20 06:38:59.851928 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [req-83c03620-f5dc-4a30-9c72-16eb327de5bc req-7ca0d8df-bed1-4793-89ec-724eb196e2dc service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030966 Oct 20 06:38:59.852512 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1304/2617] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 20 06:38:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:39:22.243460 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-599771aa-a93a-44b1-b330-c7e70cae319b tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 06:39:22.245664 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-599771aa-a93a-44b1-b330-c7e70cae319b tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] [instance: 065efbd0-fdd1-4b98-ba6a-b132a9b99086] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:39:22.248682 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG dbcounter [-] [118860] Writing DB stats nova_api:SELECT=23 {{(pid=118860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:39:22.249355 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG dbcounter [-] [118860] Writing DB stats nova_cell1:SELECT=66,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:39:22.254979 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-599771aa-a93a-44b1-b330-c7e70cae319b tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:39:22.255458 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-599771aa-a93a-44b1-b330-c7e70cae319b tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:39:22.255898 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-599771aa-a93a-44b1-b330-c7e70cae319b tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:39:22.256582 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-599771aa-a93a-44b1-b330-c7e70cae319b tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:39:22.257060 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-599771aa-a93a-44b1-b330-c7e70cae319b tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:39:22.257489 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-599771aa-a93a-44b1-b330-c7e70cae319b tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:39:22.331361 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-599771aa-a93a-44b1-b330-c7e70cae319b tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] 10.222.0.20 "POST /compute/v2.1/servers/065efbd0-fdd1-4b98-ba6a-b132a9b99086/action" status: 202 len: 0 microversion: 2.1 time: 0.091609 Oct 20 06:39:22.332041 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1314/2618] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Oct 20 06:39:22 2022] POST /compute/v2.1/servers/065efbd0-fdd1-4b98-ba6a-b132a9b99086/action => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 20 06:39:22.338067 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG dbcounter [-] [118861] Writing DB stats nova_api:SELECT=23 {{(pid=118861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:39:22.338831 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG dbcounter [-] [118861] Writing DB stats nova_cell1:SELECT=65 {{(pid=118861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:39:22.343149 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-f7a3ebc2-6912-4372-94af-04799670e7a8 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:39:22.343857 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-f7a3ebc2-6912-4372-94af-04799670e7a8 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] [instance: 065efbd0-fdd1-4b98-ba6a-b132a9b99086] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:39:22.352273 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f7a3ebc2-6912-4372-94af-04799670e7a8 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:39:22.352778 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f7a3ebc2-6912-4372-94af-04799670e7a8 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:39:22.353214 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f7a3ebc2-6912-4372-94af-04799670e7a8 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:39:22.353905 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f7a3ebc2-6912-4372-94af-04799670e7a8 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:39:22.354353 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f7a3ebc2-6912-4372-94af-04799670e7a8 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:39:22.354787 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-f7a3ebc2-6912-4372-94af-04799670e7a8 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:39:22.502834 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-f7a3ebc2-6912-4372-94af-04799670e7a8 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30be578ddd664bc79498d9a21f708f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6d602fe085a4d7d82788e61287b352d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:39:22.511290 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-f7a3ebc2-6912-4372-94af-04799670e7a8 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] 10.222.0.20 "GET /compute/v2.1/servers/065efbd0-fdd1-4b98-ba6a-b132a9b99086" status: 200 len: 1752 microversion: 2.1 time: 0.174765 Oct 20 06:39:22.511856 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1305/2619] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:39:22 2022] GET /compute/v2.1/servers/065efbd0-fdd1-4b98-ba6a-b132a9b99086 => generated 1752 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:39:23.537031 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-7eb6ad44-c68d-4a95-b568-1b394e3468ef tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:39:23.537734 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-7eb6ad44-c68d-4a95-b568-1b394e3468ef tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] [instance: 065efbd0-fdd1-4b98-ba6a-b132a9b99086] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:39:23.543804 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7eb6ad44-c68d-4a95-b568-1b394e3468ef tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:39:23.544409 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7eb6ad44-c68d-4a95-b568-1b394e3468ef tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:39:23.544881 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7eb6ad44-c68d-4a95-b568-1b394e3468ef tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:39:23.545577 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7eb6ad44-c68d-4a95-b568-1b394e3468ef tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:39:23.546031 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7eb6ad44-c68d-4a95-b568-1b394e3468ef tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:39:23.546461 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-7eb6ad44-c68d-4a95-b568-1b394e3468ef tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:39:23.686601 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-7eb6ad44-c68d-4a95-b568-1b394e3468ef tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30be578ddd664bc79498d9a21f708f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6d602fe085a4d7d82788e61287b352d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:39:23.694760 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-7eb6ad44-c68d-4a95-b568-1b394e3468ef tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] 10.222.0.20 "GET /compute/v2.1/servers/065efbd0-fdd1-4b98-ba6a-b132a9b99086" status: 200 len: 1757 microversion: 2.1 time: 0.162384 Oct 20 06:39:23.695329 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1315/2620] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:39:23 2022] GET /compute/v2.1/servers/065efbd0-fdd1-4b98-ba6a-b132a9b99086 => generated 1757 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:39:24.719651 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-a4801cd2-f95d-4341-b816-6a61145244b9 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:39:24.720293 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-a4801cd2-f95d-4341-b816-6a61145244b9 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] [instance: 065efbd0-fdd1-4b98-ba6a-b132a9b99086] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:39:24.726796 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a4801cd2-f95d-4341-b816-6a61145244b9 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:39:24.727268 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a4801cd2-f95d-4341-b816-6a61145244b9 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:39:24.727699 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a4801cd2-f95d-4341-b816-6a61145244b9 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:39:24.728380 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a4801cd2-f95d-4341-b816-6a61145244b9 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:39:24.728852 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a4801cd2-f95d-4341-b816-6a61145244b9 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:39:24.729274 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a4801cd2-f95d-4341-b816-6a61145244b9 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:39:24.870518 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-a4801cd2-f95d-4341-b816-6a61145244b9 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30be578ddd664bc79498d9a21f708f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6d602fe085a4d7d82788e61287b352d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:39:24.878700 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-a4801cd2-f95d-4341-b816-6a61145244b9 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] 10.222.0.20 "GET /compute/v2.1/servers/065efbd0-fdd1-4b98-ba6a-b132a9b99086" status: 200 len: 1757 microversion: 2.1 time: 0.163472 Oct 20 06:39:24.879265 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1306/2621] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:39:24 2022] GET /compute/v2.1/servers/065efbd0-fdd1-4b98-ba6a-b132a9b99086 => generated 1757 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:39:25.902487 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-47aff3bf-ae52-401f-9efd-abf9dbd4f999 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:39:25.903821 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-47aff3bf-ae52-401f-9efd-abf9dbd4f999 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] [instance: 065efbd0-fdd1-4b98-ba6a-b132a9b99086] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:39:25.910181 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-47aff3bf-ae52-401f-9efd-abf9dbd4f999 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:39:25.910662 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-47aff3bf-ae52-401f-9efd-abf9dbd4f999 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:39:25.911102 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-47aff3bf-ae52-401f-9efd-abf9dbd4f999 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:39:25.911788 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-47aff3bf-ae52-401f-9efd-abf9dbd4f999 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:39:25.912245 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-47aff3bf-ae52-401f-9efd-abf9dbd4f999 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:39:25.912671 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-47aff3bf-ae52-401f-9efd-abf9dbd4f999 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:39:26.054844 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-47aff3bf-ae52-401f-9efd-abf9dbd4f999 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30be578ddd664bc79498d9a21f708f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6d602fe085a4d7d82788e61287b352d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:39:26.062931 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-47aff3bf-ae52-401f-9efd-abf9dbd4f999 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] 10.222.0.20 "GET /compute/v2.1/servers/065efbd0-fdd1-4b98-ba6a-b132a9b99086" status: 200 len: 1757 microversion: 2.1 time: 0.164274 Oct 20 06:39:26.063494 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1316/2622] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:39:25 2022] GET /compute/v2.1/servers/065efbd0-fdd1-4b98-ba6a-b132a9b99086 => generated 1757 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:39:27.088245 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-e8403ef4-a019-4c50-80c7-aab1409d20a0 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:39:27.088810 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-e8403ef4-a019-4c50-80c7-aab1409d20a0 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] [instance: 065efbd0-fdd1-4b98-ba6a-b132a9b99086] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:39:27.095048 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e8403ef4-a019-4c50-80c7-aab1409d20a0 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:39:27.095525 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e8403ef4-a019-4c50-80c7-aab1409d20a0 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:39:27.095953 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e8403ef4-a019-4c50-80c7-aab1409d20a0 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:39:27.096632 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e8403ef4-a019-4c50-80c7-aab1409d20a0 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:39:27.097105 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e8403ef4-a019-4c50-80c7-aab1409d20a0 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:39:27.097521 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e8403ef4-a019-4c50-80c7-aab1409d20a0 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:39:27.240723 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-e8403ef4-a019-4c50-80c7-aab1409d20a0 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30be578ddd664bc79498d9a21f708f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6d602fe085a4d7d82788e61287b352d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:39:27.250189 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-e8403ef4-a019-4c50-80c7-aab1409d20a0 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] 10.222.0.20 "GET /compute/v2.1/servers/065efbd0-fdd1-4b98-ba6a-b132a9b99086" status: 200 len: 1757 microversion: 2.1 time: 0.165862 Oct 20 06:39:27.250759 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1307/2623] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:39:27 2022] GET /compute/v2.1/servers/065efbd0-fdd1-4b98-ba6a-b132a9b99086 => generated 1757 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:39:28.275254 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-e5e88cfc-68e7-4a00-a7ae-0704e56fcd27 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:39:28.275849 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-e5e88cfc-68e7-4a00-a7ae-0704e56fcd27 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] [instance: 065efbd0-fdd1-4b98-ba6a-b132a9b99086] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:39:28.283199 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e5e88cfc-68e7-4a00-a7ae-0704e56fcd27 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:39:28.283676 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e5e88cfc-68e7-4a00-a7ae-0704e56fcd27 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:39:28.284102 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e5e88cfc-68e7-4a00-a7ae-0704e56fcd27 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:39:28.285085 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e5e88cfc-68e7-4a00-a7ae-0704e56fcd27 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:39:28.285847 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e5e88cfc-68e7-4a00-a7ae-0704e56fcd27 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:39:28.286277 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e5e88cfc-68e7-4a00-a7ae-0704e56fcd27 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:39:28.451586 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-e5e88cfc-68e7-4a00-a7ae-0704e56fcd27 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30be578ddd664bc79498d9a21f708f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6d602fe085a4d7d82788e61287b352d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:39:28.460235 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-e5e88cfc-68e7-4a00-a7ae-0704e56fcd27 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] 10.222.0.20 "GET /compute/v2.1/servers/065efbd0-fdd1-4b98-ba6a-b132a9b99086" status: 200 len: 1757 microversion: 2.1 time: 0.189117 Oct 20 06:39:28.460831 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1317/2624] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:39:28 2022] GET /compute/v2.1/servers/065efbd0-fdd1-4b98-ba6a-b132a9b99086 => generated 1757 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 06:39:29.487438 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-9df27931-b461-449e-bb81-e96668508549 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:39:29.488054 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-9df27931-b461-449e-bb81-e96668508549 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] [instance: 065efbd0-fdd1-4b98-ba6a-b132a9b99086] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:39:29.490728 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 20 06:39:29.490857 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: Thu Oct 20 06:39:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/065efbd0-fdd1-4b98-ba6a-b132a9b99086 (ip 10.222.0.20) !!! Oct 20 06:39:29.499003 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-9df27931-b461-449e-bb81-e96668508549 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:39:29.499461 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-9df27931-b461-449e-bb81-e96668508549 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:39:29.499899 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-9df27931-b461-449e-bb81-e96668508549 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:39:29.500589 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-9df27931-b461-449e-bb81-e96668508549 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:39:29.501066 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-9df27931-b461-449e-bb81-e96668508549 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:39:29.501489 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-9df27931-b461-449e-bb81-e96668508549 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:39:29.645555 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-9df27931-b461-449e-bb81-e96668508549 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30be578ddd664bc79498d9a21f708f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6d602fe085a4d7d82788e61287b352d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:39:29.653989 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-9df27931-b461-449e-bb81-e96668508549 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] 10.222.0.20 "GET /compute/v2.1/servers/065efbd0-fdd1-4b98-ba6a-b132a9b99086" status: 200 len: 1757 microversion: 2.1 time: 0.170456 Oct 20 06:39:29.654552 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1308/2625] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:39:29 2022] GET /compute/v2.1/servers/065efbd0-fdd1-4b98-ba6a-b132a9b99086 => generated 1757 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:39:30.676388 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-1139e75e-b5dd-4dd0-bda5-5683b2e2fdb4 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:39:30.677027 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-1139e75e-b5dd-4dd0-bda5-5683b2e2fdb4 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] [instance: 065efbd0-fdd1-4b98-ba6a-b132a9b99086] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:39:30.683959 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1139e75e-b5dd-4dd0-bda5-5683b2e2fdb4 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:39:30.686734 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1139e75e-b5dd-4dd0-bda5-5683b2e2fdb4 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:39:30.687282 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1139e75e-b5dd-4dd0-bda5-5683b2e2fdb4 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:39:30.688412 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1139e75e-b5dd-4dd0-bda5-5683b2e2fdb4 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:39:30.688899 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1139e75e-b5dd-4dd0-bda5-5683b2e2fdb4 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:39:30.689464 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1139e75e-b5dd-4dd0-bda5-5683b2e2fdb4 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:39:30.835478 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-1139e75e-b5dd-4dd0-bda5-5683b2e2fdb4 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30be578ddd664bc79498d9a21f708f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6d602fe085a4d7d82788e61287b352d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:39:30.843850 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-1139e75e-b5dd-4dd0-bda5-5683b2e2fdb4 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] 10.222.0.20 "GET /compute/v2.1/servers/065efbd0-fdd1-4b98-ba6a-b132a9b99086" status: 200 len: 1757 microversion: 2.1 time: 0.171303 Oct 20 06:39:30.844405 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1318/2626] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:39:30 2022] GET /compute/v2.1/servers/065efbd0-fdd1-4b98-ba6a-b132a9b99086 => generated 1757 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 06:39:31.867389 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-ceea2be4-5be5-4a0b-b4eb-d25d60f5bc2a tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:39:31.868004 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-ceea2be4-5be5-4a0b-b4eb-d25d60f5bc2a tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] [instance: 065efbd0-fdd1-4b98-ba6a-b132a9b99086] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:39:31.874761 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ceea2be4-5be5-4a0b-b4eb-d25d60f5bc2a tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:39:31.875246 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ceea2be4-5be5-4a0b-b4eb-d25d60f5bc2a tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:39:31.875685 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ceea2be4-5be5-4a0b-b4eb-d25d60f5bc2a tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:39:31.876376 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ceea2be4-5be5-4a0b-b4eb-d25d60f5bc2a tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:39:31.876872 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ceea2be4-5be5-4a0b-b4eb-d25d60f5bc2a tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:39:31.877301 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-ceea2be4-5be5-4a0b-b4eb-d25d60f5bc2a tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:39:32.015934 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-ceea2be4-5be5-4a0b-b4eb-d25d60f5bc2a tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30be578ddd664bc79498d9a21f708f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6d602fe085a4d7d82788e61287b352d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:39:32.024010 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-ceea2be4-5be5-4a0b-b4eb-d25d60f5bc2a tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] 10.222.0.20 "GET /compute/v2.1/servers/065efbd0-fdd1-4b98-ba6a-b132a9b99086" status: 200 len: 1757 microversion: 2.1 time: 0.160568 Oct 20 06:39:32.024572 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1309/2627] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:39:31 2022] GET /compute/v2.1/servers/065efbd0-fdd1-4b98-ba6a-b132a9b99086 => generated 1757 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:39:33.047976 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-57f35875-0d9f-42dd-b597-6501f1b3b7e4 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:39:33.048588 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-57f35875-0d9f-42dd-b597-6501f1b3b7e4 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] [instance: 065efbd0-fdd1-4b98-ba6a-b132a9b99086] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:39:33.055130 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-57f35875-0d9f-42dd-b597-6501f1b3b7e4 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:39:33.055606 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-57f35875-0d9f-42dd-b597-6501f1b3b7e4 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:39:33.056053 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-57f35875-0d9f-42dd-b597-6501f1b3b7e4 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:39:33.056769 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-57f35875-0d9f-42dd-b597-6501f1b3b7e4 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:39:33.057227 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-57f35875-0d9f-42dd-b597-6501f1b3b7e4 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:39:33.057656 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-57f35875-0d9f-42dd-b597-6501f1b3b7e4 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:39:33.201418 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-57f35875-0d9f-42dd-b597-6501f1b3b7e4 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30be578ddd664bc79498d9a21f708f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6d602fe085a4d7d82788e61287b352d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:39:33.209747 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-57f35875-0d9f-42dd-b597-6501f1b3b7e4 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] 10.222.0.20 "GET /compute/v2.1/servers/065efbd0-fdd1-4b98-ba6a-b132a9b99086" status: 200 len: 1757 microversion: 2.1 time: 0.166332 Oct 20 06:39:33.210304 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1319/2628] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:39:33 2022] GET /compute/v2.1/servers/065efbd0-fdd1-4b98-ba6a-b132a9b99086 => generated 1757 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:39:34.233594 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-8545129c-1c64-42b2-b5e6-5a582d84be66 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:39:34.234209 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-8545129c-1c64-42b2-b5e6-5a582d84be66 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] [instance: 065efbd0-fdd1-4b98-ba6a-b132a9b99086] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:39:34.240661 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-8545129c-1c64-42b2-b5e6-5a582d84be66 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:39:34.241208 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-8545129c-1c64-42b2-b5e6-5a582d84be66 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:39:34.241643 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-8545129c-1c64-42b2-b5e6-5a582d84be66 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:39:34.242365 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-8545129c-1c64-42b2-b5e6-5a582d84be66 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:39:34.242799 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-8545129c-1c64-42b2-b5e6-5a582d84be66 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:39:34.243241 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-8545129c-1c64-42b2-b5e6-5a582d84be66 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:39:34.390421 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-8545129c-1c64-42b2-b5e6-5a582d84be66 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30be578ddd664bc79498d9a21f708f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6d602fe085a4d7d82788e61287b352d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:39:34.398421 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-8545129c-1c64-42b2-b5e6-5a582d84be66 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] 10.222.0.20 "GET /compute/v2.1/servers/065efbd0-fdd1-4b98-ba6a-b132a9b99086" status: 200 len: 1757 microversion: 2.1 time: 0.169024 Oct 20 06:39:34.398981 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1310/2629] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:39:34 2022] GET /compute/v2.1/servers/065efbd0-fdd1-4b98-ba6a-b132a9b99086 => generated 1757 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:39:35.421413 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-3d1ce268-8350-4350-b8cf-b8b9797a6f8e tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:39:35.422023 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-3d1ce268-8350-4350-b8cf-b8b9797a6f8e tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] [instance: 065efbd0-fdd1-4b98-ba6a-b132a9b99086] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:39:35.428454 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3d1ce268-8350-4350-b8cf-b8b9797a6f8e tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:39:35.428957 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3d1ce268-8350-4350-b8cf-b8b9797a6f8e tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:39:35.429386 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3d1ce268-8350-4350-b8cf-b8b9797a6f8e tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:39:35.430064 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3d1ce268-8350-4350-b8cf-b8b9797a6f8e tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:39:35.430510 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3d1ce268-8350-4350-b8cf-b8b9797a6f8e tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:39:35.430928 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3d1ce268-8350-4350-b8cf-b8b9797a6f8e tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:39:35.575182 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-3d1ce268-8350-4350-b8cf-b8b9797a6f8e tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30be578ddd664bc79498d9a21f708f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6d602fe085a4d7d82788e61287b352d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:39:35.583517 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-3d1ce268-8350-4350-b8cf-b8b9797a6f8e tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] 10.222.0.20 "GET /compute/v2.1/servers/065efbd0-fdd1-4b98-ba6a-b132a9b99086" status: 200 len: 1760 microversion: 2.1 time: 0.165976 Oct 20 06:39:35.584304 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1320/2630] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:39:35 2022] GET /compute/v2.1/servers/065efbd0-fdd1-4b98-ba6a-b132a9b99086 => generated 1760 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:40:07.843198 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-defd3967-9cec-4382-9525-8d802d4a5794 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1477133084"}} {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 06:40:07.843788 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-defd3967-9cec-4382-9525-8d802d4a5794 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] [instance: 065efbd0-fdd1-4b98-ba6a-b132a9b99086] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:40:07.845828 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG dbcounter [-] [118861] Writing DB stats nova_api:SELECT=12 {{(pid=118861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:40:07.846476 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG dbcounter [-] [118861] Writing DB stats nova_cell1:SELECT=36 {{(pid=118861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:40:07.852569 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-defd3967-9cec-4382-9525-8d802d4a5794 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:40:07.853076 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-defd3967-9cec-4382-9525-8d802d4a5794 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:40:07.853512 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-defd3967-9cec-4382-9525-8d802d4a5794 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:40:07.854205 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-defd3967-9cec-4382-9525-8d802d4a5794 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:40:07.854653 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-defd3967-9cec-4382-9525-8d802d4a5794 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:40:07.856234 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-defd3967-9cec-4382-9525-8d802d4a5794 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:40:07.986091 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.network.security_group_api [None req-defd3967-9cec-4382-9525-8d802d4a5794 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Removing security group db9fe50e-d10c-45c8-ba52-aab4ee1ff84f from port 8c1553c3-fdce-433e-84c9-e9d42237847c Oct 20 06:40:08.289686 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-defd3967-9cec-4382-9525-8d802d4a5794 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] 10.222.0.20 "POST /compute/v2.1/servers/065efbd0-fdd1-4b98-ba6a-b132a9b99086/action" status: 202 len: 0 microversion: 2.1 time: 0.451456 Oct 20 06:40:08.290314 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1311/2631] 10.222.0.20 () {60 vars in 1278 bytes} [Thu Oct 20 06:40:07 2022] POST /compute/v2.1/servers/065efbd0-fdd1-4b98-ba6a-b132a9b99086/action => generated 0 bytes in 453 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 20 06:40:08.309151 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG dbcounter [-] [118860] Writing DB stats nova_api:SELECT=14 {{(pid=118860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:40:08.309966 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG dbcounter [-] [118860] Writing DB stats nova_cell1:SELECT=46,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:40:08.384410 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [req-1d572cdf-0d15-4080-b957-05928ff2ffa8 req-e2de7187-220e-4dec-9083-89b12c443661 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "065efbd0-fdd1-4b98-ba6a-b132a9b99086", "tag": "8c1553c3-fdce-433e-84c9-e9d42237847c"}]} {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 06:40:08.394464 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [req-1d572cdf-0d15-4080-b957-05928ff2ffa8 req-e2de7187-220e-4dec-9083-89b12c443661 service nova] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:40:08.394940 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [req-1d572cdf-0d15-4080-b957-05928ff2ffa8 req-e2de7187-220e-4dec-9083-89b12c443661 service nova] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:40:08.395379 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [req-1d572cdf-0d15-4080-b957-05928ff2ffa8 req-e2de7187-220e-4dec-9083-89b12c443661 service nova] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:40:08.408953 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.compute.server_external_events [req-1d572cdf-0d15-4080-b957-05928ff2ffa8 req-e2de7187-220e-4dec-9083-89b12c443661 service nova] Creating event network-changed:8c1553c3-fdce-433e-84c9-e9d42237847c for instance 065efbd0-fdd1-4b98-ba6a-b132a9b99086 on hv-cinder-86156 Oct 20 06:40:08.414617 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [req-1d572cdf-0d15-4080-b957-05928ff2ffa8 req-e2de7187-220e-4dec-9083-89b12c443661 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.118726 Oct 20 06:40:08.415575 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1321/2632] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 20 06:40:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:40:09.636522 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-526d7027-3614-4813-a8b9-670079c53426 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:40:09.637095 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-526d7027-3614-4813-a8b9-670079c53426 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] [instance: 065efbd0-fdd1-4b98-ba6a-b132a9b99086] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:40:09.642941 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-526d7027-3614-4813-a8b9-670079c53426 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:40:09.643417 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-526d7027-3614-4813-a8b9-670079c53426 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:40:09.643845 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-526d7027-3614-4813-a8b9-670079c53426 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:40:09.644533 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-526d7027-3614-4813-a8b9-670079c53426 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:40:09.645004 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-526d7027-3614-4813-a8b9-670079c53426 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:40:09.645425 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-526d7027-3614-4813-a8b9-670079c53426 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:40:09.725722 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.objects.instance [None req-526d7027-3614-4813-a8b9-670079c53426 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Lazy-loading 'services' on Instance uuid 065efbd0-fdd1-4b98-ba6a-b132a9b99086 {{(pid=118861) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 20 06:40:09.797254 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-526d7027-3614-4813-a8b9-670079c53426 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] 10.222.0.20 "DELETE /compute/v2.1/servers/065efbd0-fdd1-4b98-ba6a-b132a9b99086/os-volume_attachments/853c981c-1e34-486f-a89d-c7c1c3b715e9" status: 202 len: 0 microversion: 2.1 time: 0.164973 Oct 20 06:40:09.797958 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1312/2633] 10.222.0.20 () {58 vars in 1416 bytes} [Thu Oct 20 06:40:09 2022] DELETE /compute/v2.1/servers/065efbd0-fdd1-4b98-ba6a-b132a9b99086/os-volume_attachments/853c981c-1e34-486f-a89d-c7c1c3b715e9 => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 20 06:40:09.807622 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-4286d80b-d619-42c4-a649-bbd2342029de tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:40:09.810648 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-4286d80b-d619-42c4-a649-bbd2342029de tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] [instance: 065efbd0-fdd1-4b98-ba6a-b132a9b99086] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:40:09.817488 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-4286d80b-d619-42c4-a649-bbd2342029de tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:40:09.818264 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-4286d80b-d619-42c4-a649-bbd2342029de tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:40:09.818905 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-4286d80b-d619-42c4-a649-bbd2342029de tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:40:09.819682 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-4286d80b-d619-42c4-a649-bbd2342029de tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:40:09.820194 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-4286d80b-d619-42c4-a649-bbd2342029de tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:40:09.820892 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-4286d80b-d619-42c4-a649-bbd2342029de tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:40:09.851508 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-4286d80b-d619-42c4-a649-bbd2342029de tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] 10.222.0.20 "GET /compute/v2.1/servers/065efbd0-fdd1-4b98-ba6a-b132a9b99086/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048848 Oct 20 06:40:09.852162 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1322/2634] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:40:09 2022] GET /compute/v2.1/servers/065efbd0-fdd1-4b98-ba6a-b132a9b99086/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:40:10.432339 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [req-0b78ab28-1d0a-4629-9f61-15774cfb455e req-01acab70-4afc-4dcc-bafd-f9c70b567a6b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "065efbd0-fdd1-4b98-ba6a-b132a9b99086", "tag": "8c1553c3-fdce-433e-84c9-e9d42237847c"}]} {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 06:40:10.442378 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [req-0b78ab28-1d0a-4629-9f61-15774cfb455e req-01acab70-4afc-4dcc-bafd-f9c70b567a6b service nova] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:40:10.442853 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [req-0b78ab28-1d0a-4629-9f61-15774cfb455e req-01acab70-4afc-4dcc-bafd-f9c70b567a6b service nova] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:40:10.443281 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [req-0b78ab28-1d0a-4629-9f61-15774cfb455e req-01acab70-4afc-4dcc-bafd-f9c70b567a6b service nova] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:40:10.454881 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.compute.server_external_events [req-0b78ab28-1d0a-4629-9f61-15774cfb455e req-01acab70-4afc-4dcc-bafd-f9c70b567a6b service nova] Creating event network-changed:8c1553c3-fdce-433e-84c9-e9d42237847c for instance 065efbd0-fdd1-4b98-ba6a-b132a9b99086 on hv-cinder-86156 Oct 20 06:40:10.459621 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [req-0b78ab28-1d0a-4629-9f61-15774cfb455e req-01acab70-4afc-4dcc-bafd-f9c70b567a6b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031484 Oct 20 06:40:10.460196 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1313/2635] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 20 06:40:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:40:10.863645 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-3b600146-2b74-470f-82ff-0e6164f790e9 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:40:10.865903 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-3b600146-2b74-470f-82ff-0e6164f790e9 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] [instance: 065efbd0-fdd1-4b98-ba6a-b132a9b99086] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:40:10.873005 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3b600146-2b74-470f-82ff-0e6164f790e9 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:40:10.873492 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3b600146-2b74-470f-82ff-0e6164f790e9 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:40:10.873933 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3b600146-2b74-470f-82ff-0e6164f790e9 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:40:10.874632 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3b600146-2b74-470f-82ff-0e6164f790e9 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:40:10.875087 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3b600146-2b74-470f-82ff-0e6164f790e9 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:40:10.875512 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3b600146-2b74-470f-82ff-0e6164f790e9 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:40:10.905623 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-3b600146-2b74-470f-82ff-0e6164f790e9 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] 10.222.0.20 "GET /compute/v2.1/servers/065efbd0-fdd1-4b98-ba6a-b132a9b99086/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045966 Oct 20 06:40:10.906188 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1323/2636] 10.222.0.20 () {58 vars in 1302 bytes} [Thu Oct 20 06:40:10 2022] GET /compute/v2.1/servers/065efbd0-fdd1-4b98-ba6a-b132a9b99086/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 20 06:40:10.917623 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-e2b398ba-4675-4287-ad29-1ddb0e5ad5f0 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:40:10.918498 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-e2b398ba-4675-4287-ad29-1ddb0e5ad5f0 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] [instance: 065efbd0-fdd1-4b98-ba6a-b132a9b99086] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:40:10.924531 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e2b398ba-4675-4287-ad29-1ddb0e5ad5f0 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:40:10.925055 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e2b398ba-4675-4287-ad29-1ddb0e5ad5f0 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:40:10.925493 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e2b398ba-4675-4287-ad29-1ddb0e5ad5f0 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:40:10.926191 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e2b398ba-4675-4287-ad29-1ddb0e5ad5f0 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:40:10.926640 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e2b398ba-4675-4287-ad29-1ddb0e5ad5f0 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:40:10.927069 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e2b398ba-4675-4287-ad29-1ddb0e5ad5f0 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:40:11.008956 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.wsgi [None req-e2b398ba-4675-4287-ad29-1ddb0e5ad5f0 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] HTTP exception thrown: Instance 065efbd0-fdd1-4b98-ba6a-b132a9b99086 is not attached to volume 853c981c-1e34-486f-a89d-c7c1c3b715e9 Oct 20 06:40:11.020883 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-e2b398ba-4675-4287-ad29-1ddb0e5ad5f0 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Request method failure captured: Oct 20 06:40:11.020883 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: request: DELETE /compute/v2.1/servers/065efbd0-fdd1-4b98-ba6a-b132a9b99086/os-volume_attachments/853c981c-1e34-486f-a89d-c7c1c3b715e9 HTTP/1.1 Oct 20 06:40:11.020883 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: Accept: application/json Oct 20 06:40:11.020883 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: Accept-Encoding: identity Oct 20 06:40:11.020883 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: Connection: close Oct 20 06:40:11.020883 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: Content-Length: 0 Oct 20 06:40:11.020883 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: Content-Type: application/json Oct 20 06:40:11.020883 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: Host: 10.222.0.20 Oct 20 06:40:11.020883 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: Openstack-System-Scope: None Oct 20 06:40:11.020883 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: User-Agent: python-urllib3/1.26.12 Oct 20 06:40:11.020883 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Auth-Token: gAAAAABjUOzEcdWg4Wn4q4l_OQtFHejb8H9Wew4dgKGKG9wcNx4IdIugSymmvZ8enpOjuUE_j4JgeOhXCC-1r3Zd4bngjminYwUb6T-b0abW8DmLBSegHwYw1-JRIcKPSicoiPZcIorBiCH98432w6vEPWAIJFOEEI64KXG56Dxj6xhcDp7fo3E Oct 20 06:40:11.020883 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Domain-Id: None Oct 20 06:40:11.020883 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Domain-Name: None Oct 20 06:40:11.020883 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Identity-Status: Confirmed Oct 20 06:40:11.020883 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Is-Admin-Project: True Oct 20 06:40:11.020883 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Project-Domain-Id: default Oct 20 06:40:11.020883 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Project-Domain-Name: Default Oct 20 06:40:11.020883 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Project-Id: c6d602fe085a4d7d82788e61287b352d Oct 20 06:40:11.020883 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Project-Name: tempest-TestMinimumBasicScenario-1833470283 Oct 20 06:40:11.020883 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Role: reader,member Oct 20 06:40:11.020883 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Roles: reader,member Oct 20 06:40:11.022364 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/c6d602fe085a4d7d82788e61287b352d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_c6d602fe085a4d7d82788e61287b352d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c6d602fe085a4d7d82788e61287b352d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c6d602fe085a4d7d82788e61287b352d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 20 06:40:11.022364 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Tenant: tempest-TestMinimumBasicScenario-1833470283 Oct 20 06:40:11.022364 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Tenant-Id: c6d602fe085a4d7d82788e61287b352d Oct 20 06:40:11.022364 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1833470283 Oct 20 06:40:11.022364 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-User: tempest-TestMinimumBasicScenario-1833470283-project Oct 20 06:40:11.022364 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-User-Domain-Id: default Oct 20 06:40:11.022364 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-User-Domain-Name: Default Oct 20 06:40:11.022364 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-User-Id: 30be578ddd664bc79498d9a21f708f04 Oct 20 06:40:11.022364 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-User-Name: tempest-TestMinimumBasicScenario-1833470283-project Oct 20 06:40:11.022364 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: method: > Oct 20 06:40:11.022364 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: exception: Instance 065efbd0-fdd1-4b98-ba6a-b132a9b99086 is not attached to volume 853c981c-1e34-486f-a89d-c7c1c3b715e9 Oct 20 06:40:11.023102 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: action_args: {'server_id': '065efbd0-fdd1-4b98-ba6a-b132a9b99086', 'id': '853c981c-1e34-486f-a89d-c7c1c3b715e9'} Oct 20 06:40:11.023102 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 20 06:40:11.023102 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 06:40:11.023102 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 20 06:40:11.023102 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 20 06:40:11.023102 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 20 06:40:11.023102 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 20 06:40:11.023102 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 20 06:40:11.023102 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 20 06:40:11.023102 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 853c981c-1e34-486f-a89d-c7c1c3b715e9. Oct 20 06:40:11.023102 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi Oct 20 06:40:11.023102 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 06:40:11.023102 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi Oct 20 06:40:11.023102 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 06:40:11.023102 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 06:40:11.023102 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 06:40:11.023102 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 20 06:40:11.023102 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 20 06:40:11.023102 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 20 06:40:11.024399 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 20 06:40:11.024399 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 20 06:40:11.024399 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 20 06:40:11.024399 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 065efbd0-fdd1-4b98-ba6a-b132a9b99086 is not attached to volume 853c981c-1e34-486f-a89d-c7c1c3b715e9 Oct 20 06:40:11.024399 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi Oct 20 06:40:11.024399 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 06:40:11.024399 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi Oct 20 06:40:11.024399 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 06:40:11.024399 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 06:40:11.024399 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 06:40:11.024399 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 20 06:40:11.024399 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 20 06:40:11.024399 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 065efbd0-fdd1-4b98-ba6a-b132a9b99086 is not attached to volume 853c981c-1e34-486f-a89d-c7c1c3b715e9 Oct 20 06:40:11.024399 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi Oct 20 06:40:11.024399 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-e2b398ba-4675-4287-ad29-1ddb0e5ad5f0 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Returning 404 to user: Instance 065efbd0-fdd1-4b98-ba6a-b132a9b99086 is not attached to volume 853c981c-1e34-486f-a89d-c7c1c3b715e9 {{(pid=118861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 20 06:40:11.025499 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-e2b398ba-4675-4287-ad29-1ddb0e5ad5f0 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] 10.222.0.20 "DELETE /compute/v2.1/servers/065efbd0-fdd1-4b98-ba6a-b132a9b99086/os-volume_attachments/853c981c-1e34-486f-a89d-c7c1c3b715e9" status: 404 len: 154 microversion: 2.1 time: 0.109531 Oct 20 06:40:11.025499 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1314/2637] 10.222.0.20 () {58 vars in 1416 bytes} [Thu Oct 20 06:40:10 2022] DELETE /compute/v2.1/servers/065efbd0-fdd1-4b98-ba6a-b132a9b99086/os-volume_attachments/853c981c-1e34-486f-a89d-c7c1c3b715e9 => generated 154 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 20 06:40:12.162405 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-ed801713-f1b0-4e56-8dac-ce9abbb5adda tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:40:12.162897 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-ed801713-f1b0-4e56-8dac-ce9abbb5adda tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] [instance: 065efbd0-fdd1-4b98-ba6a-b132a9b99086] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:40:12.170060 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-ed801713-f1b0-4e56-8dac-ce9abbb5adda tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:40:12.170529 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-ed801713-f1b0-4e56-8dac-ce9abbb5adda tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:40:12.170956 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-ed801713-f1b0-4e56-8dac-ce9abbb5adda tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:40:12.171631 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-ed801713-f1b0-4e56-8dac-ce9abbb5adda tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:40:12.172077 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-ed801713-f1b0-4e56-8dac-ce9abbb5adda tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:40:12.172495 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-ed801713-f1b0-4e56-8dac-ce9abbb5adda tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:40:12.196925 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-ed801713-f1b0-4e56-8dac-ce9abbb5adda tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] [instance: 065efbd0-fdd1-4b98-ba6a-b132a9b99086] Going to try to terminate instance {{(pid=118860) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 20 06:40:12.271918 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-ed801713-f1b0-4e56-8dac-ce9abbb5adda tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] 10.222.0.20 "DELETE /compute/v2.1/servers/065efbd0-fdd1-4b98-ba6a-b132a9b99086" status: 204 len: 0 microversion: 2.1 time: 0.112904 Oct 20 06:40:12.272540 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1324/2638] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 20 06:40:12 2022] DELETE /compute/v2.1/servers/065efbd0-fdd1-4b98-ba6a-b132a9b99086 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 20 06:40:12.282001 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-60fedb05-5753-42b9-837a-ba1081325c6c tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:40:12.282474 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-60fedb05-5753-42b9-837a-ba1081325c6c tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] [instance: 065efbd0-fdd1-4b98-ba6a-b132a9b99086] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:40:12.289111 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-60fedb05-5753-42b9-837a-ba1081325c6c tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:40:12.289589 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-60fedb05-5753-42b9-837a-ba1081325c6c tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:40:12.290017 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-60fedb05-5753-42b9-837a-ba1081325c6c tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:40:12.290706 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-60fedb05-5753-42b9-837a-ba1081325c6c tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:40:12.291188 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-60fedb05-5753-42b9-837a-ba1081325c6c tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:40:12.291575 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-60fedb05-5753-42b9-837a-ba1081325c6c tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:40:12.426342 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-60fedb05-5753-42b9-837a-ba1081325c6c tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30be578ddd664bc79498d9a21f708f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6d602fe085a4d7d82788e61287b352d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:40:12.434194 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-60fedb05-5753-42b9-837a-ba1081325c6c tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] 10.222.0.20 "GET /compute/v2.1/servers/065efbd0-fdd1-4b98-ba6a-b132a9b99086" status: 200 len: 1554 microversion: 2.1 time: 0.156111 Oct 20 06:40:12.434759 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1315/2639] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:40:12 2022] GET /compute/v2.1/servers/065efbd0-fdd1-4b98-ba6a-b132a9b99086 => generated 1554 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:40:13.457680 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-752d24f4-5c70-47ff-a602-bf9d4d18ac84 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:40:13.458380 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-752d24f4-5c70-47ff-a602-bf9d4d18ac84 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] [instance: 065efbd0-fdd1-4b98-ba6a-b132a9b99086] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:40:13.465820 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-752d24f4-5c70-47ff-a602-bf9d4d18ac84 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:40:13.466303 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-752d24f4-5c70-47ff-a602-bf9d4d18ac84 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:40:13.466767 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-752d24f4-5c70-47ff-a602-bf9d4d18ac84 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:40:13.467487 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-752d24f4-5c70-47ff-a602-bf9d4d18ac84 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:40:13.467937 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-752d24f4-5c70-47ff-a602-bf9d4d18ac84 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:40:13.468361 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-752d24f4-5c70-47ff-a602-bf9d4d18ac84 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:40:13.597759 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-752d24f4-5c70-47ff-a602-bf9d4d18ac84 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30be578ddd664bc79498d9a21f708f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6d602fe085a4d7d82788e61287b352d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:40:13.606192 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-752d24f4-5c70-47ff-a602-bf9d4d18ac84 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] 10.222.0.20 "GET /compute/v2.1/servers/065efbd0-fdd1-4b98-ba6a-b132a9b99086" status: 200 len: 1554 microversion: 2.1 time: 0.152658 Oct 20 06:40:13.606751 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1325/2640] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:40:13 2022] GET /compute/v2.1/servers/065efbd0-fdd1-4b98-ba6a-b132a9b99086 => generated 1554 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:40:14.631209 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-5c9de4d7-6e3c-4bbe-87ee-188020770090 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:40:14.632078 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-5c9de4d7-6e3c-4bbe-87ee-188020770090 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] [instance: 065efbd0-fdd1-4b98-ba6a-b132a9b99086] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:40:14.639733 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5c9de4d7-6e3c-4bbe-87ee-188020770090 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:40:14.640169 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5c9de4d7-6e3c-4bbe-87ee-188020770090 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:40:14.640607 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5c9de4d7-6e3c-4bbe-87ee-188020770090 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:40:14.641335 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5c9de4d7-6e3c-4bbe-87ee-188020770090 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:40:14.641838 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5c9de4d7-6e3c-4bbe-87ee-188020770090 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:40:14.642262 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5c9de4d7-6e3c-4bbe-87ee-188020770090 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:40:14.696334 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [req-666def5a-85bc-4479-a86f-5d2a2f337faa req-a5de0655-69ce-46b8-ae03-f938eae07058 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "065efbd0-fdd1-4b98-ba6a-b132a9b99086", "name": "network-vif-deleted", "tag": "8c1553c3-fdce-433e-84c9-e9d42237847c"}]} {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 06:40:14.707003 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [req-666def5a-85bc-4479-a86f-5d2a2f337faa req-a5de0655-69ce-46b8-ae03-f938eae07058 service nova] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:40:14.707169 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-5c9de4d7-6e3c-4bbe-87ee-188020770090 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30be578ddd664bc79498d9a21f708f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6d602fe085a4d7d82788e61287b352d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:40:14.707492 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [req-666def5a-85bc-4479-a86f-5d2a2f337faa req-a5de0655-69ce-46b8-ae03-f938eae07058 service nova] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:40:14.707925 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [req-666def5a-85bc-4479-a86f-5d2a2f337faa req-a5de0655-69ce-46b8-ae03-f938eae07058 service nova] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:40:14.716449 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-5c9de4d7-6e3c-4bbe-87ee-188020770090 tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] 10.222.0.20 "GET /compute/v2.1/servers/065efbd0-fdd1-4b98-ba6a-b132a9b99086" status: 200 len: 1512 microversion: 2.1 time: 0.089799 Oct 20 06:40:14.717072 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1326/2641] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:40:14 2022] GET /compute/v2.1/servers/065efbd0-fdd1-4b98-ba6a-b132a9b99086 => generated 1512 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:40:14.719876 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.compute.server_external_events [req-666def5a-85bc-4479-a86f-5d2a2f337faa req-a5de0655-69ce-46b8-ae03-f938eae07058 service nova] Creating event network-vif-deleted:8c1553c3-fdce-433e-84c9-e9d42237847c for instance 065efbd0-fdd1-4b98-ba6a-b132a9b99086 on hv-cinder-86156 Oct 20 06:40:14.724920 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [req-666def5a-85bc-4479-a86f-5d2a2f337faa req-a5de0655-69ce-46b8-ae03-f938eae07058 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104275 Oct 20 06:40:14.725736 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1316/2642] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 20 06:40:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:40:15.739498 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-4672d740-59d2-4930-bc76-35283ca22afb tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:40:15.740103 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-4672d740-59d2-4930-bc76-35283ca22afb tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] [instance: 065efbd0-fdd1-4b98-ba6a-b132a9b99086] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:40:15.746412 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-4672d740-59d2-4930-bc76-35283ca22afb tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:40:15.746887 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-4672d740-59d2-4930-bc76-35283ca22afb tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:40:15.747936 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-4672d740-59d2-4930-bc76-35283ca22afb tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:40:15.748735 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-4672d740-59d2-4930-bc76-35283ca22afb tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:40:15.749186 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-4672d740-59d2-4930-bc76-35283ca22afb tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:40:15.749630 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-4672d740-59d2-4930-bc76-35283ca22afb tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:40:15.762579 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.wsgi [None req-4672d740-59d2-4930-bc76-35283ca22afb tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] HTTP exception thrown: Instance 065efbd0-fdd1-4b98-ba6a-b132a9b99086 could not be found. Oct 20 06:40:15.764229 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-4672d740-59d2-4930-bc76-35283ca22afb tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Request method failure captured: Oct 20 06:40:15.764229 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: request: GET /compute/v2.1/servers/065efbd0-fdd1-4b98-ba6a-b132a9b99086 HTTP/1.1 Oct 20 06:40:15.764229 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: Accept: application/json Oct 20 06:40:15.764229 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: Accept-Encoding: identity Oct 20 06:40:15.764229 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: Connection: close Oct 20 06:40:15.764229 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: Content-Length: 0 Oct 20 06:40:15.764229 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: Content-Type: application/json Oct 20 06:40:15.764229 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: Host: 10.222.0.20 Oct 20 06:40:15.764229 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: Openstack-System-Scope: None Oct 20 06:40:15.764229 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: User-Agent: python-urllib3/1.26.12 Oct 20 06:40:15.764229 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Auth-Token: gAAAAABjUOzEcdWg4Wn4q4l_OQtFHejb8H9Wew4dgKGKG9wcNx4IdIugSymmvZ8enpOjuUE_j4JgeOhXCC-1r3Zd4bngjminYwUb6T-b0abW8DmLBSegHwYw1-JRIcKPSicoiPZcIorBiCH98432w6vEPWAIJFOEEI64KXG56Dxj6xhcDp7fo3E Oct 20 06:40:15.764229 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Domain-Id: None Oct 20 06:40:15.764229 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Domain-Name: None Oct 20 06:40:15.764229 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Identity-Status: Confirmed Oct 20 06:40:15.764229 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Is-Admin-Project: True Oct 20 06:40:15.764229 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Project-Domain-Id: default Oct 20 06:40:15.764229 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Project-Domain-Name: Default Oct 20 06:40:15.764229 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Project-Id: c6d602fe085a4d7d82788e61287b352d Oct 20 06:40:15.764229 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Project-Name: tempest-TestMinimumBasicScenario-1833470283 Oct 20 06:40:15.764229 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Role: reader,member Oct 20 06:40:15.764229 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Roles: reader,member Oct 20 06:40:15.765669 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/c6d602fe085a4d7d82788e61287b352d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_c6d602fe085a4d7d82788e61287b352d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c6d602fe085a4d7d82788e61287b352d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c6d602fe085a4d7d82788e61287b352d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 20 06:40:15.765669 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Tenant: tempest-TestMinimumBasicScenario-1833470283 Oct 20 06:40:15.765669 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Tenant-Id: c6d602fe085a4d7d82788e61287b352d Oct 20 06:40:15.765669 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1833470283 Oct 20 06:40:15.765669 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-User: tempest-TestMinimumBasicScenario-1833470283-project Oct 20 06:40:15.765669 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-User-Domain-Id: default Oct 20 06:40:15.765669 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-User-Domain-Name: Default Oct 20 06:40:15.765669 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-User-Id: 30be578ddd664bc79498d9a21f708f04 Oct 20 06:40:15.765669 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-User-Name: tempest-TestMinimumBasicScenario-1833470283-project Oct 20 06:40:15.765669 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: method: > Oct 20 06:40:15.765669 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: exception: Instance 065efbd0-fdd1-4b98-ba6a-b132a9b99086 could not be found. Oct 20 06:40:15.765669 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: action_args: {'id': '065efbd0-fdd1-4b98-ba6a-b132a9b99086'} Oct 20 06:40:15.766572 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 20 06:40:15.766572 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 06:40:15.766572 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 20 06:40:15.766572 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 20 06:40:15.766572 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 20 06:40:15.766572 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 20 06:40:15.766572 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 20 06:40:15.766572 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 20 06:40:15.766572 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 20 06:40:15.766572 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 20 06:40:15.766572 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 065efbd0-fdd1-4b98-ba6a-b132a9b99086 could not be found. Oct 20 06:40:15.766572 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi Oct 20 06:40:15.766572 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 06:40:15.766572 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi Oct 20 06:40:15.766572 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 06:40:15.766572 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 06:40:15.766572 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 06:40:15.766572 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 20 06:40:15.766572 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 20 06:40:15.766572 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 20 06:40:15.767956 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 20 06:40:15.767956 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 20 06:40:15.767956 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 20 06:40:15.767956 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 20 06:40:15.767956 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 20 06:40:15.767956 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 20 06:40:15.767956 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 20 06:40:15.767956 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 065efbd0-fdd1-4b98-ba6a-b132a9b99086 could not be found. Oct 20 06:40:15.767956 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi Oct 20 06:40:15.767956 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 06:40:15.767956 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi Oct 20 06:40:15.767956 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 06:40:15.767956 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 06:40:15.767956 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 06:40:15.767956 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 20 06:40:15.767956 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 20 06:40:15.767956 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 065efbd0-fdd1-4b98-ba6a-b132a9b99086 could not be found. Oct 20 06:40:15.767956 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi Oct 20 06:40:15.769260 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-4672d740-59d2-4930-bc76-35283ca22afb tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Returning 404 to user: Instance 065efbd0-fdd1-4b98-ba6a-b132a9b99086 could not be found. {{(pid=118860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 20 06:40:15.769260 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-4672d740-59d2-4930-bc76-35283ca22afb tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] 10.222.0.20 "GET /compute/v2.1/servers/065efbd0-fdd1-4b98-ba6a-b132a9b99086" status: 404 len: 111 microversion: 2.1 time: 0.030001 Oct 20 06:40:15.769260 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1327/2643] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:40:15 2022] GET /compute/v2.1/servers/065efbd0-fdd1-4b98-ba6a-b132a9b99086 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 20 06:40:15.775320 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-eb25af2a-a24b-4ec7-acb7-c1085206d1eb tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] Calling method '.version_select at 0x7fbe4ac57a60>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:40:15.793738 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-eb25af2a-a24b-4ec7-acb7-c1085206d1eb tempest-TestMinimumBasicScenario-1833470283 tempest-TestMinimumBasicScenario-1833470283-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-999875005" status: 202 len: 0 microversion: 2.1 time: 0.023018 Oct 20 06:40:15.794783 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1317/2644] 10.222.0.20 () {58 vars in 1269 bytes} [Thu Oct 20 06:40:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-999875005 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 20 06:42:13.794077 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG dbcounter [-] [118860] Writing DB stats nova_api:SELECT=19,nova_api:UPDATE=1 {{(pid=118860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:42:13.794836 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG dbcounter [-] [118860] Writing DB stats nova_cell1:SELECT=42,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:42:13.796153 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 20 06:42:13.796301 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: Thu Oct 20 06:42:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 (ip 10.222.0.20) !!! Oct 20 06:42:13.797300 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 20 06:42:13.797417 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: Thu Oct 20 06:42:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 (ip 10.222.0.20) !!! Oct 20 06:42:13.801521 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-9abe6ef9-f91d-4f81-af00-528175a0615f tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:42:13.802014 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-9abe6ef9-f91d-4f81-af00-528175a0615f tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:42:13.813999 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-9abe6ef9-f91d-4f81-af00-528175a0615f tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:42:13.814483 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-9abe6ef9-f91d-4f81-af00-528175a0615f tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:42:13.814922 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-9abe6ef9-f91d-4f81-af00-528175a0615f tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:42:13.815616 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-9abe6ef9-f91d-4f81-af00-528175a0615f tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:42:13.816071 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-9abe6ef9-f91d-4f81-af00-528175a0615f tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:42:13.816500 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-9abe6ef9-f91d-4f81-af00-528175a0615f tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:42:13.834224 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.wsgi [None req-9abe6ef9-f91d-4f81-af00-528175a0615f tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] HTTP exception thrown: Instance 42fc4539-f891-4ab5-b30a-4bfe5033db86 could not be found. Oct 20 06:42:13.835794 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-9abe6ef9-f91d-4f81-af00-528175a0615f tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Request method failure captured: Oct 20 06:42:13.835794 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: request: DELETE /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 HTTP/1.1 Oct 20 06:42:13.835794 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: Accept: application/json Oct 20 06:42:13.835794 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: Accept-Encoding: identity Oct 20 06:42:13.835794 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: Connection: close Oct 20 06:42:13.835794 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: Content-Length: 0 Oct 20 06:42:13.835794 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: Content-Type: application/json Oct 20 06:42:13.835794 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: Host: 10.222.0.20 Oct 20 06:42:13.835794 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: Openstack-System-Scope: None Oct 20 06:42:13.835794 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: User-Agent: python-urllib3/1.26.12 Oct 20 06:42:13.835794 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Auth-Token: gAAAAABjUOT8TEyteWHV2z8RkrnsToMLaxlNClh5BxtYhXfK42N4XWDIxYvbaMlmNyanhogw9L8osfx_sbQKTfeJHTda__o6-ha71BUGGJy0GvQ_RI9Mh3GIW9WIyAB8-J4QjsbkgdDqXunJE7aVnYvRPqpsoQxqzW-KmETWwXSxpvPu3SbYBWU Oct 20 06:42:13.835794 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Domain-Id: None Oct 20 06:42:13.835794 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Domain-Name: None Oct 20 06:42:13.835794 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Identity-Status: Confirmed Oct 20 06:42:13.835794 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Is-Admin-Project: True Oct 20 06:42:13.835794 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Project-Domain-Id: default Oct 20 06:42:13.835794 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Project-Domain-Name: Default Oct 20 06:42:13.835794 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Project-Id: b21953597b4c45059f7f78ac8fdecbee Oct 20 06:42:13.835794 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Project-Name: tempest-AttachVolumeTestJSON-676062256 Oct 20 06:42:13.835794 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Role: reader,member Oct 20 06:42:13.835794 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Roles: reader,member Oct 20 06:42:13.837094 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b21953597b4c45059f7f78ac8fdecbee"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b21953597b4c45059f7f78ac8fdecbee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b21953597b4c45059f7f78ac8fdecbee"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b21953597b4c45059f7f78ac8fdecbee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 20 06:42:13.837094 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Tenant: tempest-AttachVolumeTestJSON-676062256 Oct 20 06:42:13.837094 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Tenant-Id: b21953597b4c45059f7f78ac8fdecbee Oct 20 06:42:13.837094 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Tenant-Name: tempest-AttachVolumeTestJSON-676062256 Oct 20 06:42:13.837094 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-User: tempest-AttachVolumeTestJSON-676062256-project Oct 20 06:42:13.837094 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-User-Domain-Id: default Oct 20 06:42:13.837094 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-User-Domain-Name: Default Oct 20 06:42:13.837094 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-User-Id: 6da8a7cb6ef849faad7d7091a1095ab9 Oct 20 06:42:13.837094 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-User-Name: tempest-AttachVolumeTestJSON-676062256-project Oct 20 06:42:13.837094 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: method: > Oct 20 06:42:13.837094 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: exception: Instance 42fc4539-f891-4ab5-b30a-4bfe5033db86 could not be found. Oct 20 06:42:13.837094 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: action_args: {'id': '42fc4539-f891-4ab5-b30a-4bfe5033db86'} Oct 20 06:42:13.837774 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 20 06:42:13.837774 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 06:42:13.837774 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 20 06:42:13.837774 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 20 06:42:13.837774 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 20 06:42:13.837774 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 20 06:42:13.837774 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 20 06:42:13.837774 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 20 06:42:13.837774 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 20 06:42:13.837774 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 20 06:42:13.837774 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 42fc4539-f891-4ab5-b30a-4bfe5033db86 could not be found. Oct 20 06:42:13.837774 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi Oct 20 06:42:13.837774 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 06:42:13.837774 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi Oct 20 06:42:13.837774 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 06:42:13.837774 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 06:42:13.837774 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 06:42:13.837774 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 20 06:42:13.837774 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 20 06:42:13.837774 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 20 06:42:13.838985 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 20 06:42:13.838985 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 20 06:42:13.838985 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 20 06:42:13.838985 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 20 06:42:13.838985 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 20 06:42:13.838985 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 20 06:42:13.838985 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 20 06:42:13.838985 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 20 06:42:13.838985 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 20 06:42:13.838985 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 42fc4539-f891-4ab5-b30a-4bfe5033db86 could not be found. Oct 20 06:42:13.838985 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi Oct 20 06:42:13.838985 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 06:42:13.838985 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi Oct 20 06:42:13.838985 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 06:42:13.838985 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 06:42:13.838985 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 06:42:13.838985 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 20 06:42:13.838985 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 20 06:42:13.838985 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 42fc4539-f891-4ab5-b30a-4bfe5033db86 could not be found. Oct 20 06:42:13.838985 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi Oct 20 06:42:13.840107 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-9abe6ef9-f91d-4f81-af00-528175a0615f tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Returning 404 to user: Instance 42fc4539-f891-4ab5-b30a-4bfe5033db86 could not be found. {{(pid=118860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 20 06:42:13.840107 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-9abe6ef9-f91d-4f81-af00-528175a0615f tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "DELETE /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 404 len: 111 microversion: 2.1 time: 0.045136 Oct 20 06:42:13.840107 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1328/2645] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 20 06:42:13 2022] DELETE /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 20 06:42:13.843752 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d087dab9-22c4-45bb-8701-6ce1d6db6dc5] AMQP server on 10.222.0.20:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 20 06:42:13.844321 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG dbcounter [-] [118861] Writing DB stats nova_cell1:SELECT=29,nova_cell1:INSERT=1 {{(pid=118861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:42:13.845077 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG dbcounter [-] [118861] Writing DB stats nova_api:SELECT=15,nova_api:DELETE=1 {{(pid=118861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:42:13.850353 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-1a993a86-606d-4cd7-a6ed-06b0f6cf74cc tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:42:13.851049 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-1a993a86-606d-4cd7-a6ed-06b0f6cf74cc tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] [instance: 42fc4539-f891-4ab5-b30a-4bfe5033db86] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:42:13.860137 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1a993a86-606d-4cd7-a6ed-06b0f6cf74cc tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:42:13.860609 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1a993a86-606d-4cd7-a6ed-06b0f6cf74cc tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:42:13.861067 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1a993a86-606d-4cd7-a6ed-06b0f6cf74cc tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:42:13.861751 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1a993a86-606d-4cd7-a6ed-06b0f6cf74cc tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:42:13.862199 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1a993a86-606d-4cd7-a6ed-06b0f6cf74cc tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:42:13.862636 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-1a993a86-606d-4cd7-a6ed-06b0f6cf74cc tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:42:13.877963 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.wsgi [None req-1a993a86-606d-4cd7-a6ed-06b0f6cf74cc tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] HTTP exception thrown: Instance 42fc4539-f891-4ab5-b30a-4bfe5033db86 could not be found. Oct 20 06:42:13.879599 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-1a993a86-606d-4cd7-a6ed-06b0f6cf74cc tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Request method failure captured: Oct 20 06:42:13.879599 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: request: GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 HTTP/1.1 Oct 20 06:42:13.879599 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: Accept: application/json Oct 20 06:42:13.879599 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: Accept-Encoding: identity Oct 20 06:42:13.879599 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: Connection: close Oct 20 06:42:13.879599 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: Content-Length: 0 Oct 20 06:42:13.879599 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: Content-Type: application/json Oct 20 06:42:13.879599 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: Host: 10.222.0.20 Oct 20 06:42:13.879599 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: Openstack-System-Scope: None Oct 20 06:42:13.879599 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: User-Agent: python-urllib3/1.26.12 Oct 20 06:42:13.879599 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Auth-Token: gAAAAABjUOT8TEyteWHV2z8RkrnsToMLaxlNClh5BxtYhXfK42N4XWDIxYvbaMlmNyanhogw9L8osfx_sbQKTfeJHTda__o6-ha71BUGGJy0GvQ_RI9Mh3GIW9WIyAB8-J4QjsbkgdDqXunJE7aVnYvRPqpsoQxqzW-KmETWwXSxpvPu3SbYBWU Oct 20 06:42:13.879599 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Domain-Id: None Oct 20 06:42:13.879599 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Domain-Name: None Oct 20 06:42:13.879599 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Identity-Status: Confirmed Oct 20 06:42:13.879599 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Is-Admin-Project: True Oct 20 06:42:13.879599 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Project-Domain-Id: default Oct 20 06:42:13.879599 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Project-Domain-Name: Default Oct 20 06:42:13.879599 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Project-Id: b21953597b4c45059f7f78ac8fdecbee Oct 20 06:42:13.879599 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Project-Name: tempest-AttachVolumeTestJSON-676062256 Oct 20 06:42:13.879599 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Role: reader,member Oct 20 06:42:13.879599 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Roles: reader,member Oct 20 06:42:13.881085 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b21953597b4c45059f7f78ac8fdecbee"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b21953597b4c45059f7f78ac8fdecbee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b21953597b4c45059f7f78ac8fdecbee"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b21953597b4c45059f7f78ac8fdecbee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 20 06:42:13.881085 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Tenant: tempest-AttachVolumeTestJSON-676062256 Oct 20 06:42:13.881085 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Tenant-Id: b21953597b4c45059f7f78ac8fdecbee Oct 20 06:42:13.881085 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Tenant-Name: tempest-AttachVolumeTestJSON-676062256 Oct 20 06:42:13.881085 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-User: tempest-AttachVolumeTestJSON-676062256-project Oct 20 06:42:13.881085 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-User-Domain-Id: default Oct 20 06:42:13.881085 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-User-Domain-Name: Default Oct 20 06:42:13.881085 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-User-Id: 6da8a7cb6ef849faad7d7091a1095ab9 Oct 20 06:42:13.881085 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-User-Name: tempest-AttachVolumeTestJSON-676062256-project Oct 20 06:42:13.881085 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: method: > Oct 20 06:42:13.881085 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: exception: Instance 42fc4539-f891-4ab5-b30a-4bfe5033db86 could not be found. Oct 20 06:42:13.881085 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: action_args: {'id': '42fc4539-f891-4ab5-b30a-4bfe5033db86'} Oct 20 06:42:13.881937 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 20 06:42:13.881937 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 06:42:13.881937 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 20 06:42:13.881937 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 20 06:42:13.881937 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 20 06:42:13.881937 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 20 06:42:13.881937 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 20 06:42:13.881937 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 20 06:42:13.881937 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 20 06:42:13.881937 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 20 06:42:13.881937 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 42fc4539-f891-4ab5-b30a-4bfe5033db86 could not be found. Oct 20 06:42:13.881937 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi Oct 20 06:42:13.881937 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 06:42:13.881937 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi Oct 20 06:42:13.881937 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 06:42:13.881937 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 06:42:13.881937 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 06:42:13.881937 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 20 06:42:13.881937 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 20 06:42:13.881937 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 20 06:42:13.883199 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 20 06:42:13.883199 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 20 06:42:13.883199 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 20 06:42:13.883199 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 20 06:42:13.883199 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 20 06:42:13.883199 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 20 06:42:13.883199 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 20 06:42:13.883199 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 42fc4539-f891-4ab5-b30a-4bfe5033db86 could not be found. Oct 20 06:42:13.883199 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi Oct 20 06:42:13.883199 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 06:42:13.883199 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi Oct 20 06:42:13.883199 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 06:42:13.883199 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 06:42:13.883199 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 06:42:13.883199 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 20 06:42:13.883199 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 20 06:42:13.883199 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 42fc4539-f891-4ab5-b30a-4bfe5033db86 could not be found. Oct 20 06:42:13.883199 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi Oct 20 06:42:13.884387 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-1a993a86-606d-4cd7-a6ed-06b0f6cf74cc tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] Returning 404 to user: Instance 42fc4539-f891-4ab5-b30a-4bfe5033db86 could not be found. {{(pid=118861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 20 06:42:13.884387 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-1a993a86-606d-4cd7-a6ed-06b0f6cf74cc tempest-AttachVolumeTestJSON-676062256 tempest-AttachVolumeTestJSON-676062256-project] 10.222.0.20 "GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86" status: 404 len: 111 microversion: 2.1 time: 0.039071 Oct 20 06:42:13.884387 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1318/2646] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:42:13 2022] GET /compute/v2.1/servers/42fc4539-f891-4ab5-b30a-4bfe5033db86 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 20 06:42:18.277895 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-3a2e9d53-5929-4534-b74f-293cda33eb6d tempest-VolumesNegativeTest-1314491935 tempest-VolumesNegativeTest-1314491935-project] Action: 'create', calling method: .version_select at 0x7fbe4e44e310>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-547422267", "metadata": {"Type": "work"}}} {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 06:42:18.298616 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-3a2e9d53-5929-4534-b74f-293cda33eb6d tempest-VolumesNegativeTest-1314491935 tempest-VolumesNegativeTest-1314491935-project] Request method failure captured: Oct 20 06:42:18.298616 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 20 06:42:18.298616 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: Accept: application/json Oct 20 06:42:18.298616 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: Accept-Encoding: identity Oct 20 06:42:18.298616 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: Connection: close Oct 20 06:42:18.298616 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: Content-Length: 121 Oct 20 06:42:18.298616 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: Content-Type: application/json Oct 20 06:42:18.298616 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: Host: 10.222.0.20 Oct 20 06:42:18.298616 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: Openstack-System-Scope: None Oct 20 06:42:18.298616 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: User-Agent: python-urllib3/1.26.12 Oct 20 06:42:18.298616 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Auth-Token: gAAAAABjUO3KwOvbvzZJ4xci8E2vy2LBl0AG-6DWBPdGjur5sRpvK-eBbaRxC3qfQS9Wr_YONN--3ROqP0iuz25ADd0X9nI5hS6lYpAf95KV8IgCrTVHCRF1TyuOCVj8_4ecNs1KpTdctAi_5l2-ubf9Kz6bJihn8W1M3fhCfyqhE4LvjyLPaD0 Oct 20 06:42:18.298616 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Domain-Id: None Oct 20 06:42:18.298616 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Domain-Name: None Oct 20 06:42:18.298616 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Identity-Status: Confirmed Oct 20 06:42:18.298616 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Is-Admin-Project: True Oct 20 06:42:18.298616 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Project-Domain-Id: default Oct 20 06:42:18.298616 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Project-Domain-Name: Default Oct 20 06:42:18.298616 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Project-Id: d198c9c79b3148df8c65e7a7a66d18bd Oct 20 06:42:18.298616 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Project-Name: tempest-VolumesNegativeTest-1314491935 Oct 20 06:42:18.298616 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Role: reader,member Oct 20 06:42:18.298616 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Roles: reader,member Oct 20 06:42:18.299960 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d198c9c79b3148df8c65e7a7a66d18bd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d198c9c79b3148df8c65e7a7a66d18bd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d198c9c79b3148df8c65e7a7a66d18bd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d198c9c79b3148df8c65e7a7a66d18bd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 20 06:42:18.299960 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Tenant: tempest-VolumesNegativeTest-1314491935 Oct 20 06:42:18.299960 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Tenant-Id: d198c9c79b3148df8c65e7a7a66d18bd Oct 20 06:42:18.299960 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Tenant-Name: tempest-VolumesNegativeTest-1314491935 Oct 20 06:42:18.299960 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-User: tempest-VolumesNegativeTest-1314491935-project Oct 20 06:42:18.299960 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-User-Domain-Id: default Oct 20 06:42:18.299960 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-User-Domain-Name: Default Oct 20 06:42:18.299960 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-User-Id: b31ed8707ab34d9182cfaa0b8699ed22 Oct 20 06:42:18.299960 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-User-Name: tempest-VolumesNegativeTest-1314491935-project Oct 20 06:42:18.299960 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: Oct 20 06:42:18.299960 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-547422267", "metadata": {"Type": "work"}}} Oct 20 06:42:18.299960 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: method: Oct 20 06:42:18.299960 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 20 06:42:18.300772 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-547422267', 'metadata': {'Type': 'work'}}}} Oct 20 06:42:18.300772 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 20 06:42:18.300772 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 06:42:18.300772 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 20 06:42:18.300772 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 20 06:42:18.300772 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 20 06:42:18.300772 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi raise error Oct 20 06:42:18.300772 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Oct 20 06:42:18.300772 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi Oct 20 06:42:18.300772 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 20 06:42:18.300772 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 20 06:42:18.300772 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi Oct 20 06:42:18.300772 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 20 06:42:18.300772 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi '#$%' Oct 20 06:42:18.300772 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi Oct 20 06:42:18.300772 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 06:42:18.300772 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi Oct 20 06:42:18.300772 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 06:42:18.300772 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 06:42:18.300772 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 06:42:18.300772 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 20 06:42:18.300772 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 20 06:42:18.301963 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 20 06:42:18.301963 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 20 06:42:18.301963 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 20 06:42:18.301963 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 20 06:42:18.301963 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 20 06:42:18.301963 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 20 06:42:18.301963 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 20 06:42:18.301963 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 20 06:42:18.301963 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 20 06:42:18.301963 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 20 06:42:18.301963 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 20 06:42:18.301963 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi Oct 20 06:42:18.301963 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 06:42:18.301963 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi Oct 20 06:42:18.301963 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 06:42:18.301963 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 06:42:18.301963 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 06:42:18.301963 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 20 06:42:18.301963 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 20 06:42:18.303000 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 20 06:42:18.303000 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi Oct 20 06:42:18.303000 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-3a2e9d53-5929-4534-b74f-293cda33eb6d tempest-VolumesNegativeTest-1314491935 tempest-VolumesNegativeTest-1314491935-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=118860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 20 06:42:18.303000 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-3a2e9d53-5929-4534-b74f-293cda33eb6d tempest-VolumesNegativeTest-1314491935 tempest-VolumesNegativeTest-1314491935-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.132471 Oct 20 06:42:18.303000 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1329/2647] 10.222.0.20 () {60 vars in 1156 bytes} [Thu Oct 20 06:42:18 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 134 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 20 06:42:18.309937 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-bc13376c-5e07-438c-89e5-fa9ef8e9caa2 tempest-VolumesNegativeTest-1314491935 tempest-VolumesNegativeTest-1314491935-project] Action: 'create', calling method: .version_select at 0x7fbe4af4a940>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-184555519", "metadata": {"Type": "work"}}} {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 06:42:18.315532 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-bc13376c-5e07-438c-89e5-fa9ef8e9caa2 tempest-VolumesNegativeTest-1314491935 tempest-VolumesNegativeTest-1314491935-project] Request method failure captured: Oct 20 06:42:18.315532 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 20 06:42:18.315532 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: Accept: application/json Oct 20 06:42:18.315532 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: Accept-Encoding: identity Oct 20 06:42:18.315532 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: Connection: close Oct 20 06:42:18.315532 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: Content-Length: 119 Oct 20 06:42:18.315532 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: Content-Type: application/json Oct 20 06:42:18.315532 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: Host: 10.222.0.20 Oct 20 06:42:18.315532 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: Openstack-System-Scope: None Oct 20 06:42:18.315532 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: User-Agent: python-urllib3/1.26.12 Oct 20 06:42:18.315532 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Auth-Token: gAAAAABjUO3KwOvbvzZJ4xci8E2vy2LBl0AG-6DWBPdGjur5sRpvK-eBbaRxC3qfQS9Wr_YONN--3ROqP0iuz25ADd0X9nI5hS6lYpAf95KV8IgCrTVHCRF1TyuOCVj8_4ecNs1KpTdctAi_5l2-ubf9Kz6bJihn8W1M3fhCfyqhE4LvjyLPaD0 Oct 20 06:42:18.315532 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Domain-Id: None Oct 20 06:42:18.315532 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Domain-Name: None Oct 20 06:42:18.315532 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Identity-Status: Confirmed Oct 20 06:42:18.315532 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Is-Admin-Project: True Oct 20 06:42:18.315532 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Project-Domain-Id: default Oct 20 06:42:18.315532 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Project-Domain-Name: Default Oct 20 06:42:18.315532 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Project-Id: d198c9c79b3148df8c65e7a7a66d18bd Oct 20 06:42:18.315532 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Project-Name: tempest-VolumesNegativeTest-1314491935 Oct 20 06:42:18.315532 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Role: reader,member Oct 20 06:42:18.315532 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Roles: reader,member Oct 20 06:42:18.316932 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d198c9c79b3148df8c65e7a7a66d18bd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d198c9c79b3148df8c65e7a7a66d18bd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d198c9c79b3148df8c65e7a7a66d18bd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d198c9c79b3148df8c65e7a7a66d18bd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 20 06:42:18.316932 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Tenant: tempest-VolumesNegativeTest-1314491935 Oct 20 06:42:18.316932 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Tenant-Id: d198c9c79b3148df8c65e7a7a66d18bd Oct 20 06:42:18.316932 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Tenant-Name: tempest-VolumesNegativeTest-1314491935 Oct 20 06:42:18.316932 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-User: tempest-VolumesNegativeTest-1314491935-project Oct 20 06:42:18.316932 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-User-Domain-Id: default Oct 20 06:42:18.316932 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-User-Domain-Name: Default Oct 20 06:42:18.316932 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-User-Id: b31ed8707ab34d9182cfaa0b8699ed22 Oct 20 06:42:18.316932 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-User-Name: tempest-VolumesNegativeTest-1314491935-project Oct 20 06:42:18.316932 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: Oct 20 06:42:18.316932 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-184555519", "metadata": {"Type": "work"}}} Oct 20 06:42:18.316932 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: method: Oct 20 06:42:18.316932 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 20 06:42:18.317785 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-184555519', 'metadata': {'Type': 'work'}}}} Oct 20 06:42:18.317785 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 20 06:42:18.317785 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 06:42:18.317785 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 20 06:42:18.317785 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 20 06:42:18.317785 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 20 06:42:18.317785 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi raise error Oct 20 06:42:18.317785 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 20 06:42:18.317785 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi Oct 20 06:42:18.317785 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Oct 20 06:42:18.317785 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 20 06:42:18.317785 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi Oct 20 06:42:18.317785 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 20 06:42:18.317785 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi '0' Oct 20 06:42:18.317785 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi Oct 20 06:42:18.317785 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 06:42:18.317785 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi Oct 20 06:42:18.317785 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 06:42:18.317785 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 06:42:18.317785 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 06:42:18.317785 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 20 06:42:18.317785 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 20 06:42:18.318976 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 20 06:42:18.318976 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 20 06:42:18.318976 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 20 06:42:18.318976 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 20 06:42:18.318976 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 20 06:42:18.318976 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 20 06:42:18.318976 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 20 06:42:18.318976 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 20 06:42:18.318976 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 20 06:42:18.318976 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 20 06:42:18.318976 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 20 06:42:18.318976 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi Oct 20 06:42:18.318976 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 06:42:18.318976 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi Oct 20 06:42:18.318976 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 06:42:18.318976 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 06:42:18.318976 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 06:42:18.318976 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 20 06:42:18.318976 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 20 06:42:18.319959 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 20 06:42:18.319959 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi Oct 20 06:42:18.319959 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-bc13376c-5e07-438c-89e5-fa9ef8e9caa2 tempest-VolumesNegativeTest-1314491935 tempest-VolumesNegativeTest-1314491935-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=118861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 20 06:42:18.319959 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-bc13376c-5e07-438c-89e5-fa9ef8e9caa2 tempest-VolumesNegativeTest-1314491935 tempest-VolumesNegativeTest-1314491935-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.010917 Oct 20 06:42:18.319959 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1319/2648] 10.222.0.20 () {60 vars in 1156 bytes} [Thu Oct 20 06:42:18 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 20 06:42:18.325982 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-9e042bdb-f05a-42d5-9f20-cd66c8ec92fa tempest-VolumesNegativeTest-1314491935 tempest-VolumesNegativeTest-1314491935-project] Action: 'create', calling method: .version_select at 0x7fbe4e398550>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1701651296", "metadata": {"Type": "work"}}} {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 06:42:18.330961 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-9e042bdb-f05a-42d5-9f20-cd66c8ec92fa tempest-VolumesNegativeTest-1314491935 tempest-VolumesNegativeTest-1314491935-project] Request method failure captured: Oct 20 06:42:18.330961 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 20 06:42:18.330961 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: Accept: application/json Oct 20 06:42:18.330961 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: Accept-Encoding: identity Oct 20 06:42:18.330961 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: Connection: close Oct 20 06:42:18.330961 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: Content-Length: 119 Oct 20 06:42:18.330961 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: Content-Type: application/json Oct 20 06:42:18.330961 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: Host: 10.222.0.20 Oct 20 06:42:18.330961 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: Openstack-System-Scope: None Oct 20 06:42:18.330961 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: User-Agent: python-urllib3/1.26.12 Oct 20 06:42:18.330961 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Auth-Token: gAAAAABjUO3KwOvbvzZJ4xci8E2vy2LBl0AG-6DWBPdGjur5sRpvK-eBbaRxC3qfQS9Wr_YONN--3ROqP0iuz25ADd0X9nI5hS6lYpAf95KV8IgCrTVHCRF1TyuOCVj8_4ecNs1KpTdctAi_5l2-ubf9Kz6bJihn8W1M3fhCfyqhE4LvjyLPaD0 Oct 20 06:42:18.330961 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Domain-Id: None Oct 20 06:42:18.330961 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Domain-Name: None Oct 20 06:42:18.330961 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Identity-Status: Confirmed Oct 20 06:42:18.330961 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Is-Admin-Project: True Oct 20 06:42:18.330961 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Project-Domain-Id: default Oct 20 06:42:18.330961 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Project-Domain-Name: Default Oct 20 06:42:18.330961 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Project-Id: d198c9c79b3148df8c65e7a7a66d18bd Oct 20 06:42:18.330961 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Project-Name: tempest-VolumesNegativeTest-1314491935 Oct 20 06:42:18.330961 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Role: reader,member Oct 20 06:42:18.330961 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Roles: reader,member Oct 20 06:42:18.332404 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d198c9c79b3148df8c65e7a7a66d18bd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d198c9c79b3148df8c65e7a7a66d18bd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d198c9c79b3148df8c65e7a7a66d18bd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d198c9c79b3148df8c65e7a7a66d18bd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 20 06:42:18.332404 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Tenant: tempest-VolumesNegativeTest-1314491935 Oct 20 06:42:18.332404 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Tenant-Id: d198c9c79b3148df8c65e7a7a66d18bd Oct 20 06:42:18.332404 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Tenant-Name: tempest-VolumesNegativeTest-1314491935 Oct 20 06:42:18.332404 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-User: tempest-VolumesNegativeTest-1314491935-project Oct 20 06:42:18.332404 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-User-Domain-Id: default Oct 20 06:42:18.332404 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-User-Domain-Name: Default Oct 20 06:42:18.332404 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-User-Id: b31ed8707ab34d9182cfaa0b8699ed22 Oct 20 06:42:18.332404 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-User-Name: tempest-VolumesNegativeTest-1314491935-project Oct 20 06:42:18.332404 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: Oct 20 06:42:18.332404 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1701651296", "metadata": {"Type": "work"}}} Oct 20 06:42:18.332404 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: method: Oct 20 06:42:18.332404 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 20 06:42:18.333269 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1701651296', 'metadata': {'Type': 'work'}}}} Oct 20 06:42:18.333269 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 20 06:42:18.333269 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 06:42:18.333269 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 20 06:42:18.333269 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 20 06:42:18.333269 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 20 06:42:18.333269 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi raise error Oct 20 06:42:18.333269 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Oct 20 06:42:18.333269 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi Oct 20 06:42:18.333269 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 20 06:42:18.333269 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 20 06:42:18.333269 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi Oct 20 06:42:18.333269 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 20 06:42:18.333269 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi '' Oct 20 06:42:18.333269 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi Oct 20 06:42:18.333269 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 06:42:18.333269 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi Oct 20 06:42:18.333269 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 06:42:18.333269 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 06:42:18.333269 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 06:42:18.333269 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 20 06:42:18.333269 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 20 06:42:18.334713 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 20 06:42:18.334713 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 20 06:42:18.334713 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 20 06:42:18.334713 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 20 06:42:18.334713 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 20 06:42:18.334713 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 20 06:42:18.334713 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 20 06:42:18.334713 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 20 06:42:18.334713 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 20 06:42:18.334713 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 20 06:42:18.334713 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 20 06:42:18.334713 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi Oct 20 06:42:18.334713 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 06:42:18.334713 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi Oct 20 06:42:18.334713 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 06:42:18.334713 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 06:42:18.334713 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 06:42:18.334713 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 20 06:42:18.334713 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 20 06:42:18.335958 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 20 06:42:18.335958 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi Oct 20 06:42:18.335958 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-9e042bdb-f05a-42d5-9f20-cd66c8ec92fa tempest-VolumesNegativeTest-1314491935 tempest-VolumesNegativeTest-1314491935-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=118860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 20 06:42:18.335958 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-9e042bdb-f05a-42d5-9f20-cd66c8ec92fa tempest-VolumesNegativeTest-1314491935 tempest-VolumesNegativeTest-1314491935-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.010125 Oct 20 06:42:18.335958 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1330/2649] 10.222.0.20 () {60 vars in 1156 bytes} [Thu Oct 20 06:42:18 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 20 06:42:18.343281 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-756e9910-0659-485f-9542-638a85cb3b46 tempest-VolumesNegativeTest-1314491935 tempest-VolumesNegativeTest-1314491935-project] Calling method '.version_select at 0x7fbe4a9f6280>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:42:18.358133 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO oslo.messaging._drivers.impl_rabbit [-] [d087dab9-22c4-45bb-8701-6ce1d6db6dc5] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 41300. Oct 20 06:42:18.379168 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.wsgi [None req-756e9910-0659-485f-9542-638a85cb3b46 tempest-VolumesNegativeTest-1314491935 tempest-VolumesNegativeTest-1314491935-project] HTTP exception thrown: Volume tempest-invalid-1763356574 could not be found. Oct 20 06:42:18.385165 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-756e9910-0659-485f-9542-638a85cb3b46 tempest-VolumesNegativeTest-1314491935 tempest-VolumesNegativeTest-1314491935-project] Request method failure captured: Oct 20 06:42:18.385165 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1763356574 HTTP/1.1 Oct 20 06:42:18.385165 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: Accept: application/json Oct 20 06:42:18.385165 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: Accept-Encoding: identity Oct 20 06:42:18.385165 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: Connection: close Oct 20 06:42:18.385165 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: Content-Length: 0 Oct 20 06:42:18.385165 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: Content-Type: application/json Oct 20 06:42:18.385165 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: Host: 10.222.0.20 Oct 20 06:42:18.385165 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: Openstack-System-Scope: None Oct 20 06:42:18.385165 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: User-Agent: python-urllib3/1.26.12 Oct 20 06:42:18.385165 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Auth-Token: gAAAAABjUO3KwOvbvzZJ4xci8E2vy2LBl0AG-6DWBPdGjur5sRpvK-eBbaRxC3qfQS9Wr_YONN--3ROqP0iuz25ADd0X9nI5hS6lYpAf95KV8IgCrTVHCRF1TyuOCVj8_4ecNs1KpTdctAi_5l2-ubf9Kz6bJihn8W1M3fhCfyqhE4LvjyLPaD0 Oct 20 06:42:18.385165 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Domain-Id: None Oct 20 06:42:18.385165 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Domain-Name: None Oct 20 06:42:18.385165 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Identity-Status: Confirmed Oct 20 06:42:18.385165 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Is-Admin-Project: True Oct 20 06:42:18.385165 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Project-Domain-Id: default Oct 20 06:42:18.385165 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Project-Domain-Name: Default Oct 20 06:42:18.385165 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Project-Id: d198c9c79b3148df8c65e7a7a66d18bd Oct 20 06:42:18.385165 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Project-Name: tempest-VolumesNegativeTest-1314491935 Oct 20 06:42:18.385165 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Role: reader,member Oct 20 06:42:18.385165 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Roles: reader,member Oct 20 06:42:18.386472 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d198c9c79b3148df8c65e7a7a66d18bd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d198c9c79b3148df8c65e7a7a66d18bd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d198c9c79b3148df8c65e7a7a66d18bd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d198c9c79b3148df8c65e7a7a66d18bd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 20 06:42:18.386472 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Tenant: tempest-VolumesNegativeTest-1314491935 Oct 20 06:42:18.386472 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Tenant-Id: d198c9c79b3148df8c65e7a7a66d18bd Oct 20 06:42:18.386472 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Tenant-Name: tempest-VolumesNegativeTest-1314491935 Oct 20 06:42:18.386472 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-User: tempest-VolumesNegativeTest-1314491935-project Oct 20 06:42:18.386472 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-User-Domain-Id: default Oct 20 06:42:18.386472 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-User-Domain-Name: Default Oct 20 06:42:18.386472 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-User-Id: b31ed8707ab34d9182cfaa0b8699ed22 Oct 20 06:42:18.386472 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-User-Name: tempest-VolumesNegativeTest-1314491935-project Oct 20 06:42:18.386472 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: method: Oct 20 06:42:18.386472 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: exception: Volume tempest-invalid-1763356574 could not be found. Oct 20 06:42:18.386472 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: action_args: {'id': 'tempest-invalid-1763356574'} Oct 20 06:42:18.386472 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 20 06:42:18.387176 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 06:42:18.387176 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 20 06:42:18.387176 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 20 06:42:18.387176 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 20 06:42:18.387176 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 20 06:42:18.387176 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 20 06:42:18.387176 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 20 06:42:18.387176 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 20 06:42:18.387176 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 20 06:42:18.387176 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 20 06:42:18.387176 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 20 06:42:18.387176 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 20 06:42:18.387176 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 20 06:42:18.387176 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 20 06:42:18.387176 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 20 06:42:18.387176 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1763356574 could not be found. (HTTP 404) (Request-ID: req-80c401f1-b56e-436d-ab50-98b2056c274c) Oct 20 06:42:18.387176 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi Oct 20 06:42:18.387176 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 06:42:18.387176 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi Oct 20 06:42:18.388456 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 06:42:18.388456 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 20 06:42:18.388456 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 20 06:42:18.388456 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 20 06:42:18.388456 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 20 06:42:18.388456 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 20 06:42:18.388456 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 20 06:42:18.388456 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 20 06:42:18.388456 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 20 06:42:18.388456 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 20 06:42:18.388456 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 20 06:42:18.388456 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 20 06:42:18.388456 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 20 06:42:18.388456 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 20 06:42:18.388456 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 20 06:42:18.388456 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 20 06:42:18.388456 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 20 06:42:18.388456 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 20 06:42:18.388456 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 20 06:42:18.390512 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 20 06:42:18.390512 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 20 06:42:18.390512 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 20 06:42:18.390512 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 20 06:42:18.390512 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1763356574 could not be found. Oct 20 06:42:18.390512 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi Oct 20 06:42:18.390512 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 06:42:18.390512 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi Oct 20 06:42:18.390512 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 06:42:18.390512 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 06:42:18.390512 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 06:42:18.390512 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 20 06:42:18.390512 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 20 06:42:18.390512 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 20 06:42:18.390512 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 20 06:42:18.390512 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 20 06:42:18.390512 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 20 06:42:18.390512 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 20 06:42:18.390512 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 20 06:42:18.390512 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1763356574 could not be found. Oct 20 06:42:18.391886 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi Oct 20 06:42:18.391886 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 06:42:18.391886 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi Oct 20 06:42:18.391886 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 06:42:18.391886 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 06:42:18.391886 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 06:42:18.391886 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 20 06:42:18.391886 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 20 06:42:18.391886 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1763356574 could not be found. Oct 20 06:42:18.391886 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi Oct 20 06:42:18.391886 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-756e9910-0659-485f-9542-638a85cb3b46 tempest-VolumesNegativeTest-1314491935 tempest-VolumesNegativeTest-1314491935-project] Returning 404 to user: Volume tempest-invalid-1763356574 could not be found. {{(pid=118861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 20 06:42:18.391886 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-756e9910-0659-485f-9542-638a85cb3b46 tempest-VolumesNegativeTest-1314491935 tempest-VolumesNegativeTest-1314491935-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1763356574" status: 404 len: 99 microversion: 2.1 time: 0.048475 Oct 20 06:42:18.391886 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1320/2650] 10.222.0.20 () {58 vars in 1218 bytes} [Thu Oct 20 06:42:18 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1763356574 => generated 99 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 20 06:42:18.396799 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-1987092a-1c19-47dc-ada8-2c2a7f417d69 tempest-VolumesNegativeTest-1314491935 tempest-VolumesNegativeTest-1314491935-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003797 Oct 20 06:42:18.397291 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1331/2651] 10.222.0.20 () {58 vars in 1140 bytes} [Thu Oct 20 06:42:18 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Oct 20 06:42:18.405326 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-4335b72c-9edd-4e2c-a74d-1bcba737f6f8 tempest-VolumesNegativeTest-1314491935 tempest-VolumesNegativeTest-1314491935-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003781 Oct 20 06:42:18.405805 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1321/2652] 10.222.0.20 () {58 vars in 1137 bytes} [Thu Oct 20 06:42:18 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 20 06:42:18.413850 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-cb7e91c9-7ff8-48c3-94b4-99aa726c04f1 tempest-VolumesNegativeTest-1314491935 tempest-VolumesNegativeTest-1314491935-project] Calling method '.version_select at 0x7fbe4e2dca60>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:42:18.544048 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.wsgi [None req-cb7e91c9-7ff8-48c3-94b4-99aa726c04f1 tempest-VolumesNegativeTest-1314491935 tempest-VolumesNegativeTest-1314491935-project] HTTP exception thrown: Volume c7588bd3-6010-41b7-8acc-0aa8172bdb1f could not be found. Oct 20 06:42:18.546601 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-cb7e91c9-7ff8-48c3-94b4-99aa726c04f1 tempest-VolumesNegativeTest-1314491935 tempest-VolumesNegativeTest-1314491935-project] Request method failure captured: Oct 20 06:42:18.546601 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: request: DELETE /compute/v2.1/os-volumes/c7588bd3-6010-41b7-8acc-0aa8172bdb1f HTTP/1.1 Oct 20 06:42:18.546601 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: Accept: application/json Oct 20 06:42:18.546601 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: Accept-Encoding: identity Oct 20 06:42:18.546601 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: Connection: close Oct 20 06:42:18.546601 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: Content-Length: 0 Oct 20 06:42:18.546601 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: Content-Type: application/json Oct 20 06:42:18.546601 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: Host: 10.222.0.20 Oct 20 06:42:18.546601 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: Openstack-System-Scope: None Oct 20 06:42:18.546601 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: User-Agent: python-urllib3/1.26.12 Oct 20 06:42:18.546601 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Auth-Token: gAAAAABjUO3KwOvbvzZJ4xci8E2vy2LBl0AG-6DWBPdGjur5sRpvK-eBbaRxC3qfQS9Wr_YONN--3ROqP0iuz25ADd0X9nI5hS6lYpAf95KV8IgCrTVHCRF1TyuOCVj8_4ecNs1KpTdctAi_5l2-ubf9Kz6bJihn8W1M3fhCfyqhE4LvjyLPaD0 Oct 20 06:42:18.546601 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Domain-Id: None Oct 20 06:42:18.546601 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Domain-Name: None Oct 20 06:42:18.546601 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Identity-Status: Confirmed Oct 20 06:42:18.546601 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Is-Admin-Project: True Oct 20 06:42:18.546601 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Project-Domain-Id: default Oct 20 06:42:18.546601 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Project-Domain-Name: Default Oct 20 06:42:18.546601 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Project-Id: d198c9c79b3148df8c65e7a7a66d18bd Oct 20 06:42:18.546601 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Project-Name: tempest-VolumesNegativeTest-1314491935 Oct 20 06:42:18.546601 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Role: reader,member Oct 20 06:42:18.546601 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Roles: reader,member Oct 20 06:42:18.548018 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d198c9c79b3148df8c65e7a7a66d18bd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d198c9c79b3148df8c65e7a7a66d18bd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d198c9c79b3148df8c65e7a7a66d18bd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d198c9c79b3148df8c65e7a7a66d18bd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 20 06:42:18.548018 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Tenant: tempest-VolumesNegativeTest-1314491935 Oct 20 06:42:18.548018 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Tenant-Id: d198c9c79b3148df8c65e7a7a66d18bd Oct 20 06:42:18.548018 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Tenant-Name: tempest-VolumesNegativeTest-1314491935 Oct 20 06:42:18.548018 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-User: tempest-VolumesNegativeTest-1314491935-project Oct 20 06:42:18.548018 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-User-Domain-Id: default Oct 20 06:42:18.548018 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-User-Domain-Name: Default Oct 20 06:42:18.548018 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-User-Id: b31ed8707ab34d9182cfaa0b8699ed22 Oct 20 06:42:18.548018 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-User-Name: tempest-VolumesNegativeTest-1314491935-project Oct 20 06:42:18.548018 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: method: Oct 20 06:42:18.548018 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: exception: Volume c7588bd3-6010-41b7-8acc-0aa8172bdb1f could not be found. Oct 20 06:42:18.548018 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: action_args: {'id': 'c7588bd3-6010-41b7-8acc-0aa8172bdb1f'} Oct 20 06:42:18.548018 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 20 06:42:18.548848 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 06:42:18.548848 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 20 06:42:18.548848 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 20 06:42:18.548848 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 20 06:42:18.548848 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 20 06:42:18.548848 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 20 06:42:18.548848 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 20 06:42:18.548848 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 20 06:42:18.548848 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 20 06:42:18.548848 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 20 06:42:18.548848 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 20 06:42:18.548848 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 20 06:42:18.548848 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 20 06:42:18.548848 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 20 06:42:18.548848 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 20 06:42:18.548848 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c7588bd3-6010-41b7-8acc-0aa8172bdb1f could not be found. (HTTP 404) (Request-ID: req-eef0eb53-a2d5-4d4d-9469-21366ddf826b) Oct 20 06:42:18.548848 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi Oct 20 06:42:18.548848 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 06:42:18.548848 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi Oct 20 06:42:18.549942 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 06:42:18.549942 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 20 06:42:18.549942 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 20 06:42:18.549942 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 20 06:42:18.549942 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 20 06:42:18.549942 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 20 06:42:18.549942 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 20 06:42:18.549942 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 20 06:42:18.549942 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 20 06:42:18.549942 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 20 06:42:18.549942 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 20 06:42:18.549942 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 20 06:42:18.549942 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 20 06:42:18.549942 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 20 06:42:18.549942 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 20 06:42:18.549942 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 20 06:42:18.549942 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 20 06:42:18.549942 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 20 06:42:18.549942 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 20 06:42:18.550926 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 20 06:42:18.550926 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 20 06:42:18.550926 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 20 06:42:18.550926 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 20 06:42:18.550926 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c7588bd3-6010-41b7-8acc-0aa8172bdb1f could not be found. Oct 20 06:42:18.550926 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi Oct 20 06:42:18.550926 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 06:42:18.550926 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi Oct 20 06:42:18.550926 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 06:42:18.550926 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 06:42:18.550926 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 06:42:18.550926 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 20 06:42:18.550926 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 20 06:42:18.550926 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 20 06:42:18.550926 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 20 06:42:18.550926 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 20 06:42:18.550926 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 20 06:42:18.550926 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 20 06:42:18.550926 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 20 06:42:18.551921 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c7588bd3-6010-41b7-8acc-0aa8172bdb1f could not be found. Oct 20 06:42:18.551921 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi Oct 20 06:42:18.551921 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 06:42:18.551921 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi Oct 20 06:42:18.551921 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 06:42:18.551921 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 06:42:18.551921 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 06:42:18.551921 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 20 06:42:18.551921 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 20 06:42:18.551921 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c7588bd3-6010-41b7-8acc-0aa8172bdb1f could not be found. Oct 20 06:42:18.551921 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi Oct 20 06:42:18.551921 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-cb7e91c9-7ff8-48c3-94b4-99aa726c04f1 tempest-VolumesNegativeTest-1314491935 tempest-VolumesNegativeTest-1314491935-project] Returning 404 to user: Volume c7588bd3-6010-41b7-8acc-0aa8172bdb1f could not be found. {{(pid=118860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 20 06:42:18.551921 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-cb7e91c9-7ff8-48c3-94b4-99aa726c04f1 tempest-VolumesNegativeTest-1314491935 tempest-VolumesNegativeTest-1314491935-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/c7588bd3-6010-41b7-8acc-0aa8172bdb1f" status: 404 len: 109 microversion: 2.1 time: 0.137825 Oct 20 06:42:18.551921 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1332/2653] 10.222.0.20 () {58 vars in 1248 bytes} [Thu Oct 20 06:42:18 2022] DELETE /compute/v2.1/os-volumes/c7588bd3-6010-41b7-8acc-0aa8172bdb1f => generated 109 bytes in 139 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 20 06:42:18.557860 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-4eb6859b-824f-4431-922f-fff4de50aa7f tempest-VolumesNegativeTest-1314491935 tempest-VolumesNegativeTest-1314491935-project] Calling method '.version_select at 0x7fbe4ac57790>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:42:18.587923 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.wsgi [None req-4eb6859b-824f-4431-922f-fff4de50aa7f tempest-VolumesNegativeTest-1314491935 tempest-VolumesNegativeTest-1314491935-project] HTTP exception thrown: Volume ad83aa02-1efc-469b-8d8b-5d4aaa83a501 could not be found. Oct 20 06:42:18.589905 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-4eb6859b-824f-4431-922f-fff4de50aa7f tempest-VolumesNegativeTest-1314491935 tempest-VolumesNegativeTest-1314491935-project] Request method failure captured: Oct 20 06:42:18.589905 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: request: GET /compute/v2.1/os-volumes/ad83aa02-1efc-469b-8d8b-5d4aaa83a501 HTTP/1.1 Oct 20 06:42:18.589905 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: Accept: application/json Oct 20 06:42:18.589905 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: Accept-Encoding: identity Oct 20 06:42:18.589905 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: Connection: close Oct 20 06:42:18.589905 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: Content-Length: 0 Oct 20 06:42:18.589905 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: Content-Type: application/json Oct 20 06:42:18.589905 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: Host: 10.222.0.20 Oct 20 06:42:18.589905 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: Openstack-System-Scope: None Oct 20 06:42:18.589905 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: User-Agent: python-urllib3/1.26.12 Oct 20 06:42:18.589905 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Auth-Token: gAAAAABjUO3KwOvbvzZJ4xci8E2vy2LBl0AG-6DWBPdGjur5sRpvK-eBbaRxC3qfQS9Wr_YONN--3ROqP0iuz25ADd0X9nI5hS6lYpAf95KV8IgCrTVHCRF1TyuOCVj8_4ecNs1KpTdctAi_5l2-ubf9Kz6bJihn8W1M3fhCfyqhE4LvjyLPaD0 Oct 20 06:42:18.589905 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Domain-Id: None Oct 20 06:42:18.589905 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Domain-Name: None Oct 20 06:42:18.589905 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Identity-Status: Confirmed Oct 20 06:42:18.589905 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Is-Admin-Project: True Oct 20 06:42:18.589905 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Project-Domain-Id: default Oct 20 06:42:18.589905 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Project-Domain-Name: Default Oct 20 06:42:18.589905 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Project-Id: d198c9c79b3148df8c65e7a7a66d18bd Oct 20 06:42:18.589905 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Project-Name: tempest-VolumesNegativeTest-1314491935 Oct 20 06:42:18.589905 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Role: reader,member Oct 20 06:42:18.589905 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Roles: reader,member Oct 20 06:42:18.591149 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d198c9c79b3148df8c65e7a7a66d18bd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d198c9c79b3148df8c65e7a7a66d18bd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d198c9c79b3148df8c65e7a7a66d18bd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d198c9c79b3148df8c65e7a7a66d18bd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 20 06:42:18.591149 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Tenant: tempest-VolumesNegativeTest-1314491935 Oct 20 06:42:18.591149 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Tenant-Id: d198c9c79b3148df8c65e7a7a66d18bd Oct 20 06:42:18.591149 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Tenant-Name: tempest-VolumesNegativeTest-1314491935 Oct 20 06:42:18.591149 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-User: tempest-VolumesNegativeTest-1314491935-project Oct 20 06:42:18.591149 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-User-Domain-Id: default Oct 20 06:42:18.591149 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-User-Domain-Name: Default Oct 20 06:42:18.591149 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-User-Id: b31ed8707ab34d9182cfaa0b8699ed22 Oct 20 06:42:18.591149 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-User-Name: tempest-VolumesNegativeTest-1314491935-project Oct 20 06:42:18.591149 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: method: Oct 20 06:42:18.591149 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: exception: Volume ad83aa02-1efc-469b-8d8b-5d4aaa83a501 could not be found. Oct 20 06:42:18.591149 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: action_args: {'id': 'ad83aa02-1efc-469b-8d8b-5d4aaa83a501'} Oct 20 06:42:18.591149 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 20 06:42:18.592416 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 06:42:18.592416 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 20 06:42:18.592416 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 20 06:42:18.592416 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 20 06:42:18.592416 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 20 06:42:18.592416 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 20 06:42:18.592416 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 20 06:42:18.592416 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 20 06:42:18.592416 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 20 06:42:18.592416 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 20 06:42:18.592416 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 20 06:42:18.592416 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 20 06:42:18.592416 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 20 06:42:18.592416 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 20 06:42:18.592416 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 20 06:42:18.592416 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ad83aa02-1efc-469b-8d8b-5d4aaa83a501 could not be found. (HTTP 404) (Request-ID: req-adb6a29a-d70f-43f7-9ad7-b2f8c526a6c3) Oct 20 06:42:18.592416 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi Oct 20 06:42:18.592416 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 06:42:18.592416 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi Oct 20 06:42:18.593571 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 06:42:18.593571 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 20 06:42:18.593571 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 20 06:42:18.593571 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 20 06:42:18.593571 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 20 06:42:18.593571 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 20 06:42:18.593571 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 20 06:42:18.593571 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 20 06:42:18.593571 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 20 06:42:18.593571 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 20 06:42:18.593571 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 20 06:42:18.593571 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 20 06:42:18.593571 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 20 06:42:18.593571 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 20 06:42:18.593571 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 20 06:42:18.593571 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 20 06:42:18.593571 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 20 06:42:18.593571 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 20 06:42:18.593571 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 20 06:42:18.594565 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 20 06:42:18.594565 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 20 06:42:18.594565 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 20 06:42:18.594565 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 20 06:42:18.594565 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ad83aa02-1efc-469b-8d8b-5d4aaa83a501 could not be found. Oct 20 06:42:18.594565 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi Oct 20 06:42:18.594565 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 06:42:18.594565 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi Oct 20 06:42:18.594565 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 06:42:18.594565 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 06:42:18.594565 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 06:42:18.594565 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 20 06:42:18.594565 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 20 06:42:18.594565 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 20 06:42:18.594565 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 20 06:42:18.594565 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 20 06:42:18.594565 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 20 06:42:18.594565 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 20 06:42:18.594565 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 20 06:42:18.595570 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ad83aa02-1efc-469b-8d8b-5d4aaa83a501 could not be found. Oct 20 06:42:18.595570 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi Oct 20 06:42:18.595570 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 06:42:18.595570 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi Oct 20 06:42:18.595570 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 06:42:18.595570 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 06:42:18.595570 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 06:42:18.595570 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 20 06:42:18.595570 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 20 06:42:18.595570 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ad83aa02-1efc-469b-8d8b-5d4aaa83a501 could not be found. Oct 20 06:42:18.595570 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi Oct 20 06:42:18.595570 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-4eb6859b-824f-4431-922f-fff4de50aa7f tempest-VolumesNegativeTest-1314491935 tempest-VolumesNegativeTest-1314491935-project] Returning 404 to user: Volume ad83aa02-1efc-469b-8d8b-5d4aaa83a501 could not be found. {{(pid=118861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 20 06:42:18.595570 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-4eb6859b-824f-4431-922f-fff4de50aa7f tempest-VolumesNegativeTest-1314491935 tempest-VolumesNegativeTest-1314491935-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/ad83aa02-1efc-469b-8d8b-5d4aaa83a501" status: 404 len: 109 microversion: 2.1 time: 0.037278 Oct 20 06:42:18.595570 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1322/2654] 10.222.0.20 () {58 vars in 1245 bytes} [Thu Oct 20 06:42:18 2022] GET /compute/v2.1/os-volumes/ad83aa02-1efc-469b-8d8b-5d4aaa83a501 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 20 06:42:43.138690 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG dbcounter [-] [118860] Writing DB stats nova_api:SELECT=2 {{(pid=118860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:42:43.139423 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG dbcounter [-] [118860] Writing DB stats nova_cell1:SELECT=2 {{(pid=118860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:42:43.144277 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-0f67b477-ae76-46a3-8f69-2a91051c418b tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-624336852", "imageRef": "9fcec276-734d-41d9-905b-10d2bbcbfba5", "flavorRef": "452", "networks": [{"uuid": "e8c1e120-1ceb-4677-a53f-925524815e18"}]}} {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 06:42:43.197978 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.network.neutron [None req-0f67b477-ae76-46a3-8f69-2a91051c418b tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] validate_networks() for [('e8c1e120-1ceb-4677-a53f-925524815e18', None, None, None, None, None)] {{(pid=118860) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 20 06:42:43.582745 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.virt.hardware [None req-0f67b477-ae76-46a3-8f69-2a91051c418b tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Flavor limits 0:0:0 {{(pid=118860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 20 06:42:43.583169 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.virt.hardware [None req-0f67b477-ae76-46a3-8f69-2a91051c418b tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Image limits 0:0:0 {{(pid=118860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 20 06:42:43.583832 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.virt.hardware [None req-0f67b477-ae76-46a3-8f69-2a91051c418b tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Flavor pref 0:0:0 {{(pid=118860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 20 06:42:43.584466 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.virt.hardware [None req-0f67b477-ae76-46a3-8f69-2a91051c418b tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Image pref 0:0:0 {{(pid=118860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 20 06:42:43.584920 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.virt.hardware [None req-0f67b477-ae76-46a3-8f69-2a91051c418b tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 20 06:42:43.594465 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0f67b477-ae76-46a3-8f69-2a91051c418b tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:42:43.594807 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0f67b477-ae76-46a3-8f69-2a91051c418b tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:42:43.595244 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0f67b477-ae76-46a3-8f69-2a91051c418b tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:42:43.595966 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0f67b477-ae76-46a3-8f69-2a91051c418b tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:42:43.596417 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0f67b477-ae76-46a3-8f69-2a91051c418b tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:42:43.596868 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0f67b477-ae76-46a3-8f69-2a91051c418b tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:42:43.615123 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.quota [None req-0f67b477-ae76-46a3-8f69-2a91051c418b tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Getting quotas for project 73df73c7c77d435ba5c5725c2eb1567b. Resources: {'cores', 'ram', 'instances'} {{(pid=118860) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 20 06:42:43.619001 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.quota [None req-0f67b477-ae76-46a3-8f69-2a91051c418b tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Getting quotas for user cbee91e2e9974c02bca084b1777551fd and project 73df73c7c77d435ba5c5725c2eb1567b. Resources: {'cores', 'ram', 'instances'} {{(pid=118860) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 20 06:42:43.630079 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-0f67b477-ae76-46a3-8f69-2a91051c418b tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Going to run 1 instances... {{(pid=118860) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 20 06:42:43.632400 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-0f67b477-ae76-46a3-8f69-2a91051c418b tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] [instance: af4bbdd0-ce14-4f99-8094-6abc1cfb2887] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9fcec276-734d-41d9-905b-10d2bbcbfba5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118860) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 20 06:42:43.679096 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-0f67b477-ae76-46a3-8f69-2a91051c418b tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.541644 Oct 20 06:42:43.679746 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1333/2655] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Oct 20 06:42:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 543 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 20 06:42:43.689544 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG dbcounter [-] [118861] Writing DB stats nova_api:SELECT=2 {{(pid=118861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:42:43.690288 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG dbcounter [-] [118861] Writing DB stats nova_cell1:SELECT=2 {{(pid=118861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:42:43.694102 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-50620dd1-38a7-4c9f-89ff-927362e0f78c tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:42:43.695346 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-50620dd1-38a7-4c9f-89ff-927362e0f78c tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] [instance: af4bbdd0-ce14-4f99-8094-6abc1cfb2887] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:42:43.756319 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-50620dd1-38a7-4c9f-89ff-927362e0f78c tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbee91e2e9974c02bca084b1777551fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73df73c7c77d435ba5c5725c2eb1567b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:42:43.763045 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-50620dd1-38a7-4c9f-89ff-927362e0f78c tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] 10.222.0.20 "GET /compute/v2.1/servers/af4bbdd0-ce14-4f99-8094-6abc1cfb2887" status: 200 len: 1213 microversion: 2.1 time: 0.076298 Oct 20 06:42:43.763653 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1323/2656] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:42:43 2022] GET /compute/v2.1/servers/af4bbdd0-ce14-4f99-8094-6abc1cfb2887 => generated 1213 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:42:44.786783 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-c48d4f71-96ed-40e6-848a-c631a5346b13 tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:42:44.787456 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-c48d4f71-96ed-40e6-848a-c631a5346b13 tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] [instance: af4bbdd0-ce14-4f99-8094-6abc1cfb2887] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:42:44.794047 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c48d4f71-96ed-40e6-848a-c631a5346b13 tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:42:44.794629 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c48d4f71-96ed-40e6-848a-c631a5346b13 tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:42:44.795143 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c48d4f71-96ed-40e6-848a-c631a5346b13 tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:42:44.795987 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c48d4f71-96ed-40e6-848a-c631a5346b13 tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:42:44.797589 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c48d4f71-96ed-40e6-848a-c631a5346b13 tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:42:44.798105 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-c48d4f71-96ed-40e6-848a-c631a5346b13 tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:42:44.885818 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-c48d4f71-96ed-40e6-848a-c631a5346b13 tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbee91e2e9974c02bca084b1777551fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73df73c7c77d435ba5c5725c2eb1567b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:42:44.895063 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-c48d4f71-96ed-40e6-848a-c631a5346b13 tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] 10.222.0.20 "GET /compute/v2.1/servers/af4bbdd0-ce14-4f99-8094-6abc1cfb2887" status: 200 len: 1273 microversion: 2.1 time: 0.112278 Oct 20 06:42:44.895852 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1334/2657] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:42:44 2022] GET /compute/v2.1/servers/af4bbdd0-ce14-4f99-8094-6abc1cfb2887 => generated 1273 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:42:45.918317 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-5194dc7a-d85e-46a1-8876-f5434a8444a6 tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:42:45.918932 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-5194dc7a-d85e-46a1-8876-f5434a8444a6 tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] [instance: af4bbdd0-ce14-4f99-8094-6abc1cfb2887] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:42:45.926959 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5194dc7a-d85e-46a1-8876-f5434a8444a6 tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:42:45.927446 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5194dc7a-d85e-46a1-8876-f5434a8444a6 tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:42:45.927885 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5194dc7a-d85e-46a1-8876-f5434a8444a6 tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:42:45.928591 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5194dc7a-d85e-46a1-8876-f5434a8444a6 tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:42:45.929068 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5194dc7a-d85e-46a1-8876-f5434a8444a6 tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:42:45.929505 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-5194dc7a-d85e-46a1-8876-f5434a8444a6 tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:42:46.072364 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-5194dc7a-d85e-46a1-8876-f5434a8444a6 tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbee91e2e9974c02bca084b1777551fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73df73c7c77d435ba5c5725c2eb1567b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:42:46.080108 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-5194dc7a-d85e-46a1-8876-f5434a8444a6 tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] 10.222.0.20 "GET /compute/v2.1/servers/af4bbdd0-ce14-4f99-8094-6abc1cfb2887" status: 200 len: 1313 microversion: 2.1 time: 0.165696 Oct 20 06:42:46.080668 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1324/2658] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:42:45 2022] GET /compute/v2.1/servers/af4bbdd0-ce14-4f99-8094-6abc1cfb2887 => generated 1313 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:42:46.420081 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [req-e3cc29af-2844-4a0d-bbb8-971fc7b860f0 req-178dfba0-beaa-4bc4-9cbd-1fa1b803fc13 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af4bbdd0-ce14-4f99-8094-6abc1cfb2887", "tag": "b56f897f-f5b8-45d8-93cd-a89fb8a38b2f"}]} {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 06:42:46.430721 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [req-e3cc29af-2844-4a0d-bbb8-971fc7b860f0 req-178dfba0-beaa-4bc4-9cbd-1fa1b803fc13 service nova] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:42:46.431439 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [req-e3cc29af-2844-4a0d-bbb8-971fc7b860f0 req-178dfba0-beaa-4bc4-9cbd-1fa1b803fc13 service nova] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:42:46.431874 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [req-e3cc29af-2844-4a0d-bbb8-971fc7b860f0 req-178dfba0-beaa-4bc4-9cbd-1fa1b803fc13 service nova] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:42:46.444256 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.compute.server_external_events [req-e3cc29af-2844-4a0d-bbb8-971fc7b860f0 req-178dfba0-beaa-4bc4-9cbd-1fa1b803fc13 service nova] Creating event network-changed:b56f897f-f5b8-45d8-93cd-a89fb8a38b2f for instance af4bbdd0-ce14-4f99-8094-6abc1cfb2887 on hv-cinder-86156 Oct 20 06:42:46.447653 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR oslo.messaging._drivers.impl_rabbit [req-e3cc29af-2844-4a0d-bbb8-971fc7b860f0 req-178dfba0-beaa-4bc4-9cbd-1fa1b803fc13 service nova] [08a62a08-76e3-4c4c-9ead-7e177de324fc] AMQP server on 10.222.0.20:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 20 06:42:47.103233 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-6531e490-1c09-4704-b837-ea043ce4aae1 tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:42:47.103839 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-6531e490-1c09-4704-b837-ea043ce4aae1 tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] [instance: af4bbdd0-ce14-4f99-8094-6abc1cfb2887] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:42:47.110198 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-6531e490-1c09-4704-b837-ea043ce4aae1 tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:42:47.110672 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-6531e490-1c09-4704-b837-ea043ce4aae1 tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:42:47.111103 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-6531e490-1c09-4704-b837-ea043ce4aae1 tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:42:47.111782 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-6531e490-1c09-4704-b837-ea043ce4aae1 tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:42:47.112225 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-6531e490-1c09-4704-b837-ea043ce4aae1 tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:42:47.112643 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-6531e490-1c09-4704-b837-ea043ce4aae1 tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:42:47.236987 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-6531e490-1c09-4704-b837-ea043ce4aae1 tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbee91e2e9974c02bca084b1777551fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73df73c7c77d435ba5c5725c2eb1567b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:42:47.244512 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-6531e490-1c09-4704-b837-ea043ce4aae1 tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] 10.222.0.20 "GET /compute/v2.1/servers/af4bbdd0-ce14-4f99-8094-6abc1cfb2887" status: 200 len: 1313 microversion: 2.1 time: 0.145349 Oct 20 06:42:47.245115 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1325/2659] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:42:47 2022] GET /compute/v2.1/servers/af4bbdd0-ce14-4f99-8094-6abc1cfb2887 => generated 1313 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 06:42:47.455664 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO oslo.messaging._drivers.impl_rabbit [req-e3cc29af-2844-4a0d-bbb8-971fc7b860f0 req-178dfba0-beaa-4bc4-9cbd-1fa1b803fc13 service nova] [08a62a08-76e3-4c4c-9ead-7e177de324fc] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 41854. Oct 20 06:42:47.459271 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [req-e3cc29af-2844-4a0d-bbb8-971fc7b860f0 req-178dfba0-beaa-4bc4-9cbd-1fa1b803fc13 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.043389 Oct 20 06:42:47.459871 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1335/2660] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 20 06:42:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1045 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:42:48.267399 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-756222c8-016c-4116-8a57-2b4906d215d6 tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:42:48.268142 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-756222c8-016c-4116-8a57-2b4906d215d6 tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] [instance: af4bbdd0-ce14-4f99-8094-6abc1cfb2887] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:42:48.274565 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-756222c8-016c-4116-8a57-2b4906d215d6 tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:42:48.275037 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-756222c8-016c-4116-8a57-2b4906d215d6 tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:42:48.275465 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-756222c8-016c-4116-8a57-2b4906d215d6 tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:42:48.276143 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-756222c8-016c-4116-8a57-2b4906d215d6 tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:42:48.276589 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-756222c8-016c-4116-8a57-2b4906d215d6 tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:42:48.277043 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-756222c8-016c-4116-8a57-2b4906d215d6 tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:42:48.409515 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-756222c8-016c-4116-8a57-2b4906d215d6 tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbee91e2e9974c02bca084b1777551fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73df73c7c77d435ba5c5725c2eb1567b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:42:48.417188 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-756222c8-016c-4116-8a57-2b4906d215d6 tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] 10.222.0.20 "GET /compute/v2.1/servers/af4bbdd0-ce14-4f99-8094-6abc1cfb2887" status: 200 len: 1313 microversion: 2.1 time: 0.153669 Oct 20 06:42:48.417742 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1326/2661] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:42:48 2022] GET /compute/v2.1/servers/af4bbdd0-ce14-4f99-8094-6abc1cfb2887 => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:42:49.440480 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-cb0bff41-a1d8-44bd-a280-d36b921ec3d3 tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:42:49.441321 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-cb0bff41-a1d8-44bd-a280-d36b921ec3d3 tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] [instance: af4bbdd0-ce14-4f99-8094-6abc1cfb2887] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:42:49.447759 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-cb0bff41-a1d8-44bd-a280-d36b921ec3d3 tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:42:49.448288 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-cb0bff41-a1d8-44bd-a280-d36b921ec3d3 tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:42:49.448751 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-cb0bff41-a1d8-44bd-a280-d36b921ec3d3 tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:42:49.449438 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-cb0bff41-a1d8-44bd-a280-d36b921ec3d3 tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:42:49.449891 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-cb0bff41-a1d8-44bd-a280-d36b921ec3d3 tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:42:49.450311 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-cb0bff41-a1d8-44bd-a280-d36b921ec3d3 tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:42:49.577068 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-cb0bff41-a1d8-44bd-a280-d36b921ec3d3 tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbee91e2e9974c02bca084b1777551fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73df73c7c77d435ba5c5725c2eb1567b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:42:49.585475 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-cb0bff41-a1d8-44bd-a280-d36b921ec3d3 tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] 10.222.0.20 "GET /compute/v2.1/servers/af4bbdd0-ce14-4f99-8094-6abc1cfb2887" status: 200 len: 1313 microversion: 2.1 time: 0.149793 Oct 20 06:42:49.586065 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1336/2662] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:42:49 2022] GET /compute/v2.1/servers/af4bbdd0-ce14-4f99-8094-6abc1cfb2887 => generated 1313 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:42:50.608351 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-900f9b86-21b7-4bd5-a11a-70939cf242df tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:42:50.609496 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-900f9b86-21b7-4bd5-a11a-70939cf242df tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] [instance: af4bbdd0-ce14-4f99-8094-6abc1cfb2887] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:42:50.615857 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-900f9b86-21b7-4bd5-a11a-70939cf242df tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:42:50.616330 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-900f9b86-21b7-4bd5-a11a-70939cf242df tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:42:50.616785 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-900f9b86-21b7-4bd5-a11a-70939cf242df tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:42:50.618225 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-900f9b86-21b7-4bd5-a11a-70939cf242df tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:42:50.618680 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-900f9b86-21b7-4bd5-a11a-70939cf242df tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:42:50.619456 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-900f9b86-21b7-4bd5-a11a-70939cf242df tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:42:50.751701 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-900f9b86-21b7-4bd5-a11a-70939cf242df tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbee91e2e9974c02bca084b1777551fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73df73c7c77d435ba5c5725c2eb1567b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:42:50.759650 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-900f9b86-21b7-4bd5-a11a-70939cf242df tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] 10.222.0.20 "GET /compute/v2.1/servers/af4bbdd0-ce14-4f99-8094-6abc1cfb2887" status: 200 len: 1313 microversion: 2.1 time: 0.155242 Oct 20 06:42:50.760209 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1327/2663] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:42:50 2022] GET /compute/v2.1/servers/af4bbdd0-ce14-4f99-8094-6abc1cfb2887 => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:42:51.501680 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [req-462fd850-0e50-46ec-ab03-cbda0af40d4b req-98d1419e-14d3-419c-9436-37f515aece50 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af4bbdd0-ce14-4f99-8094-6abc1cfb2887", "name": "network-vif-plugged", "status": "completed", "tag": "b56f897f-f5b8-45d8-93cd-a89fb8a38b2f"}]} {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 06:42:51.511314 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [req-462fd850-0e50-46ec-ab03-cbda0af40d4b req-98d1419e-14d3-419c-9436-37f515aece50 service nova] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:42:51.511791 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [req-462fd850-0e50-46ec-ab03-cbda0af40d4b req-98d1419e-14d3-419c-9436-37f515aece50 service nova] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:42:51.512233 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [req-462fd850-0e50-46ec-ab03-cbda0af40d4b req-98d1419e-14d3-419c-9436-37f515aece50 service nova] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:42:51.522921 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.compute.server_external_events [req-462fd850-0e50-46ec-ab03-cbda0af40d4b req-98d1419e-14d3-419c-9436-37f515aece50 service nova] Creating event network-vif-plugged:b56f897f-f5b8-45d8-93cd-a89fb8a38b2f for instance af4bbdd0-ce14-4f99-8094-6abc1cfb2887 on hv-cinder-86156 Oct 20 06:42:51.527892 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [req-462fd850-0e50-46ec-ab03-cbda0af40d4b req-98d1419e-14d3-419c-9436-37f515aece50 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.153174 Oct 20 06:42:51.528465 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1337/2664] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 20 06:42:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:42:51.783142 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-99addef6-eaa9-4231-b9d2-3f99917ceb5c tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:42:51.783750 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-99addef6-eaa9-4231-b9d2-3f99917ceb5c tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] [instance: af4bbdd0-ce14-4f99-8094-6abc1cfb2887] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:42:51.790049 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-99addef6-eaa9-4231-b9d2-3f99917ceb5c tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:42:51.790522 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-99addef6-eaa9-4231-b9d2-3f99917ceb5c tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:42:51.790953 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-99addef6-eaa9-4231-b9d2-3f99917ceb5c tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:42:51.791631 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-99addef6-eaa9-4231-b9d2-3f99917ceb5c tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:42:51.792075 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-99addef6-eaa9-4231-b9d2-3f99917ceb5c tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:42:51.792492 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-99addef6-eaa9-4231-b9d2-3f99917ceb5c tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:42:51.921019 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-99addef6-eaa9-4231-b9d2-3f99917ceb5c tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbee91e2e9974c02bca084b1777551fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73df73c7c77d435ba5c5725c2eb1567b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:42:51.929202 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-99addef6-eaa9-4231-b9d2-3f99917ceb5c tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] 10.222.0.20 "GET /compute/v2.1/servers/af4bbdd0-ce14-4f99-8094-6abc1cfb2887" status: 200 len: 1313 microversion: 2.1 time: 0.150515 Oct 20 06:42:51.929766 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1328/2665] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:42:51 2022] GET /compute/v2.1/servers/af4bbdd0-ce14-4f99-8094-6abc1cfb2887 => generated 1313 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:42:52.953551 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-207bd3e0-bfa0-4b4c-a5c2-a4011efef866 tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:42:52.954255 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-207bd3e0-bfa0-4b4c-a5c2-a4011efef866 tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] [instance: af4bbdd0-ce14-4f99-8094-6abc1cfb2887] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:42:52.960931 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-207bd3e0-bfa0-4b4c-a5c2-a4011efef866 tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:42:52.961410 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-207bd3e0-bfa0-4b4c-a5c2-a4011efef866 tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:42:52.961844 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-207bd3e0-bfa0-4b4c-a5c2-a4011efef866 tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:42:52.962533 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-207bd3e0-bfa0-4b4c-a5c2-a4011efef866 tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:42:52.962985 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-207bd3e0-bfa0-4b4c-a5c2-a4011efef866 tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:42:52.963435 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-207bd3e0-bfa0-4b4c-a5c2-a4011efef866 tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:42:53.092840 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-207bd3e0-bfa0-4b4c-a5c2-a4011efef866 tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbee91e2e9974c02bca084b1777551fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73df73c7c77d435ba5c5725c2eb1567b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:42:53.101514 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-207bd3e0-bfa0-4b4c-a5c2-a4011efef866 tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] 10.222.0.20 "GET /compute/v2.1/servers/af4bbdd0-ce14-4f99-8094-6abc1cfb2887" status: 200 len: 1313 microversion: 2.1 time: 0.153066 Oct 20 06:42:53.102081 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1338/2666] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:42:52 2022] GET /compute/v2.1/servers/af4bbdd0-ce14-4f99-8094-6abc1cfb2887 => generated 1313 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:42:54.123362 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-7566158c-46ad-491c-9c0f-ac4f1d7e20c5 tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:42:54.123967 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-7566158c-46ad-491c-9c0f-ac4f1d7e20c5 tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] [instance: af4bbdd0-ce14-4f99-8094-6abc1cfb2887] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:42:54.127292 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG dbcounter [-] [118861] Writing DB stats nova_cell0:SELECT=2 {{(pid=118861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:42:54.132478 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7566158c-46ad-491c-9c0f-ac4f1d7e20c5 tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:42:54.132993 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7566158c-46ad-491c-9c0f-ac4f1d7e20c5 tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:42:54.133425 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7566158c-46ad-491c-9c0f-ac4f1d7e20c5 tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:42:54.134108 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7566158c-46ad-491c-9c0f-ac4f1d7e20c5 tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:42:54.134553 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7566158c-46ad-491c-9c0f-ac4f1d7e20c5 tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:42:54.134973 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7566158c-46ad-491c-9c0f-ac4f1d7e20c5 tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:42:54.268344 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-7566158c-46ad-491c-9c0f-ac4f1d7e20c5 tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbee91e2e9974c02bca084b1777551fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73df73c7c77d435ba5c5725c2eb1567b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:42:54.276146 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-7566158c-46ad-491c-9c0f-ac4f1d7e20c5 tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] 10.222.0.20 "GET /compute/v2.1/servers/af4bbdd0-ce14-4f99-8094-6abc1cfb2887" status: 200 len: 1497 microversion: 2.1 time: 0.156635 Oct 20 06:42:54.276736 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1329/2667] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:42:54 2022] GET /compute/v2.1/servers/af4bbdd0-ce14-4f99-8094-6abc1cfb2887 => generated 1497 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:42:54.705747 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-6649edbb-4060-49c0-8578-03ab5fd174ea tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:42:54.706212 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-6649edbb-4060-49c0-8578-03ab5fd174ea tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] [instance: af4bbdd0-ce14-4f99-8094-6abc1cfb2887] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:42:54.708063 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG dbcounter [-] [118860] Writing DB stats nova_cell0:SELECT=2 {{(pid=118860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:42:54.708721 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG dbcounter [-] [118860] Writing DB stats nova_cell0:SELECT=6 {{(pid=118860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:42:54.714942 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-6649edbb-4060-49c0-8578-03ab5fd174ea tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:42:54.715421 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-6649edbb-4060-49c0-8578-03ab5fd174ea tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:42:54.715851 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-6649edbb-4060-49c0-8578-03ab5fd174ea tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:42:54.716530 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-6649edbb-4060-49c0-8578-03ab5fd174ea tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:42:54.717083 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-6649edbb-4060-49c0-8578-03ab5fd174ea tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:42:54.717505 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-6649edbb-4060-49c0-8578-03ab5fd174ea tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:42:54.744246 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-6649edbb-4060-49c0-8578-03ab5fd174ea tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] [instance: af4bbdd0-ce14-4f99-8094-6abc1cfb2887] Going to try to terminate instance {{(pid=118860) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 20 06:42:54.817491 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-6649edbb-4060-49c0-8578-03ab5fd174ea tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] 10.222.0.20 "DELETE /compute/v2.1/servers/af4bbdd0-ce14-4f99-8094-6abc1cfb2887" status: 204 len: 0 microversion: 2.1 time: 0.115289 Oct 20 06:42:54.821091 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1339/2668] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 20 06:42:54 2022] DELETE /compute/v2.1/servers/af4bbdd0-ce14-4f99-8094-6abc1cfb2887 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 20 06:42:54.826544 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-c05c7fbd-6ec3-4147-932d-d0f40a8e9173 tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:42:54.827248 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-c05c7fbd-6ec3-4147-932d-d0f40a8e9173 tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] [instance: af4bbdd0-ce14-4f99-8094-6abc1cfb2887] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:42:54.833462 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c05c7fbd-6ec3-4147-932d-d0f40a8e9173 tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:42:54.833944 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c05c7fbd-6ec3-4147-932d-d0f40a8e9173 tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:42:54.834375 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c05c7fbd-6ec3-4147-932d-d0f40a8e9173 tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:42:54.835058 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c05c7fbd-6ec3-4147-932d-d0f40a8e9173 tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:42:54.835507 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c05c7fbd-6ec3-4147-932d-d0f40a8e9173 tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:42:54.835928 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-c05c7fbd-6ec3-4147-932d-d0f40a8e9173 tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:42:54.962326 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-c05c7fbd-6ec3-4147-932d-d0f40a8e9173 tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbee91e2e9974c02bca084b1777551fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73df73c7c77d435ba5c5725c2eb1567b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:42:54.970965 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-c05c7fbd-6ec3-4147-932d-d0f40a8e9173 tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] 10.222.0.20 "GET /compute/v2.1/servers/af4bbdd0-ce14-4f99-8094-6abc1cfb2887" status: 200 len: 1503 microversion: 2.1 time: 0.148338 Oct 20 06:42:54.971531 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1330/2669] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:42:54 2022] GET /compute/v2.1/servers/af4bbdd0-ce14-4f99-8094-6abc1cfb2887 => generated 1503 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:42:55.994784 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-8c9fa6e4-1949-43e7-ae02-3d78d1b2aa84 tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:42:55.995525 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-8c9fa6e4-1949-43e7-ae02-3d78d1b2aa84 tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] [instance: af4bbdd0-ce14-4f99-8094-6abc1cfb2887] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:42:56.002298 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-8c9fa6e4-1949-43e7-ae02-3d78d1b2aa84 tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:42:56.002782 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-8c9fa6e4-1949-43e7-ae02-3d78d1b2aa84 tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:42:56.003221 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-8c9fa6e4-1949-43e7-ae02-3d78d1b2aa84 tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:42:56.003908 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-8c9fa6e4-1949-43e7-ae02-3d78d1b2aa84 tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:42:56.004364 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-8c9fa6e4-1949-43e7-ae02-3d78d1b2aa84 tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:42:56.004816 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-8c9fa6e4-1949-43e7-ae02-3d78d1b2aa84 tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:42:56.137316 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-8c9fa6e4-1949-43e7-ae02-3d78d1b2aa84 tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbee91e2e9974c02bca084b1777551fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73df73c7c77d435ba5c5725c2eb1567b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:42:56.145514 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-8c9fa6e4-1949-43e7-ae02-3d78d1b2aa84 tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] 10.222.0.20 "GET /compute/v2.1/servers/af4bbdd0-ce14-4f99-8094-6abc1cfb2887" status: 200 len: 1503 microversion: 2.1 time: 0.154948 Oct 20 06:42:56.146079 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1340/2670] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:42:55 2022] GET /compute/v2.1/servers/af4bbdd0-ce14-4f99-8094-6abc1cfb2887 => generated 1503 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:42:56.680640 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [req-65f1cb8b-0559-4266-800f-f6eb375ed0e1 req-53600e57-2a5e-4190-a00e-591a2abc6153 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af4bbdd0-ce14-4f99-8094-6abc1cfb2887", "name": "network-vif-deleted", "tag": "b56f897f-f5b8-45d8-93cd-a89fb8a38b2f"}]} {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 06:42:56.690921 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [req-65f1cb8b-0559-4266-800f-f6eb375ed0e1 req-53600e57-2a5e-4190-a00e-591a2abc6153 service nova] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:42:56.691391 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [req-65f1cb8b-0559-4266-800f-f6eb375ed0e1 req-53600e57-2a5e-4190-a00e-591a2abc6153 service nova] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:42:56.691820 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [req-65f1cb8b-0559-4266-800f-f6eb375ed0e1 req-53600e57-2a5e-4190-a00e-591a2abc6153 service nova] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:42:56.703322 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.compute.server_external_events [req-65f1cb8b-0559-4266-800f-f6eb375ed0e1 req-53600e57-2a5e-4190-a00e-591a2abc6153 service nova] Creating event network-vif-deleted:b56f897f-f5b8-45d8-93cd-a89fb8a38b2f for instance af4bbdd0-ce14-4f99-8094-6abc1cfb2887 on hv-cinder-86156 Oct 20 06:42:56.707476 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR oslo.messaging._drivers.impl_rabbit [req-65f1cb8b-0559-4266-800f-f6eb375ed0e1 req-53600e57-2a5e-4190-a00e-591a2abc6153 service nova] [34d5407c-5259-49b2-b045-b9b98dd0bf0a] AMQP server on 10.222.0.20:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 20 06:42:57.168987 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-0c4ffe03-0fad-4562-adcd-4c3106f72352 tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:42:57.169629 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-0c4ffe03-0fad-4562-adcd-4c3106f72352 tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] [instance: af4bbdd0-ce14-4f99-8094-6abc1cfb2887] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:42:57.176122 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0c4ffe03-0fad-4562-adcd-4c3106f72352 tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:42:57.176604 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0c4ffe03-0fad-4562-adcd-4c3106f72352 tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:42:57.177072 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0c4ffe03-0fad-4562-adcd-4c3106f72352 tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:42:57.177760 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0c4ffe03-0fad-4562-adcd-4c3106f72352 tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:42:57.178206 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0c4ffe03-0fad-4562-adcd-4c3106f72352 tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:42:57.178627 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0c4ffe03-0fad-4562-adcd-4c3106f72352 tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:42:57.212619 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0c4ffe03-0fad-4562-adcd-4c3106f72352 tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:42:57.213233 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0c4ffe03-0fad-4562-adcd-4c3106f72352 tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:42:57.213692 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0c4ffe03-0fad-4562-adcd-4c3106f72352 tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:42:57.214332 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.objects.instance [None req-0c4ffe03-0fad-4562-adcd-4c3106f72352 tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Lazy-loading 'fault' on Instance uuid af4bbdd0-ce14-4f99-8094-6abc1cfb2887 {{(pid=118860) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 20 06:42:57.261967 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-0c4ffe03-0fad-4562-adcd-4c3106f72352 tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbee91e2e9974c02bca084b1777551fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73df73c7c77d435ba5c5725c2eb1567b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:42:57.269649 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-0c4ffe03-0fad-4562-adcd-4c3106f72352 tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] 10.222.0.20 "GET /compute/v2.1/servers/af4bbdd0-ce14-4f99-8094-6abc1cfb2887" status: 200 len: 1303 microversion: 2.1 time: 0.104538 Oct 20 06:42:57.270202 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1341/2671] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:42:57 2022] GET /compute/v2.1/servers/af4bbdd0-ce14-4f99-8094-6abc1cfb2887 => generated 1303 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 06:42:57.713941 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO oslo.messaging._drivers.impl_rabbit [req-65f1cb8b-0559-4266-800f-f6eb375ed0e1 req-53600e57-2a5e-4190-a00e-591a2abc6153 service nova] [34d5407c-5259-49b2-b045-b9b98dd0bf0a] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 41910. Oct 20 06:42:57.717257 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [req-65f1cb8b-0559-4266-800f-f6eb375ed0e1 req-53600e57-2a5e-4190-a00e-591a2abc6153 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 1.040389 Oct 20 06:42:57.717852 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1331/2672] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 20 06:42:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 1042 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:42:58.292488 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-e5265349-7ac8-4ca5-869c-b6e8f7f182f4 tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:42:58.293133 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-e5265349-7ac8-4ca5-869c-b6e8f7f182f4 tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] [instance: af4bbdd0-ce14-4f99-8094-6abc1cfb2887] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:42:58.299854 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e5265349-7ac8-4ca5-869c-b6e8f7f182f4 tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:42:58.300349 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e5265349-7ac8-4ca5-869c-b6e8f7f182f4 tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:42:58.300813 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e5265349-7ac8-4ca5-869c-b6e8f7f182f4 tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:42:58.301520 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e5265349-7ac8-4ca5-869c-b6e8f7f182f4 tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:42:58.301979 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e5265349-7ac8-4ca5-869c-b6e8f7f182f4 tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:42:58.302409 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e5265349-7ac8-4ca5-869c-b6e8f7f182f4 tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:42:58.315601 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.wsgi [None req-e5265349-7ac8-4ca5-869c-b6e8f7f182f4 tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] HTTP exception thrown: Instance af4bbdd0-ce14-4f99-8094-6abc1cfb2887 could not be found. Oct 20 06:42:58.317271 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-e5265349-7ac8-4ca5-869c-b6e8f7f182f4 tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Request method failure captured: Oct 20 06:42:58.317271 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: request: GET /compute/v2.1/servers/af4bbdd0-ce14-4f99-8094-6abc1cfb2887 HTTP/1.1 Oct 20 06:42:58.317271 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: Accept: application/json Oct 20 06:42:58.317271 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: Accept-Encoding: identity Oct 20 06:42:58.317271 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: Connection: close Oct 20 06:42:58.317271 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: Content-Length: 0 Oct 20 06:42:58.317271 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: Content-Type: application/json Oct 20 06:42:58.317271 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: Host: 10.222.0.20 Oct 20 06:42:58.317271 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: Openstack-System-Scope: None Oct 20 06:42:58.317271 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: User-Agent: python-urllib3/1.26.12 Oct 20 06:42:58.317271 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Auth-Token: gAAAAABjUO3hH_nIfBg0W9vUWpwRC5AuPez66ykk-f7XmEsvXY2LdfglBEecuxeCxWOwwEEczLyCQTfNy19GO_GpPOebW_B2ai1hxLbzWSH3ZEV1vfggACVN_KcNmaBdXLM0Q_ZBH4FtZ0xxSf2A6sSCuONjhK3vgkZh0TJoFDmZaax-Jx0sXmo Oct 20 06:42:58.317271 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Domain-Id: None Oct 20 06:42:58.317271 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Domain-Name: None Oct 20 06:42:58.317271 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Identity-Status: Confirmed Oct 20 06:42:58.317271 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Is-Admin-Project: True Oct 20 06:42:58.317271 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Project-Domain-Id: default Oct 20 06:42:58.317271 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Project-Domain-Name: Default Oct 20 06:42:58.317271 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Project-Id: 73df73c7c77d435ba5c5725c2eb1567b Oct 20 06:42:58.317271 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Project-Name: tempest-VolumesActionsTest-1734654454 Oct 20 06:42:58.317271 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Role: reader,member Oct 20 06:42:58.317271 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Roles: reader,member Oct 20 06:42:58.318584 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/73df73c7c77d435ba5c5725c2eb1567b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_73df73c7c77d435ba5c5725c2eb1567b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/73df73c7c77d435ba5c5725c2eb1567b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/73df73c7c77d435ba5c5725c2eb1567b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 20 06:42:58.318584 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Tenant: tempest-VolumesActionsTest-1734654454 Oct 20 06:42:58.318584 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Tenant-Id: 73df73c7c77d435ba5c5725c2eb1567b Oct 20 06:42:58.318584 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Tenant-Name: tempest-VolumesActionsTest-1734654454 Oct 20 06:42:58.318584 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-User: tempest-VolumesActionsTest-1734654454-project Oct 20 06:42:58.318584 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-User-Domain-Id: default Oct 20 06:42:58.318584 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-User-Domain-Name: Default Oct 20 06:42:58.318584 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-User-Id: cbee91e2e9974c02bca084b1777551fd Oct 20 06:42:58.318584 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-User-Name: tempest-VolumesActionsTest-1734654454-project Oct 20 06:42:58.318584 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: method: > Oct 20 06:42:58.318584 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: exception: Instance af4bbdd0-ce14-4f99-8094-6abc1cfb2887 could not be found. Oct 20 06:42:58.318584 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: action_args: {'id': 'af4bbdd0-ce14-4f99-8094-6abc1cfb2887'} Oct 20 06:42:58.319292 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 20 06:42:58.319292 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 06:42:58.319292 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 20 06:42:58.319292 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 20 06:42:58.319292 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 20 06:42:58.319292 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 20 06:42:58.319292 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 20 06:42:58.319292 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 20 06:42:58.319292 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 20 06:42:58.319292 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 20 06:42:58.319292 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af4bbdd0-ce14-4f99-8094-6abc1cfb2887 could not be found. Oct 20 06:42:58.319292 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi Oct 20 06:42:58.319292 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 06:42:58.319292 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi Oct 20 06:42:58.319292 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 06:42:58.319292 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 06:42:58.319292 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 06:42:58.319292 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 20 06:42:58.319292 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 20 06:42:58.319292 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 20 06:42:58.320809 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 20 06:42:58.320809 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 20 06:42:58.320809 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 20 06:42:58.320809 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 20 06:42:58.320809 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 20 06:42:58.320809 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 20 06:42:58.320809 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 20 06:42:58.320809 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af4bbdd0-ce14-4f99-8094-6abc1cfb2887 could not be found. Oct 20 06:42:58.320809 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi Oct 20 06:42:58.320809 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 06:42:58.320809 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi Oct 20 06:42:58.320809 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 06:42:58.320809 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 06:42:58.320809 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 06:42:58.320809 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 20 06:42:58.320809 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 20 06:42:58.320809 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af4bbdd0-ce14-4f99-8094-6abc1cfb2887 could not be found. Oct 20 06:42:58.320809 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi Oct 20 06:42:58.322554 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-e5265349-7ac8-4ca5-869c-b6e8f7f182f4 tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Returning 404 to user: Instance af4bbdd0-ce14-4f99-8094-6abc1cfb2887 could not be found. {{(pid=118860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 20 06:42:58.322554 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-e5265349-7ac8-4ca5-869c-b6e8f7f182f4 tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] 10.222.0.20 "GET /compute/v2.1/servers/af4bbdd0-ce14-4f99-8094-6abc1cfb2887" status: 404 len: 111 microversion: 2.1 time: 0.030080 Oct 20 06:42:58.322554 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1342/2673] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:42:58 2022] GET /compute/v2.1/servers/af4bbdd0-ce14-4f99-8094-6abc1cfb2887 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 20 06:42:58.368817 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-d6b5878a-3426-4358-b226-75f907c9fb2b tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-402439316", "imageRef": "9fcec276-734d-41d9-905b-10d2bbcbfba5", "flavorRef": "452", "networks": [{"uuid": "e8c1e120-1ceb-4677-a53f-925524815e18"}]}} {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 06:42:58.422084 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.network.neutron [None req-d6b5878a-3426-4358-b226-75f907c9fb2b tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] validate_networks() for [('e8c1e120-1ceb-4677-a53f-925524815e18', None, None, None, None, None)] {{(pid=118861) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 20 06:42:58.823248 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.virt.hardware [None req-d6b5878a-3426-4358-b226-75f907c9fb2b tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Flavor limits 0:0:0 {{(pid=118861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 20 06:42:58.823821 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.virt.hardware [None req-d6b5878a-3426-4358-b226-75f907c9fb2b tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Image limits 0:0:0 {{(pid=118861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 20 06:42:58.824118 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.virt.hardware [None req-d6b5878a-3426-4358-b226-75f907c9fb2b tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Flavor pref 0:0:0 {{(pid=118861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 20 06:42:58.824518 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.virt.hardware [None req-d6b5878a-3426-4358-b226-75f907c9fb2b tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Image pref 0:0:0 {{(pid=118861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 20 06:42:58.824964 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.virt.hardware [None req-d6b5878a-3426-4358-b226-75f907c9fb2b tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118861) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 20 06:42:58.834546 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d6b5878a-3426-4358-b226-75f907c9fb2b tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:42:58.835019 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d6b5878a-3426-4358-b226-75f907c9fb2b tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:42:58.835451 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d6b5878a-3426-4358-b226-75f907c9fb2b tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:42:58.836159 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d6b5878a-3426-4358-b226-75f907c9fb2b tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:42:58.836605 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d6b5878a-3426-4358-b226-75f907c9fb2b tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:42:58.837056 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-d6b5878a-3426-4358-b226-75f907c9fb2b tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:42:58.853063 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.quota [None req-d6b5878a-3426-4358-b226-75f907c9fb2b tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Getting quotas for project 73df73c7c77d435ba5c5725c2eb1567b. Resources: {'cores', 'ram', 'instances'} {{(pid=118861) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 20 06:42:58.856922 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.quota [None req-d6b5878a-3426-4358-b226-75f907c9fb2b tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Getting quotas for user cbee91e2e9974c02bca084b1777551fd and project 73df73c7c77d435ba5c5725c2eb1567b. Resources: {'cores', 'ram', 'instances'} {{(pid=118861) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 20 06:42:58.867927 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-d6b5878a-3426-4358-b226-75f907c9fb2b tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Going to run 1 instances... {{(pid=118861) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 20 06:42:58.870505 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-d6b5878a-3426-4358-b226-75f907c9fb2b tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] [instance: 6ff4750f-81b3-4e7b-8f72-1e729f61ee09] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9fcec276-734d-41d9-905b-10d2bbcbfba5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118861) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 20 06:42:58.913296 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR oslo.messaging._drivers.impl_rabbit [None req-d6b5878a-3426-4358-b226-75f907c9fb2b tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] [8535d4e4-5f21-4c91-bdb7-fd7f1671a7da] AMQP server on 10.222.0.20:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 20 06:42:59.921020 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO oslo.messaging._drivers.impl_rabbit [None req-d6b5878a-3426-4358-b226-75f907c9fb2b tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] [8535d4e4-5f21-4c91-bdb7-fd7f1671a7da] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 41932. Oct 20 06:42:59.925376 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-d6b5878a-3426-4358-b226-75f907c9fb2b tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.560998 Oct 20 06:42:59.926028 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1332/2674] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Oct 20 06:42:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 1562 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 20 06:42:59.936854 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-c6f8a5f2-87c0-48cc-ad01-794fc4c9f946 tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:42:59.937464 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-c6f8a5f2-87c0-48cc-ad01-794fc4c9f946 tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] [instance: 6ff4750f-81b3-4e7b-8f72-1e729f61ee09] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:42:59.990822 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-c6f8a5f2-87c0-48cc-ad01-794fc4c9f946 tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbee91e2e9974c02bca084b1777551fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73df73c7c77d435ba5c5725c2eb1567b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:42:59.997459 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-c6f8a5f2-87c0-48cc-ad01-794fc4c9f946 tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] 10.222.0.20 "GET /compute/v2.1/servers/6ff4750f-81b3-4e7b-8f72-1e729f61ee09" status: 200 len: 1213 microversion: 2.1 time: 0.064434 Oct 20 06:42:59.998008 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1343/2675] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:42:59 2022] GET /compute/v2.1/servers/6ff4750f-81b3-4e7b-8f72-1e729f61ee09 => generated 1213 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:43:01.021665 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-fb4d169a-a929-4f16-a35f-962252376b6d tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:43:01.022374 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-fb4d169a-a929-4f16-a35f-962252376b6d tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] [instance: 6ff4750f-81b3-4e7b-8f72-1e729f61ee09] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:43:01.029191 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-fb4d169a-a929-4f16-a35f-962252376b6d tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:43:01.029932 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-fb4d169a-a929-4f16-a35f-962252376b6d tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:43:01.030466 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-fb4d169a-a929-4f16-a35f-962252376b6d tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:43:01.031245 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-fb4d169a-a929-4f16-a35f-962252376b6d tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:43:01.031989 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-fb4d169a-a929-4f16-a35f-962252376b6d tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:43:01.032978 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-fb4d169a-a929-4f16-a35f-962252376b6d tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:43:01.104040 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-fb4d169a-a929-4f16-a35f-962252376b6d tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbee91e2e9974c02bca084b1777551fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73df73c7c77d435ba5c5725c2eb1567b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:43:01.111786 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-fb4d169a-a929-4f16-a35f-962252376b6d tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] 10.222.0.20 "GET /compute/v2.1/servers/6ff4750f-81b3-4e7b-8f72-1e729f61ee09" status: 200 len: 1271 microversion: 2.1 time: 0.095188 Oct 20 06:43:01.112439 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1333/2676] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:43:01 2022] GET /compute/v2.1/servers/6ff4750f-81b3-4e7b-8f72-1e729f61ee09 => generated 1271 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:43:02.134735 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-f37f0729-9e20-401b-8c83-5594f4497d2a tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:43:02.135340 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-f37f0729-9e20-401b-8c83-5594f4497d2a tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] [instance: 6ff4750f-81b3-4e7b-8f72-1e729f61ee09] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:43:02.143008 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f37f0729-9e20-401b-8c83-5594f4497d2a tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:43:02.143486 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f37f0729-9e20-401b-8c83-5594f4497d2a tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:43:02.143913 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f37f0729-9e20-401b-8c83-5594f4497d2a tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:43:02.144599 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f37f0729-9e20-401b-8c83-5594f4497d2a tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:43:02.145078 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f37f0729-9e20-401b-8c83-5594f4497d2a tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:43:02.145497 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-f37f0729-9e20-401b-8c83-5594f4497d2a tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:43:02.283555 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [req-82e2c731-4fe8-464b-9553-24485864d743 req-a36bbcb1-dccf-4859-a912-9443762e0078 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6ff4750f-81b3-4e7b-8f72-1e729f61ee09", "tag": "3adf31e0-af7f-4bb7-89da-840748e116dc"}]} {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 06:43:02.294784 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [req-82e2c731-4fe8-464b-9553-24485864d743 req-a36bbcb1-dccf-4859-a912-9443762e0078 service nova] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:43:02.295263 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [req-82e2c731-4fe8-464b-9553-24485864d743 req-a36bbcb1-dccf-4859-a912-9443762e0078 service nova] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:43:02.296204 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [req-82e2c731-4fe8-464b-9553-24485864d743 req-a36bbcb1-dccf-4859-a912-9443762e0078 service nova] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:43:02.312669 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.compute.server_external_events [req-82e2c731-4fe8-464b-9553-24485864d743 req-a36bbcb1-dccf-4859-a912-9443762e0078 service nova] Creating event network-changed:3adf31e0-af7f-4bb7-89da-840748e116dc for instance 6ff4750f-81b3-4e7b-8f72-1e729f61ee09 on hv-cinder-86156 Oct 20 06:43:02.317976 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [req-82e2c731-4fe8-464b-9553-24485864d743 req-a36bbcb1-dccf-4859-a912-9443762e0078 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039241 Oct 20 06:43:02.318579 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1334/2677] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 20 06:43:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 20 06:43:02.374781 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-f37f0729-9e20-401b-8c83-5594f4497d2a tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbee91e2e9974c02bca084b1777551fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73df73c7c77d435ba5c5725c2eb1567b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:43:02.383368 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-f37f0729-9e20-401b-8c83-5594f4497d2a tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] 10.222.0.20 "GET /compute/v2.1/servers/6ff4750f-81b3-4e7b-8f72-1e729f61ee09" status: 200 len: 1313 microversion: 2.1 time: 0.252460 Oct 20 06:43:02.384125 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1344/2678] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:43:02 2022] GET /compute/v2.1/servers/6ff4750f-81b3-4e7b-8f72-1e729f61ee09 => generated 1313 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:43:03.408620 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-a7f816fb-df15-4b2d-841a-134268a0e0e2 tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:43:03.409354 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-a7f816fb-df15-4b2d-841a-134268a0e0e2 tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] [instance: 6ff4750f-81b3-4e7b-8f72-1e729f61ee09] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:43:03.415471 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a7f816fb-df15-4b2d-841a-134268a0e0e2 tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:43:03.415947 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a7f816fb-df15-4b2d-841a-134268a0e0e2 tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:43:03.416377 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a7f816fb-df15-4b2d-841a-134268a0e0e2 tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:43:03.417092 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a7f816fb-df15-4b2d-841a-134268a0e0e2 tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:43:03.417537 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a7f816fb-df15-4b2d-841a-134268a0e0e2 tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:43:03.417963 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-a7f816fb-df15-4b2d-841a-134268a0e0e2 tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:43:03.549078 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-a7f816fb-df15-4b2d-841a-134268a0e0e2 tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbee91e2e9974c02bca084b1777551fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73df73c7c77d435ba5c5725c2eb1567b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:43:03.557000 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-a7f816fb-df15-4b2d-841a-134268a0e0e2 tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] 10.222.0.20 "GET /compute/v2.1/servers/6ff4750f-81b3-4e7b-8f72-1e729f61ee09" status: 200 len: 1313 microversion: 2.1 time: 0.153703 Oct 20 06:43:03.557584 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1335/2679] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:43:03 2022] GET /compute/v2.1/servers/6ff4750f-81b3-4e7b-8f72-1e729f61ee09 => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:43:04.579492 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-da6eec3b-bade-4e24-b4bc-b1bddcc0b430 tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:43:04.580256 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-da6eec3b-bade-4e24-b4bc-b1bddcc0b430 tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] [instance: 6ff4750f-81b3-4e7b-8f72-1e729f61ee09] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:43:04.586903 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-da6eec3b-bade-4e24-b4bc-b1bddcc0b430 tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:43:04.587378 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-da6eec3b-bade-4e24-b4bc-b1bddcc0b430 tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:43:04.587806 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-da6eec3b-bade-4e24-b4bc-b1bddcc0b430 tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:43:04.588483 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-da6eec3b-bade-4e24-b4bc-b1bddcc0b430 tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:43:04.588959 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-da6eec3b-bade-4e24-b4bc-b1bddcc0b430 tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:43:04.589377 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-da6eec3b-bade-4e24-b4bc-b1bddcc0b430 tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:43:04.713974 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-da6eec3b-bade-4e24-b4bc-b1bddcc0b430 tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbee91e2e9974c02bca084b1777551fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73df73c7c77d435ba5c5725c2eb1567b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:43:04.721606 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-da6eec3b-bade-4e24-b4bc-b1bddcc0b430 tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] 10.222.0.20 "GET /compute/v2.1/servers/6ff4750f-81b3-4e7b-8f72-1e729f61ee09" status: 200 len: 1313 microversion: 2.1 time: 0.146662 Oct 20 06:43:04.722169 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1345/2680] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:43:04 2022] GET /compute/v2.1/servers/6ff4750f-81b3-4e7b-8f72-1e729f61ee09 => generated 1313 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:43:05.743323 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-3cb3822e-828d-49ed-a689-158d7cf40707 tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:43:05.743930 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-3cb3822e-828d-49ed-a689-158d7cf40707 tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] [instance: 6ff4750f-81b3-4e7b-8f72-1e729f61ee09] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:43:05.750265 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-3cb3822e-828d-49ed-a689-158d7cf40707 tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:43:05.750794 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-3cb3822e-828d-49ed-a689-158d7cf40707 tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:43:05.751225 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-3cb3822e-828d-49ed-a689-158d7cf40707 tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:43:05.752173 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-3cb3822e-828d-49ed-a689-158d7cf40707 tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:43:05.752622 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-3cb3822e-828d-49ed-a689-158d7cf40707 tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:43:05.753066 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-3cb3822e-828d-49ed-a689-158d7cf40707 tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:43:05.884156 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-3cb3822e-828d-49ed-a689-158d7cf40707 tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbee91e2e9974c02bca084b1777551fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73df73c7c77d435ba5c5725c2eb1567b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:43:05.892135 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-3cb3822e-828d-49ed-a689-158d7cf40707 tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] 10.222.0.20 "GET /compute/v2.1/servers/6ff4750f-81b3-4e7b-8f72-1e729f61ee09" status: 200 len: 1313 microversion: 2.1 time: 0.152671 Oct 20 06:43:05.892706 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1336/2681] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:43:05 2022] GET /compute/v2.1/servers/6ff4750f-81b3-4e7b-8f72-1e729f61ee09 => generated 1313 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:43:06.914572 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-66e718cb-a4db-426c-a945-a81c02d156d8 tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:43:06.915155 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-66e718cb-a4db-426c-a945-a81c02d156d8 tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] [instance: 6ff4750f-81b3-4e7b-8f72-1e729f61ee09] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:43:06.921567 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-66e718cb-a4db-426c-a945-a81c02d156d8 tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:43:06.922044 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-66e718cb-a4db-426c-a945-a81c02d156d8 tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:43:06.923077 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-66e718cb-a4db-426c-a945-a81c02d156d8 tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:43:06.923756 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-66e718cb-a4db-426c-a945-a81c02d156d8 tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:43:06.924202 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-66e718cb-a4db-426c-a945-a81c02d156d8 tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:43:06.924630 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-66e718cb-a4db-426c-a945-a81c02d156d8 tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:43:07.062625 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-66e718cb-a4db-426c-a945-a81c02d156d8 tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbee91e2e9974c02bca084b1777551fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73df73c7c77d435ba5c5725c2eb1567b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:43:07.070272 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-66e718cb-a4db-426c-a945-a81c02d156d8 tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] 10.222.0.20 "GET /compute/v2.1/servers/6ff4750f-81b3-4e7b-8f72-1e729f61ee09" status: 200 len: 1313 microversion: 2.1 time: 0.159653 Oct 20 06:43:07.070834 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1346/2682] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:43:06 2022] GET /compute/v2.1/servers/6ff4750f-81b3-4e7b-8f72-1e729f61ee09 => generated 1313 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:43:07.408245 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [req-a11cf095-7a04-40dc-b6e9-22c39a8deb25 req-345ae306-025d-44e6-a3fa-35084ae8cfaa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ff4750f-81b3-4e7b-8f72-1e729f61ee09", "name": "network-vif-plugged", "status": "completed", "tag": "3adf31e0-af7f-4bb7-89da-840748e116dc"}]} {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 06:43:07.418135 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [req-a11cf095-7a04-40dc-b6e9-22c39a8deb25 req-345ae306-025d-44e6-a3fa-35084ae8cfaa service nova] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:43:07.418606 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [req-a11cf095-7a04-40dc-b6e9-22c39a8deb25 req-345ae306-025d-44e6-a3fa-35084ae8cfaa service nova] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:43:07.419650 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [req-a11cf095-7a04-40dc-b6e9-22c39a8deb25 req-345ae306-025d-44e6-a3fa-35084ae8cfaa service nova] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:43:07.432805 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.compute.server_external_events [req-a11cf095-7a04-40dc-b6e9-22c39a8deb25 req-345ae306-025d-44e6-a3fa-35084ae8cfaa service nova] Creating event network-vif-plugged:3adf31e0-af7f-4bb7-89da-840748e116dc for instance 6ff4750f-81b3-4e7b-8f72-1e729f61ee09 on hv-cinder-86156 Oct 20 06:43:07.437954 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [req-a11cf095-7a04-40dc-b6e9-22c39a8deb25 req-345ae306-025d-44e6-a3fa-35084ae8cfaa service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033983 Oct 20 06:43:07.440889 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1337/2683] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 20 06:43:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:43:08.093351 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-0c76e3f0-f8f2-4083-b4a8-e98a974e4429 tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:43:08.093964 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-0c76e3f0-f8f2-4083-b4a8-e98a974e4429 tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] [instance: 6ff4750f-81b3-4e7b-8f72-1e729f61ee09] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:43:08.100894 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0c76e3f0-f8f2-4083-b4a8-e98a974e4429 tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:43:08.101382 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0c76e3f0-f8f2-4083-b4a8-e98a974e4429 tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:43:08.102038 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0c76e3f0-f8f2-4083-b4a8-e98a974e4429 tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:43:08.102898 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0c76e3f0-f8f2-4083-b4a8-e98a974e4429 tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:43:08.103517 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0c76e3f0-f8f2-4083-b4a8-e98a974e4429 tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:43:08.103949 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-0c76e3f0-f8f2-4083-b4a8-e98a974e4429 tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:43:08.231037 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-0c76e3f0-f8f2-4083-b4a8-e98a974e4429 tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbee91e2e9974c02bca084b1777551fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73df73c7c77d435ba5c5725c2eb1567b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:43:08.239470 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-0c76e3f0-f8f2-4083-b4a8-e98a974e4429 tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] 10.222.0.20 "GET /compute/v2.1/servers/6ff4750f-81b3-4e7b-8f72-1e729f61ee09" status: 200 len: 1313 microversion: 2.1 time: 0.150056 Oct 20 06:43:08.240033 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1347/2684] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:43:08 2022] GET /compute/v2.1/servers/6ff4750f-81b3-4e7b-8f72-1e729f61ee09 => generated 1313 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:43:09.259371 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG dbcounter [-] [118861] Writing DB stats nova_cell0:SELECT=2 {{(pid=118861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:43:09.260136 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG dbcounter [-] [118861] Writing DB stats nova_cell0:SELECT=6 {{(pid=118861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:43:09.264327 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-0ef44be7-4303-45cf-9335-495342d23ba4 tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:43:09.265054 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-0ef44be7-4303-45cf-9335-495342d23ba4 tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] [instance: 6ff4750f-81b3-4e7b-8f72-1e729f61ee09] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:43:09.272733 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-0ef44be7-4303-45cf-9335-495342d23ba4 tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:43:09.273220 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-0ef44be7-4303-45cf-9335-495342d23ba4 tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:43:09.273664 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-0ef44be7-4303-45cf-9335-495342d23ba4 tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:43:09.274355 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-0ef44be7-4303-45cf-9335-495342d23ba4 tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:43:09.274808 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-0ef44be7-4303-45cf-9335-495342d23ba4 tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:43:09.275237 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-0ef44be7-4303-45cf-9335-495342d23ba4 tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:43:09.410191 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-0ef44be7-4303-45cf-9335-495342d23ba4 tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbee91e2e9974c02bca084b1777551fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73df73c7c77d435ba5c5725c2eb1567b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:43:09.419063 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-0ef44be7-4303-45cf-9335-495342d23ba4 tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] 10.222.0.20 "GET /compute/v2.1/servers/6ff4750f-81b3-4e7b-8f72-1e729f61ee09" status: 200 len: 1497 microversion: 2.1 time: 0.161192 Oct 20 06:43:09.419629 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1338/2685] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:43:09 2022] GET /compute/v2.1/servers/6ff4750f-81b3-4e7b-8f72-1e729f61ee09 => generated 1497 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:43:09.878320 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-289f909b-cde4-43ba-9042-ee1bf61f9843 tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:43:09.878815 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-289f909b-cde4-43ba-9042-ee1bf61f9843 tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] [instance: 6ff4750f-81b3-4e7b-8f72-1e729f61ee09] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:43:09.885210 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-289f909b-cde4-43ba-9042-ee1bf61f9843 tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:43:09.885700 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-289f909b-cde4-43ba-9042-ee1bf61f9843 tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:43:09.886144 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-289f909b-cde4-43ba-9042-ee1bf61f9843 tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:43:09.886837 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-289f909b-cde4-43ba-9042-ee1bf61f9843 tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:43:09.887297 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-289f909b-cde4-43ba-9042-ee1bf61f9843 tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:43:09.887727 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-289f909b-cde4-43ba-9042-ee1bf61f9843 tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:43:09.912775 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-289f909b-cde4-43ba-9042-ee1bf61f9843 tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] [instance: 6ff4750f-81b3-4e7b-8f72-1e729f61ee09] Going to try to terminate instance {{(pid=118860) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 20 06:43:09.985303 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-289f909b-cde4-43ba-9042-ee1bf61f9843 tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] 10.222.0.20 "DELETE /compute/v2.1/servers/6ff4750f-81b3-4e7b-8f72-1e729f61ee09" status: 204 len: 0 microversion: 2.1 time: 0.111287 Oct 20 06:43:09.986033 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1348/2686] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 20 06:43:09 2022] DELETE /compute/v2.1/servers/6ff4750f-81b3-4e7b-8f72-1e729f61ee09 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 20 06:43:09.994372 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-96826c48-679b-4fe8-8ae9-8ac56e4100e1 tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:43:09.994980 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-96826c48-679b-4fe8-8ae9-8ac56e4100e1 tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] [instance: 6ff4750f-81b3-4e7b-8f72-1e729f61ee09] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:43:10.001338 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-96826c48-679b-4fe8-8ae9-8ac56e4100e1 tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:43:10.002077 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-96826c48-679b-4fe8-8ae9-8ac56e4100e1 tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:43:10.002508 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-96826c48-679b-4fe8-8ae9-8ac56e4100e1 tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:43:10.003183 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-96826c48-679b-4fe8-8ae9-8ac56e4100e1 tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:43:10.003627 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-96826c48-679b-4fe8-8ae9-8ac56e4100e1 tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:43:10.004047 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-96826c48-679b-4fe8-8ae9-8ac56e4100e1 tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:43:10.131392 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-96826c48-679b-4fe8-8ae9-8ac56e4100e1 tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbee91e2e9974c02bca084b1777551fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73df73c7c77d435ba5c5725c2eb1567b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:43:10.138950 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-96826c48-679b-4fe8-8ae9-8ac56e4100e1 tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] 10.222.0.20 "GET /compute/v2.1/servers/6ff4750f-81b3-4e7b-8f72-1e729f61ee09" status: 200 len: 1503 microversion: 2.1 time: 0.148477 Oct 20 06:43:10.139508 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1339/2687] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:43:09 2022] GET /compute/v2.1/servers/6ff4750f-81b3-4e7b-8f72-1e729f61ee09 => generated 1503 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:43:11.162138 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-59600927-249b-4df2-b9d9-d7b151ca6cf1 tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:43:11.162867 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-59600927-249b-4df2-b9d9-d7b151ca6cf1 tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] [instance: 6ff4750f-81b3-4e7b-8f72-1e729f61ee09] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:43:11.164754 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG dbcounter [-] [118860] Writing DB stats nova_cell0:SELECT=2 {{(pid=118860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:43:11.170566 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-59600927-249b-4df2-b9d9-d7b151ca6cf1 tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:43:11.171047 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-59600927-249b-4df2-b9d9-d7b151ca6cf1 tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:43:11.171485 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-59600927-249b-4df2-b9d9-d7b151ca6cf1 tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:43:11.172720 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-59600927-249b-4df2-b9d9-d7b151ca6cf1 tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:43:11.173405 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-59600927-249b-4df2-b9d9-d7b151ca6cf1 tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:43:11.173834 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-59600927-249b-4df2-b9d9-d7b151ca6cf1 tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:43:11.192520 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG dbcounter [-] [118860] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:43:11.310315 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-59600927-249b-4df2-b9d9-d7b151ca6cf1 tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbee91e2e9974c02bca084b1777551fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73df73c7c77d435ba5c5725c2eb1567b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:43:11.318281 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-59600927-249b-4df2-b9d9-d7b151ca6cf1 tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] 10.222.0.20 "GET /compute/v2.1/servers/6ff4750f-81b3-4e7b-8f72-1e729f61ee09" status: 200 len: 1503 microversion: 2.1 time: 0.160317 Oct 20 06:43:11.318831 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1349/2688] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:43:11 2022] GET /compute/v2.1/servers/6ff4750f-81b3-4e7b-8f72-1e729f61ee09 => generated 1503 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:43:11.867713 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [req-3141da21-7d5c-453b-84b5-d67bb5333314 req-17c4f08f-10a8-416b-8740-0e2b226d5e27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ff4750f-81b3-4e7b-8f72-1e729f61ee09", "name": "network-vif-deleted", "tag": "3adf31e0-af7f-4bb7-89da-840748e116dc"}]} {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 06:43:11.877753 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [req-3141da21-7d5c-453b-84b5-d67bb5333314 req-17c4f08f-10a8-416b-8740-0e2b226d5e27 service nova] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:43:11.881109 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [req-3141da21-7d5c-453b-84b5-d67bb5333314 req-17c4f08f-10a8-416b-8740-0e2b226d5e27 service nova] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:43:11.881596 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [req-3141da21-7d5c-453b-84b5-d67bb5333314 req-17c4f08f-10a8-416b-8740-0e2b226d5e27 service nova] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:43:11.893999 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.compute.server_external_events [req-3141da21-7d5c-453b-84b5-d67bb5333314 req-17c4f08f-10a8-416b-8740-0e2b226d5e27 service nova] Creating event network-vif-deleted:3adf31e0-af7f-4bb7-89da-840748e116dc for instance 6ff4750f-81b3-4e7b-8f72-1e729f61ee09 on hv-cinder-86156 Oct 20 06:43:11.898846 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [req-3141da21-7d5c-453b-84b5-d67bb5333314 req-17c4f08f-10a8-416b-8740-0e2b226d5e27 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034904 Oct 20 06:43:11.899437 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1340/2689] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 20 06:43:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:43:12.341683 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-1b500b41-1ba3-4332-a8ec-f016665c6629 tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:43:12.342301 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-1b500b41-1ba3-4332-a8ec-f016665c6629 tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] [instance: 6ff4750f-81b3-4e7b-8f72-1e729f61ee09] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:43:12.349026 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1b500b41-1ba3-4332-a8ec-f016665c6629 tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:43:12.349520 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1b500b41-1ba3-4332-a8ec-f016665c6629 tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:43:12.349961 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1b500b41-1ba3-4332-a8ec-f016665c6629 tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:43:12.350659 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1b500b41-1ba3-4332-a8ec-f016665c6629 tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:43:12.351115 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1b500b41-1ba3-4332-a8ec-f016665c6629 tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:43:12.351545 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1b500b41-1ba3-4332-a8ec-f016665c6629 tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:43:12.384297 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1b500b41-1ba3-4332-a8ec-f016665c6629 tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:43:12.384822 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1b500b41-1ba3-4332-a8ec-f016665c6629 tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:43:12.385273 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-1b500b41-1ba3-4332-a8ec-f016665c6629 tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:43:12.385726 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.objects.instance [None req-1b500b41-1ba3-4332-a8ec-f016665c6629 tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Lazy-loading 'fault' on Instance uuid 6ff4750f-81b3-4e7b-8f72-1e729f61ee09 {{(pid=118860) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 20 06:43:12.430713 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-1b500b41-1ba3-4332-a8ec-f016665c6629 tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbee91e2e9974c02bca084b1777551fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73df73c7c77d435ba5c5725c2eb1567b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:43:12.440267 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-1b500b41-1ba3-4332-a8ec-f016665c6629 tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] 10.222.0.20 "GET /compute/v2.1/servers/6ff4750f-81b3-4e7b-8f72-1e729f61ee09" status: 200 len: 1303 microversion: 2.1 time: 0.102340 Oct 20 06:43:12.440857 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1350/2690] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:43:12 2022] GET /compute/v2.1/servers/6ff4750f-81b3-4e7b-8f72-1e729f61ee09 => generated 1303 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:43:13.464347 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-120ac46c-f508-4890-8426-33d2a4dbacd0 tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:43:13.465079 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-120ac46c-f508-4890-8426-33d2a4dbacd0 tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] [instance: 6ff4750f-81b3-4e7b-8f72-1e729f61ee09] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:43:13.471799 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-120ac46c-f508-4890-8426-33d2a4dbacd0 tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:43:13.472278 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-120ac46c-f508-4890-8426-33d2a4dbacd0 tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:43:13.472738 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-120ac46c-f508-4890-8426-33d2a4dbacd0 tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:43:13.473428 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-120ac46c-f508-4890-8426-33d2a4dbacd0 tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:43:13.473881 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-120ac46c-f508-4890-8426-33d2a4dbacd0 tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:43:13.474308 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-120ac46c-f508-4890-8426-33d2a4dbacd0 tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:43:13.487949 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.wsgi [None req-120ac46c-f508-4890-8426-33d2a4dbacd0 tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] HTTP exception thrown: Instance 6ff4750f-81b3-4e7b-8f72-1e729f61ee09 could not be found. Oct 20 06:43:13.489626 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-120ac46c-f508-4890-8426-33d2a4dbacd0 tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Request method failure captured: Oct 20 06:43:13.489626 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: request: GET /compute/v2.1/servers/6ff4750f-81b3-4e7b-8f72-1e729f61ee09 HTTP/1.1 Oct 20 06:43:13.489626 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: Accept: application/json Oct 20 06:43:13.489626 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: Accept-Encoding: identity Oct 20 06:43:13.489626 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: Connection: close Oct 20 06:43:13.489626 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: Content-Length: 0 Oct 20 06:43:13.489626 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: Content-Type: application/json Oct 20 06:43:13.489626 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: Host: 10.222.0.20 Oct 20 06:43:13.489626 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: Openstack-System-Scope: None Oct 20 06:43:13.489626 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: User-Agent: python-urllib3/1.26.12 Oct 20 06:43:13.489626 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Auth-Token: gAAAAABjUO3hH_nIfBg0W9vUWpwRC5AuPez66ykk-f7XmEsvXY2LdfglBEecuxeCxWOwwEEczLyCQTfNy19GO_GpPOebW_B2ai1hxLbzWSH3ZEV1vfggACVN_KcNmaBdXLM0Q_ZBH4FtZ0xxSf2A6sSCuONjhK3vgkZh0TJoFDmZaax-Jx0sXmo Oct 20 06:43:13.489626 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Domain-Id: None Oct 20 06:43:13.489626 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Domain-Name: None Oct 20 06:43:13.489626 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Identity-Status: Confirmed Oct 20 06:43:13.489626 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Is-Admin-Project: True Oct 20 06:43:13.489626 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Project-Domain-Id: default Oct 20 06:43:13.489626 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Project-Domain-Name: Default Oct 20 06:43:13.489626 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Project-Id: 73df73c7c77d435ba5c5725c2eb1567b Oct 20 06:43:13.489626 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Project-Name: tempest-VolumesActionsTest-1734654454 Oct 20 06:43:13.489626 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Role: reader,member Oct 20 06:43:13.489626 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Roles: reader,member Oct 20 06:43:13.492268 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/73df73c7c77d435ba5c5725c2eb1567b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_73df73c7c77d435ba5c5725c2eb1567b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/73df73c7c77d435ba5c5725c2eb1567b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/73df73c7c77d435ba5c5725c2eb1567b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 20 06:43:13.492268 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Tenant: tempest-VolumesActionsTest-1734654454 Oct 20 06:43:13.492268 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Tenant-Id: 73df73c7c77d435ba5c5725c2eb1567b Oct 20 06:43:13.492268 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Tenant-Name: tempest-VolumesActionsTest-1734654454 Oct 20 06:43:13.492268 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-User: tempest-VolumesActionsTest-1734654454-project Oct 20 06:43:13.492268 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-User-Domain-Id: default Oct 20 06:43:13.492268 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-User-Domain-Name: Default Oct 20 06:43:13.492268 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-User-Id: cbee91e2e9974c02bca084b1777551fd Oct 20 06:43:13.492268 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-User-Name: tempest-VolumesActionsTest-1734654454-project Oct 20 06:43:13.492268 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: method: > Oct 20 06:43:13.492268 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: exception: Instance 6ff4750f-81b3-4e7b-8f72-1e729f61ee09 could not be found. Oct 20 06:43:13.492268 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: action_args: {'id': '6ff4750f-81b3-4e7b-8f72-1e729f61ee09'} Oct 20 06:43:13.493154 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 20 06:43:13.493154 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 06:43:13.493154 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 20 06:43:13.493154 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 20 06:43:13.493154 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 20 06:43:13.493154 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 20 06:43:13.493154 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 20 06:43:13.493154 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 20 06:43:13.493154 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 20 06:43:13.493154 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 20 06:43:13.493154 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6ff4750f-81b3-4e7b-8f72-1e729f61ee09 could not be found. Oct 20 06:43:13.493154 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi Oct 20 06:43:13.493154 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 06:43:13.493154 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi Oct 20 06:43:13.493154 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 06:43:13.493154 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 06:43:13.493154 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 06:43:13.493154 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 20 06:43:13.493154 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 20 06:43:13.493154 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 20 06:43:13.494553 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 20 06:43:13.494553 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 20 06:43:13.494553 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 20 06:43:13.494553 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 20 06:43:13.494553 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 20 06:43:13.494553 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 20 06:43:13.494553 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 20 06:43:13.494553 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6ff4750f-81b3-4e7b-8f72-1e729f61ee09 could not be found. Oct 20 06:43:13.494553 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi Oct 20 06:43:13.494553 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 06:43:13.494553 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi Oct 20 06:43:13.494553 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 06:43:13.494553 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 06:43:13.494553 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 06:43:13.494553 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 20 06:43:13.494553 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 20 06:43:13.494553 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6ff4750f-81b3-4e7b-8f72-1e729f61ee09 could not be found. Oct 20 06:43:13.494553 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi Oct 20 06:43:13.495945 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-120ac46c-f508-4890-8426-33d2a4dbacd0 tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] Returning 404 to user: Instance 6ff4750f-81b3-4e7b-8f72-1e729f61ee09 could not be found. {{(pid=118861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 20 06:43:13.495945 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-120ac46c-f508-4890-8426-33d2a4dbacd0 tempest-VolumesActionsTest-1734654454 tempest-VolumesActionsTest-1734654454-project] 10.222.0.20 "GET /compute/v2.1/servers/6ff4750f-81b3-4e7b-8f72-1e729f61ee09" status: 404 len: 111 microversion: 2.1 time: 0.031348 Oct 20 06:43:13.495945 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1341/2691] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:43:13 2022] GET /compute/v2.1/servers/6ff4750f-81b3-4e7b-8f72-1e729f61ee09 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 20 06:44:14.157313 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG dbcounter [-] [118860] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=118860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:44:14.158043 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG dbcounter [-] [118860] Writing DB stats nova_cell1:SELECT=10 {{(pid=118860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:44:14.163259 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-e3e8fe24-53bc-4f62-8040-8d75266aed0f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:44:14.163741 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-e3e8fe24-53bc-4f62-8040-8d75266aed0f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:44:14.170775 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e3e8fe24-53bc-4f62-8040-8d75266aed0f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:44:14.171246 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e3e8fe24-53bc-4f62-8040-8d75266aed0f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:44:14.171679 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e3e8fe24-53bc-4f62-8040-8d75266aed0f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:44:14.172352 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e3e8fe24-53bc-4f62-8040-8d75266aed0f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:44:14.172830 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e3e8fe24-53bc-4f62-8040-8d75266aed0f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:44:14.173252 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e3e8fe24-53bc-4f62-8040-8d75266aed0f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:44:14.187807 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.wsgi [None req-e3e8fe24-53bc-4f62-8040-8d75266aed0f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] HTTP exception thrown: Instance d4ba366c-2f51-44e0-b5da-c838e4672533 could not be found. Oct 20 06:44:14.189460 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-e3e8fe24-53bc-4f62-8040-8d75266aed0f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Request method failure captured: Oct 20 06:44:14.189460 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: request: DELETE /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 HTTP/1.1 Oct 20 06:44:14.189460 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: Accept: application/json Oct 20 06:44:14.189460 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: Accept-Encoding: identity Oct 20 06:44:14.189460 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: Connection: close Oct 20 06:44:14.189460 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: Content-Length: 0 Oct 20 06:44:14.189460 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: Content-Type: application/json Oct 20 06:44:14.189460 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: Host: 10.222.0.20 Oct 20 06:44:14.189460 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: Openstack-System-Scope: None Oct 20 06:44:14.189460 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: User-Agent: python-urllib3/1.26.12 Oct 20 06:44:14.189460 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Auth-Token: gAAAAABjUOTwMaxd25vy00-4oHbEqr1c9uD0B3sBZ9MAdUaT4nUKyQqgu2h768xAiNalZc89J9ijH_fe0UIBbKxoYtfSVrasjyy2mvwwjVbv-SkvU3sz2HoGnLJESeVi8iC7ILXfpH5FGWeNjpUJsWoV8PgeWEWJ-eQs7SGcBSSwmqYY25H6IKc Oct 20 06:44:14.189460 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Domain-Id: None Oct 20 06:44:14.189460 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Domain-Name: None Oct 20 06:44:14.189460 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Identity-Status: Confirmed Oct 20 06:44:14.189460 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Is-Admin-Project: True Oct 20 06:44:14.189460 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Project-Domain-Id: default Oct 20 06:44:14.189460 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Project-Domain-Name: Default Oct 20 06:44:14.189460 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Project-Id: b90087118fe040389f291d846461c0a7 Oct 20 06:44:14.189460 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Project-Name: tempest-AttachVolumeNegativeTest-617663425 Oct 20 06:44:14.189460 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Role: reader,member Oct 20 06:44:14.189460 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Roles: reader,member Oct 20 06:44:14.191017 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b90087118fe040389f291d846461c0a7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b90087118fe040389f291d846461c0a7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b90087118fe040389f291d846461c0a7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b90087118fe040389f291d846461c0a7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 20 06:44:14.191017 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Tenant: tempest-AttachVolumeNegativeTest-617663425 Oct 20 06:44:14.191017 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Tenant-Id: b90087118fe040389f291d846461c0a7 Oct 20 06:44:14.191017 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-617663425 Oct 20 06:44:14.191017 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-User: tempest-AttachVolumeNegativeTest-617663425-project Oct 20 06:44:14.191017 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-User-Domain-Id: default Oct 20 06:44:14.191017 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-User-Domain-Name: Default Oct 20 06:44:14.191017 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-User-Id: 2c6be23065c643939055a3de375187d5 Oct 20 06:44:14.191017 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: X-User-Name: tempest-AttachVolumeNegativeTest-617663425-project Oct 20 06:44:14.191017 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: method: > Oct 20 06:44:14.191017 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: exception: Instance d4ba366c-2f51-44e0-b5da-c838e4672533 could not be found. Oct 20 06:44:14.191017 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: action_args: {'id': 'd4ba366c-2f51-44e0-b5da-c838e4672533'} Oct 20 06:44:14.191864 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 20 06:44:14.191864 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 06:44:14.191864 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 20 06:44:14.191864 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 20 06:44:14.191864 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 20 06:44:14.191864 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 20 06:44:14.191864 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 20 06:44:14.191864 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 20 06:44:14.191864 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 20 06:44:14.191864 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 20 06:44:14.191864 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d4ba366c-2f51-44e0-b5da-c838e4672533 could not be found. Oct 20 06:44:14.191864 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi Oct 20 06:44:14.191864 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 06:44:14.191864 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi Oct 20 06:44:14.191864 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 06:44:14.191864 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 06:44:14.191864 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 06:44:14.191864 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 20 06:44:14.191864 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 20 06:44:14.191864 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 20 06:44:14.193446 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 20 06:44:14.193446 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 20 06:44:14.193446 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 20 06:44:14.193446 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 20 06:44:14.193446 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 20 06:44:14.193446 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 20 06:44:14.193446 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 20 06:44:14.193446 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 20 06:44:14.193446 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 20 06:44:14.193446 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d4ba366c-2f51-44e0-b5da-c838e4672533 could not be found. Oct 20 06:44:14.193446 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi Oct 20 06:44:14.193446 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 06:44:14.193446 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi Oct 20 06:44:14.193446 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 06:44:14.193446 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 06:44:14.193446 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 06:44:14.193446 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 20 06:44:14.193446 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 20 06:44:14.193446 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d4ba366c-2f51-44e0-b5da-c838e4672533 could not be found. Oct 20 06:44:14.193446 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR nova.api.openstack.wsgi Oct 20 06:44:14.194828 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-e3e8fe24-53bc-4f62-8040-8d75266aed0f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Returning 404 to user: Instance d4ba366c-2f51-44e0-b5da-c838e4672533 could not be found. {{(pid=118860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 20 06:44:14.194828 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-e3e8fe24-53bc-4f62-8040-8d75266aed0f tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "DELETE /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 404 len: 111 microversion: 2.1 time: 0.035323 Oct 20 06:44:14.194828 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1351/2692] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 20 06:44:14 2022] DELETE /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 20 06:44:14.197174 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG dbcounter [-] [118861] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=3 {{(pid=118861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:44:14.197898 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG dbcounter [-] [118861] Writing DB stats nova_cell1:SELECT=84 {{(pid=118861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:44:14.198659 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 20 06:44:14.198788 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: Thu Oct 20 06:44:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 (ip 10.222.0.20) !!! Oct 20 06:44:14.204625 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-e9387405-6edb-4d67-8453-75df827d1456 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:44:14.205259 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-e9387405-6edb-4d67-8453-75df827d1456 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] [instance: d4ba366c-2f51-44e0-b5da-c838e4672533] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:44:14.213351 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e9387405-6edb-4d67-8453-75df827d1456 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:44:14.213821 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e9387405-6edb-4d67-8453-75df827d1456 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:44:14.214250 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e9387405-6edb-4d67-8453-75df827d1456 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:44:14.214930 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e9387405-6edb-4d67-8453-75df827d1456 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:44:14.215372 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e9387405-6edb-4d67-8453-75df827d1456 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:44:14.215789 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-e9387405-6edb-4d67-8453-75df827d1456 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:44:14.230829 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.wsgi [None req-e9387405-6edb-4d67-8453-75df827d1456 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] HTTP exception thrown: Instance d4ba366c-2f51-44e0-b5da-c838e4672533 could not be found. Oct 20 06:44:14.232353 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-e9387405-6edb-4d67-8453-75df827d1456 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Request method failure captured: Oct 20 06:44:14.232353 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: request: GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 HTTP/1.1 Oct 20 06:44:14.232353 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: Accept: application/json Oct 20 06:44:14.232353 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: Accept-Encoding: identity Oct 20 06:44:14.232353 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: Connection: close Oct 20 06:44:14.232353 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: Content-Length: 0 Oct 20 06:44:14.232353 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: Content-Type: application/json Oct 20 06:44:14.232353 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: Host: 10.222.0.20 Oct 20 06:44:14.232353 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: Openstack-System-Scope: None Oct 20 06:44:14.232353 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: User-Agent: python-urllib3/1.26.12 Oct 20 06:44:14.232353 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Auth-Token: gAAAAABjUOTwMaxd25vy00-4oHbEqr1c9uD0B3sBZ9MAdUaT4nUKyQqgu2h768xAiNalZc89J9ijH_fe0UIBbKxoYtfSVrasjyy2mvwwjVbv-SkvU3sz2HoGnLJESeVi8iC7ILXfpH5FGWeNjpUJsWoV8PgeWEWJ-eQs7SGcBSSwmqYY25H6IKc Oct 20 06:44:14.232353 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Domain-Id: None Oct 20 06:44:14.232353 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Domain-Name: None Oct 20 06:44:14.232353 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Identity-Status: Confirmed Oct 20 06:44:14.232353 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Is-Admin-Project: True Oct 20 06:44:14.232353 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Project-Domain-Id: default Oct 20 06:44:14.232353 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Project-Domain-Name: Default Oct 20 06:44:14.232353 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Project-Id: b90087118fe040389f291d846461c0a7 Oct 20 06:44:14.232353 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Project-Name: tempest-AttachVolumeNegativeTest-617663425 Oct 20 06:44:14.232353 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Role: reader,member Oct 20 06:44:14.232353 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Roles: reader,member Oct 20 06:44:14.233829 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b90087118fe040389f291d846461c0a7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b90087118fe040389f291d846461c0a7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b90087118fe040389f291d846461c0a7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b90087118fe040389f291d846461c0a7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 20 06:44:14.233829 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Tenant: tempest-AttachVolumeNegativeTest-617663425 Oct 20 06:44:14.233829 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Tenant-Id: b90087118fe040389f291d846461c0a7 Oct 20 06:44:14.233829 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-617663425 Oct 20 06:44:14.233829 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-User: tempest-AttachVolumeNegativeTest-617663425-project Oct 20 06:44:14.233829 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-User-Domain-Id: default Oct 20 06:44:14.233829 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-User-Domain-Name: Default Oct 20 06:44:14.233829 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-User-Id: 2c6be23065c643939055a3de375187d5 Oct 20 06:44:14.233829 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-User-Name: tempest-AttachVolumeNegativeTest-617663425-project Oct 20 06:44:14.233829 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: method: > Oct 20 06:44:14.233829 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: exception: Instance d4ba366c-2f51-44e0-b5da-c838e4672533 could not be found. Oct 20 06:44:14.233829 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: action_args: {'id': 'd4ba366c-2f51-44e0-b5da-c838e4672533'} Oct 20 06:44:14.234686 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 20 06:44:14.234686 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 06:44:14.234686 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 20 06:44:14.234686 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 20 06:44:14.234686 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 20 06:44:14.234686 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 20 06:44:14.234686 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 20 06:44:14.234686 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 20 06:44:14.234686 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 20 06:44:14.234686 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 20 06:44:14.234686 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d4ba366c-2f51-44e0-b5da-c838e4672533 could not be found. Oct 20 06:44:14.234686 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi Oct 20 06:44:14.234686 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 06:44:14.234686 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi Oct 20 06:44:14.234686 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 06:44:14.234686 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 06:44:14.234686 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 06:44:14.234686 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 20 06:44:14.234686 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 20 06:44:14.234686 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 20 06:44:14.236085 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 20 06:44:14.236085 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 20 06:44:14.236085 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 20 06:44:14.236085 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 20 06:44:14.236085 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 20 06:44:14.236085 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 20 06:44:14.236085 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 20 06:44:14.236085 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d4ba366c-2f51-44e0-b5da-c838e4672533 could not be found. Oct 20 06:44:14.236085 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi Oct 20 06:44:14.236085 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 06:44:14.236085 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi Oct 20 06:44:14.236085 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 06:44:14.236085 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 06:44:14.236085 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 06:44:14.236085 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 20 06:44:14.236085 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 20 06:44:14.236085 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d4ba366c-2f51-44e0-b5da-c838e4672533 could not be found. Oct 20 06:44:14.236085 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi Oct 20 06:44:14.237410 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-e9387405-6edb-4d67-8453-75df827d1456 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] Returning 404 to user: Instance d4ba366c-2f51-44e0-b5da-c838e4672533 could not be found. {{(pid=118861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 20 06:44:14.237410 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-e9387405-6edb-4d67-8453-75df827d1456 tempest-AttachVolumeNegativeTest-617663425 tempest-AttachVolumeNegativeTest-617663425-project] 10.222.0.20 "GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533" status: 404 len: 111 microversion: 2.1 time: 0.038350 Oct 20 06:44:14.237410 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1342/2693] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:44:14 2022] GET /compute/v2.1/servers/d4ba366c-2f51-44e0-b5da-c838e4672533 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 20 06:46:18.772291 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: ERROR oslo.messaging._drivers.impl_rabbit [-] [49884b92-42f1-41ad-a1c1-5d2cb66d2603] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 20 06:46:18.773046 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG dbcounter [-] [118860] Writing DB stats nova_cell1:SELECT=2 {{(pid=118860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:46:18.774420 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG dbcounter [-] [118860] Writing DB stats nova_api:SELECT=2 {{(pid=118860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:46:18.775127 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 20 06:46:18.775314 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: Thu Oct 20 06:46:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.20) !!! Oct 20 06:46:18.777045 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 20 06:46:18.777197 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: Thu Oct 20 06:46:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.20) !!! Oct 20 06:46:18.778222 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 20 06:46:18.778332 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: Thu Oct 20 06:46:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.20) !!! Oct 20 06:46:18.783813 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-3ca20b59-c3f3-4567-8363-99af1d531e68 tempest-VolumesNegativeTest-1718261252 tempest-VolumesNegativeTest-1718261252-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-233031", "imageRef": "9fcec276-734d-41d9-905b-10d2bbcbfba5", "flavorRef": "452"}} {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 06:46:18.842916 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.network.neutron [None req-3ca20b59-c3f3-4567-8363-99af1d531e68 tempest-VolumesNegativeTest-1718261252 tempest-VolumesNegativeTest-1718261252-project] validate_networks() for None {{(pid=118860) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 20 06:46:19.112019 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.virt.hardware [None req-3ca20b59-c3f3-4567-8363-99af1d531e68 tempest-VolumesNegativeTest-1718261252 tempest-VolumesNegativeTest-1718261252-project] Flavor limits 0:0:0 {{(pid=118860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 20 06:46:19.112443 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.virt.hardware [None req-3ca20b59-c3f3-4567-8363-99af1d531e68 tempest-VolumesNegativeTest-1718261252 tempest-VolumesNegativeTest-1718261252-project] Image limits 0:0:0 {{(pid=118860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 20 06:46:19.112962 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.virt.hardware [None req-3ca20b59-c3f3-4567-8363-99af1d531e68 tempest-VolumesNegativeTest-1718261252 tempest-VolumesNegativeTest-1718261252-project] Flavor pref 0:0:0 {{(pid=118860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 20 06:46:19.113374 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.virt.hardware [None req-3ca20b59-c3f3-4567-8363-99af1d531e68 tempest-VolumesNegativeTest-1718261252 tempest-VolumesNegativeTest-1718261252-project] Image pref 0:0:0 {{(pid=118860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 20 06:46:19.113791 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.virt.hardware [None req-3ca20b59-c3f3-4567-8363-99af1d531e68 tempest-VolumesNegativeTest-1718261252 tempest-VolumesNegativeTest-1718261252-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 20 06:46:19.123155 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3ca20b59-c3f3-4567-8363-99af1d531e68 tempest-VolumesNegativeTest-1718261252 tempest-VolumesNegativeTest-1718261252-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:46:19.123639 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3ca20b59-c3f3-4567-8363-99af1d531e68 tempest-VolumesNegativeTest-1718261252 tempest-VolumesNegativeTest-1718261252-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:46:19.124088 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3ca20b59-c3f3-4567-8363-99af1d531e68 tempest-VolumesNegativeTest-1718261252 tempest-VolumesNegativeTest-1718261252-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:46:19.125122 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3ca20b59-c3f3-4567-8363-99af1d531e68 tempest-VolumesNegativeTest-1718261252 tempest-VolumesNegativeTest-1718261252-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:46:19.125583 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3ca20b59-c3f3-4567-8363-99af1d531e68 tempest-VolumesNegativeTest-1718261252 tempest-VolumesNegativeTest-1718261252-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:46:19.126015 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-3ca20b59-c3f3-4567-8363-99af1d531e68 tempest-VolumesNegativeTest-1718261252 tempest-VolumesNegativeTest-1718261252-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:46:19.143291 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.quota [None req-3ca20b59-c3f3-4567-8363-99af1d531e68 tempest-VolumesNegativeTest-1718261252 tempest-VolumesNegativeTest-1718261252-project] Getting quotas for project ce72a4f6216b4f428718648e0ec619c1. Resources: {'cores', 'ram', 'instances'} {{(pid=118860) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 20 06:46:19.147269 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.quota [None req-3ca20b59-c3f3-4567-8363-99af1d531e68 tempest-VolumesNegativeTest-1718261252 tempest-VolumesNegativeTest-1718261252-project] Getting quotas for user 49b139ebf6e546d5a359cef570ff8e21 and project ce72a4f6216b4f428718648e0ec619c1. Resources: {'cores', 'ram', 'instances'} {{(pid=118860) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 20 06:46:19.158444 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-3ca20b59-c3f3-4567-8363-99af1d531e68 tempest-VolumesNegativeTest-1718261252 tempest-VolumesNegativeTest-1718261252-project] Going to run 1 instances... {{(pid=118860) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 20 06:46:19.160679 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-3ca20b59-c3f3-4567-8363-99af1d531e68 tempest-VolumesNegativeTest-1718261252 tempest-VolumesNegativeTest-1718261252-project] [instance: 736b06e4-8771-4bd8-9d60-7a2a658628fb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9fcec276-734d-41d9-905b-10d2bbcbfba5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118860) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 20 06:46:19.206163 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-3ca20b59-c3f3-4567-8363-99af1d531e68 tempest-VolumesNegativeTest-1718261252 tempest-VolumesNegativeTest-1718261252-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.435320 Oct 20 06:46:19.206804 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1352/2694] 10.222.0.20 () {60 vars in 1147 bytes} [Thu Oct 20 06:46:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 437 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 20 06:46:19.215807 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d087dab9-22c4-45bb-8701-6ce1d6db6dc5] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 20 06:46:19.216328 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG dbcounter [-] [118861] Writing DB stats nova_api:SELECT=2 {{(pid=118861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:46:19.217165 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG dbcounter [-] [118861] Writing DB stats nova_cell1:SELECT=2 {{(pid=118861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:46:19.217789 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 20 06:46:19.217918 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: Thu Oct 20 06:46:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/736b06e4-8771-4bd8-9d60-7a2a658628fb (ip 10.222.0.20) !!! Oct 20 06:46:19.219280 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 20 06:46:19.219574 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: Thu Oct 20 06:46:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/736b06e4-8771-4bd8-9d60-7a2a658628fb (ip 10.222.0.20) !!! Oct 20 06:46:19.226304 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-9390f29d-fe2a-42e7-b346-af381238acb9 tempest-VolumesNegativeTest-1718261252 tempest-VolumesNegativeTest-1718261252-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:46:19.227679 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-9390f29d-fe2a-42e7-b346-af381238acb9 tempest-VolumesNegativeTest-1718261252 tempest-VolumesNegativeTest-1718261252-project] [instance: 736b06e4-8771-4bd8-9d60-7a2a658628fb] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:46:19.487081 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-9390f29d-fe2a-42e7-b346-af381238acb9 tempest-VolumesNegativeTest-1718261252 tempest-VolumesNegativeTest-1718261252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b139ebf6e546d5a359cef570ff8e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce72a4f6216b4f428718648e0ec619c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:46:19.494392 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-9390f29d-fe2a-42e7-b346-af381238acb9 tempest-VolumesNegativeTest-1718261252 tempest-VolumesNegativeTest-1718261252-project] 10.222.0.20 "GET /compute/v2.1/servers/736b06e4-8771-4bd8-9d60-7a2a658628fb" status: 200 len: 1211 microversion: 2.1 time: 0.280543 Oct 20 06:46:19.495070 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1343/2695] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:46:19 2022] GET /compute/v2.1/servers/736b06e4-8771-4bd8-9d60-7a2a658628fb => generated 1211 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:46:20.518772 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-b08dd804-4999-4c80-aaa3-68bc053b82cc tempest-VolumesNegativeTest-1718261252 tempest-VolumesNegativeTest-1718261252-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:46:20.519339 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-b08dd804-4999-4c80-aaa3-68bc053b82cc tempest-VolumesNegativeTest-1718261252 tempest-VolumesNegativeTest-1718261252-project] [instance: 736b06e4-8771-4bd8-9d60-7a2a658628fb] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:46:20.528638 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b08dd804-4999-4c80-aaa3-68bc053b82cc tempest-VolumesNegativeTest-1718261252 tempest-VolumesNegativeTest-1718261252-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:46:20.529159 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b08dd804-4999-4c80-aaa3-68bc053b82cc tempest-VolumesNegativeTest-1718261252 tempest-VolumesNegativeTest-1718261252-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:46:20.529591 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b08dd804-4999-4c80-aaa3-68bc053b82cc tempest-VolumesNegativeTest-1718261252 tempest-VolumesNegativeTest-1718261252-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:46:20.530284 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b08dd804-4999-4c80-aaa3-68bc053b82cc tempest-VolumesNegativeTest-1718261252 tempest-VolumesNegativeTest-1718261252-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:46:20.530738 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b08dd804-4999-4c80-aaa3-68bc053b82cc tempest-VolumesNegativeTest-1718261252 tempest-VolumesNegativeTest-1718261252-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:46:20.531160 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-b08dd804-4999-4c80-aaa3-68bc053b82cc tempest-VolumesNegativeTest-1718261252 tempest-VolumesNegativeTest-1718261252-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:46:20.540092 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO oslo.messaging._drivers.impl_rabbit [-] [49884b92-42f1-41ad-a1c1-5d2cb66d2603] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 43756. Oct 20 06:46:20.611526 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-b08dd804-4999-4c80-aaa3-68bc053b82cc tempest-VolumesNegativeTest-1718261252 tempest-VolumesNegativeTest-1718261252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b139ebf6e546d5a359cef570ff8e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce72a4f6216b4f428718648e0ec619c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:46:20.619870 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-b08dd804-4999-4c80-aaa3-68bc053b82cc tempest-VolumesNegativeTest-1718261252 tempest-VolumesNegativeTest-1718261252-project] 10.222.0.20 "GET /compute/v2.1/servers/736b06e4-8771-4bd8-9d60-7a2a658628fb" status: 200 len: 1269 microversion: 2.1 time: 0.105852 Oct 20 06:46:20.620448 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1353/2696] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:46:20 2022] GET /compute/v2.1/servers/736b06e4-8771-4bd8-9d60-7a2a658628fb => generated 1269 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:46:21.643003 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-8cfc89be-9bc7-4586-b561-0f2f1bed8a87 tempest-VolumesNegativeTest-1718261252 tempest-VolumesNegativeTest-1718261252-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:46:21.643611 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-8cfc89be-9bc7-4586-b561-0f2f1bed8a87 tempest-VolumesNegativeTest-1718261252 tempest-VolumesNegativeTest-1718261252-project] [instance: 736b06e4-8771-4bd8-9d60-7a2a658628fb] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:46:21.654326 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-8cfc89be-9bc7-4586-b561-0f2f1bed8a87 tempest-VolumesNegativeTest-1718261252 tempest-VolumesNegativeTest-1718261252-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:46:21.654806 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-8cfc89be-9bc7-4586-b561-0f2f1bed8a87 tempest-VolumesNegativeTest-1718261252 tempest-VolumesNegativeTest-1718261252-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:46:21.655247 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-8cfc89be-9bc7-4586-b561-0f2f1bed8a87 tempest-VolumesNegativeTest-1718261252 tempest-VolumesNegativeTest-1718261252-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:46:21.655944 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-8cfc89be-9bc7-4586-b561-0f2f1bed8a87 tempest-VolumesNegativeTest-1718261252 tempest-VolumesNegativeTest-1718261252-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:46:21.656391 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-8cfc89be-9bc7-4586-b561-0f2f1bed8a87 tempest-VolumesNegativeTest-1718261252 tempest-VolumesNegativeTest-1718261252-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:46:21.656838 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-8cfc89be-9bc7-4586-b561-0f2f1bed8a87 tempest-VolumesNegativeTest-1718261252 tempest-VolumesNegativeTest-1718261252-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:46:21.662947 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO oslo.messaging._drivers.impl_rabbit [-] [d087dab9-22c4-45bb-8701-6ce1d6db6dc5] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 43760. Oct 20 06:46:21.798159 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-8cfc89be-9bc7-4586-b561-0f2f1bed8a87 tempest-VolumesNegativeTest-1718261252 tempest-VolumesNegativeTest-1718261252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b139ebf6e546d5a359cef570ff8e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce72a4f6216b4f428718648e0ec619c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:46:21.807846 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-8cfc89be-9bc7-4586-b561-0f2f1bed8a87 tempest-VolumesNegativeTest-1718261252 tempest-VolumesNegativeTest-1718261252-project] 10.222.0.20 "GET /compute/v2.1/servers/736b06e4-8771-4bd8-9d60-7a2a658628fb" status: 200 len: 1311 microversion: 2.1 time: 0.168606 Oct 20 06:46:21.808891 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1344/2697] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:46:21 2022] GET /compute/v2.1/servers/736b06e4-8771-4bd8-9d60-7a2a658628fb => generated 1311 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:46:21.856638 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [req-da9ebad4-869a-44fd-91c3-f09c50791640 req-b6ec378a-853d-4a57-836b-595c7d12a919 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "736b06e4-8771-4bd8-9d60-7a2a658628fb", "tag": "5c2d3daf-9c3a-441c-b040-6e169c53d078"}]} {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 06:46:21.866624 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [req-da9ebad4-869a-44fd-91c3-f09c50791640 req-b6ec378a-853d-4a57-836b-595c7d12a919 service nova] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:46:21.867097 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [req-da9ebad4-869a-44fd-91c3-f09c50791640 req-b6ec378a-853d-4a57-836b-595c7d12a919 service nova] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:46:21.868113 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [req-da9ebad4-869a-44fd-91c3-f09c50791640 req-b6ec378a-853d-4a57-836b-595c7d12a919 service nova] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:46:21.879078 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.compute.server_external_events [req-da9ebad4-869a-44fd-91c3-f09c50791640 req-b6ec378a-853d-4a57-836b-595c7d12a919 service nova] Creating event network-changed:5c2d3daf-9c3a-441c-b040-6e169c53d078 for instance 736b06e4-8771-4bd8-9d60-7a2a658628fb on hv-cinder-86156 Oct 20 06:46:21.886210 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [req-da9ebad4-869a-44fd-91c3-f09c50791640 req-b6ec378a-853d-4a57-836b-595c7d12a919 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112560 Oct 20 06:46:21.886791 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1354/2698] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 20 06:46:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:46:22.830664 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-91f4626f-0eb5-4c66-aeb8-a61017527026 tempest-VolumesNegativeTest-1718261252 tempest-VolumesNegativeTest-1718261252-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:46:22.831278 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-91f4626f-0eb5-4c66-aeb8-a61017527026 tempest-VolumesNegativeTest-1718261252 tempest-VolumesNegativeTest-1718261252-project] [instance: 736b06e4-8771-4bd8-9d60-7a2a658628fb] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:46:22.838261 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-91f4626f-0eb5-4c66-aeb8-a61017527026 tempest-VolumesNegativeTest-1718261252 tempest-VolumesNegativeTest-1718261252-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:46:22.838736 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-91f4626f-0eb5-4c66-aeb8-a61017527026 tempest-VolumesNegativeTest-1718261252 tempest-VolumesNegativeTest-1718261252-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:46:22.839170 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-91f4626f-0eb5-4c66-aeb8-a61017527026 tempest-VolumesNegativeTest-1718261252 tempest-VolumesNegativeTest-1718261252-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:46:22.839857 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-91f4626f-0eb5-4c66-aeb8-a61017527026 tempest-VolumesNegativeTest-1718261252 tempest-VolumesNegativeTest-1718261252-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:46:22.840309 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-91f4626f-0eb5-4c66-aeb8-a61017527026 tempest-VolumesNegativeTest-1718261252 tempest-VolumesNegativeTest-1718261252-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:46:22.840752 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-91f4626f-0eb5-4c66-aeb8-a61017527026 tempest-VolumesNegativeTest-1718261252 tempest-VolumesNegativeTest-1718261252-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:46:22.964064 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-91f4626f-0eb5-4c66-aeb8-a61017527026 tempest-VolumesNegativeTest-1718261252 tempest-VolumesNegativeTest-1718261252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b139ebf6e546d5a359cef570ff8e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce72a4f6216b4f428718648e0ec619c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:46:22.971563 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-91f4626f-0eb5-4c66-aeb8-a61017527026 tempest-VolumesNegativeTest-1718261252 tempest-VolumesNegativeTest-1718261252-project] 10.222.0.20 "GET /compute/v2.1/servers/736b06e4-8771-4bd8-9d60-7a2a658628fb" status: 200 len: 1311 microversion: 2.1 time: 0.144804 Oct 20 06:46:22.972131 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1345/2699] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:46:22 2022] GET /compute/v2.1/servers/736b06e4-8771-4bd8-9d60-7a2a658628fb => generated 1311 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 06:46:23.995551 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-e3687828-9a53-4f59-a74c-965bc96f073d tempest-VolumesNegativeTest-1718261252 tempest-VolumesNegativeTest-1718261252-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:46:23.996245 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-e3687828-9a53-4f59-a74c-965bc96f073d tempest-VolumesNegativeTest-1718261252 tempest-VolumesNegativeTest-1718261252-project] [instance: 736b06e4-8771-4bd8-9d60-7a2a658628fb] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:46:24.002643 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e3687828-9a53-4f59-a74c-965bc96f073d tempest-VolumesNegativeTest-1718261252 tempest-VolumesNegativeTest-1718261252-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:46:24.003067 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e3687828-9a53-4f59-a74c-965bc96f073d tempest-VolumesNegativeTest-1718261252 tempest-VolumesNegativeTest-1718261252-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:46:24.003501 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e3687828-9a53-4f59-a74c-965bc96f073d tempest-VolumesNegativeTest-1718261252 tempest-VolumesNegativeTest-1718261252-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:46:24.004184 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e3687828-9a53-4f59-a74c-965bc96f073d tempest-VolumesNegativeTest-1718261252 tempest-VolumesNegativeTest-1718261252-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:46:24.004629 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e3687828-9a53-4f59-a74c-965bc96f073d tempest-VolumesNegativeTest-1718261252 tempest-VolumesNegativeTest-1718261252-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:46:24.005075 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-e3687828-9a53-4f59-a74c-965bc96f073d tempest-VolumesNegativeTest-1718261252 tempest-VolumesNegativeTest-1718261252-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:46:24.132330 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-e3687828-9a53-4f59-a74c-965bc96f073d tempest-VolumesNegativeTest-1718261252 tempest-VolumesNegativeTest-1718261252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b139ebf6e546d5a359cef570ff8e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce72a4f6216b4f428718648e0ec619c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:46:24.140097 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-e3687828-9a53-4f59-a74c-965bc96f073d tempest-VolumesNegativeTest-1718261252 tempest-VolumesNegativeTest-1718261252-project] 10.222.0.20 "GET /compute/v2.1/servers/736b06e4-8771-4bd8-9d60-7a2a658628fb" status: 200 len: 1311 microversion: 2.1 time: 0.149422 Oct 20 06:46:24.140653 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1355/2700] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:46:23 2022] GET /compute/v2.1/servers/736b06e4-8771-4bd8-9d60-7a2a658628fb => generated 1311 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:46:25.162593 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-6fe5c6ec-8536-48c6-a011-8c9cd1803e58 tempest-VolumesNegativeTest-1718261252 tempest-VolumesNegativeTest-1718261252-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:46:25.163203 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-6fe5c6ec-8536-48c6-a011-8c9cd1803e58 tempest-VolumesNegativeTest-1718261252 tempest-VolumesNegativeTest-1718261252-project] [instance: 736b06e4-8771-4bd8-9d60-7a2a658628fb] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:46:25.169814 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-6fe5c6ec-8536-48c6-a011-8c9cd1803e58 tempest-VolumesNegativeTest-1718261252 tempest-VolumesNegativeTest-1718261252-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:46:25.170297 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-6fe5c6ec-8536-48c6-a011-8c9cd1803e58 tempest-VolumesNegativeTest-1718261252 tempest-VolumesNegativeTest-1718261252-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:46:25.170730 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-6fe5c6ec-8536-48c6-a011-8c9cd1803e58 tempest-VolumesNegativeTest-1718261252 tempest-VolumesNegativeTest-1718261252-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:46:25.171412 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-6fe5c6ec-8536-48c6-a011-8c9cd1803e58 tempest-VolumesNegativeTest-1718261252 tempest-VolumesNegativeTest-1718261252-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:46:25.171858 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-6fe5c6ec-8536-48c6-a011-8c9cd1803e58 tempest-VolumesNegativeTest-1718261252 tempest-VolumesNegativeTest-1718261252-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:46:25.172280 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-6fe5c6ec-8536-48c6-a011-8c9cd1803e58 tempest-VolumesNegativeTest-1718261252 tempest-VolumesNegativeTest-1718261252-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:46:25.303389 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-6fe5c6ec-8536-48c6-a011-8c9cd1803e58 tempest-VolumesNegativeTest-1718261252 tempest-VolumesNegativeTest-1718261252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b139ebf6e546d5a359cef570ff8e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce72a4f6216b4f428718648e0ec619c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:46:25.311248 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-6fe5c6ec-8536-48c6-a011-8c9cd1803e58 tempest-VolumesNegativeTest-1718261252 tempest-VolumesNegativeTest-1718261252-project] 10.222.0.20 "GET /compute/v2.1/servers/736b06e4-8771-4bd8-9d60-7a2a658628fb" status: 200 len: 1311 microversion: 2.1 time: 0.152792 Oct 20 06:46:25.311802 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1346/2701] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:46:25 2022] GET /compute/v2.1/servers/736b06e4-8771-4bd8-9d60-7a2a658628fb => generated 1311 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:46:26.333742 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-67f987f1-8f4f-49ea-af8d-4e046f41470f tempest-VolumesNegativeTest-1718261252 tempest-VolumesNegativeTest-1718261252-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:46:26.334332 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-67f987f1-8f4f-49ea-af8d-4e046f41470f tempest-VolumesNegativeTest-1718261252 tempest-VolumesNegativeTest-1718261252-project] [instance: 736b06e4-8771-4bd8-9d60-7a2a658628fb] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:46:26.340799 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-67f987f1-8f4f-49ea-af8d-4e046f41470f tempest-VolumesNegativeTest-1718261252 tempest-VolumesNegativeTest-1718261252-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:46:26.341286 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-67f987f1-8f4f-49ea-af8d-4e046f41470f tempest-VolumesNegativeTest-1718261252 tempest-VolumesNegativeTest-1718261252-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:46:26.341726 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-67f987f1-8f4f-49ea-af8d-4e046f41470f tempest-VolumesNegativeTest-1718261252 tempest-VolumesNegativeTest-1718261252-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:46:26.342422 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-67f987f1-8f4f-49ea-af8d-4e046f41470f tempest-VolumesNegativeTest-1718261252 tempest-VolumesNegativeTest-1718261252-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:46:26.342878 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-67f987f1-8f4f-49ea-af8d-4e046f41470f tempest-VolumesNegativeTest-1718261252 tempest-VolumesNegativeTest-1718261252-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:46:26.343304 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-67f987f1-8f4f-49ea-af8d-4e046f41470f tempest-VolumesNegativeTest-1718261252 tempest-VolumesNegativeTest-1718261252-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:46:26.478341 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-67f987f1-8f4f-49ea-af8d-4e046f41470f tempest-VolumesNegativeTest-1718261252 tempest-VolumesNegativeTest-1718261252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b139ebf6e546d5a359cef570ff8e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce72a4f6216b4f428718648e0ec619c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:46:26.485888 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-67f987f1-8f4f-49ea-af8d-4e046f41470f tempest-VolumesNegativeTest-1718261252 tempest-VolumesNegativeTest-1718261252-project] 10.222.0.20 "GET /compute/v2.1/servers/736b06e4-8771-4bd8-9d60-7a2a658628fb" status: 200 len: 1311 microversion: 2.1 time: 0.155994 Oct 20 06:46:26.486443 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1356/2702] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:46:26 2022] GET /compute/v2.1/servers/736b06e4-8771-4bd8-9d60-7a2a658628fb => generated 1311 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:46:27.510018 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-dc8fda22-a7db-44ef-8b48-3ca42130e410 tempest-VolumesNegativeTest-1718261252 tempest-VolumesNegativeTest-1718261252-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:46:27.510639 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-dc8fda22-a7db-44ef-8b48-3ca42130e410 tempest-VolumesNegativeTest-1718261252 tempest-VolumesNegativeTest-1718261252-project] [instance: 736b06e4-8771-4bd8-9d60-7a2a658628fb] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:46:27.517043 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-dc8fda22-a7db-44ef-8b48-3ca42130e410 tempest-VolumesNegativeTest-1718261252 tempest-VolumesNegativeTest-1718261252-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:46:27.517526 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-dc8fda22-a7db-44ef-8b48-3ca42130e410 tempest-VolumesNegativeTest-1718261252 tempest-VolumesNegativeTest-1718261252-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:46:27.517966 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-dc8fda22-a7db-44ef-8b48-3ca42130e410 tempest-VolumesNegativeTest-1718261252 tempest-VolumesNegativeTest-1718261252-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:46:27.518658 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-dc8fda22-a7db-44ef-8b48-3ca42130e410 tempest-VolumesNegativeTest-1718261252 tempest-VolumesNegativeTest-1718261252-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:46:27.519116 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-dc8fda22-a7db-44ef-8b48-3ca42130e410 tempest-VolumesNegativeTest-1718261252 tempest-VolumesNegativeTest-1718261252-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:46:27.519543 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-dc8fda22-a7db-44ef-8b48-3ca42130e410 tempest-VolumesNegativeTest-1718261252 tempest-VolumesNegativeTest-1718261252-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:46:27.646780 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-dc8fda22-a7db-44ef-8b48-3ca42130e410 tempest-VolumesNegativeTest-1718261252 tempest-VolumesNegativeTest-1718261252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b139ebf6e546d5a359cef570ff8e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce72a4f6216b4f428718648e0ec619c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:46:27.654935 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-dc8fda22-a7db-44ef-8b48-3ca42130e410 tempest-VolumesNegativeTest-1718261252 tempest-VolumesNegativeTest-1718261252-project] 10.222.0.20 "GET /compute/v2.1/servers/736b06e4-8771-4bd8-9d60-7a2a658628fb" status: 200 len: 1311 microversion: 2.1 time: 0.149506 Oct 20 06:46:27.655503 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1347/2703] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:46:27 2022] GET /compute/v2.1/servers/736b06e4-8771-4bd8-9d60-7a2a658628fb => generated 1311 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:46:28.379190 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [req-c0f7f712-499a-4da6-992b-d73d61e11738 req-74d7d8b6-9ebc-4bba-bf7b-24f13cb041d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "736b06e4-8771-4bd8-9d60-7a2a658628fb", "name": "network-vif-plugged", "status": "completed", "tag": "5c2d3daf-9c3a-441c-b040-6e169c53d078"}]} {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 06:46:28.390260 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [req-c0f7f712-499a-4da6-992b-d73d61e11738 req-74d7d8b6-9ebc-4bba-bf7b-24f13cb041d5 service nova] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:46:28.390997 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [req-c0f7f712-499a-4da6-992b-d73d61e11738 req-74d7d8b6-9ebc-4bba-bf7b-24f13cb041d5 service nova] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:46:28.392109 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [req-c0f7f712-499a-4da6-992b-d73d61e11738 req-74d7d8b6-9ebc-4bba-bf7b-24f13cb041d5 service nova] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:46:28.403903 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.compute.server_external_events [req-c0f7f712-499a-4da6-992b-d73d61e11738 req-74d7d8b6-9ebc-4bba-bf7b-24f13cb041d5 service nova] Creating event network-vif-plugged:5c2d3daf-9c3a-441c-b040-6e169c53d078 for instance 736b06e4-8771-4bd8-9d60-7a2a658628fb on hv-cinder-86156 Oct 20 06:46:28.408794 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [req-c0f7f712-499a-4da6-992b-d73d61e11738 req-74d7d8b6-9ebc-4bba-bf7b-24f13cb041d5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033266 Oct 20 06:46:28.409366 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1357/2704] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 20 06:46:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:46:28.677790 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-75d587a9-fafd-4379-9d56-28a7af6294d1 tempest-VolumesNegativeTest-1718261252 tempest-VolumesNegativeTest-1718261252-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:46:28.678434 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-75d587a9-fafd-4379-9d56-28a7af6294d1 tempest-VolumesNegativeTest-1718261252 tempest-VolumesNegativeTest-1718261252-project] [instance: 736b06e4-8771-4bd8-9d60-7a2a658628fb] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:46:28.685294 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-75d587a9-fafd-4379-9d56-28a7af6294d1 tempest-VolumesNegativeTest-1718261252 tempest-VolumesNegativeTest-1718261252-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:46:28.685779 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-75d587a9-fafd-4379-9d56-28a7af6294d1 tempest-VolumesNegativeTest-1718261252 tempest-VolumesNegativeTest-1718261252-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:46:28.686218 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-75d587a9-fafd-4379-9d56-28a7af6294d1 tempest-VolumesNegativeTest-1718261252 tempest-VolumesNegativeTest-1718261252-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:46:28.686911 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-75d587a9-fafd-4379-9d56-28a7af6294d1 tempest-VolumesNegativeTest-1718261252 tempest-VolumesNegativeTest-1718261252-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:46:28.687363 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-75d587a9-fafd-4379-9d56-28a7af6294d1 tempest-VolumesNegativeTest-1718261252 tempest-VolumesNegativeTest-1718261252-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:46:28.687819 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-75d587a9-fafd-4379-9d56-28a7af6294d1 tempest-VolumesNegativeTest-1718261252 tempest-VolumesNegativeTest-1718261252-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:46:28.817506 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-75d587a9-fafd-4379-9d56-28a7af6294d1 tempest-VolumesNegativeTest-1718261252 tempest-VolumesNegativeTest-1718261252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b139ebf6e546d5a359cef570ff8e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce72a4f6216b4f428718648e0ec619c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:46:28.826008 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-75d587a9-fafd-4379-9d56-28a7af6294d1 tempest-VolumesNegativeTest-1718261252 tempest-VolumesNegativeTest-1718261252-project] 10.222.0.20 "GET /compute/v2.1/servers/736b06e4-8771-4bd8-9d60-7a2a658628fb" status: 200 len: 1311 microversion: 2.1 time: 0.151949 Oct 20 06:46:28.826570 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1348/2705] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:46:28 2022] GET /compute/v2.1/servers/736b06e4-8771-4bd8-9d60-7a2a658628fb => generated 1311 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 06:46:29.846359 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG dbcounter [-] [118860] Writing DB stats nova_cell0:SELECT=2 {{(pid=118860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:46:29.847066 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG dbcounter [-] [118860] Writing DB stats nova_cell0:SELECT=6 {{(pid=118860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:46:29.851507 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-44f663cc-26b0-4cc9-8823-36698defa436 tempest-VolumesNegativeTest-1718261252 tempest-VolumesNegativeTest-1718261252-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:46:29.852243 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-44f663cc-26b0-4cc9-8823-36698defa436 tempest-VolumesNegativeTest-1718261252 tempest-VolumesNegativeTest-1718261252-project] [instance: 736b06e4-8771-4bd8-9d60-7a2a658628fb] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:46:29.859199 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-44f663cc-26b0-4cc9-8823-36698defa436 tempest-VolumesNegativeTest-1718261252 tempest-VolumesNegativeTest-1718261252-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:46:29.859682 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-44f663cc-26b0-4cc9-8823-36698defa436 tempest-VolumesNegativeTest-1718261252 tempest-VolumesNegativeTest-1718261252-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:46:29.860122 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-44f663cc-26b0-4cc9-8823-36698defa436 tempest-VolumesNegativeTest-1718261252 tempest-VolumesNegativeTest-1718261252-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:46:29.860861 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-44f663cc-26b0-4cc9-8823-36698defa436 tempest-VolumesNegativeTest-1718261252 tempest-VolumesNegativeTest-1718261252-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:46:29.861316 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-44f663cc-26b0-4cc9-8823-36698defa436 tempest-VolumesNegativeTest-1718261252 tempest-VolumesNegativeTest-1718261252-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:46:29.861743 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-44f663cc-26b0-4cc9-8823-36698defa436 tempest-VolumesNegativeTest-1718261252 tempest-VolumesNegativeTest-1718261252-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:46:29.994219 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-44f663cc-26b0-4cc9-8823-36698defa436 tempest-VolumesNegativeTest-1718261252 tempest-VolumesNegativeTest-1718261252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b139ebf6e546d5a359cef570ff8e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce72a4f6216b4f428718648e0ec619c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:46:30.002177 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-44f663cc-26b0-4cc9-8823-36698defa436 tempest-VolumesNegativeTest-1718261252 tempest-VolumesNegativeTest-1718261252-project] 10.222.0.20 "GET /compute/v2.1/servers/736b06e4-8771-4bd8-9d60-7a2a658628fb" status: 200 len: 1311 microversion: 2.1 time: 0.156881 Oct 20 06:46:30.002741 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1358/2706] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:46:29 2022] GET /compute/v2.1/servers/736b06e4-8771-4bd8-9d60-7a2a658628fb => generated 1311 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:46:31.025451 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-7af1821b-8b39-420c-85ca-d016ded71ef9 tempest-VolumesNegativeTest-1718261252 tempest-VolumesNegativeTest-1718261252-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:46:31.026063 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-7af1821b-8b39-420c-85ca-d016ded71ef9 tempest-VolumesNegativeTest-1718261252 tempest-VolumesNegativeTest-1718261252-project] [instance: 736b06e4-8771-4bd8-9d60-7a2a658628fb] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:46:31.027944 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG dbcounter [-] [118861] Writing DB stats nova_cell0:SELECT=2 {{(pid=118861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 06:46:31.033518 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7af1821b-8b39-420c-85ca-d016ded71ef9 tempest-VolumesNegativeTest-1718261252 tempest-VolumesNegativeTest-1718261252-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:46:31.034029 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7af1821b-8b39-420c-85ca-d016ded71ef9 tempest-VolumesNegativeTest-1718261252 tempest-VolumesNegativeTest-1718261252-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:46:31.034465 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7af1821b-8b39-420c-85ca-d016ded71ef9 tempest-VolumesNegativeTest-1718261252 tempest-VolumesNegativeTest-1718261252-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:46:31.035167 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7af1821b-8b39-420c-85ca-d016ded71ef9 tempest-VolumesNegativeTest-1718261252 tempest-VolumesNegativeTest-1718261252-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:46:31.035615 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7af1821b-8b39-420c-85ca-d016ded71ef9 tempest-VolumesNegativeTest-1718261252 tempest-VolumesNegativeTest-1718261252-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:46:31.036039 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-7af1821b-8b39-420c-85ca-d016ded71ef9 tempest-VolumesNegativeTest-1718261252 tempest-VolumesNegativeTest-1718261252-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:46:31.164715 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-7af1821b-8b39-420c-85ca-d016ded71ef9 tempest-VolumesNegativeTest-1718261252 tempest-VolumesNegativeTest-1718261252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b139ebf6e546d5a359cef570ff8e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce72a4f6216b4f428718648e0ec619c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:46:31.172433 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-7af1821b-8b39-420c-85ca-d016ded71ef9 tempest-VolumesNegativeTest-1718261252 tempest-VolumesNegativeTest-1718261252-project] 10.222.0.20 "GET /compute/v2.1/servers/736b06e4-8771-4bd8-9d60-7a2a658628fb" status: 200 len: 1461 microversion: 2.1 time: 0.151356 Oct 20 06:46:31.173021 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1349/2707] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:46:31 2022] GET /compute/v2.1/servers/736b06e4-8771-4bd8-9d60-7a2a658628fb => generated 1461 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:46:31.218136 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-5338e477-3b1b-4ca9-8033-597f35b6f93a tempest-VolumesNegativeTest-1718261252 tempest-VolumesNegativeTest-1718261252-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:46:31.218645 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-5338e477-3b1b-4ca9-8033-597f35b6f93a tempest-VolumesNegativeTest-1718261252 tempest-VolumesNegativeTest-1718261252-project] [instance: 736b06e4-8771-4bd8-9d60-7a2a658628fb] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:46:31.225246 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5338e477-3b1b-4ca9-8033-597f35b6f93a tempest-VolumesNegativeTest-1718261252 tempest-VolumesNegativeTest-1718261252-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:46:31.225733 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5338e477-3b1b-4ca9-8033-597f35b6f93a tempest-VolumesNegativeTest-1718261252 tempest-VolumesNegativeTest-1718261252-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:46:31.226200 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5338e477-3b1b-4ca9-8033-597f35b6f93a tempest-VolumesNegativeTest-1718261252 tempest-VolumesNegativeTest-1718261252-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:46:31.227010 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5338e477-3b1b-4ca9-8033-597f35b6f93a tempest-VolumesNegativeTest-1718261252 tempest-VolumesNegativeTest-1718261252-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:46:31.227602 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5338e477-3b1b-4ca9-8033-597f35b6f93a tempest-VolumesNegativeTest-1718261252 tempest-VolumesNegativeTest-1718261252-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:46:31.228141 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-5338e477-3b1b-4ca9-8033-597f35b6f93a tempest-VolumesNegativeTest-1718261252 tempest-VolumesNegativeTest-1718261252-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:46:31.253014 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-5338e477-3b1b-4ca9-8033-597f35b6f93a tempest-VolumesNegativeTest-1718261252 tempest-VolumesNegativeTest-1718261252-project] [instance: 736b06e4-8771-4bd8-9d60-7a2a658628fb] Going to try to terminate instance {{(pid=118860) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 20 06:46:31.330180 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-5338e477-3b1b-4ca9-8033-597f35b6f93a tempest-VolumesNegativeTest-1718261252 tempest-VolumesNegativeTest-1718261252-project] 10.222.0.20 "DELETE /compute/v2.1/servers/736b06e4-8771-4bd8-9d60-7a2a658628fb" status: 204 len: 0 microversion: 2.1 time: 0.115592 Oct 20 06:46:31.330846 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1359/2708] 10.222.0.20 () {58 vars in 1239 bytes} [Thu Oct 20 06:46:31 2022] DELETE /compute/v2.1/servers/736b06e4-8771-4bd8-9d60-7a2a658628fb => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 20 06:46:31.340247 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-b306a6fd-b914-4610-ae86-e43fe349ade2 tempest-VolumesNegativeTest-1718261252 tempest-VolumesNegativeTest-1718261252-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:46:31.340989 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-b306a6fd-b914-4610-ae86-e43fe349ade2 tempest-VolumesNegativeTest-1718261252 tempest-VolumesNegativeTest-1718261252-project] [instance: 736b06e4-8771-4bd8-9d60-7a2a658628fb] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:46:31.346928 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b306a6fd-b914-4610-ae86-e43fe349ade2 tempest-VolumesNegativeTest-1718261252 tempest-VolumesNegativeTest-1718261252-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:46:31.347417 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b306a6fd-b914-4610-ae86-e43fe349ade2 tempest-VolumesNegativeTest-1718261252 tempest-VolumesNegativeTest-1718261252-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:46:31.347857 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b306a6fd-b914-4610-ae86-e43fe349ade2 tempest-VolumesNegativeTest-1718261252 tempest-VolumesNegativeTest-1718261252-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:46:31.348554 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b306a6fd-b914-4610-ae86-e43fe349ade2 tempest-VolumesNegativeTest-1718261252 tempest-VolumesNegativeTest-1718261252-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:46:31.349046 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b306a6fd-b914-4610-ae86-e43fe349ade2 tempest-VolumesNegativeTest-1718261252 tempest-VolumesNegativeTest-1718261252-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:46:31.349476 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-b306a6fd-b914-4610-ae86-e43fe349ade2 tempest-VolumesNegativeTest-1718261252 tempest-VolumesNegativeTest-1718261252-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:46:31.476092 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.policy [None req-b306a6fd-b914-4610-ae86-e43fe349ade2 tempest-VolumesNegativeTest-1718261252 tempest-VolumesNegativeTest-1718261252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b139ebf6e546d5a359cef570ff8e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce72a4f6216b4f428718648e0ec619c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118861) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:46:31.484618 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-b306a6fd-b914-4610-ae86-e43fe349ade2 tempest-VolumesNegativeTest-1718261252 tempest-VolumesNegativeTest-1718261252-project] 10.222.0.20 "GET /compute/v2.1/servers/736b06e4-8771-4bd8-9d60-7a2a658628fb" status: 200 len: 1467 microversion: 2.1 time: 0.149446 Oct 20 06:46:31.485217 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1350/2709] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:46:31 2022] GET /compute/v2.1/servers/736b06e4-8771-4bd8-9d60-7a2a658628fb => generated 1467 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 06:46:32.508327 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-10973b17-608b-4d09-817d-d7df8dc622f9 tempest-VolumesNegativeTest-1718261252 tempest-VolumesNegativeTest-1718261252-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:46:32.509111 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-10973b17-608b-4d09-817d-d7df8dc622f9 tempest-VolumesNegativeTest-1718261252 tempest-VolumesNegativeTest-1718261252-project] [instance: 736b06e4-8771-4bd8-9d60-7a2a658628fb] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:46:32.515406 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-10973b17-608b-4d09-817d-d7df8dc622f9 tempest-VolumesNegativeTest-1718261252 tempest-VolumesNegativeTest-1718261252-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:46:32.515886 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-10973b17-608b-4d09-817d-d7df8dc622f9 tempest-VolumesNegativeTest-1718261252 tempest-VolumesNegativeTest-1718261252-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:46:32.516326 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-10973b17-608b-4d09-817d-d7df8dc622f9 tempest-VolumesNegativeTest-1718261252 tempest-VolumesNegativeTest-1718261252-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:46:32.517037 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-10973b17-608b-4d09-817d-d7df8dc622f9 tempest-VolumesNegativeTest-1718261252 tempest-VolumesNegativeTest-1718261252-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:46:32.517492 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-10973b17-608b-4d09-817d-d7df8dc622f9 tempest-VolumesNegativeTest-1718261252 tempest-VolumesNegativeTest-1718261252-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:46:32.517923 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-10973b17-608b-4d09-817d-d7df8dc622f9 tempest-VolumesNegativeTest-1718261252 tempest-VolumesNegativeTest-1718261252-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:46:32.647021 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-10973b17-608b-4d09-817d-d7df8dc622f9 tempest-VolumesNegativeTest-1718261252 tempest-VolumesNegativeTest-1718261252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b139ebf6e546d5a359cef570ff8e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce72a4f6216b4f428718648e0ec619c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:46:32.655303 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-10973b17-608b-4d09-817d-d7df8dc622f9 tempest-VolumesNegativeTest-1718261252 tempest-VolumesNegativeTest-1718261252-project] 10.222.0.20 "GET /compute/v2.1/servers/736b06e4-8771-4bd8-9d60-7a2a658628fb" status: 200 len: 1467 microversion: 2.1 time: 0.151220 Oct 20 06:46:32.655864 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1360/2710] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:46:32 2022] GET /compute/v2.1/servers/736b06e4-8771-4bd8-9d60-7a2a658628fb => generated 1467 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:46:33.258938 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [req-a7827913-2554-4ae9-9a61-c7c489813e9f req-57b2e5c0-c0e3-4e7a-b1af-eecc906eb3e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "736b06e4-8771-4bd8-9d60-7a2a658628fb", "name": "network-vif-deleted", "tag": "5c2d3daf-9c3a-441c-b040-6e169c53d078"}]} {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 06:46:33.272567 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [req-a7827913-2554-4ae9-9a61-c7c489813e9f req-57b2e5c0-c0e3-4e7a-b1af-eecc906eb3e0 service nova] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:46:33.273732 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [req-a7827913-2554-4ae9-9a61-c7c489813e9f req-57b2e5c0-c0e3-4e7a-b1af-eecc906eb3e0 service nova] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:46:33.274590 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [req-a7827913-2554-4ae9-9a61-c7c489813e9f req-57b2e5c0-c0e3-4e7a-b1af-eecc906eb3e0 service nova] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:46:33.291057 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.compute.server_external_events [req-a7827913-2554-4ae9-9a61-c7c489813e9f req-57b2e5c0-c0e3-4e7a-b1af-eecc906eb3e0 service nova] Creating event network-vif-deleted:5c2d3daf-9c3a-441c-b040-6e169c53d078 for instance 736b06e4-8771-4bd8-9d60-7a2a658628fb on hv-cinder-86156 Oct 20 06:46:33.299669 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [req-a7827913-2554-4ae9-9a61-c7c489813e9f req-57b2e5c0-c0e3-4e7a-b1af-eecc906eb3e0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045147 Oct 20 06:46:33.301309 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1351/2711] 10.222.0.20 () {64 vars in 1317 bytes} [Thu Oct 20 06:46:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 06:46:33.678760 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.api.openstack.wsgi [None req-865f4eeb-50b3-4473-b922-4dd18ec0eaae tempest-VolumesNegativeTest-1718261252 tempest-VolumesNegativeTest-1718261252-project] Calling method '>' {{(pid=118860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:46:33.680056 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.compute.api [None req-865f4eeb-50b3-4473-b922-4dd18ec0eaae tempest-VolumesNegativeTest-1718261252 tempest-VolumesNegativeTest-1718261252-project] [instance: 736b06e4-8771-4bd8-9d60-7a2a658628fb] Fetching instance by UUID {{(pid=118860) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:46:33.687952 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-865f4eeb-50b3-4473-b922-4dd18ec0eaae tempest-VolumesNegativeTest-1718261252 tempest-VolumesNegativeTest-1718261252-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:46:33.688447 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-865f4eeb-50b3-4473-b922-4dd18ec0eaae tempest-VolumesNegativeTest-1718261252 tempest-VolumesNegativeTest-1718261252-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:46:33.689264 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-865f4eeb-50b3-4473-b922-4dd18ec0eaae tempest-VolumesNegativeTest-1718261252 tempest-VolumesNegativeTest-1718261252-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:46:33.689983 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-865f4eeb-50b3-4473-b922-4dd18ec0eaae tempest-VolumesNegativeTest-1718261252 tempest-VolumesNegativeTest-1718261252-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:46:33.690443 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-865f4eeb-50b3-4473-b922-4dd18ec0eaae tempest-VolumesNegativeTest-1718261252 tempest-VolumesNegativeTest-1718261252-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:46:33.690878 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-865f4eeb-50b3-4473-b922-4dd18ec0eaae tempest-VolumesNegativeTest-1718261252 tempest-VolumesNegativeTest-1718261252-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:46:33.724341 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-865f4eeb-50b3-4473-b922-4dd18ec0eaae tempest-VolumesNegativeTest-1718261252 tempest-VolumesNegativeTest-1718261252-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:46:33.725079 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-865f4eeb-50b3-4473-b922-4dd18ec0eaae tempest-VolumesNegativeTest-1718261252 tempest-VolumesNegativeTest-1718261252-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:46:33.725528 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG oslo_concurrency.lockutils [None req-865f4eeb-50b3-4473-b922-4dd18ec0eaae tempest-VolumesNegativeTest-1718261252 tempest-VolumesNegativeTest-1718261252-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:46:33.726125 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.objects.instance [None req-865f4eeb-50b3-4473-b922-4dd18ec0eaae tempest-VolumesNegativeTest-1718261252 tempest-VolumesNegativeTest-1718261252-project] Lazy-loading 'fault' on Instance uuid 736b06e4-8771-4bd8-9d60-7a2a658628fb {{(pid=118860) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 20 06:46:33.778810 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: DEBUG nova.policy [None req-865f4eeb-50b3-4473-b922-4dd18ec0eaae tempest-VolumesNegativeTest-1718261252 tempest-VolumesNegativeTest-1718261252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b139ebf6e546d5a359cef570ff8e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce72a4f6216b4f428718648e0ec619c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118860) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 06:46:33.786707 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: INFO nova.api.openstack.requestlog [None req-865f4eeb-50b3-4473-b922-4dd18ec0eaae tempest-VolumesNegativeTest-1718261252 tempest-VolumesNegativeTest-1718261252-project] 10.222.0.20 "GET /compute/v2.1/servers/736b06e4-8771-4bd8-9d60-7a2a658628fb" status: 200 len: 1301 microversion: 2.1 time: 0.112010 Oct 20 06:46:33.787443 dv-cinder-861566-3-iscsi devstack@n-api.service[118860]: [pid: 118860|app: 0|req: 1361/2712] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:46:33 2022] GET /compute/v2.1/servers/736b06e4-8771-4bd8-9d60-7a2a658628fb => generated 1301 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 06:46:34.810803 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-db7fad9a-99f2-411d-95ff-448500615b4b tempest-VolumesNegativeTest-1718261252 tempest-VolumesNegativeTest-1718261252-project] Calling method '>' {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 06:46:34.811500 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.compute.api [None req-db7fad9a-99f2-411d-95ff-448500615b4b tempest-VolumesNegativeTest-1718261252 tempest-VolumesNegativeTest-1718261252-project] [instance: 736b06e4-8771-4bd8-9d60-7a2a658628fb] Fetching instance by UUID {{(pid=118861) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 06:46:34.817694 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-db7fad9a-99f2-411d-95ff-448500615b4b tempest-VolumesNegativeTest-1718261252 tempest-VolumesNegativeTest-1718261252-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:46:34.818169 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-db7fad9a-99f2-411d-95ff-448500615b4b tempest-VolumesNegativeTest-1718261252 tempest-VolumesNegativeTest-1718261252-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:46:34.818602 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-db7fad9a-99f2-411d-95ff-448500615b4b tempest-VolumesNegativeTest-1718261252 tempest-VolumesNegativeTest-1718261252-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:46:34.819285 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-db7fad9a-99f2-411d-95ff-448500615b4b tempest-VolumesNegativeTest-1718261252 tempest-VolumesNegativeTest-1718261252-project] Acquiring lock "0427de57-e601-4680-b509-510497497143" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 06:46:34.819733 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-db7fad9a-99f2-411d-95ff-448500615b4b tempest-VolumesNegativeTest-1718261252 tempest-VolumesNegativeTest-1718261252-project] Lock "0427de57-e601-4680-b509-510497497143" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 06:46:34.820656 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG oslo_concurrency.lockutils [None req-db7fad9a-99f2-411d-95ff-448500615b4b tempest-VolumesNegativeTest-1718261252 tempest-VolumesNegativeTest-1718261252-project] Lock "0427de57-e601-4680-b509-510497497143" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 06:46:34.833479 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.wsgi [None req-db7fad9a-99f2-411d-95ff-448500615b4b tempest-VolumesNegativeTest-1718261252 tempest-VolumesNegativeTest-1718261252-project] HTTP exception thrown: Instance 736b06e4-8771-4bd8-9d60-7a2a658628fb could not be found. Oct 20 06:46:34.835066 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-db7fad9a-99f2-411d-95ff-448500615b4b tempest-VolumesNegativeTest-1718261252 tempest-VolumesNegativeTest-1718261252-project] Request method failure captured: Oct 20 06:46:34.835066 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: request: GET /compute/v2.1/servers/736b06e4-8771-4bd8-9d60-7a2a658628fb HTTP/1.1 Oct 20 06:46:34.835066 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: Accept: application/json Oct 20 06:46:34.835066 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: Accept-Encoding: identity Oct 20 06:46:34.835066 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: Connection: close Oct 20 06:46:34.835066 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: Content-Length: 0 Oct 20 06:46:34.835066 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: Content-Type: application/json Oct 20 06:46:34.835066 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: Host: 10.222.0.20 Oct 20 06:46:34.835066 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: Openstack-System-Scope: None Oct 20 06:46:34.835066 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: User-Agent: python-urllib3/1.26.12 Oct 20 06:46:34.835066 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Auth-Token: gAAAAABjUO652vJZmLGozuj0kZi__BuNe1FFPjsPB0hmC1P0Q2l6ntVD9tYyfnkvdxc1Qd-voxv480vCEb85EOc1a-8DaUSmYcYvXuhAAjwgpX1BZYSlCVJA5-BJytburwFe8d7CQjTimgW_lSbtGOu_obHH-XogfBXj71M8VxUHx9tkszcYauU Oct 20 06:46:34.835066 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Domain-Id: None Oct 20 06:46:34.835066 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Domain-Name: None Oct 20 06:46:34.835066 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Identity-Status: Confirmed Oct 20 06:46:34.835066 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Is-Admin-Project: True Oct 20 06:46:34.835066 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Project-Domain-Id: default Oct 20 06:46:34.835066 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Project-Domain-Name: Default Oct 20 06:46:34.835066 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Project-Id: ce72a4f6216b4f428718648e0ec619c1 Oct 20 06:46:34.835066 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Project-Name: tempest-VolumesNegativeTest-1718261252 Oct 20 06:46:34.835066 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Role: reader,member Oct 20 06:46:34.835066 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Roles: reader,member Oct 20 06:46:34.837466 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ce72a4f6216b4f428718648e0ec619c1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ce72a4f6216b4f428718648e0ec619c1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ce72a4f6216b4f428718648e0ec619c1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ce72a4f6216b4f428718648e0ec619c1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}] Oct 20 06:46:34.837466 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Tenant: tempest-VolumesNegativeTest-1718261252 Oct 20 06:46:34.837466 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Tenant-Id: ce72a4f6216b4f428718648e0ec619c1 Oct 20 06:46:34.837466 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-Tenant-Name: tempest-VolumesNegativeTest-1718261252 Oct 20 06:46:34.837466 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-User: tempest-VolumesNegativeTest-1718261252-project Oct 20 06:46:34.837466 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-User-Domain-Id: default Oct 20 06:46:34.837466 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-User-Domain-Name: Default Oct 20 06:46:34.837466 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-User-Id: 49b139ebf6e546d5a359cef570ff8e21 Oct 20 06:46:34.837466 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: X-User-Name: tempest-VolumesNegativeTest-1718261252-project Oct 20 06:46:34.837466 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: method: > Oct 20 06:46:34.837466 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: exception: Instance 736b06e4-8771-4bd8-9d60-7a2a658628fb could not be found. Oct 20 06:46:34.837466 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: action_args: {'id': '736b06e4-8771-4bd8-9d60-7a2a658628fb'} Oct 20 06:46:34.838394 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: {{(pid=118861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 20 06:46:34.838394 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 06:46:34.838394 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 20 06:46:34.838394 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 20 06:46:34.838394 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 20 06:46:34.838394 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 20 06:46:34.838394 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 20 06:46:34.838394 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 20 06:46:34.838394 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 20 06:46:34.838394 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 20 06:46:34.838394 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 736b06e4-8771-4bd8-9d60-7a2a658628fb could not be found. Oct 20 06:46:34.838394 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi Oct 20 06:46:34.838394 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 06:46:34.838394 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi Oct 20 06:46:34.838394 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 06:46:34.838394 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 06:46:34.838394 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 06:46:34.838394 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 20 06:46:34.838394 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 20 06:46:34.838394 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 20 06:46:34.839852 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 20 06:46:34.839852 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 20 06:46:34.839852 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 20 06:46:34.839852 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 20 06:46:34.839852 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 20 06:46:34.839852 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 20 06:46:34.839852 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 20 06:46:34.839852 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 736b06e4-8771-4bd8-9d60-7a2a658628fb could not be found. Oct 20 06:46:34.839852 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi Oct 20 06:46:34.839852 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 06:46:34.839852 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi Oct 20 06:46:34.839852 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 06:46:34.839852 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 06:46:34.839852 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 06:46:34.839852 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 20 06:46:34.839852 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 20 06:46:34.839852 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 736b06e4-8771-4bd8-9d60-7a2a658628fb could not be found. Oct 20 06:46:34.839852 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: ERROR nova.api.openstack.wsgi Oct 20 06:46:34.841078 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: DEBUG nova.api.openstack.wsgi [None req-db7fad9a-99f2-411d-95ff-448500615b4b tempest-VolumesNegativeTest-1718261252 tempest-VolumesNegativeTest-1718261252-project] Returning 404 to user: Instance 736b06e4-8771-4bd8-9d60-7a2a658628fb could not be found. {{(pid=118861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 20 06:46:34.841078 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: INFO nova.api.openstack.requestlog [None req-db7fad9a-99f2-411d-95ff-448500615b4b tempest-VolumesNegativeTest-1718261252 tempest-VolumesNegativeTest-1718261252-project] 10.222.0.20 "GET /compute/v2.1/servers/736b06e4-8771-4bd8-9d60-7a2a658628fb" status: 404 len: 111 microversion: 2.1 time: 0.030962 Oct 20 06:46:34.841592 dv-cinder-861566-3-iscsi devstack@n-api.service[118861]: [pid: 118861|app: 0|req: 1352/2713] 10.222.0.20 () {58 vars in 1236 bytes} [Thu Oct 20 06:46:34 2022] GET /compute/v2.1/servers/736b06e4-8771-4bd8-9d60-7a2a658628fb => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0)